MT9V111 - 1/4-Inch SOC VGA Digital Image Sensor Features 1/4-Inch SOC VGA CMOS Active-Pixel Digital Image Sensor MT9V111 Datasheet, Rev. N For the latest data sheet revision, please visit www.onsemi.com Features Table 1: • System-On-a-Chip (SOC)—Completely integrated camera system • Ultra low-power, low cost CMOS image sensor • Superior low-light performance • Up to 30 fps progressive scan at 27 MHz for highquality video at VGA resolution • On-chip Image Flow Processor (IFP) performs sophisticated processing: color recovery and correction, sharpening, gamma, lens shading correction, on-the-fly defect correction, 2X fixed zoom • Image decimation to arbitrary size with smooth, continuous zoom and pan • Automatic exposure, white balance and black compensation, flicker avoidance, color saturation, and defect identification and correction, auto frame rate, back light compensation • Xenon and LED-type flash support • Two-wire serial programming interface • ITU_R BT.656 (YCbCr), YUV, 565RGB, 555RGB, and 444RGB output data formats Parameter Optical Format Active Imager Size Active Pixels Pixel Size Color Filter Array Shutter Type Maximum Data Rate/ Master Clock Frame Rate VGA (640 x 480) CIF (352 x 288) QVGA (320 x 240) ADC Resolution Responsivity Dynamic Range SNRMAX Supply Voltage Power Consumption Operating Temperature Packaging Applications • • • • Key Performance Parameters Value 1/4-inch (4:3) 3.58mm(H) x 2.69mm(V) 4.48mm (Diagonal) 640H x 480V (VGA) 5.6 um x 5.6 um RGB Bayer Pattern Electronic Rolling Shutter (ERS) 1213.5 MPS/2427 MHz 15 fps at 12 MHz (default), programmable up to 30 fps at 27 MHz Programmable up to 60 fps Programmable up to 90 fps 10-bit, on-chip 1.9 V/lux-sec (550nm) 60 dB 45 dB 2.8V +0.25V <80 mW at 2.8 V, 15 fps at 12 MHz -20°C to +60°C 44-Ball ICSP, wafer or die Cellular phones PDAs PC Camera Toys and other battery-powered products General Description The ON SemiconductorMT9V111 is a 1/4-inch VGA-format CMOS active-pixel digital image sensor, the result of combining the MT9V011 image sensor core with ON Semiconductor's third-generation digital image flow processor technology. The MT9V111 has an active imaging pixel array of 649 x 489, capturing high-quality color images at VGA resolution. The sensor is a complete camera-on-a-chip solution and is designed specifically to meet the demands of battery-powered products such as cellular phones, PDAs, and toys. It incorporates sophisticated camera functions on-chip and is programmable through a simple two-wire serial interface. MT9V111_DS Rev. N 5/15 EN 1 ©Semiconductor Components Industries, LLC 2015, MT9V111 - 1/4-Inch SOC VGA Digital Image Sensor Ordering Information Ordering Information Table 2: Available Part Numbers Part Number Product Description Orderable Product Attribute Description MT9V111D00ATCK82AC1-305 VGA 1/4" SOC Die Sales, 305m Thickness MT9V111D00STCK82AC1K-305 VGA 1/11" SOC Die Sales, 305m Thickness MT9V111IA7ATC-DP VGA 1/13" SOC Dry Pack with Protective Film MT9V111IA7ATC-DR VGA 1/4" SOC Dry Pack without Protective Film MT9V111IA7ATC-TP VGA 1/4" CIS SOC Tape & Reel with Protective Film MT9V111IA7ATC-TR VGA 1/4" SOC Tape & Reel without Protective Film MT9V111_DS Rev. N 5/15 EN 2 ©Semiconductor Components Industries, LLC,2015. MT9V111 - 1/4-Inch SOC VGA Digital Image Sensor Table of Contents Table of Contents Applications . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .1 General Description . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .1 Ordering Information. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .2 General Description . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .6 Ball Assignment . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .8 Image Flow Processor. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .10 Output Data Ordering . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .12 Sensor Core Overview . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .13 Electrical Specifications. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .15 Propagation Delays. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .17 Appendix A – Sensor Timing . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .20 Serial Bus Description . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .21 Two-wire Serial Interface Sample Write and Read Sequences (with Saddr = 1) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .23 Appendix B – Overview of Programming . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .27 Revision History. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .31 MT9V111_DS Rev. N 5/15 EN 3 ©Semiconductor Components Industries, LLC,2015. MT9V111 - 1/4-Inch SOC VGA Digital Image Sensor List of Figures List of Figures Figure 1: Figure 2: Figure 3: Figure 4: Figure 5: Figure 6: Figure 7: Figure 8: Figure 9: Figure 10: Figure 11: Figure 12: Figure 13: Figure 14: Figure 15: Figure 16: Figure 17: Figure 18: Figure 19: Figure 20: Figure 21: Figure 22: Figure 23: Figure 24: Figure 25: Figure 26: Chip Block Diagram . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .6 Internal Register Grouping . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .7 Typical Configuration (Connection) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .7 44-Ball ICSP Package . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .8 Image Flow Processor Block Diagram . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .11 Sensor Core Block Diagram . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .13 Pixel Array Description . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .13 Pixel Color Pattern Detail (Top Right Corner) . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .14 Spatial Illustration of Image Readout. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .14 Propagation Delays for PIXCLK and Data Out Signals . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .17 Propagation Delays for FRAME_VALID and LINE_VALID Signals. . . . . . . . . . . . . . . . . . . . . . . . . . . . . .17 Data Output Timing Diagram . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .18 Spectral Response. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .19 Die Center - Image CenterOffset . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .19 Row Timing and FRAME_VALID/LINE_VALID Signals . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .20 Timing Diagram Showing a Write to Reg0x09 with Value 0x0284 . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .23 Timing Diagram Showing a Read from Reg0x09; Returned Value 0x0284 . . . . . . . . . . . . . . . . . . . . . . .23 Timing Diagram Showing a Bytewise Write to Reg0x09 with Value 0x0284. . . . . . . . . . . . . . . . . . . . . .24 Timing Diagram Showing a Bytewise Read from Reg0x09; Returned Value 0x0284 . . . . . . . . . . . . . .24 Serial Host Interface Start Condition Timing . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .25 Serial Host Interface Stop Condition Timing . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .25 Serial Host Interface Data Timing for Write . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .25 Serial Host Interface Data Timing for Read . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .25 Acknowledge Signal Timing After an 8-bit Write to the Sensor . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .26 Acknowledge Signal Timing After an 8-bit Read from the Sensor . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .26 44-Ball ICSP Package Outline Drawing . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .30 MT9V111_DS Rev. N 5/15 EN 4 ©Semiconductor Components Industries, LLC,2015. MT9V111 - 1/4-Inch SOC VGA Digital Image Sensor List of Tables List of Tables Table 1: Table 2: Table 2: Table 3: Table 4: Table 5: Table 6: Table 7: Table 8: Table 9: Table 10: Table 11: Table 12: Table 13: Table 14: Table 15: Key Performance Parameters. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .1 Available Part Numbers. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .2 Ball Description. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .8 YUV/YCbCr Output Data Ordering. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .12 RGB Output Data Ordering in Default Mode . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .12 Byte Ordering in 8 + 2 Bypass Mode . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .12 DC Electrical Characteristics . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .15 AC Electrical Characteristics . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .16 Frame Time . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .20 Frame Time—Larger than One Frame . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .20 Non-Default Register Settings Optimizing 15 fps at 12 MHz Operation . . . . . . . . . . . . . . . . . . . . . . . .27 Non-Default Register Settings Optimizing 30 fps at 27 MHz Operation . . . . . . . . . . . . . . . . . . . . . . . .27 Relation Between IFP R55[9:5] Setting and Frame Rate Range . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .27 Decimation, Zoom, and Pan . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .28 YCbCr Settings. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .29 YUV Settings. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .29 MT9V111_DS Rev. N 5/15 EN 5 ©Semiconductor Components Industries, LLC,2015. MT9V111 - 1/4-Inch SOC VGA Digital Image Sensor General Description General Description This SOC VGA CMOS image sensor features ON Semiconductor’s breakthrough, lownoise CMOS imaging technology that achieves CCD image quality (based on signal-tonoise ratio and low-light sensitivity) while maintaining the inherent size, cost and integration advantages of CMOS. The MT9V111 is a fully-automatic, single-chip camera, requiring only a power supply, lens and clock source for basic operation. Output video is streamed via a parallel eightbit DOUT port as shown in Figure 1. Output pixel clock is used to latch the data, while FRAME_VALID and LINE_VALID signals indicate the active video. The sensor can be put in an ultra-low power sleep mode by asserting the STANDBY pin. Output pads can also be tri-stated by de-asserting the OE# pin. The MT9V111 internal registers can be configured using a two-wire serial interface. The MT9V111 can be programmed to output progressive scan images up to 30 fps in an 8-bit ITU_R BT.656 (YCbCr) formerly CCIR656, YUV, 565RGB, 555RGB, or 444RGB formats. The FRAME_VALID and LINE_VALID signals are output on dedicated pins, along with a pixel clock that is synchronous with valid data. Figure 1: Chip Block Diagram SCLK SDATA SADDR CLK STANDBY OE# VDD/DGND VAA/AGND VAAPIX Communication Bus Image Flow Processor Sensor Core . Based on MT9V011 . 668H x 496V (VGA+ Reference) . 1/4-inch optical format . Auto Black compensation . Programmable analog gain . Programmable exposure . Low power, 10-bit ADCs . Color correction, gamma, DOUT(7:0) lens shading correction . Auto exposure, white balance . Interpolation and defect correction . Flicker avoidance PIXCLK FRAME_VALID LINE_VALID FLASH SRAM Line Buffers The MT9V111 can accept the input clock of up to 27 MHz, delivering 30 fps. With poweron defaults (see Appendix B for recommended defaults), the camera is configured to deliver 15 fps at 12 MHz and automatically slows down the frame rate in low-light conditions to achieve longer exposures and better image quality. Internally, the MT9V111 consists of a sensor core and an image flow processor. The sensor core functions to capture raw Bayer-encoded images that are input into the IFP as shown in Figure 1. The IFP processes the incoming stream to create interpolated, color-corrected output and controls the sensor core to maintain the desirable exposure and color balance. Sensor core and IFP registers are grouped into two separate address spaces, as shown in Figure 2. The internal registers can be accessed via the two-wire serial interface. Selecting the desired address space can be accomplished by programming register R1 which remains present in both register sets. MT9V111_DS Rev. N 5/15 EN 6 ©Semiconductor Components Industries, LLC,2015. MT9V111 - 1/4-Inch SOC VGA Digital Image Sensor General Description Figure 2: Internal Register Grouping Note: R0 R1 R0 R1 Sensor Core Registers (R2..R255) IFP Registers (R2..R255) R1=4 R1=1 Program R1 to select the desired space (4 = sensor core registes, 1 = IFP/SOC registers). Figure 3 shows MT9V111 typical connections. For low-noise operation, the MT9V111 requires separate supplies for analog and digital power. Incoming digital and analog ground conductors can be tied together right next to the die. Both power supply rails should be decoupled to ground using capacitors. The use of inductance filters is not recommended. Figure 3: Typical Configuration (Connection) VDD VDD VAA VAAPIX ADC_TEST VAA 1.5KΩ SADDR 1.5KΩ 1KΩ RESET# Two-wire serial bus { Master Clock DOUT(7:0) FRAME_VALID LINE_VALID PIXCLK SDATA SCLK { 10µF To CMOS camera port CLKIN FLASH To Xenon flash trigger or LED enable SCAN_EN DGND Note: MT9V111_DS Rev. N 5/15 EN AGND STANDBY DGND OE# AGND 1.5K resistor value is recommended, but may be greater for slower two-wire speed. 7 ©Semiconductor Components Industries, LLC,2015. MT9V111 - 1/4-Inch SOC VGA Digital Image Sensor Ball Assignment Ball Assignment Figure 4: 44-Ball ICSP Package 1 2 3 4 5 6 7 A DGND DOUT2 DOUT4 DGND DOUT6 VDD DGND B DOUT1 VDD DOUT3 VDD DOUT7 VDD VDD C NC DOUT0 DOUT5 VDD SCAN DGND D DGND _EN OE# NC E PIXCLK FLASH F FRAME_ VALID VDD SCLK G DGND CLKIN SDATA DGND VDD RESET# STAND SADDR AGND ADC_ TEST VAAPIX DGND VAA VAA AGND LINE_ VALID BY Top View (Ball Down) Table 2: Ball Description Ball Numbers Name Type G2 CLKIN Input Master Clock into sensor. Default is 12 MHz (27 MHz maximum). F3 SCLK Input Serial Clock. F4 SADDR Input Serial Interface address select: Reg0xB8 when HIGH (default). Reg0x90 when LOW. Description F6 ADC_TEST Input Tie to VAAPIX (factory use only). E6 RESET# Input Asynchronous reset of sensor when LOW. All registers assume factory defaults. E7 STANDBY Input When HIGH puts the imager in ultra-low power standby mode. D6 OE# Input Output_Enable_Bar pin. When HIGH tri-state all outputs except SDATA (tie LOW for normal operation). C6 SCAN_EN Input G3 SDATA I/O Tie to Digital ground. Serial data I/O. E2 FLASH Output Flash Strobe. E1 PIXCLK Output Pixel Clock Out. Pixel data output are valid during rising edge of this clock. IFP Reg0x08 [9] inverts polarity. Frequency = Master Clock. E3 LINE_VALID Output Active HIGH during line of selectable valid pixel data. F1 FRAME_VALID Output Active HIGH during frame of valid pixel data. B5 DOUT7 Output ITU_R BT.656/RGB data bit 7 (MSB). MT9V111_DS Rev. N 5/15 EN 8 ©Semiconductor Components Industries, LLC,2015. MT9V111 - 1/4-Inch SOC VGA Digital Image Sensor Ball Assignment Table 2: Ball Description (continued) Ball Numbers Name Type A5 DOUT6 Output ITU_R BT.656/RGB data bit 6. Description C3 DOUT5 Output ITU_R BT.656/RGB data bit 5. A3 DOUT4 Output ITU_R BT.656/RGB data bit 4. B3 DOUT3 Output ITU_R BT.656/RGB data bit 3. A2 DOUT2 Output ITU_R BT.656/RGB data bit 2. B1 DOUT1 Output ITU_R BT.656/RGB data bit 1. C2 DOUT0 Output ITU_R BT.656/RGB data bit 0 (LSB). A6,B2,B4,B6 , B7,C5,E5,F2 G5,G6 VDD Supply VAA Supply F7 VAAPIX Supply Pixel Array Power (2.8V). F5,G7 AGND Supply Analog Ground. A1,D1,A4,A 7,C7,D7,G1, G4 C1,D2 DGND Supply MT9V111_DS Rev. N 5/15 EN Digital Power (2.8V). Analog Power (2.8V). Digital Ground. NC No connect. 9 ©Semiconductor Components Industries, LLC,2015. MT9V111 - 1/4-Inch SOC VGA Digital Image Sensor Image Flow Processor Image Flow Processor Overview of Architecture The image flow processor consists of a color processing pipeline and a measurement and control logic block as shown in Figure 5. The stream of raw data from the sensor enters the pipeline and undergoes a number of transformations. Image stream processing starts from conditioning the black level and applying a digital gain. The lens shading block compensates for signal loss caused by the lens. Next, the data is interpolated to recover missing color components for each pixel and defective pixels are corrected. The resulting interpolated RGB data passes through the current color correction matrix (CCM), gamma, and saturation corrections and is formatted for final output. The measurement and control logic continuously accumulates statistics about image brightness and color. Indoor 50/60 Hz flicker is detected and automatically updated when possible. Based on these measurements the IFP calculates updated values for exposure time and sensor analog gains, which are sent to the sensor core via the communication bus. Color correction is achieved through linear transformation of the image with a 3 x 3 color correction matrix. Color saturation can be adjusted in the range from zero (black and white) to 1.25 (125% of full color saturation). Gamma correction compensates for non-linear dependence of the display device output vs. driving signal (e.g. monitor brightness vs. CRT voltage). Output and Formatting Processed video can be output in the form of a standard ITU_R BT.656 or RGB stream. ITU_R BT.656 (default) stream contains 4:2:2 data with optional embedded synchronization codes. This kind of output is typically suitable for subsequent display by standard video equipment. For JPEG/MPEG compression, YUV/ encoding is suitable. RGB functionality is provided to support LCD devices. The MT9V111 can be configured to output 16-bit RGB (RGB565), 15-bit RGB (RGB555) as well as two types of 12-bit RGB (RGB444). The user can configure internal registers to swap odd and even bytes, chrominance channels and luminance and chrominance components to facilitate interface to application processors. MT9V111_DS Rev. N 5/15 EN 10 ©Semiconductor Components Industries, LLC,2015. MT9V111 - 1/4-Inch SOC VGA Digital Image Sensor Image Flow Processor Figure 5: Image Flow Processor Block Diagram IMAGE SENSOR LENS CORRECTION DEMOSAICING AE, AWB, FLICKER AVOIDANCE COLOR CORRECTION FLASH CONTROL GAMMA CORRECTION OUTPUT FORMATTING The MT9V111 features smooth, continuous zoom and pan. This functionality is available when the IFP output is downsized in the decimation block. The decimation block can downsize the original VGA image to any integer size, including QVGA, QQVGA, CIF and QCIF with no loss to the field of view. The user can program the desired size of the output image in terms of horizontal and vertical pixel count. In addition the user can program the size of a region for downsizing. Continuous zoom is achieved every time the region of interest is less than the entire VGA image. The maximum zoom factor is equal to the ratio of VGA to the size of the region of interest. For example, an image rendered on a 160x120 display can be zoomed by 640/160=480/120=4 times. Continuous pan is achieved by adjusting the starting coordinates of the region of interest. Also a fixed 2X up-zoom is implemented by means of windowing down the sensor core. In this mode the IFP receives a QVGA-sized input data and outputs a VGA-size image. The sub-window can be panned both vertically and horizontally by programming sensor core registers. The MT9V111 supports both LED and Xenon-type flash light sources using a dedicated output pad. For Xenon devices the pad generates a strobe to fire when the imager's shutter is fully open. For LED the pad can be asserted or de-asserted asynchronously. Flash modes are configured and engaged over the two-wire serial interface using IFP Reg0x98. MT9V111_DS Rev. N 5/15 EN 11 ©Semiconductor Components Industries, LLC,2015. MT9V111 - 1/4-Inch SOC VGA Digital Image Sensor Output Data Ordering Output Data Ordering In YCbCr the first and second bytes can be swapped. Luma/chroma bytes can be swapped as well. R and B channels are bit-wise swapped when chroma swap is enabled. See IFP Reg0x3A for channel swapping configuration. Table 3: YUV/YCbCr Output Data Ordering Mode 1st Byte 2nd Byte Default (no swap) Cbi Swapped CrCb Cri Swapped YC Swapped CrCb, YC Table 4: 3rd Byte 4th Byte Yi Cri Yi+1 Yi Cbi Yi+1 Yi Cbi Yi+1 Cri Yi Cri Yi+1 Cbi RGB Output Data Ordering in Default Mode Mode (Swap Disabled) Byte D7 D6 D5 D4 D3 D2 D1 D0 RGB 565 First Second First Second First Second First Second R7 G4 0 G4 R7 B7 0 G7 R6 G3 R7 G3 R6 B6 0 G6 R5 G2 R6 G2 R5 B5 0 G5 R4 B7 R5 B7 R4 B4 0 G4 R3 B6 R4 B6 G7 0 R7 B7 G7 B5 R3 B5 G6 0 R6 B6 G6 B4 G7 B4 G5 0 R5 B5 G5 B3 G6 B3 G4 0 R4 B4 RGB 555 RGB 444x RGB x444 A bypass mode is available whereby raw Bayer 10-bits data is output as two bytes. See IFP Reg8[7]. Table 5: Byte Ordering in 8 + 2 Bypass Mode Byte Ordering 8+2 Bypass MT9V111_DS Rev. N 5/15 EN First Second D9 0 D8 0 D7 0 12 D6 0 D5 0 D4 0 D3 D1 D2 D0 ©Semiconductor Components Industries, LLC,2015. MT9V111 - 1/4-Inch SOC VGA Digital Image Sensor Sensor Core Overview Sensor Core Overview The sensor consists of a pixel array of 668 x 496 total, analog readout chain, 10-bit ADC with programmable gain and black offset, and timing and control. Note: See Sensor Core (MT9V011) data sheet for more details. Figure 6: Sensor Core Block Diagram Control Register Active Pixel Sensor Array Communication Bus to IFP Timing and Control Clock Sync. Signals Analog Processing 10-bit Data to IFP ADC The sensor core’s pixel array is configured as 668 columns by 496 rows (shown in Figure 7). The first 18 columns and the first 6 rows of pixels are optically black and can be used to monitor the black level. The last column and the last row of pixels are also optically black. The black row data is used internally for the automatic black level adjustment. There are 649 columns by 489 rows of optically active pixels, which provides a four-pixel boundary around the VGA (640 x 480) image to avoid boundary affects during color interpolation and correction. The additional active column and additional active row are used to allow horizontally and vertically mirrored readout to also start on the same color pixel, as shown in Figure 7. Figure 7: Pixel Array Description (0, 0) 6 black rows 1 black column VGA (640 x 480) + 4 pixel boundary for color correction + additional active column + additional active row = 649 x 489 active pixels (667,495) 18 black columns 1 black row The sensor core uses the RGB Bayer color pattern (shown in Figure 8). Even-numbered rows contain green and red color pixels, and odd-numbered rows contain blue and green color pixels. Even-numbered columns contain green and blue color pixels; oddnumbered columns contain red and green color pixels. MT9V111_DS Rev. N 5/15 EN 13 ©Semiconductor Components Industries, LLC,2015. MT9V111 - 1/4-Inch SOC VGA Digital Image Sensor Sensor Core Overview Figure 8: Pixel Color Pattern Detail (Top Right Corner) column readout direction .. . row readout direction ... black pixels G R G R G R G B G B G B G B G R G R G R G B G B G B G B G R G R G R G B G B G B G B Pixel (18,6) (First Optical clear pixel) .. . The sensor core image data is read-out in a progressive scan. Valid image data is surrounded by horizontal and vertical blanking, as shown in Figure 9. The amount of horizontal and vertical blanking is programmable through the sensor core registers Reg0x05 and Reg0x06, respectively. LINE_VALID is HIGH during the shaded region of the figure. See “Appendix A – Sensor Timing” on page 20 for the description of FRAME_VALID timing. Figure 9: Spatial Illustration of Image Readout P0,0 P0,1 P0,2.....................................P0,n-1 P0,n P1,0 P1,1 P1,2.....................................P1,n-1 P1,n 00 00 00 .................. 00 00 00 00 00 00 .................. 00 00 00 VALID IMAGE HORIZONTAL BLANKING Pm-1,0 Pm-1,1.....................................Pm-1,n-1 Pm-1,n 00 00 00 .................. 00 00 00 Pm,0 Pm,1.....................................Pm,n-1 Pm,n 00 00 00 .................. 00 00 00 Notes: MT9V111_DS Rev. N 5/15 EN 00 00 00 ..................................... 00 00 00 00 00 00 ..................................... 00 00 00 00 00 00 .................. 00 00 00 00 00 00 .................. 00 00 00 VERTICAL BLANKING VERTICAL/HORIZONTAL BLANKING 00 00 00 ..................................... 00 00 00 00 00 00 ..................................... 00 00 00 00 00 00 .................. 00 00 00 00 00 00 .................. 00 00 00 1. Do not change these registers. Contact ON Semiconductor support for settings different from defaults. 2. IFP controls these registers when AE, AWE, or flicker avoidance are enabled. 14 ©Semiconductor Components Industries, LLC,2015. MT9V111 - 1/4-Inch SOC VGA Digital Image Sensor Electrical Specifications Electrical Specifications The recommended die operating temperature ranges from -20°C to +40°C. The sensor image quality may degrade above +40°C. Table 6: DC Electrical Characteristics VDD = VAA = 2.8 ± 0.25V; TA = 25°C Symbol Definition VIH Input High Voltage VIL Input Low Voltage IIN Input Leakage Current Condition No Pull-up Resistor; VIN = VDD or DGND MAX Unit VDD - 0.25 MIN TYP VDD + 0.25 V -0.3 0.8 V -5 5.0 A VOH Output High Voltage VOL Output Low Voltage 0.2 V IOH Output High Current 15.0 mA IOL Output Low Current 20.0 mA IOZ Tri-state Output Leakage Current 5.0 A IAA Analog Operating Supply Current IDD Digital Operating Supply Current IAA Standby Analog Standby Supply Current IDD Standby Digital Standby Supply Current Notes: MT9V111_DS Rev. N 5/15 EN VDD - 0.2 Default settings, CLOAD = 10pF CLKIN = 12 MHz CLKIN = 27 MHz Default settings, CLOAD = 10pF CLKIN = 12 MHz CLKIN = 27 MHz STDBY = VDD STDBY = VDD V 10.0 10.0 20.0 20.0 25.0 25.0 mA 5.0 10.0 0.0 8.0 15.0 2.5 20.0 20.0 5.0 mA 0.0 2.5 5.0 A A 1. To place the chip in standby mode, first raise STANDBY to VDD, then wait two master clock cycles before turning off the master clock. Two master clock cycles are required to place the analog circuitry into standby, low-power mode. 2. When STANDBY is de-asserted, standby mode is exited immediately (within several master clocks), but the current frame and the next two frames will be invalid. The fourth frame will contain a valid image. 15 ©Semiconductor Components Industries, LLC,2015. MT9V111 - 1/4-Inch SOC VGA Digital Image Sensor Electrical Specifications Table 7: AC Electrical Characteristics VDD = VAA = 2.8 ± 0.25V; TA = 25°C Symbol fCLKIN Definition Condition Input Clock Frequency Clock Duty Cycle t R t F 45 Input Clock Rise Time Input Clock Fall Time CLKIN to PIXCLK propagation delay: LOW-to-HIGH HIGH-to-LOW CLOAD = 10pF t PIXCLK to DOUT(7:0) at 27 MHz Setup Time Hold Time CLOAD = 10pF tDSETUP PIXCLK to DOUT(7:0) at 12 MHz Setup Time Hold Time CLOAD = 10pF t PLHP PHLP t DSETUP tDHOLD tDHOLD tOH tPLHF,L tPHLF,L tOUTR tOUTF MIN Data Hold Time from PIXCLK falling edge CLKIN to FRAME_VALID and LINE_VALID propagation delay: LOW-to-HIGH HIGH-to-LOW TYP MAX Unit 12 27 MHz 50 55 ns 2.0 ns 12 10 ns 13.0 13.0 ns 25.0 25.0 ns 9.0 ns CLOAD = 10pF ns Output Rise Time CLOAD = 10pF 9.0 7.5 7.0 Output Fall Time CLOAD = 10pF 9.0 Notes: MT9V111_DS Rev. N 5/15 EN % 2.0 ns ns 1. For 30 fps operation with a 27 MHz clock, it is very important to have a precise duty cycle equal to 50%. With a slower frame rate and a slower clock the clock duty cycle can be relaxed. 16 ©Semiconductor Components Industries, LLC,2015. MT9V111 - 1/4-Inch SOC VGA Digital Image Sensor Propagation Delays Propagation Delays Propagation Delays for PIXCLK and Data Out Signals The typical output delay, relative to the master clock edge, is 7.5 ns. Note that the data outputs change on the falling edge of the master clock, with the pixel clock rising on the subsequent rising edge of the master clock. Propagation Delays for FRAME_VALID and LINE_VALID Signals The LINE_VALID and FRAME_VALID signals change on the same falling master clock edge as the data output. The LINE_VALID goes HIGH on the same falling master clock edge as the output of the first valid pixel's data and returns LOW on the same master clock falling edge as the end of the output of the last valid pixel's data. As shown in Figure 12, Data Output Timing Diagram, on page 18, FRAME_VALID goes HIGH 6 pixel clocks prior to the time that the first LINE_VALID goes HIGH. It returns LOW at a time corresponding to 6 pixel clocks after the last LINE_VALID goes LOW. Figure 10: Propagation Delays for PIXCLK and Data Out Signals tR tF CLKIN tPHLP tPLHP PIXCLK tPLHD, tPHLD DOUT (7:0) Figure 11: DOUT (7:0) DOUT (7:0) tOH DOUT (7:0) DOUT (7:0) Propagation Delays for FRAME_VALID and LINE_VALID Signals tPLHF,L MT9V111_DS Rev. N 5/15 EN tPHLF,L CLKIN CLKIN FRAME_VALID LINE_VALID FRAME_VALID LINE_VALID 17 ©Semiconductor Components Industries, LLC,2015. MT9V111 - 1/4-Inch SOC VGA Digital Image Sensor Propagation Delays Figure 12: Data Output Timing Diagram PIXCLK FRAME_VALID tLVHOLD tLVSETUP LINE_VALID DOUT(7:0) tFVHOLD tFVSETUP tDSETUP Cb0 Y0 Cr0 Y1 Ylast Cb0 Ylast Cb0 tDHOLD Note: PIXCLK = MAX 27 MHz tFVSETUP = / setup time for FRAME_VALID before rising edge of PIXCLK / = 18ns tFVHOLD = / hold time for FRAME_VALID after rising edge of PIXCLK / = 18ns tLVSETUP = / setup time for LINE_VALID before rising edge of PIXCLK / = 18ns tLVHOLD = / hold time for LINE_VALID after rising edge of PIXCLK / = 18ns tDSETUP = / setup time for DOUT before rising edge of PIXCLK / = 13ns tDHOLD = / hold time for DOUT after rising edge of PIXCLK / = 13ns Frame start: FF00 00A0 Line start: FF00 0080 Line end: FF00 0090 Frame end: FF00 00B0 MT9V111_DS Rev. N 5/15 EN 18 ©Semiconductor Components Industries, LLC,2015. MT9V111 - 1/4-Inch SOC VGA Digital Image Sensor Propagation Delays Figure 13: Spectral Response Relative Response 1.2 Blue Green (B) Green (R) 1.0 Relative Response Red 0.8 0.6 0.4 0.2 0.0 350 450 550 650 750 850 950 1050 Wavelength (nm) Figure 14: Die Center - Image CenterOffset - Direction + Direction 0 11.0um Die Center + Direction ARRAY 0 -91.3um - Direction Pixel Array Center Pixel (0, 0) Note: MT9V111_DS Rev. N 5/15 EN Not to scale. 19 ©Semiconductor Components Industries, LLC,2015. MT9V111 - 1/4-Inch SOC VGA Digital Image Sensor Appendix A – Sensor Timing Appendix A – Sensor Timing Figure 15: Row Timing and FRAME_VALID/LINE_VALID Signals ... FRAME_VALID ... LINE_VALID ... Number of master clocks Note: Table 8: P1 A Q A Q A P2 The signals in Figure 15 are defined in Table 8. Frame Time Parameter Name Equation (Master Clocks) Default Timing At 12 MHz A Active Data Time (Reg0x04 - 7) x 2 = 1,280 pixel clocks = 1,280 master clocks = 106.7us P1 Frame Start Blanking (Reg0x05 + 112) x 2 = 300 pixel clocks = 300 master clocks = 25.0us P2 Frame End Blanking 14 CLKS = 14 pixel clocks = 14 master clocks = 1.17us Q Horizontal Blanking (Reg0x05 + 121) x 2 (MIN Reg0x05 value = 9) = 318 pixel clocks = 318 master clocks = 26.5us A+Q Row Time (Reg0x04 + Reg0x05 +114) x 2 = 1,598 pixel clocks = 1,598 master clocks = 133.2us V Vertical Blanking (Reg0x06 + 9) x (A + Q) + (Q - P1 - P2) = 20, 778 pixel clocks = 20,778 master clocks = 1.73ms Nrows x (A + Q) Frame Valid Time (Reg0x03 - 7) x (A + Q) - (Q - P1 - P2) = 767,036 pixel clocks = 767,036 master clocks = 63.92ms F Total Frame Time (Reg0x03 + Reg0x06 + 2) x (A + Q) = 787,814 pixel clocks = 787,814 master clocks = 65.65ms Note: In order to avoid flicker, frame time is 65.65ms. Sensor timing is shown above in terms of master clock cycle. The vertical blanking and total frame time equations assume that the number of integration rows (bits 11 through 0 of Reg0x09) is less than the number of active row plus blanking rows (Reg0x03 + 1 + Reg0x06 + 1). If this is not the case, the number of integration rows must be used instead to determine the frame time, as shown in Table 9. Table 9: Frame Time—Larger than One Frame Parameter Name Equation (Master Clocks) Default Timing V’ Vertical Blanking (long integration time) (Reg0x09 - Reg0x03) x (A + Q) F’ Total Frame Time (long integration time) (Reg0x09 + 1) x (A + Q) – – MT9V111_DS Rev. N 5/15 EN 20 ©Semiconductor Components Industries, LLC,2015. MT9V111 - 1/4-Inch SOC VGA Digital Image Sensor Serial Bus Description Serial Bus Description Registers are written to and read from the MT9V111 through the two-wire serial interface bus. The sensor is a serial interface slave and is controlled by the serial clock (SCLK), which is driven by the serial interface master. Data is transferred into and out of the MT9V111 through the serial data (SDATA) line. The SDATA line is pulled up to 2.8V offchip by a 1.5K resistor. Either the slave or master device can pull the SDATA line down— the serial interface protocol determines which device is allowed to pull the SDATA line down at any given time. The registers are 16 bits wide and can be accessed through 16bit or eight-bit two-wire serial bus sequences. Protocol The two-wire serial interface defines several different transmission codes, as follows: • a start bit • the slave device eight-bit address. SADDR is used to select between two different addresses in case of conflict with another device. If SADDR is LOW, the slave address is 0x90; if SADDR is HIGH, the slave address is 0xB8. • a(n) (no) acknowledge bit • an eight-bit message • a stop bit Sequence A typical read or write sequence begins by the master sending a start bit. After the start bit, the master sends the slave device's eight-bit address. The last bit of the address determines if the request will be a read or a write, where a "0" indicates a write and a "1" indicates a read. The slave device acknowledges its address by sending an acknowledge bit back to the master. If the request was a write, the master then transfers the 8-bit register address to which a write should take place. The slave sends an acknowledge bit to indicate that the register address has been received. The master then transfers the data eight bits at a time, with the slave sending an acknowledge bit after each 8 bits. The MT9V111 uses 16-bit data for its internal registers, thus requiring two eight-bit transfers to write to one register. After 16 bits are transferred, the register address is automatically incremented, so that the next 16 bits are written to the next register address. The master stops writing by sending a start or stop bit. A typical read sequence is executed as follows. First the master sends the write-mode slave address and eight-bit register address, just as in the write request. The master then sends a start bit and the read-mode slave address. The master then clocks out the register data eight bits at a time. The master sends an acknowledge bit after each eightbit transfer. The register address is auto-incremented after every 16 bits is transferred. The data transfer is stopped when the master sends a no-acknowledge bit. The MT9V111 allows for eight-bit data transfers through the two-wire serial interface by writing (or reading) the most significant eight bits to the register and then writing (or reading) the least significant eight bits to Reg0x7F (127). Bus Idle State The bus is idle when both the data and clock lines are HIGH. Control of the bus is initiated with a start bit, and the bus is released with a stop bit. Only the master can generate the start and stop bits. MT9V111_DS Rev. N 5/15 EN 21 ©Semiconductor Components Industries, LLC,2015. MT9V111 - 1/4-Inch SOC VGA Digital Image Sensor Serial Bus Description Start Bit The start bit is defined as a HIGH-to-LOW transition of the data line while the clock line is HIGH. Stop Bit The stop bit is defined as a LOW-to-HIGH transition of the data line while the clock line is HIGH. Slave Address The 8-bit address of a two-wire serial interface device consists of seven bits of address and 1 bit of direction. A “0” in the least significant bit (LSB) of the address indicates write mode, and a “1” indicates read mode. The write address of the sensor is 0xB8, while the read address is 0xB9; this only applies when SADDR is set HIGH. Data Bit Transfer One data bit is transferred during each clock pulse. The serial interface clock pulse is provided by the master. The data must be stable during the HIGH period of the serial clock—it can only change when the two-wire serial interface clock is LOW. Data is transferred eight bits at a time, followed by an acknowledge bit. Acknowledge Bit The master generates the acknowledge clock pulse. The transmitter (which is the master when writing, or the slave when reading) releases the data line, and the receiver indicates an acknowledge bit by pulling the data line LOW during the acknowledge clock pulse. No-Acknowledge Bit The no-acknowledge bit is generated when the data line is not pulled down by the receiver during the acknowledge clock pulse. A no-acknowledge bit is used to terminate a read sequence. MT9V111_DS Rev. N 5/15 EN 22 ©Semiconductor Components Industries, LLC,2015. MT9V111 - 1/4-Inch SOC VGA Digital Image Sensor Two-wire Serial Interface Sample Write and Read Sequences (with Saddr = 1) Two-wire Serial Interface Sample Write and Read Sequences (with SADDR = 1) 16-Bit Write Sequence A typical write sequence for writing 16 bits to a register is shown in Figure 16. A start bit given by the master, followed by the write address, starts the sequence. The image sensor will then give an acknowledge bit and expects the register address to come first, followed by the 16-bit data. After each eight-bit the image sensor will give an acknowledge bit. All 16 bits must be written before the register will be updated. After 16 bits are transferred, the register address is automatically incremented, so that the next 16 bits are written to the next register. The master stops writing by sending a start or stop bit. Figure 16: Timing Diagram Showing a Write to Reg0x09 with Value 0x0284 SCLK SDATA Reg0x09 0xB8 ADDR START ACK 0000 0010 ACK 1000 0100 ACK STOP ACK 16-Bit Read Sequence A typical read sequence is shown in Figure . First the master has to write the register address, as in a write sequence. Then a start bit and the read address specifies that a read is about to happen from the register. The master then clocks out the register data eight bits at a time. The master sends an acknowledge bit after each eight-bit transfer. The register address is auto-incremented after every 16 bits is transferred. The data transfer is stopped when the master sends a no-acknowledge bit. Figure 17: Timing Diagram Showing a Read from Reg0x09; Returned Value 0x0284 SCLK SDATA 0xB8 ADDR START MT9V111_DS Rev. N 5/15 EN Reg 0x09 ACK 0xB9 ADDR ACK ACK 23 1000 0100 0000 0010 ACK STOP NACK ©Semiconductor Components Industries, LLC,2015. MT9V111 - 1/4-Inch SOC VGA Digital Image Sensor Two-wire Serial Interface Sample Write and Read Sequences (with Saddr = 1) Eight-Bit Write Sequence All registers in the camera are treated and accessed as 16-bit, even when some registers do not have all 16-bits used. However, certain hosts only support 8-bit serial communication access. The camera provides a special accommodation for these hosts. To be able to write one byte at a time to the register a special register address is added. The 8-bit write is done by first writing the upper 8 bits to the desired register and then writing the lower 8 bits to the special register address (Reg0x7F). The register is not updated until all 16 bits have been written. It is not possible to just update half of a register. In Figure 18, a typical sequence for 8-bit writing is shown. The second byte is written to the special register (Reg0x7F). Figure 18: Timing Diagram Showing a Bytewise Write to Reg0x09 with Value 0x0284 SCLK SDATA 0xB8 ADDR 0000 0010 Reg0x09 0xB8 ADDR 1000 0100 Reg0x7F STOP START START ACK ACK ACK ACK ACK ACK Eight-Bit Read Sequence To read one byte at a time the same special register address is used for the lower byte. The upper 8 bits are read from the desired register. By following this with a read from the special register (Reg0x7F) the lower 8 bits are accessed, as shown in Figure 19 The master sets the no-acknowledge bits. Figure 19: Timing Diagram Showing a Bytewise Read from Reg0x09; Returned Value 0x0284 SCLK SDATA 0xB8 ADDR 0xB9 ADDR Reg0x09 0000 0010 START START ACK ACK NACK ACK SCLK SDATA 0xB8 ADDR 0xB9 ADDR Reg0x7F 1000 0100 STOP START START MT9V111_DS Rev. N 5/15 EN ACK ACK ACK 24 NACK ©Semiconductor Components Industries, LLC,2015. MT9V111 - 1/4-Inch SOC VGA Digital Image Sensor Two-wire Serial Interface Sample Write and Read Sequences (with Saddr = 1) Two-wire Serial Bus Timing The two-wire serial interface operation requires a certain minimum of master clock cycles between transitions. These are specified below in master clock cycles. Figure 20: Serial Host Interface Start Condition Timing 5 4 SCLK SDATA Figure 21: Serial Host Interface Stop Condition Timing 5 4 SCLK SDATA Note: Figure 22: All timing are in units of master clock cycle. Serial Host Interface Data Timing for Write 4 Note: Figure 23: 4 SDATA is driven by an off-chip transmitter. Serial Host Interface Data Timing for Read 5 Note: MT9V111_DS Rev. N 5/15 EN SDATA is pulled LOW by the sensor, or allowed to be pulled HIGH by a pull-up resistor off-chip. 25 ©Semiconductor Components Industries, LLC,2015. MT9V111 - 1/4-Inch SOC VGA Digital Image Sensor Two-wire Serial Interface Sample Write and Read Sequences (with Saddr = 1) Figure 24: Acknowledge Signal Timing After an 8-bit Write to the Sensor 3 6 SCLK Sensor pulls down SDATA pin SDATA Figure 25: Acknowledge Signal Timing After an 8-bit Read from the Sensor 6 7 SCLK SDATA Note: MT9V111_DS Rev. N 5/15 EN Sensor tri-states SDATA pin (turns off pull down) After a read, the master receiver must pull down SDATA to acknowledge receipt of data bits. When read sequence is complete, the master must generate a no acknowledge by leaving SDATA to float HIGH. On the following cycle, a start or stop bit may be used. 26 ©Semiconductor Components Industries, LLC,2015. MT9V111 - 1/4-Inch SOC VGA Digital Image Sensor Appendix B – Overview of Programming Appendix B – Overview of Programming Default Sensor Configuration In its default configuration, the sensor outputs up to 15 fps at 12 MHz master clock frequency. Auto exposure, automatic white balance, 60Hz flicker avoidance, defect correction, and automatic noise suppression in low light conditions are enabled. The frame rate is controlled by AE and can be slowed down to 5 fps in low light. Lens shading correction is disabled. Gamma correction uses gamma = 0.6. Image data are output in YCbCr ITU_R.BT.656 VGA format, with Y, Cb, and Cr values ranging from 16 to 240. The use of the non-default register settings shown in Table 10 are recommended to optimize sensor performance in the above configuration. Table 10: Non-Default Register Settings Optimizing 15 fps at 12 MHz Operation Core: R5 = 46, R7[4] = 0, R33 = 58369, R47 = 63414 IFP: R51= 5137, R56 = 2168, R57= 290, R59 = 1068, R62 = 4095, R64 = 7696, R65 = 5143, R66 = 4627, R67 = 4370, R68 = 28944, R69 = 29811 Note: Table 11: Non-default register settings required for an optimal 30 fps, 27 MHz operation are shown in Table 11 Non-Default Register Settings Optimizing 30 fps at 27 MHz Operation Note: Core: R5 = 132, R6 = 10, R7[4] = 0, R33 = 58369 IFP: R51 = 5137, R57 = 290, R59 = 1068, R62 = 4095, R89 = 504, R90 = 605, R92 = 8222, R93 = 10021, R100 = 4477 To obtain register settings for other frame rates and clock speeds, please contact a ON Semiconductor FAE. Auto Exposure Target image brightness and accuracy of AE are set by IFP R46[7:0] and R46[15:8], respectively. For example, to overexpose images, set IFP R46[7:0] = 120. To change image brightness on LCD in RGB preview mode, use IFP R52[15:8]. AE logic can be programmed to keep the frame rate constant or vary it within certain range, by writing to IFP R55[9:5] one of the values tabulated in Table 12. Table 12: Relation Between IFP R55[9:5] Setting and Frame Rate Range Minimum Frame Rate Maximum Frame Rate = 15 fps Maximum Frame Rate = 30 fps 30 fps 15 fps 7.5 fps 5 fps N/A 8 16 24 4 8 16 24 The speed of AE is set using IFP R47. The speed should be high in preview modes and lower for video output to avoid sudden changes in brightness between frames. Auto exposure is disabled by setting IFP R6[14] = 0. When AE, AWB, and flicker avoidance are all disabled (IFP R6[14] = 0, IFP R6[1] = 0, and IFP R8[11] = 0), exposure and analog gains can be adjusted manually (see core registers R9, R12, and R43 through R46). MT9V111_DS Rev. N 5/15 EN 27 ©Semiconductor Components Industries, LLC,2015. MT9V111 - 1/4-Inch SOC VGA Digital Image Sensor Appendix B – Overview of Programming Automatic White Balance AWB can be disabled by setting IFP R6[1]=0. Use IFP R37[2:0] and R37[6:3] to speed up AWB response. Please note that speeding AWB up may result in color oscillation. If necessary, AWB range can be restricted by changing the upper limit in IFP R36[14:8] and lower limit in IFP R36[6:0]. Flicker Avoidance Use IFP R91 to choose automatic/manual, 50Hz/60Hz flicker avoidance and IFP R8[11] = 0 to disable this feature. Flash For flash programming, see IFP R152 description. Decimation, Zoom, and Pan For output decimation programming, see IFP R165 description. Table 13 provides a few examples. Table 13: Decimation, Zoom, and Pan Note: Ifp Registers CIF Output (Correct Aspect Ratio) QVGA Output 2:1 Zoom QVGA Output 1:1 Zoom R165 R166 R167 R168 R169 R170 26 586 352 0 480 288 160 320 320 120 240 240 0 640 320 0 480 240 For fixed 2x upsize zoom, set core R30[0] = 1. Interpolation Use IFP R5[2:0] to adjust image sharpness. By default, sharpness is automatically reduced in low-light conditions (see IFP R5[3]). For RGB565 16-bit capture, set IFP R6[12] = 0 and IFP R5[3] = 0 to avoid contouring. Special Effects To switch from color to gray scale output, set IFP R8[5] = 1. Contact a ON Semiconductor FAE for register settings producing other special effects (e.g. sepia output). Image Mirroring To mirror images horizontally, set core R32[14] = 1 and IFP R8[0] = 1. To flip images vertically, set core R32[15] = 1 and IFP R8[1] = 1. Test Pattern See IFP R72 and IFP Reg58[5:3] description. MT9V111_DS Rev. N 5/15 EN 28 ©Semiconductor Components Industries, LLC,2015. MT9V111 - 1/4-Inch SOC VGA Digital Image Sensor Appendix B – Overview of Programming Gamma Correction See Table 14 and Table for register settings required to setup non-default gamma correction. Please note that these settings determine output signal range. Use YCbCr settings with ITU_R BTU-compatible devices. Use YUV settings for JPEG capture and RGB preview; switching to YUV mode requires setting IFP R52 = 0 and IFP R53 = 65281. Table 14: Table 15: YCbCr Settings Gamma 0.45 0.5 0.55 0.6 (Default) 0.7 1.0 IFP R83 IFP R84 IFP R85 IFP R86 IFP R87 12836 23876 39039 49326 57552 10781 21563 37495 48553 57551 8984 19508 35952 47780 57549 7700 17709 34409 47008 57548 5389 14627 31581 45207 57545 2052 8208 24640 41088 57536 Gamma 0.45 0.5 0.55 0.6 0.7 1.0 IFP R83 IFP R84 IFP R85 IFP R86 IFP R87 14377 26957 44432 56005 65260 12321 24643 42631 54976 65259 10267 22331 40831 54202 65257 8726 20276 39031 53173 65255 6159 16680 35945 51371 65252 2308 9234 27720 46481 65241 YUV Settings MT9V111_DS Rev. N 5/15 EN 29 ©Semiconductor Components Industries, LLC,2015. MT9V111 - 1/4-Inch SOC VGA Digital Image Sensor Appendix B – Overview of Programming Figure 26: 44-Ball ICSP Package Outline Drawing 0.95 (FOR REFERENCE ONLY) 1.17 ±0.10 B SEATING PLANE 0.10 A A 0.22 (FOR REFERENCE ONLY) 0.175 (FOR REFERENCE ONLY) 0.575 ±0.050 4.50 0.375 ±0.075 BALL A1 BALL A1 ID 0.75 TYP BALL A7 44X Ø0.35 BALL A1 CORNER 5.30 CTR PIXEL (0,0) 3.500 ±0.075 DIMENSIONS APPLY TO SOLDER BALLS POST REFLOW. THE PREREFLOW DIAMETER IS Ø0.33 3.400 ±0.075 3.50 ±0.05 CL 4.50 2.688 5.30 CTR CTR 7.00 ±0.075 0.100 (FOR REFERENCE ONLY) OPTICAL CENTER PACKAGE CENTER 2.25 0.75 TYP CL 2.25 3.50 ±0.05 OPTICAL AREA 3.584 CTR MAXIMUM ROTATION OF OPTICAL AREA RELATIVE TO PACKAGE EDGES: 1º MAXIMUM TILT OF OPTICAL AREA RELATIVE TO B : 0.3º MAXIMUM TILT OF OPTICAL AREA RELATIVE TO TOP OF COVER GLASS: 0.3º 7.00 ±0.075 SOLDER BALL MATERIAL: 62% Sn, 36% Pb, 2%Ag OR 96.5% Sn, 3%Ag, 0.5% Cu SOLDER MASK DEFINED BALL PADS: Ø 0.27 LID MATERIAL: BOROSILICATE GLASS 0.40 THICKNESS IMAGE SENSOR DIE SUBSTRATE MATERIAL: PLASTIC LAMINATE ENCAPSULANT: EPOXY Notes: MT9V111_DS Rev. N 5/15 EN 1. All dimensions in millimeters. 2. ICSP package information is preliminary. 30 ©Semiconductor Components Industries, LLC,2015. MT9V111 - 1/4-Inch SOC VGA Digital Image Sensor Revision History Revision History Rev. N . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .4/16/15 • Updated “Ordering Information” on page 2 Rev. M. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .3/27/15 • Converted to ON Semiconductor template Rev. L . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 5/3/11 • Updated trademarks • Applied updated template Rev. K . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 6/10 • Updated to non-confidential Rev. J. . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 5/10 • Updated to Aptina template • Transfered registers to a separate document Rev. H, Production . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 6/06 • Updated Table 6, “IFP Register List,” on page 12 Rev. G, Production . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1/05 • Modified tOH definition in Table 7, “AC Electrical Characteristics,” on page 16 • Updated Figure 10, Propagation Delays for PIXCLK and Data Out Signals, on page 17 Rev. F, Production . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 8/04 • Updated 44-Ball ICSP Package Outline Drawing Rev. E . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 7/04 • Replaced 28-Pin PLCC package information with the 44-Ball ICSP • Updated Table 12 (Frame Time) • Updated Electrical Specifications Rev. D, Preliminary . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 3/04 • Modify for external web posting - streamlined register descriptions • Add Appendix B Rev. C, Preliminary . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 2/04 • Added Key Performance Parameter Table, Update Register Tables, Update Electrical Specification Table, Added Figures (Image Center Offset, Die Placement, 28-Pin PLCC Package Outline Drawing and Spectral Response) Rev. B, Preliminary, Draft . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . 1/04 • Format edits on 1/15/04 MT9V111_DS Rev. N 5/15 EN 31 ©Semiconductor Components Industries, LLC,2015. MT9V111 - 1/4-Inch SOC VGA Digital Image Sensor Revision History Rev. A, Preliminary, Draft . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . .12/03 • Initial Release of document A-Pix is a trademark of Semiconductor Components Industries, LLC (SCILLC) or its subsidiaries in the United States and/or other countries. ON Semiconductor and the ON logo are registered trademarks of Semiconductor Components Industries, LLC (SCILLC) or its subsidiaries in the United States and/or other countries. SCILLC owns the rights to a number of patents, trademarks, copyrights, trade secrets, and other intellectual property. A listing of SCILLC’s product/patent coverage may be accessed at www.onsemi.com/site/pdf/ Patent-Marking.pdf. SCILLC reserves the right to make changes without further notice to any products herein. SCILLC makes no warranty, representation or guarantee regarding the suitability of its products for any particular purpose, nor does SCILLC assume any liability arising out of the application or use of any product or circuit, and specifically disclaims any and all liability, including without limitation special, consequential or incidental damages. “Typical” parameters which may be provided in SCILLC data sheets and/or specifications can and do vary in different applications and actual performance may vary over time. All operating parameters, including “Typicals” must be validated for each customer application by customer’s technical experts. SCILLC does not convey any license under its patent rights nor the rights of others. SCILLC products are not designed, intended, or authorized for use as components in systems intended for surgical implant into the body, or other applications intended to support or sustain life, or for any other application in which the failure of the SCILLC product could create a situation where personal injury or death may occur. Should Buyer purchase or use SCILLC products for any such unintended or unauthorized application, Buyer shall indemnify and hold SCILLC and its officers, employees, subsidiaries, affiliates, and distributors harmless against all claims, costs, damages, and expenses, and reasonable attorney fees arising out of, directly or indirectly, any claim of personal injury or death associated with such unintended or unauthorized use, even if such claim alleges that SCILLC was negligent regarding the design or manufacture of the part. SCILLC is an Equal Opportunity/Affirmative Action Employer. This literature is subject to all applicable copyright laws and is not for resale in any manner. MT9V111_DS Rev. N 5/15 EN 32 ©Semiconductor Components Industries, LLC,2015 .