CROSS REFERENCE TO RELATED APPLICATIONS
[0001] This application claims priority to
U. S. Patent Application No. 13/289,778 filed November 4, 2012 entitled, "Apparatus Comprising Image Sensor Array Having Global Shutter Shared by
a Plurality of Pixels," which is related to Application No. (
13/289,795) (Docket No. 4283.888) entitled "Imaging Apparatus Comprising Image Sensor Array
Having Shared Global Shutter Circuitry" filed on November 4, 2012. The above application
is incorporated herein by reference in its entirety.
FIELD OF THE INVENTION
[0002] The present invention relates in general to optical based apparatus, and particularly
is related to an image sensor array based apparatus.
BACKGROUND OF THE INVENTION
[0003] Image sensor integrated circuits having multiple pixel image sensor arrays are commercially
available. Imaging apparatus having image sensor arrays are available in a variety
of forms, including digital cameras, mobile phones, surveillance equipment, medical
diagnostic equipment, and indicia decoding apparatus. Imaging apparatuses are available
in forms with indicia decoding capability and without decoding capability. Imaging
apparatus with indicia decoding capability can be regarded as indicia reading apparatus.
[0004] Indicia reading apparatus for reading decodable indicia are available in multiple
varieties. For example, minimally featured indicia reading apparatus devoid of a keyboard
and display are common in point of sale applications. Indicia reading apparatus devoid
of a keyboard and display are available in the recognizable gun style form factor
having a handle and trigger button (trigger) that can be actuated by an index finger.
Indicia reading apparatus having keyboards and displays are also available, often
in a form where a keyboard and display is commonly located by the providing of a touch
screen type display. Keyboard and display equipped indicia reading apparatus are commonly
used in retail, shipping and warehouse applications. In a keyboard and display equipped
indicia reading apparatus, a trigger button for actuating the output of decoded messages
is typically provided in such locations as to enable actuation by a thumb of an operator.
Indicia reading apparatus in a form devoid of a keyboard and display or in a keyboard
and display equipped form are commonly used in a variety of data collection applications
including retail point of sale applications, retail inventory applications, shipping
applications, warehousing applications, security check point applications, patient
care applications, and personal use, common where keyboard and display equipped indicia
reading apparatus is provided by a personal mobile telephone having indicia reading
functionality. Fixed mount indicia reading apparatus are also commonly available,
e.g., installed under or near a countertop at a point of sale. Some indicia reading apparatus
are adapted to read bar code symbols including one or more of one dimensional (1D)
bar codes, stacked 1D bar codes, and two dimensional (2D) bar codes. Other indicia
reading apparatus are adapted to read OCR characters while still other indicia reading
apparatus are equipped to read both bar code symbols and OCR characters.
BRIEF DESCRIPTION OF THE DRAWINGS
[0005] The features described herein can be better understood with reference to the drawings
described below. The drawings are not necessarily to scale, emphasis instead generally
being placed upon illustrating the principles of the invention. In the drawings, like
numerals are used to indicate like parts throughout the various views.
[0006] Fig. 1 is a schematic physical form view of an indicia reading apparatus in one embodiment;
[0007] Fig. 2 is a block diagram of an indicia reading apparatus in one embodiment;
[0008] Fig. 3 is an exploded assembly perspective view of an imaging module;
[0009] Fig. 4 is a perspective view of an imaging module;
[0010] Fig. 5 is an implementation view illustrating an imaging apparatus provide by a fixed
mount indicia reading apparatus mounted at a countertop at a point of sale checkout
station;
[0011] Fig. 6 is a timing diagram illustrating a method which can be performed by an imaging
apparatus;
[0012] Fig. 7 is an electrical block diagram illustrating an embodiment of an image sensor
array;
[0013] Fig. 8 is a timing diagram illustrating operation of an apparatus according to a
rolling reset (shutter) configuration;
[0014] Fig. 9 is a timing diagram illustrating operation of an apparatus according to a
2x2 binning global shutter configuration;
[0015] Fig. 10 is a timing diagram illustrating operation of an apparatus in accordance
with a 1x2 binning global shutter interlacing configuration;
[0016] Fig. 11 is an electrical block diagram illustrating an embodiment of an image sensor
array;
[0017] Fig. 12 is a timing diagram illustrating operation of an apparatus according to a
1x4 binning global shutter configuration;
[0018] Fig. 13 is a timing diagram illustrating a method that can be performed by an imaging
apparatus.
SUMMARY OF THE INVENTION
[0019] There is set forth herein in one embodiment an image sensor array including a global
shutter shared by first and second pixels. The global shutter can include a charge
storage area having an associated shield for reducing charge build up on the charge
storage area attributable to incident light rays. There is set forth herein in one
embodiment an imaging apparatus having one or more configuration. The one or more
configuration can include one or more of a configuration wherein a frame read out
from an image sensor array has unbinned pixel values, a configuration wherein a frame
read out from an image sensor array has binned pixel values corresponding to an MxN,
M>=2, N>=2 arrangement of pixel values, and a configuration wherein a frame read out
from an image sensor array has binned pixel values corresponding to a 1xN, N>=2 arrangement
of pixel values.
DETAILED DESCRIPTION OF THE INVENTION
[0020] Referring to Fig. 1, there is set forth herein an apparatus provided by an image
sensor array 1033 that includes a global shutter 6028 shared by first and second pixels
6011 and 6012. Global shutter 6028 can include charge storage area 6029 and shield
6030. The charge storage area 6029 can include an associated opaque shield 6030 for
reducing charge build up on storage area 6029 attributable to light being incident
on charge storage area 6029. In one embodiment, image sensor array 1033 can include
a plurality of cells 6000. Each cell 6000 can have a global shutter 6028 shared by
first and second pixels. Global shutter 6028 can include charge storage area 6029
shared by first and second pixels, and an opaque shield 6030 associated with the charge
storage area 6029. In one embodiment, image sensor array 1033 can be incorporated
as an image sensor integrated circuit 1040. In one embodiment, image sensor array
1033 can be disposed in imaging apparatus 1000. Imaging apparatus 1000 can take on
a variety of forms. In the embodiment of Fig. 1, imaging apparatus 1000 is shown as
being provided by an image sensor based indicia reading apparatus. First and second
pixels can be regarded as sharing a global shutter if there is an instance in the
operation of array 1033 in which charge from the first pixel is transferred to the
charge storage area of the global shutter and an instance in the operation of array
1033 in which charge from the second pixel is transferred to the charge storage area
of the global shutter. The instances can be simultaneous or sequential.
[0021] An exemplary hardware platform for support of operations described herein with reference
to an exemplary image sensor array based imaging apparatus 1000 is shown and described
with reference to Fig. 2.
[0022] Imaging apparatus 1000 can include an image sensor 1032 comprising a multiple pixel
image sensor array 1033 having pixels arranged in rows and columns of pixels, associated
column circuitry 1034 and row circuitry 1035. Associated with the image sensor 1032
can be array amplifier circuitry 1036 (amplifier), and an analog to digital converter
1037 which converts image information in the form of analog signals read out of image
sensor array 1033 into image information in the form of digital signals. Image sensor
1032 can also have an associated timing and control circuit 1038 for use in controlling
e.g., the exposure period of image sensor 1032, gain applied to the amplifier 1036. The
noted circuit components 1032, 1036, 1037, and 1038 can be packaged into a common
image sensor integrated circuit 1040. Image sensor integrated circuit 1040 can incorporate
fewer than the noted number of components. In one example, image sensor integrated
circuit 1040 can include image sensor 1032 without including elements 1035, 1036,
1037 and 1038.
[0023] In one example, image sensor integrated circuit 1040 can have an image sensor array
1033 that includes a plurality of cells,
e.g., cells 6000. Cells of the plurality of cells can include first and second pixels
6011, 6012 sharing a common global shutter 6028. Global shutter 6028 can include a
common charge storage area 6029 and opaque shield 6030. Opaque shield 6030 can reduce
a charge build up on charge storage area 6029 attributable to light rays being incident
on charge storage area 6029.
[0024] In one example, image sensor integrated circuit 1040 can incorporate a Bayer pattern
filter, so that defined at the image sensor array 1033 are red pixels at red pixel
positions, green pixels at green pixel positions, and blue pixels at blue pixel positions.
Frames that can be captured utilizing an image sensor array 1033 incorporating a Bayer
pattern can include red pixel values at red pixel positions, green pixel values at
green pixel positions, and blue pixel values at blue pixel positions. In an embodiment
incorporating a Bayer pattern image sensor array, CPU 1060 prior to subjecting a frame
to further processing can interpolate pixel values at frame pixel positions intermediate
of green pixel positions utilizing green pixel values for development of a monochrome
frame of image data. Alternatively, CPU 1060 prior to subjecting a frame for further
processing can interpolate pixel values intermediate of red pixel positions utilizing
red pixel values for development of a monochrome frame of image data. CPU 1060 can
alternatively, prior to subjecting a frame for further processing interpolate pixel
values intermediate of blue pixel positions utilizing blue pixel values. Apparatus
1000 in one aspect can process a raw frame captured utilizing an image sensor array
1033 having a color filter by subjecting the raw color frame to a de-mosaicing process.
Color image data of a frame can be subjected to demosaicing by adding two additional
color scale values for each pixel position of the frame. In the case image sensor
array 1033 includes a Bayer pattern filter, red pixel values at green and blue pixel
positions can be interpolated utilizing red pixel values at red pixel positions. Blue
pixel values at red and green pixel positions can be interpolated utilizing blue pixel
values at blue pixel positions. Further, green pixel values at red and blue pixel
positions can be interpolated utilizing green pixel values at green pixel positions.
An imaging subsystem of apparatus 1000 can include image sensor 1032 and a lens assembly
200 for focusing an image onto image sensor array 1033 of image sensor 1032.
[0025] In the course of operation of apparatus 1000, image signals can be read out of image
sensor 1032, converted, and stored into a system memory such as RAM 1080. A memory
1085 of apparatus 1000 can include RAM 1080, a nonvolatile memory such as EPROM 1082
and a storage memory device 1084 such as may be provided by a flash memory or a hard
drive memory. In one embodiment, apparatus 1000 can include CPU 1060 which can be
adapted to read out image data stored in memory 1080 and subject such image data to
various image processing algorithms. Apparatus 1000 can include a direct memory access
unit (DMA) 1070 for routing image information read out from image sensor 1032 that
has been subject to conversion to RAM 1080. In another embodiment, apparatus 1000
can employ a system bus providing for bus arbitration mechanism (
e.g., a PCI bus) thus eliminating the need for a central DMA controller. A skilled artisan
would appreciate that other embodiments of the system bus architecture and/or direct
memory access components providing for efficient data transfer between the image sensor
1032 and RAM 1080 are within the scope and the spirit of the invention.
[0026] Referring to further aspects of apparatus 1000, imaging lens assembly 200 can be
adapted for focusing an image of a decodable indicia 15 located within a field of
view 1240 on a substrate, T, onto image sensor array 1033. A size in target space
of a field of view 1240 of apparatus 1000 can be varied in a number of alternative
ways. A size in target space of a field of view 1240 can be varied,
e.g., by changing an apparatus to target distance, changing an imaging lens assembly
setting, changing a number of pixels of image sensor array 1033 that are subject to
read out. Imaging light rays can be transmitted about imaging axis 25. Lens assembly
200 can be adapted to be capable of multiple focal lengths and multiple planes of
optimum focus (best focus distances).
[0027] Apparatus 1000 can include an illumination assembly 800 for illumination of target,
T, which can be provided by a substrate and projection of an illumination pattern
1260. Illumination pattern 1260, in the embodiment shown can be projected to be proximate
to but larger than an area defined by field of view 1240, but can also be projected
in an area smaller than an area defined by a field of view 1240. Illumination assembly
800 can include a light source bank 500, comprising one or more light sources. A physical
form view of an example of an illumination subsystem is shown in Figs. 3-4. As shown
in Figs. 3-4, an imaging module 400 can be provided having a circuit board 402 carrying
image sensor 1032 and lens assembly 200 disposed in support 430 disposed on circuit
board 402. In the embodiment of Figs. 3 and 4, illumination assembly 800 has a light
source bank 500 provided by single light source 502. In another embodiment, light
source bank 500 can be provided by more than one light source. Apparatus 1000 can
also include an aiming assembly 600 for projecting an aiming pattern (not shown).
Aiming assembly 600 which can comprise a light source bank can be coupled to aiming
light source bank power input unit 1208 for providing electrical power to a light
source bank of aiming assembly 600. Power input unit 1208 can be coupled to system
bus 1500 via interface 1108 for communication with CPU 1060. An imaging module apparatus
as shown in Figs. 3 and 4 can be
e.g., disposed in a hand held housing 1014 as shown in Fig. 1 or fixed positioned at
fixed mounted at a scanning location 480 which can be provided,
e.g., by a checkout counter or a ceiling above a conveyor belt.
[0028] In one embodiment, illumination assembly 800 can include, in addition to light source
bank 500, an illumination lens assembly 300, as is shown in the embodiment of Fig.
2. In addition to or in place of illumination lens assembly 300 illumination assembly
800 can include alternative light shaping optics,
e.g. one or more diffusers, mirrors and prisms. In use, apparatus 1000 can be oriented
by an operator with respect to a target, T, (
e.g., a piece of paper, a package, another type of substrate) bearing decodable indicia
15 in such manner that illumination pattern 1260 is projected on a decodable indicia
15. In the example of Fig. 2, decodable indicia 15 is provided by a 1D bar code symbol.
Decodable indicia 15 could also be provided by a 2D bar code symbol or optical character
recognition (OCR) characters.
[0029] Referring to further aspects of apparatus 1000, lens assembly 200 can be controlled
with use of electrical power input unit 1202 which provides energy for changing a
plane of optimum focus of lens assembly 200. In one embodiment, an electrical power
input unit 1202 can operate as a controlled voltage source, and in another embodiment,
as a controlled current source. Electrical power input unit 1202 can apply signals
for changing optical characteristics of lens assembly 200,
e.g., for changing a focal length and/or a best focus distance of (a plane of optimum
focus of) lens assembly 200. Light source bank electrical power input unit 1206 can
provide energy to light source bank 500. In one embodiment, electrical power input
unit 1206 can operate as a controlled voltage source. In another embodiment, electrical
power input unit 1206 can operate as a controlled current source. In another embodiment
electrical power input unit 1206 can operate as a combined controlled voltage and
controlled current source. Electrical power input unit 1206 can change a level of
electrical power provided to (energization level of) light source bank 500,
e.g., for changing a level of illumination output by light source bank 500 of illumination
assembly 800 for generating illumination pattern 1260.
[0030] In another aspect, apparatus 1000 can include power supply 1402 that supplies power
to a power grid 1404 to which electrical components of apparatus 1000 can be connected.
Power supply 1402 can be coupled to various power sources,
e.g., a battery 1406, a serial interface 1408 (
e.g., USB, RS232), and/or AC/DC transformer 1410.
[0031] Further regarding power input unit 1206, power input unit 1206 can include a charging
capacitor that is continually charged by power supply 1402. Power input unit 1206
can be configured to output energy within a range of energization levels.
[0032] Apparatus 1000 can also include a number of peripheral devices including trigger
1220 which may be used to make active a trigger signal for activating frame readout
and/or certain decoding processes. Apparatus 1000 can be adapted so that activation
of trigger 1220 activates a trigger signal and initiates a decode attempt. Specifically,
apparatus 1000 can be operative so that in response to activation of a trigger signal,
a succession of frames can be captured by way of read out of image data from image
sensor array 1033 (typically in the form of analog signals) and then storage of the
image data (in the form of digitized N bit values) after conversion into memory 1080
(which can buffer one or more of the succession of frames at a given time). CPU 1060
can be operative to subject one or more of the succession of frames to a decode attempt.
[0033] For attempting to decode a bar code symbol,
e.g., a one dimensional bar code symbol, CPU 1060 can process image data of a frame corresponding
to a line of pixel positions (
e.g., a row, a column, or a diagonal set of pixel positions) to determine a spatial pattern
of dark and light cells and can convert each light and dark cell pattern determined
into a character or character string via table lookup. Where a decodable indicia representation
is a 2D bar code symbology, a decode attempt can comprise the steps of locating a
finder pattern using a feature detection algorithm, locating matrix lines intersecting
the finder pattern according to a predetermined relationship with the finder pattern,
determining a pattern of dark and light cells along the matrix lines, and converting
each light pattern into a character or character string via table lookup.
[0034] Apparatus 1000 can include various interface circuits for coupling various of the
peripheral devices to system address/data bus (system bus) 1500, for communication
with CPU 1060 also coupled to system bus 1500. Apparatus 1000 can include interface
circuit 1028 for coupling image sensor timing and control circuit 1038 to system bus
1500, interface circuit 1102 for coupling electrical power input unit 1202 to system
bus 1500, interface circuit 1106 for coupling illumination light source bank power
input unit 1206 to system bus 1500, and interface circuit 1120 for coupling trigger
1220 to system bus 1500. Apparatus 1000 can also include a display 1222 coupled to
system bus 1500 and in communication with CPU 1060, via interface 1122, as well as
pointer mechanism 1224 in communication with CPU 1060 via interface 1124 connected
to system bus 1500. Apparatus 1000 can also include range detector unit 1210 coupled
to system bus 1500 via interface 1110. In one embodiment, range detector unit 1210
can be an acoustic range detector unit. Various interface circuits of apparatus 1000
can share circuit components. For example, a common microcontroller can be established
for providing control inputs to both image sensor timing and control circuit 1038
and to power input unit 1206. A common microcontroller providing control inputs to
circuit 1038 and to power input unit 1206 can be provided to coordinate timing between
image sensor array 1033 controls and illumination subsystem controls. Apparatus 1000
can comprise one or more communication interface 1050 in communication with CPU 1060
via system bus 1500. Communication interface 1050 can be a wireline or wireless communication
interface,
e.g,. an IEEE 802.11 compliant communication interface or a Bluetooth communication interface.
[0035] A succession of frames of image data that can be captured and subject to the described
processing can be full pixel resolution full frames (including pixel values corresponding
to each pixel of image sensor array 1033 or a maximum number of pixels read out from
image sensor array 1033 during operation of apparatus 1000). A succession of frames
of image data that can be captured and subject to the described processing can also
be reduced picture size frames comprising pixel values corresponding to less than
a maximum and less than each pixel of image sensor array 1033. A succession of frames
of image data that can be captured and subject to the described processing can also
comprise a combination of full pixel resolution full frames and reduced picture size
frames. A reduced picture size frame can be captured
e.g., by performing binning of the values of adjacent pixels, by skipping readout of
pixels of and/or by selectively reading out pixels one or more discrete coordinate
areas of image sensor array 1033.
[0036] An isolated discrete coordinate area of image sensor array 1033 can be regarded as
a "window." A frame having image data corresponding to one or more window can be regarded
as a windowed frame. An example of a window is a center row of pixels. Another example
of a window is N, N≤ 500 center rows of image sensor array 1033. A read out frame
can comprise one or more window. Pixels corresponding to a full pixel resolution full
frame can be read out for capture by selectively addressing pixels of image sensor
1032 having image sensor array 1033 corresponding to the full pixel resolution full
frame. Pixels corresponding to a reduced picture size frame can be read out for capture
by selectively addressing pixels of image sensor 1032 having image sensor array 1033
corresponding to the pixel positions of the reduced picture size. A reduced picture
size frame can also be read out by binning pixels of the image sensor array 1033,
i.e., by aggregating (
e.g., summing or averaging) values of neighboring pixels. In one embodiment, a number
of pixels subject to addressing and read out determine a picture size of a frame.
A full pixel resolution full frame can be regarded as having a first relatively larger
picture size and a windowed frame can be regarded as having a relatively smaller picture
size relative to a picture size of a full pixel resolution full frame. A picture size
of a windowed frame can vary depending on the number of pixels subj ect to addressing
for readout and capture of a windowed frame, and also a number of binned pixels within
a window. A windowed frame can be a full pixel resolution windowed frame wherein each
pixel within the window is subject to read out without binning or a reduced resolution
windowed frame wherein pixels within a window are skipped for purposes of read out
or alternatively, binned. A reduced resolution full frame can be captured by reading
out each pixel of image sensor array 1033 (
i.e., reading out an image signal corresponding to a charge) with each pixel forming a
bin with one or more adjacent pixels.
[0037] Apparatus 1000 can capture frames of image data at a rate known as a frame rate.
A typical frame rate is 60 frames per second (FPS) which translates to a frame time
(frame period) of 16.6 ms. Another typical frame rate is 30 frames per second (FPS)
which translates to a frame time (frame period) of 33.3 ms per frame. A frame rate
of apparatus 1000 can be increased (and frame time decreased) by decreasing of a number
of pixels subject to readout.
[0038] Further aspects of apparatus 1000 in one embodiment are described with reference
again to Fig. 1. Trigger 1220, display 1222, pointer mechanism 1224, and keyboard
1226 can be disposed on a common side of a hand held housing 1014 as shown in Fig.
1. Display 1222 and pointer mechanism 1224 in combination can be regarded as a user
interface of apparatus 1000. Display 1222 in one embodiment can incorporate a touch
panel for navigation and virtual actuator selection in which case a user interface
of apparatus 1000 can be provided by display 1222 incorporating the noted touch panel.
A display incorporating a touch panel can be regarded as a "touch screen." A user
interface of apparatus 1000 can also be provided by configuring apparatus 1000 to
be operative to be reprogrammed by decoding of programming bar code symbols. A hand
held housing 1014 for apparatus 1000 can in another embodiment be devoid of a display
and can be in a gun style form factor. Imaging module 400 including image sensor array
1033 and imaging lens assembly 200 can be incorporated in hand held housing 1014.
Apparatus 1000 in another embodiment can be devoid of housing 1014.
[0039] In the implementation view of Fig. 5, indicia reading apparatus 1000 having fixed
mount housing 1015 and imaging module 400 incorporated in housing 1015 is shown as
being disposed at a point of sale. Indicia reading apparatus 1000 in the implementation
view of Fig. 5 is a fixed position and fixed mount indicia reading apparatus that
is mounted at a checkout counter. Indicia reading apparatus 1000 having fixed mount
housing 1015 can also be mounted
e.g., at a ceiling above a conveyor belt. In one embodiment, apparatus 1000 can be devoid
of a housing such as housing 1014 or housing 1015 and can be provided,
e.g., by and apparatus having the components of imaging module 400. Referring again to
Fig. 2, Fig. 2 includes a dashed border 1014, 1015 indicating that components depicted
within border 1014, 1015 can be disposed within a housing such as a hand held housing
1014 as depicted in Fig. 1 or a fixed mount housing 1015 as depicted in Fig. 5.
[0040] A timing diagram illustrating operation of the apparatus 1000 during performance
of indicia reading operations is shown in Fig. 6. Referring to the timing diagram
of Fig. 6, signal 5002 is a trigger signal which can be made active,
e.g., via actuation of trigger 1220, via power up apparatus 1000, via receipt of a serial
command from an external computer. Signal 5102 is an illumination energization level
signal having varying energization levels. Signal 5202 is an exposure control signal
having active states defining exposure periods and inactive states intermediate exposure
periods. Signal 5302 is a readout control signal. When readout control signal 5302
is active, image data in the form of analog image signals can be read out of image
sensor array 1033. For readout of pixel values of image sensor array 1033 as shown
in Fig. 1, image signals read out can correspond to charge stored at charge storage
areas constructed according to charge storage area 6029 of image sensor array 1033.
Further regarding the timing diagram of Fig. 6, periods 5420-5430 are periods at which
CPU 1060 can process frames of image data,
e.g., for attempting to decode for decodable indicia. Apparatus 1000 can be operative
so that prior to exposure period 5220 and after time to, apparatus 1000 can be capturing
"parameter determination" frames that are processed for parameter determination that
may or may not be subject to decode attempt.
[0041] In a particular embodiment as set forth in Fig. 7, there is provided an image sensor
array 1033 having a global shutter 6028 including charge storage area 6029 and opaque
shield 6030 shared by a plurality of pixels including first and second pixels 6011,
6012 and third and fourth pixels 6013, 6014. A set of P, P>1 pixels sharing a common
charge storage area circuit can be regarded as a cell. By providing an image sensor
array in which charge storage area 6029 is shared by a plurality of pixels, the total
number of transistors per pixel of the image sensor array 1033 can be reduced, resulting
in increased fill factor and increased signal to noise ratio for the image sensor
array 1033. In one embodiment, an opaque shield 6030 can be provided for shielding
light so that light rays which would otherwise be incident on charge storage area
6029 are not incident on charge storage area 6029. Pixels of image sensor array 1033
that share a common charge storage area 6029 can be
e.g., Bayer pattern color pixels or monochrome pixels. Apparatus 1000 can include a timing
and control circuit 1038 that enables several configurations, including: (a) rolling
reset (shutter) configuration; (b) 2x2 binning global shutter configuration; (c) 1x2
binning global shutter interlacing configuration; (d) 2x2 binning rolling reset configuration;
(e) 1x2 binning rolling reset configuration (f) a 1xN binning global shutter configuration.
[0042] Referring to image sensor array 1033, image sensor array 1033, as illustrated in
the embodiment of Fig. 7, can include a repeating pattern of cells 6000. Cells 6000
can be arranged in a plurality of rows and columns of cells, and can be characterized
by a charge storage area 6029 shared by two or more pixels within the cell. As each
cell 6000 can include first and second rows and first and second columns of pixels
aligned with one or more adjacent cells as illustrated in Fig. 7 to define rows and
columns of adjacent cells, image sensor array 1033 as shown in Fig. 7 can be regarded
as having a plurality of rows
e.g. rows 6220, 6221, 6222, 6223, 6224, 6225, 6226, 6227 and columns
e.g., columns 6321, 6322, 6323, 6324, 6325, 6326, 6327, 6328 of pixels.
[0043] In one example, cells of a repeating pattern of cells can have the elements as shown
in Fig. 7. In the diagram of Fig. 7, a first row of pixels 6002 includes green and
red pixels, G, R and a second row of pixels 6004 includes blue and green pixels, B
and G. Pixels P
x,y, P
x+1, y, P
x, y+1, and P
x+1, y+1 can include respective photodiodes 6111, 6112, 6113, 6114 and respective transfer
transistors 6011, 6012, 6013, 6014. The pixels P
x,y, P
x+1, y, P
x, y+1, and P
x+1, y+1, in the embodiment of Fig. 7 can share a common global shutter 6028 comprising a common
charge storage area 6029 and opaque shield 6030. In the embodiment of Fig. 7, charge
storage area 6029 can be provided as part of an amplifier circuit 6020. Pixel amplifier
circuit 6020 in one embodiment can include a charge storage area 6029 provided by
a floating diffusion, a reset transistor 6022, a select transistor 6024 and a detection
transistor 6026. Image sensor array 1033 can include an opaque shield 6030. Opaque
shield 6030 can restrict light from being incident on charge storage area 6029 which
can be provided by a floating diffusion thereby reducing an amount of charge build
up on charge storage area 6029 attributable to incident light.
[0044] For output of a signal responsive to light incident on a certain pixel, the pixel's
photodiode 6111 can be exposed during an exposure period, a charge accumulated on
the pixel's photodiode 6111 during the exposure period can be transferred to the storage
area 6029 at a transfer time, and a signal can be read out from storage area 6029
at a readout time. The read out signal can correspond to a charge stored at the charge
storage area 6029. In some instances the transfer time and readout time can be simultaneous.
In other instances the transfer time and the readout time can be sequential with the
readout time occurring after the transfer time. It was determined in the development
of array 1033 that where readout is sequential to transfer and without the presence
of opaque shield 6030, light incident on charge storage area 6029 during the delay
between transfer and readout would potentially cause a signal readout from a charge
storage area 6029 to be non-representative of light incident on one or more pixel
subject to readout.
[0045] For initiation of exposure of photodiode 6111 of pixel P
x,y relative to the example of Fig. 7, transfer transistor 6011 and reset transistor
6022 can be turned on and off in a manner so that they have simultaneous on times.
For termination of exposure of pixel P
x,y transfer transistor 6011 can be turned on and off. Turning on transfer transistor
6011 can terminate exposure and transfer charge accumulated at photodiode 6111 to
charge storage area 6029. For readout of the charge stored at storage area 6029 select
transistor 6024 can be turned on. If select transistor 6024 is on at the time transfer
transistor 6011 is turned on for transfer, transfer and readout can be simultaneous.
The transfer of charges from more than one photodiode
e.g., photodiode 6111 and photodiode 6113 simultaneously can result in an aggregate charge
being stored at charge storage area 6029. The aggregate charge can be regarded as
a binned pixel value. A charge stored at charge storage area 6029 can be responsive
to light incident on one or more pixel of image sensor array 1033. A binned pixel
value can be defined when the charge stored at charge storage area 6029 is responsive
to light incident on more than one pixel of image sensor array,
e.g., 2 pixels, 3 pixels, 4 pixels, and so on. A binned pixel value can represent light
not at the spatial area of a single pixel but a spatial area defined by a arrangement
of adjacent pixels
e.g., pixel P
x,y, P
x, y+1. An arrangement of adjacent pixels subject to simultaneous charge transfer for binning
can also be regarded as binned pixels. An arrangement of adjacent pixels subject to
simultaneous charge transfer for binning can be regarded as a superpixel. An aggregate
charge stored at a common charge storage area 6029 of image sensor array 1033 can
comprise the aggregate charge of two or more,
i.e., at least first and second pixels. In one example an aggregate charge stored at a
common charge storage area can comprise the aggregate charge of 2 pixels; in another
example 3 pixels, in another example 4 pixels, and so on.
[0046] Global shutter 6028 including charge storage area 6029 and shield 6030 can facilitate
global shutter operation. An image sensor array 1033 having one or more global shutter
6028 can be capable of global shutter operation. For global shutter operation in one
embodiment pixels of each row of pixels of image sensor array 1033 subject to readout
can have common exposure initiation and termination times. Rows of pixels subject
to readout for readout of a frame can include a first set of rows defining a first
row of cells and a second set of rows defining a second row of cell. Further for global
shutter operation, at the common exposure termination times, charges stored at pixel
photodiodes of image sensor array 1033 subject to readout can be transferred to a
global shutter charge storage area 6029 shared by a plurality of pixels. Further for
global shutter operation global shutter shield 6030 can restrict unwanted charge buildup
at a charge storage area 6029 attributable to light rays being incident on charge
storage area 6029 prior to readout of image data representative of light incident
on a pixel or an arrangement of adjacent pixels of array 1033. For global shutter
operation read out of image data from various global shutter charge storage areas
6029 of image sensor array can be sequential, with shield 6030 of the various charge
storage areas storing charges for readout restricting charge buildup attributable
to light rays incident on charge storage areas so that read out pixel values are representative
of light incident on a pixel or set of pixels of image sensor array. Image sensor
array 1033 can include global shutter circuitry, the global shutter circuitry including
one or more global shutter 6028.
[0047] Apparatus 1000 can include a plurality of alternative configurations, including (a)
a rolling reset configuration, (b) a 2x2 binning global shutter configuration, (c)
a 2x2 binning rolling reset configuration, (d) a 1x2 binning global shutter interlacing
configuration, (e) a 1x2 binning rolling reset configuration and (f) a 1x4 binning
global shutter configuration. Additional configurations of apparatus 1000 can include
one or more of configurations (b) though (f) with different bin size designators.
[0048] According to (a) a rolling reset configuration, exposure of pixels of alternating
rows of image sensor array 1033 can be initiated sequentially and pixel values making
up a frame of image data can be read out with full pixel resolution (a number of pixel
values read out can equal a number of pixels of the image sensor array 1033 addressed
for readout).
[0049] According to (b) a 2x2 binning global shutter configuration, exposure of pixels of
alternating rows of cells and in one embodiment each row of pixels of image sensor
array 1033 can be initiated simultaneously and image data pixel values making up a
frame of image data can be read out with reduced resolution in both the X (pixel position
row) and Y (pixel position column) dimensions, with a pixel value being read out for
each of several 2x2 bins of adjacent pixels. Where pixels are binned, image signals
of the various pixels of the bin are aggregated (
e.g., summed or averaged) so that during readout of a frame a single pixel value is read
out for the bin. In a 2x2 binning global shutter configuration, exposure of pixels
of different rows of a cell (and row of pixels of array 1033) can be initiated simultaneously.
[0050] According to (c) a 2x2 binning rolling reset configuration, exposure of pixels of
alternating rows of cells of image sensor array 1033 can be initiated sequentially
and pixel values making up a frame of image data can be read out with reduced resolution
in both the X (pixel position row) and Y (pixel position column) dimensions, with
a pixel value being read out for each of several 2x2 bins of adjacent pixels.
[0051] According to (d) a 1x2 binning global shutter interlacing configuration, exposure
of pixels of alternating rows of cells and in one embodiment each row of cells of
image sensor array 1033 can be initiated simultaneously and pixel values making up
a frame of image data can be read out with reduced resolution in the Y (pixel position
column) dimension with no reduction in resolution in the X dimension, with a pixel
value being read out for each of several 1x2 bins of adjacent pixels. In a 1x2 binning
global shutter interlacing configuration, exposure of pixels of different rows of
a cell (and of array 1033) can be initiated simultaneously.
[0052] According to (e) a 1x2 binning rolling reset configuration, exposure of pixels of
alternating rows of cells of image sensor array 1033 can be initiated sequentially
and pixel values making up a frame of image data can be read out with reduced resolution
in the Y (pixel position column) dimension with no reduction in resolution in resolution
the X dimension, with a pixel value being read out for each of several 1x2 bins of
adjacent pixels.
[0053] According to (f) a 1x4 binning global shutter configuration, exposure of pixels of
a plurality of rows of cells of image sensor array 1033 and in one embodiment each
row of bins of image sensor array 1033 can be initiated simultaneously and pixel values
making up a frame of image data can be read out with reduced resolution in the Y (pixel
position column) dimension with no reduction in resolution in the X dimension, with
a pixel value being read out for each of several 1x4 bins of adjacent pixels. In a
1x4 binning global shutter configuration, exposure of pixels of different rows of
a cell (and rows of pixels of array 1033) can be initiated simultaneously.
[0054] In the development of apparatus 1000, it was observed that currently available CMOS
global shutter image sensor arrays consume 5 to 6 transistors per pixel. Thus there
is required a relatively large pixel size for implementation with acceptable fill
factor for many applications. For a commercially available 5Mpx CMOS sensor, with
a pixel size of 1.75um to 2.2um, challenges exist with respect to arranging 5 to 6
transistors per pixel and still providing a pixel fill factor yielding an acceptable
signal to noise ratio (SNR).
[0055] Further description of the noted configurations is presented herein below:
[0056] (a) rolling reset (shutter) configuration:
[0057] Referring Fig. 7, there are two rows of pixels: the Nth row consists of green and
red pixels, G and R and N+1th row consists of pixel blue and green pixels, B and G.
Operating in accordance with a rolling reset configuration, timing and control circuit
1038 for controlling image sensor array 1033 can generate the timing control as shown
in Fig. 8 for operation in accordance with the rolling reset configuration, which
can be regarded as a rolling shutter configuration.
[0058] Exposure of the Nth row 6002 can be initiated by turning on and off transfer transistors
6011 and 6012 and reset transistors 6022 in a manner that the transfer transistors
6011 and 6012 and reset transistor 6022 have simultaneous on times. Terminating exposure
of a pixel
e.g., pixel P
x,y can be performed by turning on a pixel transfer transistor,
e.g., transfer transistor 6011 to transfer charge accumulated at the pixel photodiode
6111 to a charge storage area
e.g., charge storage area 6029. Prior to transfer, reset transistor 6022 can be turned
on and off to remove charge from charge storage area 6029. The presence of shield
6030 can reduce the amount of charge buildup at charge storage area 6029 prior to
the turning on and off of reset transistor 6022 for charge transfer. Exposure of pixels
of the Nth row can be terminated sequentially. In the example explained with reference
to the timing diagram of Fig. 8, select transistor 6024 controlling readout can be
activated simultaneously with the activation of a transfer transistor for transferring
charge to storage area 6029. Accordingly, readout can be simultaneous with charge
transfer.
[0059] As indicated by the timing diagram of Fig. 8, exposure and readout of pixels of row
N + 1 can be sequential to the exposure and readout of pixels of row N. Exposure transfer
and readout can be performed over a larger area of the array 1033 in the manner depicted
for the cell 6000 shown in Fig. 7 with reference to the timing diagram of Fig. 8.
In a rolling reset configuration (rolling shutter configuration) each pixel subject
to readout can be subject to exposure termination at the time of readout.
[0060] (b) 2x2 binning global shutter configuration:
[0061] Referring Fig. 7, four pixels belong to a 2x2 cell 6000 which consists of pixels
P
x,y, P
x+1, y, P
x, y+1, and P
x+1, y+1. Timing and control circuit 1038, operating according to the 2x2 binning global shutter
configuration can generate the timing control as shown in Fig. 9 to perform the 2x2
binning global shutter configuration.
[0062] For operating in a binning rolling reset configuration, exposure of each pixel of
a cell subject for readout and each cell of an array 1033 subject to readout can be
initiated and terminated simultaneously. For simultaneous exposure initiation of pixels
P
x,y, P
x+1, y, P
x, y+1, and P
x+1, y+1 transfer transistors 6011, 6012, 6013 and 6014 and reset transistor 6022 can be turned
on and off in a manner so that they have simultaneously on periods as is indicated
by the timing diagram of Fig. 9. For simultaneous exposure termination of pixels P
x,y, P
x+1, y, P
x, y+1, and P
x+1, y+1 and transfer of charge from respective photodiode 6111, 6112, 6113, 6114 to charge
storage area 6029 transfer transistors 6011, 6012, 6013 and 6014 and can be turned
on simultaneously subsequent to a turning on and off of reset transistor 6022 for
clearing charge from charge storage area 6029. Because charges from multiple pixels
can be transferred simultaneously, a resulting charge at charge storage area 6029
can be an aggregate charge that defines a binned pixel value indicative of light over
the spatial area delimited by the combination of pixels P
x,y, P
x+1, y, P
x, y+1, and P
x+1, y+1.
[0063] Exposure transfer and readout can be performed over a larger area of the array 1033
in the manner depicted for the cell 6000 shown in Fig. 7 with reference to the timing
diagram of Fig. 9. In a 2x2 binning global shutter configuration each cell (and each
pixel of each cell) subject to readout can be subject to simultaneous exposure initiation
and simultaneous exposure termination so that each pixel of image sensor array 1033
subject to readout has a common exposure period). Readout of pixel values P
x+1, y+1 can be sequential. While a 2x2 "bin" of pixels is specifically described, image sensor
array 1033 can be configured so that bins can be provided in alternative dimensions,
e.g., MxN, M≥1, N≥1, wherein at least one of M≥2 or N≥2 in accordance with a binning
global shutter configuration. In the timing diagram of Fig. 9, readout of an image
signal from charge storage area 6029 is depicted as being simultaneous with charge
transfer as is indicated by the select transistor 6024 being on at the time of charge
transfer. However, it will be understood that for other cells of an image sensor array
1033 readout may not be simultaneous with charge transfer. For another cell of image
sensor array 1033 select transistor 6024 can be turned on at the period indicated
by dashed in period 6032, with all other timing being the same as depicted in Fig.
9. During the delay between transfer of charge to a charge storage area 6029 constructed
in the manner charge storage area 6029 and the readout of a signal from the charge
storage area a shield constructed in the manner of shield 6030 can be preventing light
from being incident on the charge storage area thus reducing a buildup of charge on
the charge storage area 6029.
[0064] In the 2x2 binning global shutter configuration, pixels of image sensor array 1033
subject to readout can be subject to simultaneous exposure initiation and termination,
with pixel values being read out defined by aggregate charges from multiple pixels.
When exposure of all pixels of image sensor array 1033 subject to readout is initiated
and terminated simultaneously, an overall frame exposure time is reduced, rendering
a captured frame less likely to include motion blur defect. With shorter overall frame
exposure time an illumination on time for illumination assembly 800 where apparatus
includes illumination assembly 800 can be reduced, reducing power consumption.
[0065] There is set forth herein with reference to Fig. 7 an apparatus comprising an image
sensor array 1033 having a first arrangement of adjacent pixels (location A) including
a first pixel P
x,y and a second pixel P
x,y+1, the first pixel and the second pixel of the first set of adjacent pixels sharing
a first common global shutter 6028 having a first charge storage area 6029, wherein
the image sensor array 1033 has a second arrangement of adjacent pixels (location
B) including a first pixel P
x,y and a second pixel P
x,y+1, the first pixel and the second pixel of the second set of adjacent pixels sharing
a second global shutter 6028 having a second common charge storage area 6029, wherein
the first pixel and the second pixel of the first arrangement of adjacent pixels (location
A) are disposed in first and second rows of the image sensor array respectively, and
wherein the first pixel and the second pixel of the second arrangement of adjacent
pixels (location B) are disposed in third and fourth rows of the image sensor array
respectively, wherein the image sensor array is controlled so that each of the first
pixel and the second pixel of the first arrangement of adjacent pixels (location A)
and each of the first pixel and the second pixel of the second arrangement of adjacent
pixels (location B) have common exposure initiation and termination times, wherein
the image sensor array 1033 is further controlled so that readout of an image signal
corresponding to a charge stored on the second common charge storage area 6029 (location
B) is performed sequentially relative to readout of an image signal stored on the
first common charge storage area 6029 (location A).
[0066] (c) 2x2 binning rolling reset configuration:
[0067] In a 2x2 binning rolling reset configuration operation of image sensor array 1033
can be in the manner of the 2x2 binning global shutter configuration except that instead
of cells subject to readout being subject to simultaneous exposure initiation and
termination, and sequential readout, cells subject to readout can be subject to sequential
exposure initiation, sequential exposure termination (by charge transfer) and sequential
readout. While a 2x2 "bin" of pixels is specifically described, image sensor array
1033 can be configured so that bins can be provided in alternative dimensions,
e.g., MxN, M≥1, N≥1, wherein at least one of M≥2 or N≥2 in accordance with a binning
rolling reset configuration.
[0068] (d) 1x2 binning global shutter interlacing configuration:
[0069] Referring to Fig. 7, under one exemplary control, four pixels P
x,y, P
x+1, y, P
x, y+1, and P
x+1, y+1 belong to a 2x2 cell of pixels which share a common global shutter 6028 having a
charge storage area 6029 and an opaque shield. For operating in accordance with a
1x2 binning global shutter interlacing configuration, timing and control circuit 1038
can generate the timing control as shown in Fig. 10. While a 1x2 "bin" of pixels is
specifically described, image sensor array 1033 can be configured so that bins can
be provided in alternative dimensions,
e.g., 1xN, N≥2 in accordance with a binning global shutter interlacing configuration.
[0070] For operation in accordance with a 1x2 binning global shutter interlacing configuration
with reference to cell 6000, left side pixels P
x,y, P
x, y+1 can be subject to simultaneous exposure initiation and termination (by charge transfer)
and readout and subsequently thereto right side pixels P
x+1, ,y, P
x+1, y+1 can be subject to simultaneously exposure initiation and exposure termination (by
charge transfer) and readout.
[0071] For simultaneously initiating exposure of left pixels, transfer transistors 6011,
6013 and reset transistor 6022 can be turned on and off in a manner as to have simultaneous
on times. For simultaneously terminating exposure of left pixels P
x,y, P
x, y+1 transfer transistors 6011, 6013 can be simultaneously turned on and off subsequent
to a turning on and off of reset transistor 6022 for clearing charge from charge storage
area 6029. As charges from photodiode 6111 and photodiode 6113 will thus be transferred
simultaneously, their charges will be aggregated to define a binned pixel value representative
of light over the spatial area delimited by the combination of pixel P
x,y and pixel P
x, y+1. For simultaneously initiating exposure of right pixels P
x+1, y, P
x+1, y+1 transfer transistors 6012, 6014 and reset transistor 6022 can be turned on and off
in a manner so that they have simultaneous on periods. For simultaneously terminating
exposure of left pixels P
x,y, P
x, y+1 transfer transistors 6012, 6014 can be turned on and off subsequent to a turning
off of reset transistor 6022 for clearing charge from charge storage areas area 6029.
The charges from photodiode 6112 and photodiode 6114 being transferred simultaneously
their charges will be aggregated to define a binned pixel value representing light
over the spatial area delimited by the combination of pixel P
x,+1, y and pixel P
x,+1, y+1.
[0072] Exposure transfer and readout can be performed over a larger area of the array 1033
in the manner depicted for the cell 6000 shown in the transistor view portion of Fig.
7. with reference to the timing diagram of Fig. 10. In a 1x2 binning global shutter
interlacing configuration, left pixels of each cell (and each pixel of each cell)
subject to readout can be subject to simultaneous exposure initiation and termination
so that each left pixel of each 2x2 cell of image sensor array 1033 subject to readout
has a common exposure period. Each cell (and each pixel of each cell) subject to readout
can be subject to simultaneous exposure initiation and termination so that each left
pixel of each 2x2 cell of image sensor array 1033 subject to readout has a common
exposure period. The right pixel common exposure period (as indicated by the time
between transfer transistor active periods) can be sequential to the left pixel common
exposure period as depicted in the timing diagram of Fig. 10.
[0073] While left side cell pixels of array 1033 subject to readout can have common exposure
periods, readout of exposed left side cell pixels can be sequential. Similarly while
right side cell pixels of array 1033 subject to readout can have common exposure periods,
readout of exposed right side cell pixels can be sequential.
[0074] In the timing diagram of Fig. 10, readout of an image signal from charge storage
area 6029 is depicted as being simultaneous with charge transfer as is indicated by
the select transistor 6024 being on at the time of charge transfer. However, it will
be understood that for other cells of an image sensor array 1033 readout may not be
simultaneous with charge transfer. For another cell of image sensor array 1033, select
transistor 6024 can be turned on at the period indicated by dashed in period 6042,
6044 for readout of a cell left bin and right bin respectively with all other timing
being the same as depicted in the timing diagram of Fig. 10. During the delay between
transfer of charge to charge storage area constructed in the manner charge storage
area 6029 and the readout of a signal from the charge storage area 6029 a shield constructed
in the manner of shield 6030 can be preventing light from being incident on the charge
storage area thus reducing a buildup of charge on the charge storage area and maintaining
the characteristic of a read out image signal as being representative of light incident
on a bin of adjacent pixels during a preceding exposure period.
[0075] In the development of image sensor array 1033 it was determined that reading out
binned pixel values representative of light over 1xN, N>=2 pixels can increase a likelihood
of decoding a decodable indicia particularly where provided by a 1D bar code symbol
having bars imaged in alignment to columns of the array 1033. A 1xN bin does not have
any loss of pixel resolution in the x dimension, the critical dimension for one dimensional
symbology (1 D) decoding, and the lower resolution in the y dimension can increase
a detection of a vertically elongated bar or space.
[0076] (e) 1x2 binning rolling reset configuration:
[0077] Operation in a 1x2 binning rolling reset configuration can be in the manner of a
1x2 global shutter interlacing configuration except that instead of cells subject
to readout being subject to simultaneous exposure initiation and termination, and
sequential readout, cells subject to readout can be subject to sequential exposure
initiation, sequential exposure termination (by charge transfer) and sequential readout.
While a 1x2 "bin" of pixels is specifically described, image sensor array 1033 can
be configured so that bins can be provided in alternative dimensions,
e.g., 1xN, N≥2 in accordance with a binning rolling reset configuration.
[0078] (f) 1x4 binning global shutter configuration:
[0079] With reference to the 1x2 binning global shutter interlacing configuration, it was
described that pixels of an image sensor array 1033 can be exposed during successive
global left cell pixel exposure periods and a right cell pixel exposure period, with
cell left side pixels having a first common exposure period which can be regarded
as a global exposure period and a cell right side pixels having a second common exposure
period that can be regarded as a global exposure period.
[0080] With minor circuit modification, image sensor array 1033 can be provided in one embodiment
so that all pixels of image sensor array 1033 subject to readout can have a common
(global) exposure period with charges of pixels being aggregated to define binned
pixel values indicative of light on a 1x4 pixel area.
[0081] In the embodiment of Fig. 11, additional transfer transistors namely transistors
7052, 7054, 8051, 8053 are added for each four (2x2) pixel cell of array 1033 to provide
1x4 binning global shutter configuration as shown in Fig. 11. In the specific example
of Fig. 11, there is provided a circuit arrangement yielding 1x4 binning. Depending
on timing control, adjacent groups of pixels that share a common storage area 6029
can be a 2x2 group of pixels (by control according to configurations (a), (b), (c),
(d), (e) or a 1x4 group of pixels (by control according to the control described herein
below). Accordingly, sets of pixels shown in Fig. 11 depending on timing control can
define a 2x2 cell and a 1x4 cell. By deletion of transfer transistors, the circuit
of Fig. 11 can be modified so that sharing of a global shutter 7028 having a charge
storage area 7029 and opaque shield 7030 can be on a 1x4 basis but not a 2x2 basis
so that the circuit defines a distribution of 1x4 pixel cells but not also a distribution
of 2x2 pixel cells as in the embodiment of Fig. 11. While a 1x4 "bin" of pixels is
specifically described, image sensor array 1033 can be configured so that bins can
be provided in alternative dimensions,
e.g., 1xN, N≥2 in accordance with a binning global shutter configuration, e.g. N=2, N=3,
N=4, N=5, N=10 and so on. In one embodiment as shown in Fig. 11, 2x2 cell 6000 as
described in connection with the transistor view section of Fig. 7 is defined by the
set of pixels P
j, k, P
j+i ,k, P
j, k+1, P
j+1, k+1, and also by the set of pixels P
j,k+2, P
j+1, k+2, P
j, k+1, P
j, k+3, P
j+i, k+3. A 1x4 cell of pixels is defined by set of pixels P
j, k, P
j ,k+1, P
j, k+2, P
j, k+3 and also by the set of pixels P
j+1 ,k, P
j+1, k+1, P
j+1, k+2, P
j+i, k+3.
[0082] Referring to Fig. 11, there is shown a segment of an image sensor array 1033 having
eight pixels, namely pixels P
j, k, P
j+1 ,k, P
j, k+1, P
j+1, k+1, and pixels P
j,k+2, P
j+1,
k+2, P
j, k+1, P
j, k+3, P
j+1, k+3. The pixels define rows and columns of pixels that can extend through the active
area of image sensor array 1033. The segment of Fig. 11 includes a global shutter
7028 having charge storage area 7029 and global shutter 8028 having a charge storage
area 8029, each of global shutter 7028 and global shutter 8028 having an associated
opaque shield 7030, 8030 for reducing a charge build up on storage areas 7029, 8029,
respectively attributable to light rays being incident of array 1033. Charge storage
area 7029 can be provided as part of an amplifier circuit 7020 which includes charge
storage area 7029 provided by a floating diffusion, reset transistor 7022, select
transistor 7024 and detection transistor 7026. Charge storage area 8029 can be provided
as part of an amplifier circuit 8020 which includes charge storage area 8029 provided
by a floating diffusion, reset transistor 8022, select transistor 8024, and detection
transistor 8026.
[0083] Timing and control circuit 1038 can generate the timing control as shown in Fig.
12 to provide operation in a 1x4 binning global shutter configuration.
[0084] Referring to the timing diagram of Fig. 12, each pixel shown in Fig. 11 can be subject
to simultaneous exposure initiation by turning on and off of the indicated transfer
and reset transistors in the manner indicated. Each pixel shown in Fig. 11 can be
subject to simultaneous exposure termination and charge transfer by turning on and
off the indicated transfer transistors. The turning on and off of the indicated transfer
transistors can be subsequent to a turning on and off of the indicated reset transistors
to clear accumulated charges therefrom, the presence of shields 7030, 8030 reducing
such charges.
[0085] For simultaneous exposure termination and charge transfer referring to the timing
diagram of Fig. 12 the turning on and off of transfer and reset transistors can be
coordinated so that charges from left side pixel photodiodes are transferred to charge
storage area 7029 and further so that charges from right side pixel photodiodes are
transferred to charge storage area 8029. The transfer of charges of left side photodiodes
7111, 7113, 8111, 8113 to charge storage area 7029 being simultaneous, the charges
will be aggregated to define a binned pixel value indicative of light incident on
the spatial area delimited by the set of pixels P
j,k, P
j, k+1, P
j, k+2 P
j, k+3. The transfer of charges of right side photodiodes 7012, 7014, 8012, 8014 to charge
storage area 8029 being simultaneous the charges will be aggregated to define a binned
pixel value indicative of light incident on the spatial area delimited by the set
of pixels P
j+i, k, P
j+1, k+1, P
j+1, k+2, P
j+1, k+3. Further referring to the timing diagram of Fig. 12 readout of signals from charge
storage area 7029 and charge storage area 8029 can be sequential. Namely, select transistor
7024 can be turned on and off to read out a signal corresponding to the binned pixel
value charge stored at charge storage area 7029 and then select transistor 8024 can
be subsequently turned on and off to read out a signal corresponding to the binned
pixel value charge stored at charge storage area 8029. During the delay between the
readouts of signals from charge storage area 7029 and charge storage area 8029, opaque
shield 8030 can be blocking light rays from being incident of charge storage area
8029 thereby reducing unwanted charge buildup on charge storage area 8029.
[0086] Exposure transfer and readout can be performed over a larger area of the array 1033
in the manner depicted for the set of pixels shown in Fig. 11 with reference to the
timing diagram of Fig. 12. In a 1x4 binning global shutter configuration each cell
(and each pixel of each cell) subject to readout can be subject to simultaneous exposure
initiation and termination so that each pixel of image sensor array 1033 subject to
readout has a common exposure period that can be regarded as a global exposure period.
Readout of exposed pixels can be sequential however. In the timing diagram of Fig.
12 readout of image signal from charge storage area 7029 is depicted as being simultaneous
with charge transfer as is indicated by the select transistor being on at the time
of charge transfer. However, it will be understood that for other charge storage areas
of an image sensor array 1033 readout may not be simultaneous with charge transfer.
For example readout of pixel value in the form of an analog signal from charge storage
area 8029 is not simultaneous with charge transfer. During the delay between transfer
of charge to charge storage area constructed in the manner charge storage area 8029
and the readout of a signal from the charge storage area 8029 shield 8030 can be preventing
light from being incident on the charge storage area 8029 thus reducing a buildup
of charge on the charge storage area 8029. Referring to exploded view section of Fig.
11, 1x4 cells constructed according to cell 7000 can be distributed throughout array
1033 to define aligned and adjacent rows and columns of 1x4 cells 7000 or image sensor
array 1033, the aligned adjacent 1x4 cells 7000 defining rows
e.g., rows 7221, 7222, 7223 and columns
e.g., columns 7325, 7326, 7327 of pixels.
[0087] All the above configurations (a) through (f) can be performed with windowing operation
so that there can be provided binning with windowing with a single frame readout.
Windowing can be accomplished by selectively addressing for readout of binned or unbinned
pixel values from less than a maximum number of pixels at one or more localized pixel
coordinate areas of image sensor array 1033. An example of a window is a center J
( J≥1) rows of pixels of image sensor array 1033, where J is the number of rows of
image sensor array 1033.
[0088] In one embodiment, configurations as set forth herein are "fixed" configurations.
That is, apparatus 1000 can be manufactured and provided to an end user so that the
function of the apparatus 1000 does not vary from the function of a particular configuration
e.g., one of configurations (a) (b) (c) (d) (e) or (f) in the lifetime of the apparatus
1000.
[0089] In another embodiment, the configurations set forth herein are dynamic configurations
capable of change during the lifetime of the apparatus 1000 responsively to an operator
input control. Image sensor 1032 can have appropriate switching circuitry 1031 as
indicated in Fig. 2 for performing the noted switching functionality and image sensor
array 1033 can be configured so that each of the configurations (a) (b) (c) (d) (e)
and (f) can be activated by apparatus 1000. In one example, a user interface display
1222 can display various buttons 6102, 6104, 6106, 6108, 6110, 6112 as shown in Fig.
1 corresponding to various configurations allowing an operator to actuate one configuration
out of a plurality of configurations. Apparatus 1000 can also be adapted so that an
operator can input an alternative operator input control for selection of a configuration.
The alternative operator input control can be
e.g., one or more of a serial command transmitted from a computer external to apparatus
1000 and received by communication interface 1050 of apparatus 1000 or a reading of
a programming bar code symbol. The configurations (a), (b), (c), (d), (e), and (f)
set forth herein are set forth as being configurations of imaging apparatus 1000.
As specific operations of image sensor array 1033 correspond to each configuration,
the configurations (a), (b), (c), (d), (e), and (f) can be regarded as configurations
of image sensor array 1033, image sensor 1032 and image sensor integrated circuit
1040. In one embodiment, apparatus 1000 can be operative so that apparatus 1000 remains
in a currently active configuration for a duration of a trigger signal activation
period (the on time of trigger signal 5002) as set forth with reference to the timing
diagram of Fig. 6.
[0090] Apparatus 1000 can also be adapted to capture one or more frame between trigger signal
activation periods, and can process the one or more frame for sensing of one or more
sensed condition.
[0091] In one embodiment an operator can activate a certain one of a plurality of configurations
in a manner that is dependent on an expected operating environment of apparatus 1000.
Document reading is a process where a standard sized document,
e.g., A4 paper, business card, is subject to image capture for archiving purposes. In
the development of apparatus 1000, it was determined that for document reading frame
pixel resolution is often an important factor in determining a quality of a frame
representing a standard size document. Standard size documents commonly include fine
grain print or other details not rendered appropriately absent highest pixel resolution.
Accordingly, in the development of apparatus 1000 it was determined that it can be
useful for an operator to input an operator input control to activate configuration
(a) rolling reset configuration, yielding a highest possible pixel resolution for
use of apparatus 1000 in performance of document reading.
[0092] In the development of apparatus 1000 it was determined that motion tolerance is an
important factor in determining success and speed of decoding for decodable indicia.
Configurations set forth herein such as configurations (b) (d) and (f) that facilitates
global shutter operation can provide improved motion tolerance and accordingly improved
decoding success rate and speed. Configurations herein facilitating global shutter
operation facilitate improved motion tolerance for the reason that with shorter exposure
times resulting from global shutter operation, movement of apparatus 1000 or target
T (Fig. 2) during exposure is less likely to result in image blur of a captured frame.
Accordingly, in use of apparatus 1000, an operator can input an operator input control
to activate a configuration facilitating global shutter operation for use of the apparatus
for indicia decoding.
[0093] By the providing of both a rolling reset configuration and a configuration in which
global shutter operation is facilitated there is set forth herein in one embodiment
an imaging apparatus comprising an image sensor array, an imaging lens assembly for
focusing an image onto the image sensor array wherein the imaging apparatus includes
a first configuration in which one or more frame is read out of the image sensor array
in accordance with a rolling shutter operation in which exposure of pixels of first
and second rows of pixels of the image sensor array is initiated sequentially, and
wherein pixel values responsive to light incident on pixels of the first and second
rows of pixels subject to readout are un-binned pixel values that represent light
incident on a spatial area delimited by a single pixel of the image sensor array,
and wherein the imaging apparatus includes a second configuration in which one or
more frame is read out of the image sensor array in accordance with a global shutter
operation in which exposure of pixels of the first and second rows of pixels of the
image sensor array is initiated and terminated simultaneously, and wherein pixel values
responsive to light incident on pixels of the first and second rows of pixels subject
to readout are binned pixel values read out using shared global shutter circuitry
of the image sensor array that represent light incident on a spatial area delimited
by an arrangement of two or more pixels of the image sensor array.
[0094] Further, in the development of apparatus 1000 it was determined that different configurations
that facilitate global shutter operation can yield a most significant improvement
in decoding performance depending on a particular reading range (imaging apparatus
to target distance). In the development of apparatus 1000 it was determined that at
relatively close reading range (imaging apparatus to target distance),
e.g., under 30cm, a reduction of pixel resolution of a captured frame from a full pixel
resolution (one pixel value for each pixel subject to readout) is less likely to affect
decoding performance. At relatively close reading range, a decodable indicia representation
is more likely to be represented by pixel values of a larger portion of the frame.
Accordingly, in the development of apparatus 1000 it was determined that an operator
can input and operator input control to apparatus 1000 for activation of configuration
facilitating global shutter operation with binned pixel values representing light
incident on an area MxN bin of pixels, M>=2, N>=2,
e.g., configuration (b) for use of the apparatus 1000 for decoding at relatively close
reading range, providing good motion tolerance and pixel resolution sufficient for
facilitating decoding of 1D and 2D (
e.g., matrix bar code symbols) at relatively close reading range.
[0095] Further in the development of apparatus 1000 it was determined that at relatively
longer reading ranges,
e.g., greater than 5m, a decodable indicia is likely to be represented by a smaller portion
of pixel values of a frame and accordingly more likely to be affected by a loss in
resolution. Accordingly, in the development of apparatus 1000 it was determined that
an operator can input an operator input control to apparatus 1000 for activation of
configuration facilitating global shutter operation with binned pixel values representing
light incident on an area 1xN bin of pixels, N>=2 for use of the apparatus 1000 for
decoding at longer reading ranges. With 1xN binning active a read out and captured
frame includes full pixel resolution in the x dimension, reduced pixel resolution
in the y dimension. A 1xN bin does not have any loss of pixel resolution in the x
dimension, the critical dimension for 1 D decoding, and the lower resolution in the
y dimension can increase a detection of a vertically elongated bar or space. Accordingly,
activation of a configuration facilitating global shutter operation and 1xN binning
can increase motion tolerance without reduction of pixel resolution in the x dimension
and without reduction of decoding performance.
[0096] In another embodiment, image sensor array 1033 can be controlled so that configurations
described herein are dynamic configurations that can be varied responsively a sensed
condition.
[0097] A timing diagram illustrating operation of apparatus 1000 in one embodiment during
performance of image capture operations is shown in Fig. 13. Referring to the timing
diagram of Fig. 13, signal 5002 is a trigger signal which can be made active,
e.g., via actuation of trigger 1220, via power up apparatus 1000, via receipt of a serial
command from an external computer. Signal 5102 is an illumination energization level
signal having on and off states. Signal 5202 is an exposure control signal having
active states defining exposure periods and inactive states intermediate exposure
periods. Exposure control signal 5202 can control activation and deactivation of transfer
transistors,
e.g., transfer transistor 6011 and reset transistors
e.g., reset transistor 6022. Signal 5302 is a readout control signal. When readout control
signal 5302 is active, image signals can be read out of image sensor array 1033. Further
regarding the timing diagram of Fig. 13, periods 5420, 5422, 5424 are periods at which
CPU 1060 can process frames of image data,
e.g., for one or more of attempting to decode for decodable indicia, de-mosaicing in
the case the image data is color image data, parameter determination. Period 5220
is the exposure period for frame
N-1, period 5320 is the readout period for frame
N-1 and period 5420 is the processing period for frame
N-1. For the succeeding frame, frame
N, periods 5222, 5322, 5422 are the exposure, readout and processing periods respectively.
For the next succeeding frame, frame
N+1, periods 5224, 5324, 5424 are exposure, readout and processing periods respectively.
Apparatus 1000 can be operative so that prior to exposure period 5220 and after trigger
signal 5002 is activated apparatus 1000 can be capturing "parameter determination"
frames that are processed for parameter (
e.g., exposure, gain) determination and in some instances, not subject to a decode attempt
or other processing unrelated to parameter determination.
[0098] With reference to the timing diagram of Fig. 13 Frame= Frame
N-1 can be read out in according with the rolling reset configuration and can have a
full frame full pixel resolution with a frame picture size equal to the picture size
of the image sensor array 1033. In one example image sensor array 1033 can be a 5Mpx
(2592x1944) image sensor array and Frame= Frame
N-1 can have a picture size of 2592x1944 pixel values.
[0099] With further reference to the timing diagram of Fig. 13 Frame= Frame
N-1 can be read out with image sensor array 1033 operating in accordance with a 2x2 binning
global shutter configuration and can read out a full frame of reduced pixel resolution
having a picture size of 1296x972 (quarter pixel resolution resulting from 2x2 binning).
[0100] Frame =Frame
N+1 can be read out with image sensor array 1033 operating in accordance with a 1xN (N=4)
binning global shutter configuration, configuration (f) with windowing and can output
a windowed frame of reduced pixel resolution. In one example a window of 2592x500
center row pixels can be exposed for read out of a reduced pixel resolution windowed
frame having picture size (number of pixel values) of 2592x125 (full pixel resolution
in the x dimension, reduced pixel resolution in the y dimension).
[0101] Frame = Frame
N-1 having the highest resolution of Frames = Frame
N-1, Frame
N, Frame
N+1 can be a frame optimized for visual quality and can be particularly well suited for
use as a digital photograph for display on a display
e.g., display 1222 or for archiving. Frames for use a digital photograph can include
portrait type frames (personal portrait, landscape) and document reading frames,
e.g., where apparatus 1000 is used for document reading and archiving and/or displaying
a standard size document,
e.g., and A4 paper document or a business card document. Frames = Frame
N, Frame
N+1 as indicated in the timing diagram of Fig. 13 have relatively short exposure periods
and accordingly have improved motion tolerance and each can be particularly well suited
for use as a frame for subjecting to attempts to decode for a decodable indicia during
respective processing period 5422, 5424 (Frame = Frame
N-1 can also be subject to an attempt to decode during processing period 5420). Frame
= Frame
N being a full frame of reduced pixel resolution relative to a full pixel resolution
frame can be especially well suited for reading at a close imaging apparatus to target
distance where a decodable indicia such as a bar code symbol representation can be
expected to consume a relatively larger area of a target substrate T (Fig. 2) that
can be represented by a full frame and where spatial resolution can be less important
for providing a successful decode. Frame =Frame
N+1 being a windowed frame of reduced resolution (but with no reduction in pixel resolution
in the x dimension) can be especially well suited for use in a decode attempt at a
relatively longer imaging apparatus to target distance where a decodable indicia can
be expected to consume a relatively smaller portion of an area that can be represented
by a full frame of image data and where spatial resolution of a frame is relatively
more important for a successful decode.
[0102] In one embodiment the switching of configurations as indicated in the timing diagram
of Fig. 13 during a trigger signal activation period can be on a closed loop basis
e.g., responsive to one or more sensed condition. In one embodiment a sensed condition
can be a sensed imaging apparatus to target distance. A sensed imaging apparatus to
target distance can be determined
e.g., based on an output of one or more of range detection unit 1210 or based on a position
and/or size of a projected light pattern such as aiming pattern 1262 (Fig. 2) in a
captured frame of image data (in such embodiment, projection of aiming pattern 1262
can be synchronized to one or more exposure period occurring during a trigger signal
activation period). For example, apparatus 1000 can be operative to switch to a 2x2
binning global shutter configuration, configuration (b) on sensing of a close imaging
apparatus to target distance (d=d
1) and can further be operative to switch to a 1x4 binning global shutter configuration,
configuration (f), on sensing of a long range imaging apparatus to target distance
d=d
2>d
1, and can further be operative to switch to a rolling reset configuration, configuration
(a), on sensing of a maximally long imaging apparatus to target distance d=d
3>d
2. A sensing that a maximally long reading distance, d=d
3, is present can be a determination that apparatus 1000 is being used to capture a
portrait frame of image data in which activation of a rolling reset configuration
having full pixel resolution can optimize apparatus 1000 for performance of the use
case. In one example, d
1 can be designated as distances of under 1m, d
2 can be designated as distances between 1m and 30m and d
3 can be designated as distances of greater than 30m. In one embodiment, one or more
sensed condition can be determined by processing of image data
e.g., image data captured using imaging assembly 1033 of imaging apparatus 1000. In one
example as already referenced, the processing can be processing to determine a location
and/or size of a projected light pattern projected by the apparatus 1000 for purposes
of determining a reading range (imaging apparatus to target distance). In another
example a processing of image data can be processing to determine that a decodable
indicia is represented in a captured frame of image data. For example, apparatus 1000
can be operating in rolling reset configuration, configuration (a) and a processing
of a frame captured using image sensor array 1033 with the configuration active
e.g., during processing period 5420 can yield a determination that a decodable indicia
is represented in a current field of view of apparatus 1000. Apparatus 1000 can be
operative so that responsively to such determination apparatus 1000 can switch operation
of apparatus 1000 to a configuration that well adapts apparatus 1000 for use in decoding
of decodable indicia,
e.g., a configuration facilitating global shutter operation,
e.g., configurations (b), (d), or (f) set forth herein. While in some embodiments, it
can be useful to activate configuration (a) for digital photograph reading, configuration
(b) for relatively close range indicia decoding, and configuration (f) for relatively
long range indicia decoding, it will be understand that the various configurations
can be usefully activated for alternative applications. For example, it can be useful
to activate configurations (b) or (f) for digital photograph capture where motion
tolerance is a major concern, or activate configuration (b) for relatively long range
indicia decoding, or activate configuration (a) for indicia decoding at relatively
close or relatively long range or activate configuration (f) for digital photograph
capture or for relatively close range indicia decoding.
[0103] While an example is set forth with reference to Fig. 13 wherein configurations can
be switched responsively to one or more sensed condition sensed during a trigger signal
activation period, a switching of configurations responsively to a sensed condition
can in addition or alternatively occur intermediate of trigger signal activation periods.
For example, between trigger signal activation periods apparatus 1000 can be operative
to determine a range of apparatus 1000 or other sensed condition and responsively
to the range determination or other sensed condition can activate a certain configuration
and in one embodiment apparatus 1000 can operate in accordance with the certain configuration
for a duration of a next activated trigger signal activation period. In one embodiment,
imaging apparatus 1000 can be operative so that intermediate of trigger signal activation
periods, imaging apparatus 1000 utilizes image sensor array 1033 to capture one or
more frame of image data for processing for determing a sensed condition, as set forth
herein.
[0104] Further, in one embodiment with reference to the timing diagram of Fig. 13 configurations
of image sensor array 1033 can be switched responsively to a trigger signal activation
on an open loop basis without being responsive to a sensed condition. In the example
of the timing diagram of Fig. 13 a configuration switching is depicted wherein there
is switching between configuration (a), configuration (b) and configuration (f). However,
apparatus 1000 can be operative to perform configuration switching according to an
alternative pattern,
e.g., any possible permutation of an ordering of the configurations (a), (b) and (f).
Further, apparatus 1000 can be operative so that a period of an activated configuration
is more than one frame. In the example of Fig. 13, the configuration activation periods
are depicted as having a duration of one frame. However, apparatus 1000 can be adapted
in another embodiment so that one or more configurations depicted as being activated
during a trigger signal activation period have configuration activation periods of
more than one frame.
[0105] A small sample of systems methods and apparatus that are described herein is as follows:
A1. An apparatus comprising:
an image sensor array having a plurality of pixels including a first pixel and a second
pixel, the first pixel and the second pixel sharing a common global shutter having
a charge storage area and an associated opaque shield, the opaque shield for reducing
charge buildup on the charge storage area attributable to light rays being incident
on the charge storage area.
A2. The apparatus of A1, wherein the image sensor array is operative so that a charge
from the first pixel is transferred to the charge storage area and remains at the
charge storage area for a storage period prior to readout of the charge from the charge
storage area, wherein the opaque shield reduces build up of charge at the charge storage
area during the charge storage period so that an affect of incident light on the charge
storage area during the charge storage period is reduced.
A3. The apparatus of A2, wherein the image sensor array is operative so that a charge
from the second pixel is transferred to the common charge storage area simultaneously
with the transfer of the charge from the first pixel, the charge storage area storing
an aggregate charge of at least the first pixel and the second pixel.
A4. The apparatus of A3, wherein the image sensor array includes the first pixel,
the second pixel, a third pixel and a fourth pixel shared by the charge storage area,
wherein the image sensor array is operative so that charge from the second pixel,
third pixel and fourth pixel are transferred to the charge storage area simultaneously
with the transfer of charge from the first pixels, wherein the charge storage area
has an aggregate charge of the first pixel, second pixel,
third pixel and fourth pixel defining a binned pixel value present light over the
spatial area defined by the first pixel, second pixel, third pixel and fourth pixel.
A5. The apparatus of any of A1 through A4, wherein the image sensor array is operative
so that charges from the first pixel and the second pixel are subject to simultaneous
transfer to the charge storage area for storage of an aggregate charge on the charge
storage area for a storage period prior to readout of the aggregate charge from the
charge storage area, wherein the aggregate charge defines a binned pixel value, and
wherein the opaque shield reduces build up of charge at the charge storage area attributable
to incident light rays during the charge storage period so that an affect of incident
light on the charge storage area during the charge storage period is reduced.
A6. The apparatus of A5, wherein the binned pixel value represents light incident
on a spatial area delimited by a 1xN, N≥2 arrangement of adjacent pixels of the image
sensor array.
A7. The apparatus of A5, wherein the binned pixel value represents light incident
on a spatial area delimited on an MxN, M≥2, N≥2 arrangement of adjacent pixels of
the image sensor array.
A8. The apparatus of any of A1 through A7, wherein the apparatus includes a hand held
housing in which the image sensor array is disposed.
A9. The apparatus of any of A1 through A7, wherein the apparatus is provided by an
image sensor integrated circuit.
A10. The apparatus of any of A1 through A8, wherein the apparatus is provided by an
imaging apparatus having an imaging lens for focusing an image onto the image sensor
array, the apparatus operative to capture a frame of image data utilizing the image
sensor array.
A11. The apparatus of any of A1 through A8, wherein the apparatus is provided by an
imaging apparatus having an imaging lens for focusing an image onto the image sensor
array, the imaging apparatus being operative to capture a frame of image data utilizing
the image sensor array and further being operative to subject the frame of image data
to an attempt to decode a decodable indicia.
A12. The apparatus of A10 or A11, wherein the frame of image data is a windowed frame.
A13. The apparatus of A10 or A11 wherein the frame of image data is a windowed frame
having binned pixel values.
A14. The apparatus of A10 or A11, wherein the frame of image data is a windowed frame
having binned pixel values, wherein pixel values of the binned pixel values represent
light incident on a spatial area delimited by a 1xN, N≥2 arrangement of adjacent pixels
of the image sensor array.
A15. The apparatus of A10 or A11, wherein the apparatus is operative so that responsively
to trigger signal activation the apparatus reads out a first frame and a second frame
of image data from the image sensor array.
A16. The apparatus of A15, wherein the second frame of image data is read out subsequent
to read out of the first frame.
A17. The apparatus of A15, wherein the first frame is a full pixel resolution full
frame and wherein the second frame of image data has a picture size reduced relative
to a picture size corresponding to a full pixel resolution full frame.
A18. The apparatus of A15, wherein the first frame has a first set of pixel values
corresponding to a first set of pixels of the image sensor array, wherein the second
frame has a set of pixel values corresponding to a second set of pixels of the image
sensor array, the second set of pixels being different than the first set.
A19. The apparatus of A15, wherein the first frame has a first set of pixel values
corresponding to a first set of pixels of the image sensor array, wherein the second
frame has a set of pixel values corresponding to a second set of pixels of the image
sensor array, the second set of pixels being different than the first set, wherein
one or more of the first set of pixel values and second set of pixel values are binned
pixel values.
A20. The apparatus of any of A1 through A19, wherein the first pixel and the second
pixel are disposed in first and second adjacent rows of the image sensor array, wherein
the image sensor array is operative so that the first pixel and the second pixel have
sequential exposure initiation times, wherein the image sensor array is further operative
so that the first pixel and the second pixel have sequential readout times.
A21. The apparatus of any of A1 through A20, wherein the apparatus includes a first
configuration and a second configuration, wherein each of the first configuration
and the second configuration are configurations in which pixels of different rows
of the image sensor array subject to readout have common exposure initiation and termination
times.
A22. The apparatus of any of A1 through A20, wherein the apparatus includes a first
configuration and a second configuration, wherein each of the first configuration
and the second configuration are configurations in which pixels of the image sensor
array subject to readout have common exposure initiation and termination times, wherein
binned pixels values corresponding to arrangements of adjacent pixels of a first dimension
are read out of the image sensor array when the apparatus operates in accordance with
the first configuration, and wherein binned pixel values corresponding to arrangements
of adjacent pixels of a second dimension are read out of the image sensor array when
the apparatus operates in accordance with the second configuration, and wherein the
second dimension is different than the first dimension.
A23. The apparatus of any of A1 through A20, wherein the apparatus includes a first
configuration and a second configuration, wherein the first pixel and the second pixel
of the image sensor array when subject to readout with the first configuration active
do not have common exposure initiation and termination times, and wherein the first
pixel and second pixel of the image sensor array when subject to readout with the
second configuration active do have common exposure initiation and termination times.
A24. The apparatus of any of A1 through A20, wherein the apparatus includes a first
configuration and a second configuration, wherein apparatus is operative to switch
from the first configuration to the second configuration responsively to a manually
input control manually input to the apparatus, the apparatus operating in accordance
with a selected configuration for a duration of a trigger signal activation period
activated subsequent to a selection of a selected configuration.
A25. The apparatus of any of A1 through A20, wherein the apparatus has a first configuration
in which pixel values read out from the image sensor array are devoid of binned pixel
values corresponding to bins of pixels of the image sensor array, and a second configuration
in which pixel values read out from the image sensor array include binned pixel values
corresponding to bins of pixels, wherein the apparatus is operative to switch between
the first configuration and the second configuration responsively to one or more of
a sensed condition and an operator input control.
A26. The apparatus of any of A1 through A25, wherein the image sensor array includes
a plurality of cells, each cell having a set of components constructed in accordance
with the first pixel the second pixel the common storage area and the shield so that
each cell has a first pixel a second pixel a common storage area and an opaque shield.
A27. The apparatus of any of A1 through A25, wherein the image sensor array includes
first and second cells, each cell of the first and second cells having a set of components
constructed in accordance with the first pixel the second pixel, the common storage
area and the shield so that each of the first cell and the second cell has a first
pixel a second pixel a common storage area and an opaque shield, wherein the image
sensor array is operative so that there is a common exposure initiation time for exposure
of the first and second pixels of the first cell and for the first and second pixels
of the second cell, the image sensor array further being operative so that transfer
of charge from the first pixel to the charge storage area of the first cell and transfer
of charge from the first pixel to the charge storage area of the second cell is performed
simultaneously, the image sensor array further being operative so that readout of
charge from the charge storage area of second cell is initiated sequentially in relation
to readout of charge from the charge storage area of the first cell.
A28. The apparatus of any of A1 through A26, wherein the charge storage area is included
in a pixel amplifier circuit.
A29. The apparatus of any of A1 through A27, wherein the apparatus is operative in
accordance with a configuration wherein exposure of pixels of successive rows of cells
of the image sensor array is initiated sequentially.
A30. The apparatus of any of A1 through A27, wherein the apparatus is operative in
accordance with a configuration ,wherein exposure of pixels of a plurality of rows
of pixels the image sensor array is initiated simultaneously.
A31. The apparatus of any of A1 through A27, wherein the apparatus is operative in
accordance with a configuration, wherein exposure of pixels of a plurality of rows
of cells of the image sensor array is initiated simultaneously, and wherein there
is read out from the image sensor array pixel values corresponding to bins of pixels
having vertically elongated dimensions MxN, N>M.
B1. An apparatus comprising:
an image sensor array having a first arrangement of adjacent pixels including a first
pixel and a second pixel, the first pixel and the second pixel of the first arrangement
of adjacent pixels sharing a first global shutter having a first charge storage area;
wherein the image sensor array has a second arrangement of adjacent pixels including
a first pixel and a second pixel, the first pixel and the second pixel of the second
arrangement of adjacent pixels sharing a second global shutter having a second charge
storage area;
wherein the first pixel and the second pixel of the first arrangement of adjacent
pixels are disposed in first and second rows of the image sensor array respectively,
and wherein the first pixel and the second pixel of the second arrangement of adjacent
pixels are disposed in third and fourth rows of the image sensor array respectively;
wherein the image sensor array is operative so that each of the first pixel and the
second pixel of the first arrangement of adjacent pixels and each of the first pixel
and the second pixel of the second arrangement of adjacent pixels have common exposure
initiation and termination times;
wherein the image sensor array is further operative so that readout of an image signal
corresponding to a charge stored on the second common charge storage area is performed
sequentially relative to readout of an image signal corresponding to a charge stored
on the first common charge storage area.
B2. The apparatus of B1, wherein the second common charge storage area comprises an
associated opaque shield, the opaque shield for reducing an amount of charge build
up on the second common charge storage area attributable to light rays being incident
on the second common charge storage area during a delay between a termination of exposure
of the first pixel and the second pixel of the second arrangement of adjacent pixels,
and read out of an image signal corresponding to a charge stored on the second common
charge storage area.
B3. The apparatus of B2, wherein the image sensor array is operative so that a charge
from the first pixel of the second arrangement of adjacent pixels is transferred to
the common charge storage area of the second arrangement of adjacent pixels and remains
at the common charge storage area of the second arrangement of adjacent pixels for
a storage period prior to readout of the charge from the common charge storage area
of the second arrangement of adjacent pixels, wherein the opaque shield reduces build
up of charge at the common charge storage area of the second arrangement of adjacent
pixels during the charge storage period so that an affect of incident light on the
common charge storage area during the charge storage period is reduced.
B4. The apparatus of any of B1 through B3, wherein the image sensor array is operative
so that a charge from the second pixel of the second arrangement of adjacent pixels
is transferred to the common charge storage area of the second arrangement of adjacent
pixels simultaneously with the transfer of the charge from the first pixel of the
second arrangement of adjacent pixels, the common charge storage area of the second
arrangement of adjacent pixels storing an aggregate charge of at least the first pixel
and the second pixel.
B5. The apparatus of B4, wherein the second arrangement of adjacent pixels includes
the first pixel, the second pixel, a third pixel and a fourth pixel shared by the
common charge storage area of the second arrangement of adjacent pixels, wherein the
image sensor array is operative so that charge from the second pixel, third pixel
and fourth pixel of the second arrangement of adjacent pixels are transferred simultaneously
with the transfer of charge from the first pixel of the second arrangement of adjacent
pixels, wherein the common charge storage area of the second arrangement of adjacent
pixels stores an aggregate charge of the first pixel, second pixel, third pixel and
fourth pixel defining a binned pixel value representing light over the spatial area
defined by the first pixel, second pixel, third pixel and fourth pixel of the second
arrangement of adjacent pixels.
B6. The apparatus of any of B1 through B4, wherein the image sensor array is operative
so that charges from the first pixel and the second pixel of the second arrangement
of adj acent pixels are subject to simultaneous transfer to the common charge storage
area of the second arrangement of adjacent pixels for storage of an aggregate charge
on the common charge storage area of the second arrangement of adjacent pixels for
a storage period prior to readout of the aggregate charge from the common charge storage
area of the second arrangement of adjacent pixels, wherein the aggregate charge defines
a binned pixel value, and wherein the opaque shield reduces build up of charge at
the common charge storage area attributable to incident light rays during the charge
storage period so that an affect of incident light on the common charge storage area
during the charge storage period is reduced.
B7. The apparatus of B6, wherein the binned pixel value represents light incident
on a spatial area delimited by a 1xN, N≥2 arrangement of adjacent pixels of the image
sensor array.
B8. The apparatus of B6, wherein the binned pixel value represents light incident
on a spatial area delimited on an MxN, M≥2, N≥2 arrangement of adjacent pixels of
the image sensor array.
B9. The apparatus of any of B1 through B8, wherein the apparatus includes a hand held
housing in which the image sensor array is disposed.
B10. The apparatus of any of B1 through B9, wherein the apparatus is provided by an
image sensor integrated circuit.
B11. The apparatus of any of B1 through B9, wherein the apparatus is provided by an
imaging apparatus having an imaging lens for focusing an image onto the image sensor
array, the apparatus operative to capture a frame of image data utilizing the image
sensor array.
B12. The apparatus of any of B1 through B9, wherein the apparatus is provided by an
imaging apparatus having an imaging lens for focusing an image onto the image sensor
array, the imaging apparatus being operative to capture a frame of image data utilizing
the image sensor array and further being operative to subject the frame of image data
to an attempt to decode a decodable indicia.
B13. The apparatus of B11 or B12, wherein the frame of image data is a windowed frame.
B14. The apparatus of B11 or B12, wherein the frame of image data is a windowed frame
having binned pixel values.
B15. The apparatus of B11 or B12, wherein the frame of image data is a windowed frame
having binned pixel values, wherein pixel values of the binned pixel values represent
light incident on a spatial area delimited by a 1xN, N≥2 arrangement of adjacent pixels
of the image sensor array.
B16. The apparatus of any of B11 or B12, wherein the apparatus is operative so that
responsively to trigger signal activation the apparatus reads out a first frame and
a second frame of image data from the image sensor array.
B17. The apparatus of B16, wherein the second frame of image data is read out subsequent
to read out of the first frame.
B18. The apparatus of B16, wherein the first frame is a full pixel resolution full
frame and wherein the second frame of image data has a picture size reduced relative
to a picture size corresponding to a full pixel resolution full frame.
B19. The apparatus of B16, wherein the first frame has a first set of pixel values
corresponding to a first set of pixels of the image sensor array, wherein the second
frame has a set of pixel values corresponding to a second set of pixels of the image
sensor array, the second set of pixels being different than the first set.
B20. The apparatus of B16, wherein the first frame has a first set of pixel values
corresponding to a first set of pixels of the image sensor array, wherein the second
frame has a set of pixel values corresponding to a second set of pixels of the image
sensor array, the second set of pixels being different than the first set, wherein
one or more of the first set of pixel values and second set of pixel values are binned
pixel values.
B21. The apparatus of any of B1 through B20, wherein the apparatus includes a first
configuration and a second configuration, wherein each of the first configuration
and the second configurations are configurations in which pixels of different rows
of the image sensor array subject to readout have common exposure initiation and termination
times.
B22. The apparatus of any of B1 through B20, wherein the apparatus includes a first
configuration and a second configuration, wherein each of the first configuration
and the second configuration are configurations in which pixels of the image sensor
array subject to readout have common exposure initiation and termination times, wherein
binned pixels values corresponding to pixel sets of a first dimension are read out
of the image sensor array when the apparatus operates in accordance with the first
configuration, and wherein binned pixel values corresponding to pixel sets of a second
dimension are read out of the image sensor array when the apparatus operates in accordance
with the second configuration, and wherein the second dimension is different than
the first dimension.
B23. The apparatus of any of B1 through B20, wherein the apparatus includes a first
configuration and a second configuration, wherein apparatus is operative to switch
from the first configuration to the second configuration responsively to a manually
input control manually input to the apparatus, the apparatus operating in accordance
with a selected configuration for a duration of a trigger signal activation period
activated subsequent to a selection of a selected configuration.
B24. The apparatus of any of B1 through B23, wherein the common charge storage area
of the second set of adjacent pixels is included in a pixel amplifier circuit.
B25. The apparatus of any of B1 through B23, wherein the apparatus is operative in
accordance with a configuration, wherein exposure of pixels of a plurality of rows
of cells of the image sensor array is initiated simultaneously, and wherein there
is read out from the image sensor array pixel values correspondingly to bins of pixels
having vertically elongated dimensions MxN, N>M.
C1. An imaging apparatus comprising:
an image sensor array;
an imaging lens assembly for focusing an image onto the image sensor array;
wherein the imaging apparatus includes a first configuration in which the imaging
apparatus is operative to read out one or more frame of image data from the image
sensor array in accordance with a rolling shutter operation in which exposure of pixels
of first and second rows of pixels of the image sensor array is initiated sequentially,
and wherein pixel values responsive to light incident on pixels of the first and second
rows of pixels subject to readout are un-binned pixel values that represent light
incident on a spatial area delimited by a single pixel of the image sensor array;
wherein the imaging apparatus includes a second configuration in which of the imaging
apparatus is operative to read out one or more frame of image data from the image
sensor array in accordance with a global shutter operation in which exposure of pixels
of the first and second rows of pixels of the image sensor array is initiated and
terminated simultaneously, and wherein pixel values responsive to light incident on
pixels of the first and second rows of pixels subject to readout are binned pixel
values read out using shared global shutter circuitry of the image sensor array that
represent light incident on a spatial area delimited by an arrangement of two or more
pixels of the image sensor array.
C2. The imaging apparatus of C1, wherein the imaging apparatus includes a hand held
housing in which the image sensor array is disposed.
C3. The imaging apparatus of C1, wherein the imaging apparatus is adapted for fixed
mounting.
C4. The imaging apparatus of any of C1 through C3, wherein the imaging apparatus is
operative so that the first configuration and the second configuration can be activated
responsively to an operator input control.
C5. The imaging apparatus of any of C1 through C3, wherein the imaging apparatus is
operative to sequentially activate the first configuration and the second configuration
on an open loop basis responsively to a trigger signal activation.
C6. The imaging apparatus of C5, wherein the imaging apparatus is operative to sequentially
activate the first configuration and the second configuration by activating the second
configuration prior to activating the first configuration.
C7. The imaging apparatus of any of C1 through C6, wherein the imaging apparatus is
operative to activate one or more of the first configuration and The imaging apparatus
of any of claims C1 through C7, wherein the imaging apparatus is operative so that
the imaging apparatus can sequentially activate the first configuration and the second
configuration during a trigger signal activation period.
C8. The imaging apparatus of C1, wherein the first and second rows of pixels are adjacent
rows of pixels.
C9. The imaging apparatus of C1, wherein the first and second rows of pixels are non-adjacent
rows of pixels.
C10. The imaging apparatus of any of C1 though C9, wherein the arrangement of two
or more pixels is an arrangement of MxN adjacent pixels, M>=2, N>=2.
C11. The imaging apparatus of any of C1 though C9, wherein the arrangement of two
or more pixels is an arrangement of 1xN adjacent pixels, N>=2.
C12. The imaging apparatus of C1, wherein the imaging apparatus is operative to attempt
to decode a decodable indicia by processing of one or more frame captured with the
second configurations active.
C13. The imaging apparatus of any of C1 though C12, wherein the arrangement of two
or more pixels in accordance with the second configuration is an arrangement of MxN
adjacent pixels, M>=2, N>=2, and wherein the imaging apparatus includes a third configuration
in which the imaging apparatus is operative to read out one or more frame of image
data from the image sensor array in accordance with a global shutter operation in
which exposure of pixels of the first and second rows of pixels of the image sensor
array is initiated and terminated simultaneously, and wherein pixel values responsive
to light incident on pixels of the first and second rows of pixels subject to readout
are binned pixel values that are read out using shared global shutter circuitry of
the image sensor array and which represent light incident on a spatial area delimited
by an arrangement of two or more pixels of the image sensor array, the arrangement
of two or more pixels in accordance with the third configuration being an arrangement
of 1xN adjacent pixels, N>=2.
D1. A method comprising:
providing and imaging apparatus having an image sensor array, an imaging lens assembly
for focusing an image onto the image sensor array, wherein the imaging apparatus includes
a first configuration in which the imaging apparatus is operative to read out one
or more frame of image data from the image sensor array in accordance with a rolling
shutter operation in which exposure of pixels of first and second rows of pixels of
the image sensor array is initiated sequentially, and wherein pixel values responsive
to light incident on pixels of the first and second rows of pixels subject to readout
are un-binned pixel values that represent light incident on a spatial area delimited
by a single pixel of the image sensor array, wherein the imaging apparatus includes
a second configuration in which the imaging apparatus is operative to read out one
or more frame of image data from the image sensor array in accordance with a global
shutter operation in which exposure of pixels of the first and second rows of pixels
of the image sensor array is initiated and terminated simultaneously, and wherein
pixel values responsive to light incident on pixels of the first and second rows of
pixels subject to readout are binned pixel values read out using shared global shutter
circuitry of the image sensor array that represent light incident on a spatial area
delimited by an arrangement of two or more pixels of the image sensor array; and
activating one or more of the first configuration and the second configuration.
D2. The method of D1, wherein the activating includes activating one or more of the
first configuration and the second configuration responsively to an operator input
control.
D3. The method of any of D1 or D2, wherein the activating includes activating one
or more of the first configuration and the second configuration responsively to one
or more sensed condition.
D4. The method of D3, wherein the one or more sensed condition is an imaging apparatus
to target distance.
D5. The method of any of D3 through D4, wherein the sensed condition is sensed by
processing of image data captured using the imaging apparatus.
D6. The method of any of D3 through D4, wherein the sensed condition sensed by processing
of image data captured using the imaging apparatus, the processing being a processing
to recognize a representation of a spatial feature.
D7. The method of any of D3 through D4, wherein the sensed condition sensed by processing
of image data captured using the imaging apparatus, the processing being a processing
to recognize a representation of a spatial feature, the spatial feature being a decodable
indicia.
D8. The method of any of D3 through D7, wherein the activating includes activating
one or more of the first configuration and the second configuration responsively to
one or more a sensed condition, the sensed condition being sensed during a trigger
signal activation period.
D9. The method of any of D1 through D8, wherein the activating includes activating
each of the first configuration and the second configuration during a trigger signal
activation period.
D10. The method of any of D1 through D2, wherein the activating includes activating
each of the first configuration and the second configuration on an open loop basis
during a trigger signal activation period.
D11. The method any of D3 through D7, wherein the activating includes activating each
of the first configuration and the second configuration responsively to one or more
sensed condition during a trigger signal activation period.
D12. The method of any of D1 through D11, wherein the activating includes activating
the first configuration for use of the apparatus for document capture, and activating
the second configuration for use of the apparatus for reading of decodable indicia.
D13. The method of any of D1 through D12, wherein the arrangement of two or more pixels
in accordance with the second configuration is an arrangement of MxN adjacent pixels,
M>=2, N>=2, and wherein the providing further includes providing the imaging apparatus
to include a third configuration in which the imaging apparatus is operative to read
out one or more frame of image data from the image sensor array in accordance with
a global shutter operation in which exposure of pixels of the first and second rows
of pixels of the image sensor array is initiated and terminated simultaneously, and
wherein pixel values responsive to light incident on pixels of the first and second
rows of pixels subject to readout are binned pixel values read out using shared global
shutter circuitry of the image sensor array that represent light incident on a spatial
area delimited by an arrangement of two or more pixels of the image sensor array,
the arrangement of two or more pixels in accordance with the third configuration being
an arrangement of 1xN adjacent pixels, N>=2.
D14. The method of D13, wherein the activating includes activating the first configuration
for use of the apparatus for document capture, and activating the second configuration
for use of the apparatus for reading of decodable indicia at relatively close range,
and wherein the activating includes activating the third configuration for use of
imaging apparatus for reading of decodable indicia at relatively long range.
[0106] While the present invention has been described with reference to a number of specific
embodiments, it will be understood that the true spirit and scope of the invention
should be determined only with respect to claims that can be supported by the present
specification. Further, while in numerous cases herein wherein systems and apparatuses
and methods are described as having a certain number of elements it will be understood
that such systems, apparatuses and methods can be practiced with fewer than or greater
than the mentioned certain number of elements. Also, while a number of particular
embodiments have been described, it will be understood that features and aspects that
have been described with reference to each particular embodiment can be used with
each remaining particularly described embodiment.