[Technical Field]
[0001] The disclosure relates to a technique for improving image quality by adjusting a
position of an image sensor.
[Background Art]
[0002] Recently, as functions of a mobile device are diversified, needs for improvement
of an image capture function using the mobile device is also increasing. Accordingly,
what is demanded is a technique for improving quality of an image obtained through
the mobile device.
[0003] An electronic device may include a camera module for performing an optical image
stabilization (OIS) function. The electronic device may compensate for shake by moving
the lens assembly included in the camera module, or by moving the image sensor through
the OIS function. The OIS function may include a sensor shift scheme for moving the
image sensor and a lens shift scheme for moving the lens assembly.
[Disclosure of Invention]
[Technical Problem]
[0004] An electronic device adopting an optical image stabilization (OIS) of a sensor shift
scheme performs OIS by moving an image sensor in an x-axis direction and/or a y-axis
direction substantially perpendicular to an optical axis (e.g., a z-axis). At this
time, while the electronic device performs the OIS by moving the image sensor, the
image sensor may rotate around the optical axis, that is, rotate in a roll direction.
If the image sensor rotates in the roll direction, image quality may be subject to
deterioration such as capturing an image different from a user's intention.
[Solution to Problem]
[0005] A camera module according to an embodiment of the disclosure may include an image
sensor, an optical image stabilization (OIS) carrier coupled to the image sensor to
move the image sensor on a plane perpendicular to an optical axis, a housing for accommodating
the image sensor and the OIS carrier, an OIS magnet fixed to a first side of the OIS
carrier, a first OIS coil and a second OIS coil fixed to a first inner surface of
the housing to face the OIS magnet, the first OIS coil and the second OIS coil disposed
side by side on the first inner surface along a direction perpendicular to the optical
axis, and a driving circuit electrically connected to the first OIS coil and the second
OIS coil. The driving circuit may control a first current applied to the first OIS
coil and a second current applied to the second OIS coil to perform OIS by moving
the image sensor in a direction perpendicular to the optical axis, and to perform
roll rotation correction of the image sensor by rotating the image sensor on a plane
perpendicular to the optical axis.
[0006] An electronic device module according to an embodiment of the disclosure may include
an image sensor, an OIS carrier coupled to the image sensor to move the image sensor
on a plane perpendicular to an optical axis, a housing for accommodating the image
sensor and the OIS carrier, an OIS magnet fixed to a first side of the OIS carrier,
a first OIS coil and a second OIS coil fixed to a first inner surface of the housing
to face the OIS magnet, the first OIS coil and the second OIS coil disposed side by
side on the first inner surface along a direction perpendicular to the optical axis,
and at least one processor electrically connected to the first OIS coil and the second
OIS coil. The at least one processor may control a first current applied to the first
OIS coil and a second current applied to the second OIS coil to perform OIS by moving
the image sensor in a direction perpendicular to the optical axis, and to perform
roll rotation correction of the image sensor by rotating the image sensor on a plane
perpendicular to the optical axis.
[Advantageous Effects of Invention]
[0007] According to various embodiments disclosed in this document, while performing optical
image stabilization (OIS) by moving an image sensor, an electronic device may also
correct a roll direction rotation of the image sensor. Hence, the electronic device
may capture/acquire an image with improved quality.
[0008] Effects obtainable from the disclosure are not limited to the above-mentioned effects,
and other effects which are not mentioned may be clearly understood by those skilled
in the art of the disclosure through the following descriptions.
[Brief Description of Drawings]
[0009]
FIG. 1 illustrates a camera module mounted in an electronic device according to an
embodiment.
FIG. 2 illustrates an exploded perspective view of a camera module according to an
embodiment.
FIG. 3 illustrates an exploded perspective view of a camera module according to an
embodiment.
FIG. 4 illustrates a part of a hardware configuration included in a camera module
according to an embodiment.
FIG. 5 illustrates a part of a hardware configuration included in a camera module
according to an embodiment.
FIG. 6 illustrates an image sensor and a printed circuit board (PCB) connected to
the image sensor according to an embodiment.
FIG. 7 illustrates a camera module when viewed from an optical axis direction according
to an embodiment.
FIG. 8 is a block diagram of an electronic device in a network environment according
to various embodiments.
FIG. 9 is a block diagram illustrating a camera module according to various embodiments.
[0010] With regard to the description of the drawings, identical or similar reference numerals
may be used for identical or similar components.
[Mode for the Invention]
[0011] Hereinafter, various embodiments of the disclosure are described with reference to
the attached drawings. However, it is not intended to limit the disclosure to specific
embodiments, and should be understood to embrace various modifications, equivalents,
and/or alternatives of the embodiments of the disclosure.
[0012] FIG. 1 illustrates a camera module mounted in an electronic device according to an
embodiment.
[0013] Referring to FIG. 1, an electronic device 100 may include at least one camera module.
For example, at least one camera module may be disposed on a rear surface of the electronic
device 100 to face the back of the electronic device 100. According to an embodiment,
the electronic device 100 may include a first camera module 111, a second camera module
112, a third camera module 113, and a fourth camera module 114. For example, the first
camera module 111 is an ultra-wide camera, the second camera module 112 is a wide
camera, and the third camera module 113 and the fourth camera module 114 may be tele
cameras. For example, the third camera module 113 may be a 3x zoom camera, and the
fourth camera module 114 may be a 10x zoom camera. According to an embodiment, the
electronic device 100 may further include a distance sensor 120. However, the type
or the number of the camera modules illustrated in FIG. 1 are one example, and do
not limit the scope of the disclosure.
[0014] According to an embodiment, a rear cover 130 of the electronic device 100 may include
at least one opening. For example, the rear cover 130 of the electronic device 100
may include a first opening 131 corresponding to the first camera module 111, a second
opening 132 corresponding to the second camera module 112, a third opening 133 corresponding
to the third camera module 113, and a fourth opening 134 corresponding to the fourth
camera module 114. The rear cover 130 of the electronic device 100 may further include
an opening 135 corresponding to the distance sensor 120. According to an embodiment,
the fourth camera module 114 may obtain an image corresponding to light passing through
the fourth opening 134.
[0015] According to an embodiment, the electronic device 100 may include a processor (e.g.,
a processor 820 of FIG. 8) electrically connected to the camera module (e.g., the
first camera module 111, the second camera module 112, the third camera module 113,
and the fourth camera module 114). In the disclosure, at least some of operations
described as being performed by the camera module may be understood as being performed
by the processor of the electronic device 100. In addition, at least some of operations
described as being performed by the processor of the electronic device 100 may be
understood as being performed by the camera module (e.g., the camera module 880 of
FIG. 8) in the disclosure.
[0016] Referring to FIG. 1, the electronic device 100 is illustrated as including the four
camera modules, which is only an example and does not limit the scope of the disclosure.
For example, embodiments of the disclosure may be applied to an electronic device
including one camera module, embodiments of the disclosure may be applied to an electronic
device including a plurality of camera modules, and embodiments of the disclosure
may be applied to some or all of the camera modules included in the electronic device.
[0017] FIG. 2 illustrates an exploded perspective view of a camera module according to an
embodiment. FIG. 3 illustrates an exploded perspective view of a camera module according
to an embodiment. FIG. 4 illustrates a part of a hardware configuration included in
a camera module according to an embodiment. FIG. 5 illustrates a part of a hardware
configuration included in a camera module according to an embodiment. FIG. 2 through
FIG. 5 illustrate configurations included in a camera module 200 according to an embodiment.
The camera module 200 shown in FIG. 2 through FIG. 5 may correspond to the fourth
camera module 114 of FIG. 1, or may correspond to at least one of the first camera
module 111, the second camera module 112, or the third camera module 113.
[0018] Referring to FIG. 2 through FIG. 5, the camera module 200 may include an image sensor
250, an optical image stabilization (OIS) carrier 240, and a housing 210. According
to an embodiment, the camera module 200 may further include an upper shield can 212,
a lower shield can 214, a lens 222, a prism 224, an auto focus (AF) carrier 230, and
a flexible printed circuit board (FPCB) 260.
[0019] According to an embodiment, the camera module 200 may include the lens 222 and the
prism 224. In an embodiment, the lens 222 may be referred to as a first reflector,
and the prism 224 may be referred to as a second reflector. According to an embodiment,
the lens 222 and the prism 224 may be securely disposed in the housing 210.
[0020] According to an embodiment, the lens 222 may include a structure which refracts light
incident in the -z direction by about 90 degrees. According to an embodiment, the
lens 222 (the first reflector) may change light incident on the camera module 200
to a second optical axis (e.g., the x-axis) to make it substantially parallel to a
first optical axis (e.g., the z-axis). For example, the light incident on the camera
module 200 in the -z direction may travel in the +x direction while passing through
the lens 222.
[0021] According to an embodiment, the prism 224 (the second reflector) may change the light
reflected to the second optical axis (e.g., the x-axis) back to the first optical
axis (e.g., the z-axis). For example, the prism 224 may refract the light traveling
in the +x direction by about 90 degrees. The light traveling in the +x direction as
passing through the lens 222 may be refracted again by the prism 224 to travel in
the -z direction. In the disclosure, the 'optical axis' may indicate the first optical
axis, that is, the z-axis, or may indicate an axis substantially parallel to the z-axis.
[0022] According to FIG. 2 through FIG. 5, the camera module 200 is illustrated as a folded-type
camera module in which the incident light is refracted twice but this is only an example,
and various other embodiments are possible. For example, embodiments of the disclosure
may be applied to a folded-type camera module in which the incident light is refracted
once through one reflector, or a direct-type camera module in which the incident light
enters the image sensor 250 without being refracted.
[0023] According to an embodiment, the camera module 200 may include the image sensor 250.
In an embodiment, the image sensor 250 may be a complementary metal oxide semiconductor
(CMOS) sensor or a charged coupled device (CCD) sensor. A plurality of individual
pixels may be integrated in the image sensor 250, and each individual pixel may include
a micro lens, a color filter, and a photodiode. Each individual pixel is a type of
a light detector and may convert the inputted light into an electrical signal. For
example, a light receiving element of the image sensor 250 may generate a current
by generating a photoelectric effect using light received through the lens 222, and
amplify the generated current. For example, each individual pixel may include a photoelectric
transformation element (or a position sensitive detector (PSD)) and a plurality of
transistors (e.g., a reset transistor, a transfer transistor, a select transistor,
a driver transistor).
[0024] According to an embodiment, the image sensor 250 may be disposed on a sensor PCB
252. For example, the image sensor 250 may be electrically connected to the sensor
PCB 252. In addition, the image sensor 250 may be coupled and disposed in a specific
portion of the sensor PCB 252. Regarding the sensor PCB 252, it shall be described
with reference to FIG. 6.
[0025] According to an embodiment, the image sensor 250 may be disposed to move within the
housing 210. According to an embodiment, the image sensor 250 may be moved on a two-dimensional
plane substantially perpendicular to the optical axis (e.g., the z-axis). The electronic
device 100 (or the camera module 200) may move the image sensor 250 to perform the
OIS function. For example, the electronic device 100 (or the camera module 200) may
move the image sensor 250 in a direction (e.g., a +x/-x direction, or a +y/-y direction)
substantially perpendicular to the optical axis to compensate for shake of the electronic
device 100. According to an embodiment, the image sensor 250 may be moved in a direction
substantially parallel to the optical axis (e.g., the z-axis). The electronic device
100 (or the camera module 200) may move the image sensor 250 to perform the AF function.
For example, the electronic device 100 (or the camera module 200) may focus on a subject
by moving the image sensor 250 in a direction substantially parallel to the optical
axis. However, embodiments of the disclosure may be also applied to a camera module
which performs the AF function by moving the lens, and performs the OIS by moving
the image sensor.
[0026] According to an embodiment, the camera module 200 may include the OIS carrier 240
which is coupled to the image sensor 250 to move the image sensor 250 on a plane (e.g.,
an xy plane) substantially perpendicular to the optical axis (e.g., the z-axis). For
example, the OIS carrier 240 may be attached to the sensor PCB 252 and configured
to move together with the image sensor 250.
[0027] According to an embodiment, the camera module 200 may include the AF carrier 230
for moving the image sensor 250 in a direction substantially parallel to the optical
axis (e.g., the z-axis). According to an embodiment, the AF carrier 230 may accommodate
the OIS carrier 240. For example, as the AF carrier 230 moves in the direction substantially
parallel to the optical axis, the image sensor 250 may also move in the direction
substantially parallel to the optical axis. In addition, if the OIS carrier 240 moves
within the AF carrier 230 in the direction substantially perpendicular to the optical
axis, the image sensor 250 may move together with the OIS carrier 240 in the direction
substantially perpendicular to the optical axis.
[0028] According to an embodiment, the camera module 200 may include a stopper 235 coupled
to the AF carrier 230. The stopper 235 may prevent the OIS carrier 240 accommodated
inside the AF carrier 230 from moving out of the AF carrier 230. For example, the
stopper 235 may prevent the OIS carrier 240 from moving in the optical axis (e.g.,
the z-axis) direction with respect to the AF carrier 230.
[0029] According to an embodiment, the camera module 200 may include the housing 210 for
accommodating the image sensor 250 and the AF carrier 230. The housing 210 may accommodate
the lens 222, the prism 224, the image sensor 250, the OIS carrier 240, and the AF
carrier 230. According to an embodiment, the camera module 200 may include the upper
shield can 212 and the lower shield can 214 disposed outside the housing 210. The
upper shield can 212 and the lower shield can 214 may form an exterior of the camera
module 200. According to an embodiment, the camera module 200 may include the FPCB
260 secured to the housing 210. A driving circuit of the camera module 200 may be
disposed on the FPCB 260.
[0030] According to an embodiment, the camera module 200 may include an AF magnet 238 fixed
to an outer side (e.g., a side facing the -y direction) of the AF carrier 230. In
addition, the camera module 200 may include an AF coil 268 fixed to one surface (e.g.,
an inner surface facing the +y direction) of inner surfaces of the housing 210. For
example, the AF coil 268 may be disposed on the FPCB 260. According to an embodiment,
the driving circuit of the camera module 200 may control the current applied to the
AF coil 268 to thus move the AF carrier 230 in a direction substantially parallel
to the optical axis (e.g., the z-axis). For example, the driving circuit of the camera
module 200 may perform the AF function by controlling the current applied to the AF
coil 268 to move the image sensor 250 in the optical axis direction.
[0031] According to an embodiment, the camera module 200 may include an AF position sensor
288 for detecting a position of the AF carrier 230. The AF position sensor 288 may
be disposed around the AF coil 268. For example, the AF position sensor 288 may be
disposed in an inner hole of the AF coil 268. According to an embodiment, the driving
circuit of the camera module 200 may detect the position of the AF magnet 238 through
the AF position sensor 288, and identify the position of the image sensor 250 on the
optical axis based on the position of the AF magnet 238.
[0032] According to an embodiment, the camera module 200 may include an AF ball group 272.
The AF ball group 272 may be disposed between the housing 210 and the AF carrier 230.
If the camera module 200 performs the AF function, the AF carrier 230 may be smoothly
moved in the optical axis direction by the AF ball group 272.
[0033] According to an embodiment, the camera module 200 may include an x-axis OIS magnet
246 fixed to one (e.g., a side facing the +x direction) of outer surfaces of the OIS
carrier 240. In addition, the camera module 200 may include an x-axis OIS coil 266
fixed to one (e.g., an inner surface facing the -x direction) of the inner surfaces
of the housing 210. For example, the x-axis OIS coil 266 may be disposed on the FPCB
260. According to an embodiment, the driving circuit of the camera module 200 may
control the current applied to the x-axis OIS coil 266 to thus move the OIS carrier
240 in a direction (e.g., the +x/-x direction) substantially perpendicular to the
optical axis (e.g., the z-axis). For example, the driving circuit of the camera module
200 may perform the OIS function by controlling the current applied to the x-axis
OIS coil 266 to move the image sensor 250 in the direction (e.g., the +x/-x direction)
substantially perpendicular to the optical axis.
[0034] According to an embodiment, the camera module 200 may include an x-axis OIS position
sensor 286 for detecting the position of the OIS carrier 240 on the x-axis. The x-axis
OIS position sensor 286 may be disposed around the x-axis OIS coil 266. For example,
the x-axis OIS position sensor 286 may be disposed in an inner hole of the x-axis
OIS coil 266. According to an embodiment, the driving circuit of the camera module
200 may detect a position of the x-axis OIS magnet 246 through the x-axis OIS position
sensor 286, and identify the position of the image sensor 250 on the x-axis based
on the position of the x-axis OIS magnet 246. FIG. 2 through FIG. 5 illustrates the
x-axis OIS magnet 246 is one in number, but the number of the x-axis OIS magnets 246
is not limited thereto. According to an embodiment, the number of the x-axis OIS magnets
246 may be two or more. For example, the x-axis OIS magnet may include two magnets
such as y-axis OIS magnets 242 and 244. According to an embodiment, the x-axis OIS
magnet may include a first x-axis OIS magnet and a second x-axis OIS magnet. According
to an embodiment, the first x-axis OIS magnet and the second x-axis OIS magnet may
correspond to different polarities. For example, the first x-axis OIS magnet may correspond
to the N pole, and the second x-axis OIS magnet may correspond to the S pole. For
example, the first x-axis OIS magnet may correspond to the S pole, and the second
x-axis OIS magnet may correspond to the N pole. According to an embodiment, the first
OIS x-axis magnet and the second x-axis OIS magnet may correspond to the same polarity.
For example, both the first x-axis OIS magnet and the second x-axis OIS magnet may
be the N pole, or both the first x-axis OIS magnet and the second x-axis OIS magnet
may be the S pole.
[0035] According to an embodiment, the camera module 200 may include the y-axis OIS magnets
242 and 244 fixed to another surface (hereafter, a first side) (e.g., a side facing
the +y direction) of the outer surface of the OIS carrier 240. For example, the first
OIS magnet 242 and the second OIS magnet 422 may be disposed on the first side of
the OIS carrier 240. For example, unlike the illustration in FIG. 2 through FIG. 5,
an OIS magnet formed with one magnet may be disposed. According to an embodiment,
the first OIS magnet 242 and the second OIS magnet 244 may correspond to different
polarities. For example, the first OIS magnet 242 may correspond to the N pole, and
the second OIS magnet 244 may correspond to the S pole. For example, the first OIS
magnet 242 may correspond to the S pole, and the second OIS magnet 244 may correspond
to the N pole. According to an embodiment, the first OIS magnet 242 and the second
OIS magnet 244 may correspond to the same polarity. For example, both the first OIS
magnet 242 and the second OIS magnet 244 may be the N pole, or both the first OIS
magnet 242 and the second OIS magnet 244 may be the S pole.
[0036] According to an embodiment, the camera module 200 may include a first OIS coil 262
and a second OIS coil 264 fixed to another surface (hereafter, a first inner surface)
(e.g., an inner surface facing the -y direction) of the inner surfaces of the housing
210. According to an embodiment, the first OIS coil 262 and the second OIS coil 264
may be arranged side by side along a direction (e.g., the x-axis direction) substantially
perpendicular to the optical axis on the first inner surface.
[0037] According to an embodiment, the driving circuit of the camera module 200 may control
a first current applied to the first OIS coil 262 and a second current applied to
the second OIS coil 264, and thus move the OIS carrier 240 in a direction (e.g., a
+y/-y direction) substantially perpendicular to the optical axis (e.g., the z-axis).
For example, the driving circuit of the camera module 200 may perform the OIS function
by controlling the first current applied to the first OIS coil 262 and the second
current applied to the second OIS coil 264 to move the image sensor 250 in the direction
(e.g., the +y/-y direction) substantially perpendicular to the optical axis.
[0038] According to an embodiment, the camera module 200 may include a first OIS position
sensor 282 and a second OIS position sensor 284 for detecting the position of the
OIS carrier 240 on the y-axis. The first OIS position sensor 282 and the second OIS
position sensor 284 may be disposed around the first OIS coil 262 and the second OIS
coil 264 respectively. For example, the first OIS position sensor 282 and the second
OIS position sensor 284 may be disposed in inner holes of the first OIS coil 262 and
the second OIS coil 264 respectively. According to an embodiment, the driving circuit
of the camera module 200 may detect positions of the first OIS magnet 242 and the
second OIS magnet 244 through the first OIS position sensor 282 and the second OIS
position sensor 284, and identify the position of the image sensor 250 on the y-axis
based on the positions.
[0039] According to an embodiment, the camera module 200 may include an OIS ball group 274.
The OIS ball group 274 may be disposed between the AF carrier 230 and the OIS carrier
240. If the camera module 200 performs the OIS function, the OIS carrier 240 may be
smoothly moved within the AF carrier 230 by the OIS ball group 274 in a direction
substantially perpendicular to the optical axis.
[0040] According to an embodiment, while the camera module 200 performs the OIS by moving
the image sensor 250, a rotation in the roll direction in which the image sensor 250
rotates around the optical axis may occur. Since the quality of the image captured
through the camera module 200 may deteriorate if the image sensor 250 rotates in the
roll direction, the camera module 200 (or the electronic device 100) of the disclosure
may perform roll rotation correction of the image sensor 250. For example, the camera
module 200 of the disclosure may perform the roll rotation correction of the image
sensor 250, using the OIS magnets (e.g., the first OIS magnet 242 and the second OIS
magnet 242) disposed on the first side (e.g., the side facing the +y direction) of
the OIS carrier 240, and the first OIS coil 262 and the second OIS coil 264 disposed
on the first inner surface (e.g., the inner surface facing the +y direction) of the
housing 210. In the disclosure, 'roll rotation correction' may indicate correcting
the position of the image sensor 250 by rotating the image sensor 250 in an opposite
direction if the image sensor 250 rotates in the roll direction. In the disclosure,
'roll rotation correction' may be an operation included in the OIS operation of the
camera module. For example, 'roll rotation correction' may be a kind of the OIS operation
in the disclosure.
[0041] According to an embodiment, the driving circuit of the camera module 200 may control
the first current applied to the first OIS coil 262 and the second current applied
to the second OIS coil 264, to thus rotate the OIS carrier 240 on a plane substantially
perpendicular to the optical axis (e.g., z). For example, the driving circuit of the
camera module 200 may perform the roll rotation correction of the image sensor 250,
by controlling the first current applied to the first OIS coil 262 and the second
current applied to the second OIS coil 264 to rotate the image sensor 250 on the plane
substantially perpendicular to the optical axis.
[0042] According to an embodiment, the driving circuit of the camera module 200 may control
the first current applied to the first OIS coil 262 and the second current applied
to the second OIS coil 264, and thus control electromagnetic forces exerted to the
first OIS magnet 242 and the second OIS magnet 244 to point the same direction, or
control them to point opposite directions.
[0043] For example, if the first OIS magnet 242 and the second OIS magnet 244 correspond
to the same polarity (e.g., the N pole), and the driving circuit applies a current
of the same direction to the first OIS coil 262 and the second OIS coil 264, the OIS
carrier 240 may move in the +y or -y direction. In addition, if the first OIS magnet
242 and the second OIS magnet 244 correspond to the same polarity (e.g., the N pole),
and the driving circuit applies currents of different directions to the first OIS
coil 262 and the second OIS coil 264, the OIS carrier 240 may rotate clockwise or
counterclockwise around the optical axis.
[0044] For example, if the first OIS magnet 242 and the second OIS magnet 244 correspond
to different polarities, and the driving circuit applies currents of different directions
to the first OIS coil 262 and the second OIS coil 264, the OIS carrier 240 may move
in the +y or -y direction. In addition, the first OIS magnet 242 and the second OIS
magnet 244 correspond to different polarities, and the driving circuit applies a current
of the same direction to the first OIS coil 262 and the second OIS coil 264, the OIS
carrier 240 may rotate clockwise or counterclockwise around the optical axis.
[0045] According to an embodiment, by controlling the currents applied to the first OIS
coil 262 and the second OIS coil 264, the electronic device 100 (or the camera module
200) may perform the OIS by moving the image sensor 250 in a direction substantially
perpendicular to the optical axis, and perform the roll rotation correction of the
image sensor 250 by rotating the image sensor 250 on a plane substantially perpendicular
to the optical axis..
[0046] FIG. 6 illustrates an image sensor and a PCB connected to the image sensor according
to an embodiment.
[0047] According to an embodiment, the sensor PCB 252 may include a fixed portion 602, a
movable portion 612, 614, and 616, and stiffeners 622 and 624. Additionally, the sensor
PCB 252 may include a connector 604 connected to outside. According to an embodiment,
the image sensor 250 may be disposed in a specific portion of the sensor PCB 252.
[0048] According to an embodiment, the fixed portion 602 of the sensor PCB 252 may be secured
to the housing 210 of the camera module 200. The connector 604 of the sensor PCB 252
may be connected to the processor (e.g., an image signal processor (ISP), an application
processor (AP)) included in the electronic device 100.
[0049] According to an embodiment, the movable portion of the sensor PCB 252 may include
the first portion 612, the second portion 614, and the third portion 616. As the first
portion 612 flexibly moves or shakes, the image sensor 250 may move in the y-axis
direction. As the second portion 614 flexibly moves or shakes, the image sensor 250
may move in the x-axis direction. As the third portion 616 flexibly moves or shakes,
the image sensor 250 may move in the z-axis direction. According to an embodiment,
since the sensor PCB 252 includes the first portion 612, the second portion 614, and
the third portion 616 which may be flexibly shaken, the camera module 200 may perform
the sensor shift AF and the sensor shift OIS using the movement of the image sensor
250.
[0050] According to an embodiment, the sensor PCB 252 may include the first stiffener 622
and the second stiffener 624. The first stiffener 622 may be disposed between the
first portion 612 and the second portion 614, and the second stiffener 624 may be
disposed between the second portion 614 and the third portion 616. The sensor PCB
252 may be shaken in the x, y, and z axes, and maintain a stable form by means of
the first stiffener 622 and the second stiffener 624.
[0051] Referring to FIG. 6, the image sensor 250 is illustrated as being disposed on the
sensor PCB 252 which may be shaken in three axes, but this is only an example, and
various other embodiments are possible. For example, in a camera module which performs
the AF using the lens shift scheme and performs the OIS using the sensor shift scheme,
the movable portion included in the sensor PCB may be configured in only two axes.
[0052] FIG. 7 illustrates a camera module when viewed from an optical axis direction according
to an embodiment.
[0053] According to an embodiment, the camera module 200 may control the current applied
to the AF coil 268 to move the image sensor 250 in a direction substantially parallel
to the optical axis. The camera module 200 may perform the AF function by moving the
image sensor 250 in the direction substantially parallel to the optical axis.
[0054] According to an embodiment, the camera module 200 may control the current applied
to the x-axis OIS coil 266 to move the image sensor 250 in a direction (e.g., the
+x/-x direction) substantially perpendicular to the optical axis. For example, the
driving circuit of the camera module 200 may control the current applied to the x-axis
OIS coil 266, and the OIS carrier 240 may be moved by electromagnetic interaction
between the x-axis OIS coil 266 and the x-axis OIS magnet 246 in the direction (e.g.,
the +x/-x direction) substantially perpendicular to the optical axis. The driving
circuit may perform the OIS by moving the OIS carrier 240 and the image sensor 250
in the direction (e.g., the +x/-x direction) substantially perpendicular to the optical
axis.
[0055] According to an embodiment, the camera module 200 may control the current applied
to the first OIS coil 262 and the second OIS coil 264 to move the image sensor 250
on a plane substantially perpendicular to the optical axis (e.g., the z-axis). For
example, the driving circuit of the camera module 200 may control the currents applied
to the first OIS coil 262 and the second OIS coil 264, and the OIS carrier 240 may
be moved by electromagnetic interaction between the first OIS coil 262 and the first
OIS magnet 242 and electromagnetic interaction between the second OIS coil 264 and
the second OIS magnet 244 on the plane substantially perpendicular to the optical
axis.
[0056] According to an embodiment, the driving circuit of the camera module 200 may control
the first current applied to the first OIS coil 262 and the second current applied
to the second OIS coil 264, and thus perform the OIS by moving the image sensor 250
in a direction (e.g., the +y/-y direction) substantially perpendicular to the optical
axis. In addition, the driving circuit of the camera module 200 may control the first
current applied to the first OIS coil 262 and the second current applied to the second
OIS coil 264, and thus perform the roll rotation correction of the image sensor 250
by rotating the image sensor 250 on a plane (e.g., an xy plane) substantially perpendicular
to the optical axis.
[0057] Referring to FIG. 4 and FIG. 7, the electronic device 100 (or the camera module 200)
may perform the OIS and/or the roll rotation correction using result values of the
first OIS position sensor 282 and the second OIS position sensor 284.
[0058] According to an embodiment, the camera module 200 may perform the OIS using a sum
or average value of a first sensing value of the first OIS position sensor 282 and
a second sensing value of the second OIS position sensor 284. The camera module 200
may identify the position of the image sensor 250 on the y-axis based on the sum value
of the first sensing value and the second sensing value, or the average value of the
first sensing value and the second sensing value, and perform the OIS based on the
position of the image sensor 250 on the y-axis.
[0059] According to an embodiment, the camera module 200 may perform the roll rotation correction
using a difference of the first sensing value of the first OIS position sensor 282
and the second sensing value of the second OIS position sensor 284. The camera module
200 may identify whether the image sensor 250 rotates in the roll direction based
on the difference value of the first sensing value and the second sensing value, and
perform the roll rotation correction of the image sensor 250 if determining the roll
rotation of the image sensor 250. For example, if the difference of the first sensing
value and the second sensing value is greater than or equal to a threshold value,
the camera module 200 may determine that the roll rotation correction of the image
sensor 250 is required.
[0060] The camera module (e.g., the first camera module 111) according to an embodiment
may include an image sensor (e.g., the image sensor 250), an OIS carrier (e.g., the
OIS carrier 240) coupled to the image sensor to move the image sensor on a plane perpendicular
to an optical axis, a housing (e.g., the housing 210) for accommodating the image
sensor and the OIS carrier, an OIS magnet (e.g., the first OIS magnet 242) fixed to
a first side of the OIS carrier, a first OIS coil (e.g., the first OIS coil 262) and
a second OIS coil (e.g., the second OIS coil 264) fixed to a first inner surface of
the housing to face the OIS magnet, the first OIS coil and the second OIS coil disposed
side by side on the first inner surface along a direction perpendicular to the optical
axis, and a driving circuit electrically connected to the first OIS coil and the second
OIS coil. The driving circuit may control a first current applied to the first OIS
coil and a second current applied to the second OIS coil to perform OIS by moving
the image sensor in a direction perpendicular to the optical axis, and to perform
roll rotation correction of the image sensor by rotating the image sensor on a plane
perpendicular to the optical axis.
[0061] In the camera module according to an embodiment, the OIS magnet may include a first
OIS magnet and a second OIS magnet, the first OIS coil may face the first OIS magnet,
and the second OIS coil may face the second OIS magnet.
[0062] In the camera module according to an embodiment, the first OIS magnet and the second
OIS magnet may correspond to the same polarity, and the driving circuit may perform
the OIS by controlling the first current and the second current to point the same
direction, and perform the roll rotation correction by controlling the first current
and the second current to point opposite directions.
[0063] In the camera module according to an embodiment, the first OIS magnet and the second
OIS magnet may correspond to different polarities, and the driving circuit may perform
the OIS by controlling the first current and the second current to point opposite
directions, and perform the roll rotation correction by controlling the first current
and the second current to point the same direction.
[0064] The camera module according to an embodiment may further include a first OIS position
sensor disposed around the first OIS coil, and a second OIS position sensor disposed
around the second OIS coil, and the driving circuit may identify a position of the
image sensor through at least a part of a first sensing value of the first OIS position
sensor and a second sensing value of the second OIS position sensor.
[0065] In the camera module according to an embodiment, the driving circuit may perform
the OIS using at least one of a sum value of the first sensing value and the second
sensing value, or an average value of the first sensing value and the second sensing
value.
[0066] In the camera module according to an embodiment, the driving circuit may perform
the roll rotation correction using a difference value between the first sensing value
and the second sensing value.
[0067] The camera module according to an embodiment may further include an AF carrier for
accommodating the OIS carrier and received in the housing, an AF magnet fixed to a
side of the AF carrier, and an AF coil fixed to a second inner surface of the housing
to face the AF magnet. The driving circuit may perform AF by controlling a current
applied to the AF coil to move the image sensor in a direction parallel to the optical
axis.
[0068] In the camera module according to an embodiment, the optical axis may be a first
optical axis, and may further include a first reflector for changing light incident
on the camera module into a second optical axis substantially perpendicular to the
first optical axis, to be substantially parallel to the first optical axis, and a
second reflector for changing the light changed into the second optical axis to the
first optical axis.
[0069] In the camera module according to an embodiment, the first reflector and the second
reflector may be secured to the housing.
[0070] An electronic device module according to an embodiment may include an image sensor,
an OIS carrier coupled to the image sensor to move the image sensor on a plane perpendicular
to an optical axis, a housing for accommodating the image sensor and the OIS carrier,
an OIS magnet fixed to a first side of the OIS carrier, a first OIS coil and a second
OIS coil fixed to a first inner surface of the housing to face the OIS magnet, the
first OIS coil and the second OIS coil disposed side by side on the first inner surface
along a direction perpendicular to the optical axis, and at least one processor electrically
connected to the first OIS coil and the second OIS coil. The at least one processor
may control a first current applied to the first OIS coil and a second current applied
to the second OIS coil to perform OIS by moving the image sensor in a direction perpendicular
to the optical axis, and to perform roll rotation correction of the image sensor by
rotating the image sensor on a plane perpendicular to the optical axis.
[0071] In the electronic device according to an embodiment, the OIS magnet may include a
first OIS magnet and a second OIS magnet, the first OIS coil may face the first OIS
magnet, and the second OIS coil may face the second OIS magnet.
[0072] In the electronic device according to an embodiment, the first OIS magnet and the
second OIS magnet may correspond to the same polarity, and the at least one processor
may perform the OIS by controlling the first current and the second current to point
the same direction, and perform the roll rotation correction by controlling the first
current and the second current to point opposite directions.
[0073] In the electronic device according to an embodiment, the first OIS magnet and the
second OIS magnet may correspond to different polarities, and the at least one processor
may perform the OIS by controlling the first current and the second current to point
opposite directions, and perform the roll rotation correction by controlling the first
current and the second current to point the same direction.
[0074] The electronic device according to an embodiment may further include a first OIS
position sensor disposed around the first OIS coil, and a second OIS position sensor
disposed around the second OIS coil, and the at least one processor may identify a
position of the image sensor through at least a part of a first sensing value of the
first OIS position sensor and a second sensing value of the second OIS position sensor.
[0075] In the electronic device according to an embodiment, the at least one processor may
perform the OIS using at least one of a sum value of the first sensing value and the
second sensing value, or an average value of the first sensing value and the second
sensing value.
[0076] In the electronic device according to an embodiment, the at least one processor may
perform the roll rotation correction using a difference value between the first sensing
value and the second sensing value.
[0077] The electronic device according to an embodiment may further include an AF carrier
for accommodating the OIS carrier and received in the housing, an AF magnet fixed
to a side of the AF carrier, and an AF coil fixed to a second inner surface of the
housing to face the AF magnet. The at least one processor may perform AF by controlling
a current applied to the AF coil to move the image sensor in a direction parallel
to the optical axis.
[0078] In the electronic device according to an embodiment, the optical axis may be a first
optical axis, and may further include a first reflector for changing light incident
on the camera module into a second optical axis substantially perpendicular to the
first optical axis, to be substantially parallel to the first optical axis, and a
second reflector for changing the light changed into the second optical axis to the
first optical axis.
[0079] In the electronic device according to an embodiment, the first reflector and the
second reflector may be secured to the housing.
[0080] FIG. 8 is a block diagram of an electronic device 801 in a network environment 800
according to various embodiments. Referring to FIG. 8, the electronic device 801 in
the network environment 800 may communicate with an electronic device 802 over a first
network 898 (e.g., a short-range wireless communication network), or may communicate
with at least one of an electronic device 804 or a server 808 over a second network
899 (e.g., a long-range wireless communication network). According to an embodiment,
the electronic device 801 may communicate with the electronic device 804 via the server
808. According to an embodiment, the electronic device 801 may include a processor
820, a memory 830, an input module 850, an audio output module 855, a display module
860, an audio module 870, a sensor module 876, an interface 877, a connection terminal
878, a haptic module 879, a camera module 880, a power management module 888, a battery
889, a communication module 890, a subscriber identification module 896, or an antenna
module 897. In an embodiment, at least one (e.g., the connection terminal 878) of
the components may be omitted, or one or more other components may be added, in the
electronic device 801. In an embodiment, some (e.g., the sensor module 876, the camera
module 880, or the antenna module 897) of the components may be integrated into a
single component (e.g., the display module 860).
[0081] The processor 820 may, for example, execute software (e.g., a program 840) to thus
control at least one other component (e.g., a hardware or software component) of the
electronic device 801 coupled to the processor 820, and perform various data processing
or computations. According to an embodiment, as at least a part of the data processing
or computation, the processor 820 may store a command or data received from other
component (e.g., the sensor module 876 or the communication module 890) in a volatile
memory 832, process the command or the data stored in the volatile memory 832, and
store resulting data in a non-volatile memory 834. According to an embodiment, the
processor 820 may include a main processor 821 (e.g., a central processing device
or an AP) or an auxiliary processor 823 (e.g., a graphics processing device, a neural
processing unit (NPU), an image signal processor, a sensor hub processor, or a communication
processor) for operating independently from or in conjunction with it. For example,
if the electronic device 801 includes the main processor 821 and the auxiliary processor
823, the auxiliary processor 823 may be configured to use lower power than the main
processor 821, or to be specific for a designated function. The auxiliary processor
823 may be implemented as separately from, or as a part of the main processor 821.
[0082] The auxiliary processor 823 may control at least some of functions or states related
to at least one component (e.g., the display module 860, the sensor module 876, or
the communication module 890) of the components of the electronic device 801, for
example, instead of the main processor 821 while the main processor 821 is in an inactive
(e.g., sleeping) state, or together with the main processor 821 while the main processor
821 is in an active state (e.g., executing an application). According to an embodiment,
the auxiliary processor 823 (e.g., an image signaling processor or a communication
processor) may be implemented as a part of other component (e.g., the camera module
880 or the communication module 890) functionally related. According to an embodiment,
the auxiliary processor 823 (e.g., the NPU) may include a hardware structure specified
for artificial intelligence model processing. An artificial intelligence model may
be generated through machine learning. Such learning may be performed, for example,
by the electronic device 801 where the artificial intelligence is conducted, or via
a separate server (e.g., the server 808). A learning algorithm may include, but not
limited to, for example, supervised learning, unsupervised learning, semi-supervised
learning or reinforcement learning. The artificial intelligence model may include
a plurality of artificial neural network layers. The artificial neural network may
be a deep neural network (DNN), a convolutional neural network (CNN), a recurrent
neural network (RNN), a restricted Boltzmann machine (RBM), a deep belief network
(DBN), a bidirectional recurrent deep neural network (BRDNN), deep Q-networks or a
combination of two or more of them, but is not limited thereto. The artificial intelligence
model may, additionally or alternatively, include a software structure, in addition
to the hardware structure.
[0083] The memory 830 may store various data used by at least one component (e.g., the processor
820 or the sensor module 876) of the electronic device 801. The data may include,
for example, software (e.g., the program 840), and input data or output data for a
command related thereto. The memory 830 may include the volatile memory 832 or the
non-volatile memory 834.
[0084] The program 840 may be stored as software in the memory 830, and may include, for
example, an operating system 842, middleware 844 or an application 846.
[0085] The input module 850 may receive a command or data to be used by the component (e.g.,
the processor 820) of the electronic device 801 from outside (e.g., a user) of the
electronic device 801. The input module 850 may include, for example, a microphone,
a mouse, a keyboard, a key (e.g., a button), or a digital pen (e.g., a stylus pen).
[0086] The audio output module 855 may output a sound signal to the outside of the electronic
device 801. The audio output module 855 may include, for example, a speaker or a receiver.
The speaker may be used for a general use such as multimedia playing or record playing.
The receiver may be used to receive an incoming call. According to an embodiment,
the receiver may be implemented separately from, or as a part of the speaker.
[0087] The display module 860 may visually provide information to the outside (e.g., the
user) of the electronic device 801. The display module 860 may include, for example,
a display, a hologram device, or a projector and control circuitry for controlling
a corresponding device. According to an embodiment, the display module 860 may include
a touch sensor configured to detect a touch, or a pressure sensor configured to measure
an intensity of a force generated by the touch.
[0088] The audio module 870 may convert a sound into an electrical signal, or convert an
electrical signal into a sound. According to an embodiment, the audio module 870 may
obtain the sound via the input module 850, or output the sound via the audio output
module 855, or an external electronic device (e.g., the electronic device 802) (e.g.,
a speaker or a headphone) directly or wirelessly connected with the electronic device
801.
[0089] The sensor module 876 may detect an operation state (e.g., a power or a temperature)
of the electronic device 801, or an external environment state (e.g., a user state),
and generate an electrical signal or a data value corresponding to the detected state.
According to an embodiment, the sensor module 876 may include, for example, a gesture
sensor, a gyro sensor, a barometric sensor, a magnetic sensor, an acceleration sensor,
a grip sensor, a proximity sensor, a color sensor, an infrared (IR) sensor, a biosensor,
a temperature sensor, a humidity sensor, or an illuminance sensor.
[0090] The interface 877 may support one or more designated protocols to be used for the
electronic device 801 to connect with the external electronic device (e.g., the electronic
device 802) directly or wirelessly. According to an embodiment, the interface 877
may include, for example, a high definition multimedia interface (HDMI), a universal
serial bus (USB) interface, a secure digital (SD) card interface, or an audio interface.
[0091] The connection terminal 878 may include a connector for physically connecting the
electronic device 801 with the external electronic device (e.g., the electronic device
802). According to an embodiment, the connection terminal 878 may include, for example,
an HDMI connector, a USB connector, an SD card connector, or an audio connector (e.g.,
a headphone connector).
[0092] The haptic module 879 may convert an electrical signal into a mechanical stimulus
(e.g., a vibration or a motion) or an electrical stimulus to be recognized by the
user through tactile sensation or kinesthetic sensation. According to an embodiment,
the haptic module 879 may include, for example, a motor, a piezoelectric element,
or an electric stimulator.
[0093] The camera module 880 may capture a still image or moving images. According to an
embodiment, the camera module 880 may include one or more lenses, image sensors, image
signal processors, or flashes.
[0094] The power management module 888 may manage power supplied to the electronic device
801. According to an embodiment, the power management module 888 may be implemented
as at least a part of, for example, a power management integrated circuit (PMIC).
[0095] The battery 889 may supply the power to at least one component of the electronic
device 801. According to an embodiment, the battery 889 may include, for example,
a primary cell which is not rechargeable, a secondary cell which is rechargeable or
a fuel cell.
[0096] The communication module 890 may support establishment of a direct (e.g., wired)
communication channel or a wireless communication channel between the electronic device
801 and the external electronic device (e.g., the electronic device 802, the electronic
device 804, or the server 808), and communication over the established communication
channel. The communication module 890 may include one or more communication processors
operated independently from the processor 820 (e.g., the application processor), and
supporting the direct (e.g., wired) communication or the wireless communication. According
to an embodiment, the communication module 890 may include a wireless communication
module 892 (e.g., a cellular communication module, a short-range wireless communication
module, or a GNSS communication module) or a wired communication module 894 (e.g.,
a local region network (LAN) communication module, or a power line communication module).
A corresponding communication module of these communication modules may communicate
with the external electronic device 804 via the first network 898 (e.g., a short-range
communication network such as Bluetooth, wireless-fidelity (Wi-Fi) direct, or infrared
data association (IrDA)) or the second network 899 (e.g., a long-range communication
network such as a legacy cellular network, a 5th (5G) network, a next-generation communication
network, Internet, or a computer network (e.g., a LAN or a wide area network (WAN)).
These various communication modules may be integrated as a single component (e.g.,
a single chip), or may be implemented as a plurality of separate components (e.g.,
multiple chips). The wireless communication module 892 may identify and authenticate
the electronic device 801 in the communication network such as the first network 898
or the second network 899 using subscriber information (e.g., international mobile
subscriber identity (IMSI)) stored in the subscriber identification module 896.
[0097] The wireless communication module 892 may support a 5G network after a 4G network
and a next-generation communication technology, for example, a new radio (NR) access
technology. The NR access technology may support high-speed transmission of high-capacity
data (enhanced mobile broadband (eMBB)), minimization of terminal power and connection
of multiple terminals (massive machine type communications (mMTC)), or high reliability
and low latency (ultra-reliable and low-latency communications (URLLC)). The wireless
communication module 892 may support, for example, a high-frequency band (e.g., millimeter
waves (mmWave) band), to achieve a high data transmission rate. The wireless communication
module 892 may support various technologies for securing performance in the high-frequency
band, for example, techniques such as beamforming, massive multiple-input and multiple-output
(MIMO), full dimensional (FD)-MIMO, an array antenna, analog beamforming, or a large
scale antenna. The wireless communication module 892 may support various requirements
specified in the electronic device 801, the external electronic device (e.g., the
electronic device 804), or a network system (e.g., the second network 899). According
to an embodiment, the wireless communication module 892 may support a peak data rate
(e.g., 20 Gbps or more) for realizing the eMBB, loss coverage (e.g., 164 dB or smaller)
for realizing the mMTC, or U-plane latency (e.g., 0.5 ms or smaller for each of downlink
(DL) and uplink (UL), or 1 ms or smaller for round trip) for realizing the URLLC.
[0098] The antenna module 897 may transmit or receive a signal or power to or from the outside
(e.g., the external electronic device). According to an embodiment, the antenna module
897 may include an antenna including a radiator formed of a conductor or a conductive
pattern formed on a substrate (e.g., a PCB). According to an embodiment, the antenna
module 897 may include a plurality of antennas (e.g., array antennas). In this case,
at least one antenna appropriate for a communication scheme used in the communication
network such as the first network 898 or the second network 899 may be selected, for
example, by the communication module 890 from the plurality of the antennas. The signal
or the power may be transmitted or received between the communication module 890 and
the external electronic device via the at least one antenna selected. According to
some embodiment, other component (e.g., a radio frequency integrated circuit (RFIC))
than the radiator may be additionally formed as a part of the antenna module 897.
[0099] According to various embodiments, the antenna module 897 may form an mmWave antenna
module. According to an embodiment, the mmWave antenna module may include a PCB, an
RFIC disposed on or adjacent to a first surface (e.g., a bottom surface) of the PCB
and supporting a designated high frequency band (e.g., the mmWave band), and a plurality
of antennas (e.g., array antennas) disposed on or adjacent to a second surface (e.g.,
a top surface or a side surface) of the PCB and transmitting or receiving signals
of the designated high frequency band.
[0100] At least some of the components may be connected to each other through an inter-peripheral
communication scheme (e.g., a bus, general purpose input and output (GPIO), serial
peripheral interface (SPI), or mobile industry processor interface (MIPI)) and exchange
signals (e.g., commands or data) therebetween.
[0101] According to an embodiment, a command or data may be transmitted or received between
the electronic device 801 and the external electronic device 804 via the server 808
connected to the second network 899. The external electronic device 802 or 804 may
be a device of the same or different type as or from the electronic device 801. According
to an embodiment, all or some of operations executed at the electronic device 801
may be carried out at one or more of the external electronic devices 802, 804, or
808. For example, if the electronic device 801 needs to perform a function or a service
automatically, or in response to a request from the user or other device, the electronic
device 801 may request one or more external electronic devices to perform at least
a part of the function or the service, instead of or in addition to executing the
function or the service. The one or more external electronic devices receiving the
request may perform at least a part of the function or the service requested, or an
additional function or service related to the request, and provide a result of the
execution to the electronic device 801. The electronic device 801 may provide the
result as at least a part of a response to the request, without or with further processing
of the result. For doing so, for example, cloud computing, distributed computing,
mobile edge computing (MEC), or client-server computing technology may be used. The
electronic device 801 may provide an ultra-low delay service using, for example, the
distributed computing or the MEC. In an embodiment, the external electronic device
804 may include an Internet of things (IoT) device. The server 808 may be an intelligent
server using the machine learning and/or a neural network. According to an embodiment,
the external electronic device 804 or the server 808 may be included in the second
network 899. The electronic device 801 may be applied to an intelligent service (e.g.,
smart home, smart city, smart car, or healthcare) based on a 5G communication technology
and an IoT-related technology.
[0102] The electronic device according to various embodiments disclosed in the disclosure
may be a device of various types. The electronic device may include, for example,
a portable communication device (e.g., a smartphone), a computer device, a portable
multimedia device, a portable medical device, a camera, a wearable device, or a home
appliance. The electronic device according to an embodiment of the disclosure is not
limited to the devices described above.
[0103] It should be appreciated that various embodiments of the disclosure and the terms
used therein are not intended to limit technological features disclosed in this document
to particular embodiments, and embrace various modifications, equivalents, or alternatives
of a corresponding embodiment. With respect to the descriptions of the drawings, similar
reference numerals may be used for similar or related elements. A singular form of
a noun corresponding to an item may include one or more of the items, unless the relevant
context clearly indicates otherwise. As used herein, each of such phrases as "A or
B", "at least one of A and B", "at least one of A or B", "A, B, or C", "at least one
of A, B, and C", and "at least one of A, B, or C", may include one, or all possible
combinations of the items enumerated together in a corresponding one of the phrases.
Such terms as "1st" and "2nd", or "first" and "second" may be used to simply distinguish
a corresponding component from another, and do not limit the corresponding components
in other aspect (e.g., importance or order). If an element (e.g., a first element)
is referred to, with or without the term "operatively" or "communicatively", as "coupled"
or "connected" to another element (e.g., a second element), it means that the element
may be coupled with the other element directly (e.g., wiredly), wirelessly, or via
a third element.
[0104] The term "module" used in various embodiments of the disclosure may include a unit
implemented in hardware, software or firmware, and may be interchangeably used with
a term, for example, logic, a logic block, a part, or circuitry. The module may be
a single integral component, or a minimum unit or part thereof, for performing one
or more functions. For example, according to an embodiment, the module may be implemented
in a form of an application-specific integrated circuit (ASIC).
[0105] Various embodiments of the disclosure may be implemented as software (e.g., the program
840) including one or more instructions which are stored in a storage medium (e.g.,
the internal memory 836 or the external memory 838) readable by a machine (e.g., the
electronic device 801). For example, a processor (e.g., the processor 820) of the
machine (e.g., the electronic device 801) may invoke at least one of the one or more
instructions stored in the storage medium, and execute it or them. This allows the
machine to be operated to perform at least one function according to the at least
one instruction invoked. The one or more instructions may include a code generated
by a complier or a code executable by an interpreter. The machine-readable storage
medium may be provided in the form of a non-transitory storage medium. Herein, 'non-transitory'
simply means that the storage medium is a tangible device, and does not include a
signal (e.g., an electromagnetic wave), but this term does not differentiate between
a case where data is semi-permanently stored in the storage medium and a case where
the data is temporarily stored.
[0106] According to an embodiment, a method according to various embodiments of the disclosure
may be included and provided in a computer program product. The computer program product
may be traded as a product between a seller and a buyer. The computer program product
may be distributed in the form of a machine-readable storage medium (e.g., a compact
disc read only memory (CD-ROM)), or may be distributed (e.g., downloaded or uploaded)
directly or online via an application store (e.g., Play Store
™) or between two user devices (e.g., smart phones). In the online distribution, at
least a part of the computer program product may be temporarily stored in the machine-readable
storage medium such as a memory of a manufacturer's server, an application store server,
or a relay server, or may be temporarily generated.
[0107] According to various embodiments, each component (e.g., a module or a program) of
the above-described components may include a single entity or multiple entities, and
some of the multiple entities may be separately deployed in different components.
According to various embodiments, one or more components or operations of the above-described
components may be omitted, or one or more other components or operations may be added.
Alternatively or additionally, a plurality of components (e.g., modules or programs)
may be integrated as a single component. In this case, the integrated component may
perform one or more functions of each component of the plurality of the components
in the same or similar manner as they are performed by a corresponding component of
the plurality of the components before the integration. According to various embodiments,
operations performed by the module, the program or other component may be carried
out sequentially, in parallel, repeatedly, or heuristically, one or more of the operations
may be executed in a different order or omitted, or one or more other operations may
be added.
[0108] FIG. 9 is a block diagram 900 illustrating a camera module 880 according to various
embodiments. Referring to FIG. 9, the camera module 880 may include a lens assembly
910, a flash 920, an image sensor 930, an image stabilizer 940, a memory 950 (e.g.,
a buffer memory), or an image signal processor 960. The lens assembly 910 may collect
light emitted from a subject to be captured for an image. The lens assembly 910 may
include one or more lenses. According to an embodiment, the camera module 880 may
include a plurality of lens assemblies 910. In this case, the camera module 880 may
form, for example, a dual camera, a 360-degree camera, or a spherical camera. Some
of the plurality of the lens assemblies 910 may have the same lens properties (e.g.,
an angle of view, a focal length, autofocus, an f number, or optical zoom), or at
least one lens assembly may have one or more lens properties different from the lens
properties of the other lens assemblies. The lens assembly 910 may include, for example,
a wide angle lens or a tele lens.
[0109] The flash 920 may emit light used to enhance the light emitted or reflected from
the subject. According to an embodiment, the flash 920 may include one or more light
emitting diodes (e.g., a red-green-blue (RGB) light emitting diode (LED), a white
LED, an infrared LED, or an ultraviolet LED), or a xenon lamp. The image sensor 930
may convert the light emitted or reflected from the subject and transmitted through
the lens assembly 910 into an electrical signal, and thus acquire an image corresponding
to the subject. According to an embodiment, the image sensor 930 may include one image
sensor selected from image sensors having different properties, for example, an RGB
sensor, a black and white (BW) sensor, an IR sensor, or an ultraviolet (UV) sensor,
a plurality of image sensors having the same properties, or a plurality of image sensors
having different properties. The image sensors included in the image sensor 930 each
may be implemented using, for example, a CCD sensor or a CMOS sensor.
[0110] The image stabilizer 940 may, in response to a movement of the camera module 880
or the electronic device (e.g., the electronic device 801 of FIG. 9) including the
same, move at least one lens or the image sensor 930 included in the lens assembly
in a specific direction or control an operational attribute of the image sensor 930
(e.g., adjust a read-out timing). This allows to compensate for at least a part of
a negative effect by the movement on the captured image. According to an embodiment,
the image stabilizer 940 may detect such a movement of the camera module 880 or the
electronic device 801 using a gyro sensor (not shown) or an acceleration sensor (not
shown) disposed inside or outside the camera module 880, according to an embodiment.
According to an embodiment, the image stabilizer 940 may be implemented with, for
example, an optical image stabilizer. The memory 950 may at least temporarily store
at least a part of the image obtained through the image sensor 930 for a subsequent
image processing task. For example, if the image acquisition is delayed due to shutter
lag or multiple images are captured quickly, a raw image acquired (e.g., a Bayer-patterned
image or a high-resolution image) may be stored in the memory 950, and its corresponding
copy image (e.g., a low-resolution image) may be previewed through the display module
860. Next, if a designated condition is satisfied (e.g., a user input or a system
command), at least a part of the raw image stored in the memory 950 may be obtained
and processed, for example, by the image signal processor 960. According to an embodiment,
the memory 950 may be configured as at least a part of the memory 950, or as a separate
memory operated independently.
[0111] The image signal processor 960 may perform one or more image processing on an image
obtained through the image sensor 930 or an image stored in the memory 950. The one
or more image processing may include, for example, depth map generation, 3D modeling,
panorama generation, feature point extraction, image synthesizing, or image compensation
(e.g., noise reduction, resolution adjustment, brightness adjustment, blurring, sharpening,
or softening). Additionally or alternatively, the image signal processor 960 may control
(e.g., control exposure time, or control read-out timing) at least one (e.g., the
image sensor 930) of the components included in the camera module 880. The image processed
by the image signal processor 960 may be stored back in the memory 950 for further
processing, or may be provided to an external component (e.g., the memory 830, the
display module 860, the electronic device 802, the electronic device 804, or the server
808) of the camera module 880. According to an embodiment, the image signal processor
960 may be configured as at least a part of the processor 820, or as a separate processor
operated independently from the processor 820. If the image signal processor 960 is
configured as the separate processor from the processor 820, at least one image processed
by the image signal processor 960 may be displayed on the display module 860 as it
is or after further image processing by the processor 820.
[0112] According to an embodiment, the electronic device 801 may include a plurality of
camera modules 880 each having different properties or capabilities. In this case,
for example, at least one of the plurality of the camera modules 880 may be a wide
camera, and at least another one may be a tele camera. Similarly, at least one of
the plurality of the camera modules 880 may be a front camera, and at least another
one may be a rear camera.