BACKGROUND OF THE INVENTION
1. Field of the Invention
[0001] Apparatuses and methods consistent with the present invention relate to improving
image quality.
2. Description of the Related Art
[0002] As technology for processing image signals has developed, the quality of images provided
to users have improved. Movie judder cancellation (MJC) is one technique to improve
the image quality of movie-image.
[0003] MJC can effectively reduce judder generated when a movie-image is reproduced. However,
if MJC for the movie-image is performed, the movie-image appears broken, particularly
when the movie-image has large amounts of movement.
[0004] Therefore, there is a need for methods to reduce judder in a movie-image by performing
MJC on the movie-image without the image becoming broken.
SUMMARY OF THE INVENTION
[0005] Exemplary embodiments of the present invention address at least the above problems
and/or disadvantages and other disadvantages not described above. Also, the present
invention is not required to overcome the disadvantages described above, and an exemplary
embodiment of the present invention may not overcome any of the problems described
above.
[0006] An aspect of the present invention provides a method for improving the image quality
by adaptively processing image signals relating to improving the image quality based
on the amount of movement of an input movie-image, so that MJC is performed on the
movie-image without breaking the image, and an image signal processing apparatus and
an AV device using the same.
[0007] According to an aspect of the present invention, there is provided a method for improving
image quality, the method including detecting the amount of movement in an input movie-frame,
and adaptively processing improvement of the image quality of the input movie-frame
based on the detected amount of movement.
[0008] Suitably, in processing improvement of the image quality, movie judder cancellation
(MJC) of the input movie-frame is performed based on the detected amount of movement.
[0009] Suitably, in processing improvement of the image quality, if the detected amount
of movement is higher than a first threshold value and lower than a second threshold
value, MJC performance level is changed according to the amount of movement.
[0010] Suitably, in processing improvement of the image quality, if the detected amount
of movement is higher than the first threshold value and lower than the second threshold
value, the MJC performance level is inversely proportional to the amount of movement.
[0011] Suitably, in processing improvement of the image quality, if the detected amount
of movement is lower than the first threshold value, the MJC performance level is
maximized, and if the detected amount of movement is higher than the second threshold
value, the MJC performance level is minimized. Suitably, the amount of movement includes
at least one of the sum of absolute difference (SAD) of the input movie-frame, and
the size of a motion vector of the input movie-frame.
[0012] According to an exemplary aspect of the present invention, there is provided an apparatus
to improve image quality, including a detection unit which detects amount of movement
of an input movie-frame, and an image quality improving unit which adaptively processes
improvement of the image quality of the input movie-frame based on the amount of movement
detected by the detection unit.
[0013] Suitably, the image quality improving unit performs movie judder cancellation (MJC)
of the input movie-frame based on the detected amount of movement.
[0014] Suitably, if the detected amount of movement is higher than a first threshold value
and lower than a second threshold value, the image quality improving unit changes
the MJC performance level according to the amount of movement.
[0015] Suitably, if the detected amount of movement is higher than the first threshold value
and lower than the second threshold value, the image quality improving unit causes
the MJC performance level to be inversely proportional to the amount of movement.
[0016] Suitably, if the detected amount of movement is lower than the first threshold value,
the image quality improving unit maximizes the MJC performance level, and if the detected
amount of movement is higher than the second threshold value, the image quality improving
unit minimizes the MJC performance level.
[0017] Suitably, the amount of movement includes at least one of the sum of absolute difference
(SAD) of the input movie-frame, and the size of a motion vector of the input movie-frame.
[0018] According to an exemplary aspect of the present invention, there is provided an image
signal processing apparatus which processes images, the apparatus including a detection
unit which detects amount of movement of an input movie-frame, and an image quality
improving unit which adaptively processes improvement of image quality of the input
movie-frame based on the amount of movement detected by the detection unit.
[0019] According to an exemplary aspect of the present invention, there is provided an audio
video (AV) device which processes images and provides users the images, including
a detection unit which detects amount of movement of an input movie-frame, and an
image quality improving unit which adaptively processes improvement of image quality
of the input movie-frame based on the amount of movement detected by the detection
unit.
BRIEF DESCRIPTION OF THE DRAWINGS
[0020] The present invention will be more apparent by describing certain exemplary embodiments
of the present invention with reference to the accompanying drawings, in which:
[0021] FIG. 1 is a block diagram of an image signal processing apparatus according to an
exemplary embodiment of the present invention;
[0022] FIG. 2 is a detailed block diagram of an adaptive MJC unit 120 shown in FIG. 1;
[0023] FIG. 3A is a graph used to calculate F
SAD;
[0024] FIG. 3B is a graph used to calculate F
MV;
[0025] FIG. 3C is a graph used to determine the amount of MJC performance;
[0026] FIG. 4 is a flow chart to illustrate the process of processing an image signal of
the image signal processing apparatus shown in FIG. 1; and
[0027] FIG. 5 is a block diagram of an AV device according to another exemplary embodiment
of the present invention.
DETAILED DESCRIPTION OF EXEMPLARY EMBODIMENTS OF THE INVENTION
[0028] Certain exemplary embodiments of the present invention will now be described in greater
detail with reference to the accompanying drawings.
[0029] In the following description, like drawing reference numerals are used for like elements,
even in different drawings. The matters defined in the description, such as detailed
construction and elements, are provided to assist in a comprehensive understanding
of the invention. However, the present invention can be practiced without those specifically
defined matters. Also, well-known functions or constructions are not described in
detail since they would obscure the invention with unnecessary detail.
[0030] FIG. 1 is a block diagram of an image signal processing apparatus according to an
exemplary embodiment of the present invention. The image signal processing apparatus
is an apparatus which performs processing of input signals, such as deinterlacing
and scaling.
[0031] While processing an image signal, the image signal processing apparatus performs
movie judder cancellation (MJC) on a movie-image to improve the image quality of the
movie-image. To this end, the image signal processing apparatus adaptively performs
MJC based on the amount of movement of the movie-image.
[0032] The image signal processing apparatus includes a film mode detection (FMD) unit 110,
an adaptive MJC unit 120, a deinterlacing unit 130, and a scaling unit 140.
[0033] The FMD unit 110 determines a mode of an input image. In more detail, the FMD unit
110 determines the mode of an input image by calculating the number of frames per
second of the input image. If the frame rate is 24, the FMD unit 110 determines that
the input image has film mode, that is, it is a movie-image.
[0034] The FMD unit 110 outputs the image to the adaptive MJC unit 120 or the deinterlacing
unit 130 according to the mode. More specifically, if the input image is a movie-image,
the FMD unit 110 outputs the input image to the adaptive MJC unit 120. If the input
image is not a movie-image, the FMD unit 110 outputs the input image to the deinterlacing
unit 130.
[0035] The adaptive MJC unit 120 carries out MJC on the movie-image received from the FMD
unit 110 to improve the image quality. This process is described in detail with reference
to FIG. 2. FIG. 2 is a detailed block diagram of the adaptive MJC unit 120 shown in
FIG. 1.
[0036] As shown in FIG. 2, the adaptive MJC unit 120 includes a movement amount detection
unit 121, a factor calculation unit 125, and a MJC performing unit 129.
[0037] The movement amount detection unit 121 detects the amount of movement in each frame
of the movie-image received from the FMD unit 110. The movement amount detection unit
121 includes a ΣSAD (sum of absolute difference) detection unit 121-1, and a motion
vector (MV) detection unit 121-2.
[0038] The ΣSAD detection unit 121-1 detects ΣSAD of a movie-frame as the amount of movement
of an input movie-frame (referred to hereinafter as the "amount of movement"). The
ΣSAD of the movie-frame is the sum of SADs of macro blocks of the current movie-frame
which is calculated by comparing the current movie-frame with a previous movie-frame.
The ΣSAD is also indicated as Min. Error. The SAD is the sum of absolute differences
between the value of each pixel constituting macro blocks of the current movie-frame
and the value of each corresponding pixel constituting macro blocks of the previous
movie-frame.
[0039] The MV detection unit 121-2 detects a motion vector of an input movie-frame (referred
to hereinafter as the "motion vector") as the amount of movement.
[0040] The factor calculation unit 125 calculates a factor which is referred to for MJC
using the ΣSAD detected by the ΣSAD detection unit 121-1, and the motion vector detected
by the MV detection unit 121-2.
[0041] The factor calculation unit 125 includes a F
SAD calculation unit 125-1, an F
MV calculation unit 125-2, and an addition unit 125-3.
[0042] The F
SAD calculation unit 125-1 calculates an F
SAD by putting the ΣSAD detected by the ΣSAD detection unit 121-1 to the graph of FIG.
3A. In FIG. 3A, F
SAD is a factor having a value ranging from 0 to 16.
[0043] As shown in FIG. 3A, if the ΣSAD is lower than a first threshold value of ΣSAD_th1,
the F
SAD is 0, and if the ΣSAD is higher than a second threshold value of ΣSAD_th2, the F
SAD is 16.
[0044] If the ΣSAD is higher than ΣSAD_th1 and lower than ESAD_th2, the F
SAD is proportional to the ΣSAD. That is, if the ΣSAD is higher than ΣSAD_th1 and lower
than ΣSAD_th2, the F
SAD adaptively changes according to the ΣSAD.
[0045] The F
MV calculation unit 125-2 is described in detail with reference to FIG. 2.
[0046] The F
MV calculation unit 125-2 calculates an F
MV by putting |MV| detected by the MV detection unit 121-2 into the graph of FIG. 3B.
In FIG. 3B, F
MV is a factor having a value ranging from 0 to 16, which is as in F
SAD.
[0047] As shown in FIG. 3B, if |MV| is lower than a first threshold value of |MV|_th1, the
F
MV is 0, and if |MV| is higher than a second threshold value of |MV|_th2, the F
MV is 16.
[0048] If |MV| is higher than |MV|_th1 and lower than |MV|_th2, the F
MV is proportional to |MV|. That is, if |MV| is higher than |MV|_th1 and lower than
|MV|_th2, the F
MV adaptively changes according to |MV|.
[0049] The addition unit 125-3 is described in detail with reference to FIG. 2.
[0050] The addition unit 125-3 calculates F (=F
SAD + F
MV), which is the sum of F
SAD calculated by the ΣSAD calculation unit 125-1 and F
MV calculated by the F
MV calculation unit 125-2, as a factor.
[0051] The MJC performing unit 129 is a type of element for improving image quality which
calculates MJC performance level by putting F calculated by the addition unit 125-3
into the graph of FIG. 3C, and performs MJC on the input movie-frame according to
the calculated MJC performance level. As shown in FIG. 3C, the MJC performance level
is inversely proportional to F.
[0052] In FIG. 3C, if F is 0, the MJC performance level is maximized. Since F is F
SAD + F
MV, if F is 0, F
SAD and F
M are also 0. This means ΣSAD < ΣSAD_th1 and |MV| < |MV|_th1, or, in other words, movement
is very low.
[0053] In FIG. 3C, if F is 32, the MJC performance level is minimized. Since F is F
SAD + F
MV, if F is 32, F
SAD is 16, and F
M is also 16. This means ΣSAD > ΣSAD_th2 and |MV| > |MV|_th2, or, in other words, movement
is very high.
[0054] If F is higher than 0 and lower than 32, the MJC performance level is inversely proportional
to F. Since F is F
SAD + F
MV, if F is higher than 0 and lower than 32, F
SAD is higher than 0 and lower than 16, and F
M is higher than 0 and lower than 16. This means |SAD_th1 < ΣSAD < ΣSAD_th2, or |MV|_th1
< |MV| < |MV|_th2, or in other words, movement is neither very low nor very high.
[0055] The movie-frame MJC-processed in the MJC performing unit 129 is output to the deinterlacing
unit 130. Hereinafter, please refer to FIG. 1 again.
[0056] The deinterlacing unit 130 receives an image from the FMD unit 110 or the adaptive
MJC unit 120. If the input image is an interlaced image, the deinterlacing unit 130
converts the input image into a progressive image by deinterlacing.
[0057] The scaling unit 140 adjusts the scale of the image output from the deinterlacing
unit 130 so that the image size fits on the display.
[0058] The process of processing an image signal of the image signal processing apparatus
of FIG. 1 is described with reference to FIG. 4.
[0059] As shown in FIG. 4, in operation S410, the FMD unit 110 determines the mode of an
input image.
[0060] If the input image is in film mode in S410-Y, the ΣSAD detection unit 121-1 in the
adaptive MJC unit 120 detects ΣSAD of the input image, and the MV detection unit 121-2
detects a motion vector of the input image in operation S420.
[0061] Subsequently, in operation S430, the F
SAD calculation unit 125-1 in the adaptive MJC unit 120 calculates an F
SAD by putting the ΣSAD into the graph of FIG. 3A, and the F
MV calculation unit 125-2 calculates an F
MV by putting |MV| (the size of MV) into the graph of FIG. 3B.
[0062] In operation S440, the addition unit 125-3 in the adaptive MJC unit 120 calculates
F (=F
SAD + F
MV), which is the sum of F
SAD and F
MV, as a factor.
[0063] In operation S450, the MJC performing unit 129 calculates MJC performance level by
putting F into the graph of FIG. 3C, and performs MJC of the input movie-frame according
to the calculated MJC performance level.
[0064] Next, if the input image is an interlaced image, the deinterlacing unit 130 performs
deinterlacing in operation S460, and the scaling unit 140 scales the input image in
operation S470.
[0065] The process of adaptively performing MJC based on the amount of movement of an input
movie-image has been described in detail with reference to the exemplary embodiment.
[0066] In the exemplary embodiment, MJC performance level is determined by a factor calculated
using ΣSAD and MV, but this is just given as an example for ease of understanding
and convenience of description, and the present invention is not limited thereto.
Accordingly, even when MJC performance level is directly determined using ΣSAD and
MV without calculating the factor, technical idea of the present invention can be
applied. That is, when MJC performance level is "adaptively" determined directly or
indirectly using the amount of movement, such as ΣSAD and MV, (for example, MJC performance
level is adaptively inversely proportional to the amount of movement of the movie-frame),
this case is also included within the scope of the present invention.
[0067] ΣSAD and MV are just an example of amount of movement for convenience of description.
Accordingly, even when other indexes indicating the amount of movement are used, the
technical idea of the present invention can be applied.
[0068] In the exemplary embodiment, MJC is adaptively performed using both ΣSAD and MV,
but this is just given as an example for ease of understanding and convenience of
description. Even when MJC is adaptively performed using one of ΣSAD and MV, the technical
idea of the present invention can be applied.
[0069] Furthermore, MJC is an example of a process to improve the image quality of movie-images,
and the technical idea of the present invention can be applied to other processes
of improving the image quality.
[0070] In graphs of FIGs. 3A and 3B, F
SAD and F
MV are described as linearly proportional to ΣSAD and |MV|, respectively, between the
first threshold value and the second threshold value, but this is merely an example.
F
SAD and F
MV may be non-linearly proportional to ΣSAD and |MV|, respectively, between the first
threshold value and the second threshold value.
[0071] In addition, in graphs of FIG. 3C, the MJC performance level is described as linearly
in inverse proportion to F, but this is just an example. Accordingly, the MJC performance
level may be nonlinearly in inverse proportion to F.
[0072] In graphs of FIGs. 3A and 3B, there are two threshold values, but the number of threshold
values is not limited thereto. Even when there are three or more threshold values,
the technical idea of the present invention can be applied. If there are three or
more threshold values, each inclination between the threshold values may be set differently.
[0073] Moreover, if F is 32, that is, the amount of movement is very high, the MJC performance
level is determined to be 0, but this is an example for convenience of explanation.
Accordingly, the MJC performance level may have a value other than 0.
[0074] The image signal processing apparatus as shown in FIG. 1 is given as an example for
convenience of explanation. An image signal processing apparatus applying the present
invention does not necessarily include all the units as shown in FIG. 1. The technical
idea of the present invention can be applied to an image signal processing apparatus
omitting the deinterlacing unit 130 from the units of FIG. 1.
[0075] The image signal processing apparatus according to the present invention may be mounted
in an audio video (AV) device which processes AV signals and provides users with the
AV signals. The AV device reproduces AV stored in a hard disk drive (HDD), a digital
video disk (DVD), or a memory device, or AV received from the outside to users, and
may be a broadcast receiving apparatus such as a television and a set top box, a personal
multimedia player (PMP), a digital video express (DivX) player, a mobile phone having
an AV reproduction function, or an MP3 player.
[0076] FIG. 5 is a block diagram of an AV device according to another exemplary embodiment
of the present invention. As shown in FIG. 5, the AV device 500 includes an AV receiving
unit 510, an AV processing unit 520, an AV output unit 530, a user command receiving
unit 540, a control unit 550, and a graphic user interface (GUI) generation unit 560.
[0077] The AV receiving unit 510 receives an AV signal input from an external device, and
the AV processing unit 520 processes the AV signal output from the AV receiving unit
510.
[0078] The AV processing unit 520 includes an AV separation unit 521, an audio decoding
unit 523, an audio processing unit 525, a video decoding unit 527, and a video processing
unit 529.
[0079] The AV separation unit 521 separates the AV signal output from the AV receiving unit
510 into an audio signal, and a video signal.
[0080] The audio decoding unit 523 decodes the audio signal output from the broadcast separation
unit 521, and the audio processing unit 525 processes the decoded audio signal output
from the audio decoding unit 523.
[0081] The video decoding unit 527 decodes the video signal output from the AV separation
unit 521, and the video processing unit 529 processes the decoded video signal output
from the video decoding unit 527.
[0082] The GUI generation unit 560 generates a GUI to be displayed on a display unit. The
generated GUI is transmitted to the video processing unit 529, and added to video
displayed on the display unit.
[0083] The output unit 530 includes an audio output unit 531, and a video output unit 535.
The audio output unit 531 outputs the audio signal output from the audio processing
unit 525 through a speaker. The video output unit 535 outputs the video signal output
from the video processing unit 529 on the display unit.
[0084] The user command receiving unit 540 transmits user commands received from a remote
control to the control unit 550. The control unit 550 controls the entire operation
of the AV device 500 according to the user commands received from the user command
receiving unit 540.
[0085] The video processing unit 529 may be implemented with the image signal processing
apparatus as described above.
[0086] Furthermore, even when the adaptive MJC unit 120 of FIG. 2 is implemented with a
separate element, the technical idea of the present invention can be applied.
[0087] As can be appreciated from the above description, according to preferred embodiments
of the present invention processing image signals relating to improving the image
quality can be adaptively performed based on the amount of movement of an input movie-image
so that MJC of the movie-image can be performed without breaking the image, and judder
of the movie-image can be reduced.
[0088] The foregoing exemplary embodiments are merely exemplary and are not to be construed
as limiting the present invention. The present teaching can be readily applied to
other types of apparatuses. Also, the description of the exemplary embodiments of
the present invention is intended to be illustrative, and not to limit the scope of
the claims, and many alternatives, modifications, and variations will be apparent
to those skilled in the art.
[0089] Attention is directed to all papers and documents which are filed concurrently with
or previous to this specification in connection with this application and which are
open to public inspection with this specification, and the contents of all such papers
and documents are incorporated herein by reference.
[0090] All of the features disclosed in this specification (including any accompanying claims,
abstract and drawings), and/or all of the steps of any method or process so disclosed,
may be combined in any combination, except combinations where at least some of such
features and/or steps are mutually exclusive.
[0091] Each feature disclosed in this specification (including any accompanying claims,
abstract and drawings) may be replaced by alternative features serving the same, equivalent
or similar purpose, unless expressly stated otherwise. Thus, unless expressly stated
otherwise, each feature disclosed is one example only of a generic series of equivalent
or similar features.
[0092] The invention is not restricted to the details of the foregoing embodiment(s). The
invention extends to any novel one, or any novel combination, of the features disclosed
in this specification (including any accompanying claims, abstract and drawings),
or to any novel one, or any novel combination, of the steps of any method or process
so disclosed.
1. A method for improving image quality of an input movie-frame, the method comprising:
detecting an amount of movement in the input movie-frame; and
adaptively processing an improvement of an image quality of the input movie-frame
based on the detected amount of movement.
2. The method of claim 1, wherein in the adaptive processing of the improvement of the
image quality, movie judder cancellation (MJC) of the input movie-frame is performed
based on the detected amount of movement.
3. The method of claim 2, wherein in the processing of the improvement of the image quality,
if the detected amount of movement is higher than a first threshold value and lower
than a second threshold value, an MJC performance level is changed according to the
detected amount of movement.
4. The method of claim 3, wherein in the processing of the improvement of the image quality,
if the detected amount of movement is higher than the first threshold value and lower
than the second threshold value, the MJC performance level is inversely proportional
to the detected amount of movement.
5. The method of claim 3 or claim 4, wherein in the processing of the improvement of
the image quality, if the detected amount of movement is lower than the first threshold
value, the MJC performance level is maximized, and if the detected amount of movement
is higher than the second threshold value, the MJC performance level is minimized.
6. The method of any one of claims 1 to 5, wherein the detected amount of movement includes
at least one of a sum of an absolute difference (SAD) of the input movie-frame, and
a size of a motion vector of the input movie-frame.
7. An apparatus to improve image quality of an input movie-frame, comprising:
a detection unit (110) which detects an amount of movement of the input movie-frame;
and
an image quality improving unit (120) which adaptively processes an improvement of
an image quality of the input movie-frame based on the amount of movement detected
by the detection unit.
8. The apparatus of claim 7, wherein the image quality improving unit (120) performs
movie judder cancellation (MJC) of the input movie-frame based on the detected amount
of movement.
9. The apparatus of claim 8, wherein if the detected amount of movement is higher than
a first threshold value and lower than a second threshold value, the image quality
improving unit (120) changes an MJC performance level according to the detected amount
of movement.
10. The apparatus of claim 9, wherein if the detected amount of movement is higher than
the first threshold value and lower than the second threshold value, the image quality
improving unit (120) causes the MJC performance level to be inversely proportional
to the detected amount of movement.
11. The apparatus of claim 9 or claim 10, wherein if the detected amount of movement is
lower than the first threshold value, the image quality improving unit (120) maximizes
the MJC performance level, and if the detected amount of movement is higher than the
second threshold value, the image quality improving unit minimizes the MJC performance
level.
12. The apparatus of any one of claims 7 to 11, wherein the detected amount of movement
includes at least one of a sum of an absolute difference (SAD) of the input movie-frame,
and a size of a motion vector of the input movie-frame.
13. An image signal processing apparatus which processes images and comprises the apparatus
of any one of claims 7 to 12, the image signal processing apparatus comprising:
a detection unit (121) which detects an amount of movement of an input movie-frame;
and
an image quality improving unit (129) which adaptively processes an improvement of
an image quality of the input movie-frame based on the amount of movement detected
by the detection unit.
14. An audio video (AV) device which processes images, provides the processed images to
a user and comprises the apparatus of any one of claims 7 to 12, the device comprising:
a detection unit (121) which detects an amount of movement of an input movie-frame;
and
an image quality improving unit (129) which adaptively processes an improvement of
an image quality of the input movie-frame based on the amount of movement detected
by the detection unit.