(19)
(11)EP 2 507 988 B1

(12)EUROPEAN PATENT SPECIFICATION

(45)Mention of the grant of the patent:
04.01.2017 Bulletin 2017/01

(21)Application number: 10834629.7

(22)Date of filing:  26.11.2010
(51)International Patent Classification (IPC): 
H04N 1/46(2006.01)
H04N 1/60(2006.01)
G06T 1/00(2006.01)
H04N 1/40(2006.01)
(86)International application number:
PCT/JP2010/071627
(87)International publication number:
WO 2011/068179 (09.06.2011 Gazette  2011/23)

(54)

IMAGE INFORMATION PROCESSING METHOD, IMAGE INFORMATION PROCESSING APPARATUS, IMAGE PROCESSING APPARATUS, AND RECORDING MEDIUM

VERFAHREN ZUR VERARBEITUNG VON BILDINFORMATIONEN, VORRICHTUNG ZUR VERARBEITUNG VON BILDINFORMATIONEN, BILDVERARBEITUNGSVORRICHTUNG UND AUFZEICHNUNGSMEDIUM

PROCÉDÉ DE TRAITEMENT D'INFORMATIONS D'IMAGE, APPAREIL DE TRAITEMENT D'INFORMATIONS D'IMAGE, APPAREIL DE TRAITEMENT D'IMAGE ET SUPPORT D'ENREGISTREMENT


(84)Designated Contracting States:
AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

(30)Priority: 01.12.2009 JP 2009273507
16.03.2010 JP 2010059123

(43)Date of publication of application:
10.10.2012 Bulletin 2012/41

(73)Proprietor: Ricoh Company, Ltd.
Tokyo 143-8555 (JP)

(72)Inventor:
  • HARA, Takayuki
    Tokyo 143-8555 (JP)

(74)Representative: Maury, Richard Philip 
Marks & Clerk LLP 90 Long Acre
London WC2E 9RA
London WC2E 9RA (GB)


(56)References cited: : 
JP-A- 2000 251 076
JP-A- 2002 185 805
JP-A- 2007 208 941
US-A1- 2009 009 766
JP-A- 2000 251 076
JP-A- 2007 208 940
US-A1- 2005 094 170
  
      
    Note: Within nine months from the publication of the mention of the grant of the European patent, any person may give notice to the European Patent Office of opposition to the European patent granted. Notice of opposition shall be filed in a written reasoned statement. It shall not be deemed to have been filed until the opposition fee has been paid. (Art. 99(1) European Patent Convention).


    Description

    Technical Field



    [0001] The present invention relates to an image processing method, an image information processing apparatus, and an image processing apparatus that determine an object region for evaluating image quality in the entire region of an image. Further, the present invention also relates to a recording medium having recorded therein a program that implements the image processing method so as to be readable by a machine.

    Background Art



    [0002] Up until now, the image forming performance of an image forming apparatus is evaluated in such a manner as to compare differences between the colors of an image output from the image forming apparatus such as a printer and the colors of original image information. Generally, the image forming performance is evaluated according to the following method. In other words, a chart image for color evaluation is first output using prepared image information and then read by a scanner to obtain output image information. After that, in regard to the colors of respective parts in the chart image, differences between the colors expressed by the original image information and the colors expressed by the output image information are calculated to thereby evaluate the image forming performance.

    [0003] In recent years, however, demand for outputting photographic images or the like has been increasing. Therefore, according to such an evaluation method, the above-described chart image for color evaluation has to be output onto an expensive gloss photo paper, which results in an increase in cost. Further, in the case of outputting the same images in large amounts, the likelihood of obtaining a good result would be high by using the colors of an image to be actually output as objects to be inspected rather using than a chart image for color evaluation including only limited colors. Therefore, there have been demanded techniques for evaluating image forming performance using an image freely output by the user instead of a chart image for color evaluation.

    [0004] In order to evaluate image forming performance using an image freely output by a user, a technique for extracting an object region suitable for color evaluation from the entire region of the image is necessary. As such, a region extraction method disclosed in Patent Document 1 is known. According to this region extraction method, a small segment region including a target pixel is first extracted from the entire region of an original image based on image information, and then an entropy value indicating evenness (uniformity) in density between respective pixels in the small segment region is calculated based on the pixel values of the respective pixels in the small segment region. After repeatedly performing the processing of extracting small segment regions and calculating entropy values thereof while sequentially shifting target pixels, the small segment region in which density between the respective pixels is even is specified from the entire region of the image based on the entropy values of the respective small segment regions. The region in which the density between the respective pixels is even is suitable for evaluating an output color because it has less color variations. That is, with the application of the region extraction method disclosed in Patent Document 1, it is possible to extract an object region suitable for color evaluation from the entire region of an original image provided by the user.

    [0005] However, even if an object region suitable for color evaluation can be extracted, the adjustment of image forming performance excellent in color reproducibility is not always made possible. Specifically, a general image forming apparatus has at least a characteristic in which the reproducibility of one color is degraded as it adjusts image forming performance so as to faithfully reproduce another color. Thus, even if an object region suitable for color evaluation is extracted by the application of the region extraction method disclosed in Patent Document 1, when image forming performance is adjusted to bring its output color in close to an original color based on the measurement result of an actual output color of the object region, the color reproducibility of other regions is greatly degraded. Accordingly, the color reproducibility of an image could be rather degraded as a whole.

    [0006] Further, image forming performance cannot be accurately evaluated only by the extraction of region in which a difference in density is even. In order to accurately evaluate image forming performance, it is requested that the regions have a color tone close to a color material (color purity is high) and are adequately dispersed in the entire region of an image (spatial dispersion degree is high), besides the evenness of a difference in density (evenness degree is high). Specifically, in the image forming apparatus that outputs color images, at least three different color materials, such as Y (yellow), M (magenta), and C (cyan), are used as the color materials of ink and toner. The image forming apparatus reproduces various color tones by appropriately mixing such monochromatic color materials together on a paper or adjusting an area ratio of single-color dots composed of only the respective color materials. In order to accurately evaluate color reproducibility in such a configuration, it is necessary to select, as object regions, regions having color tones close to the color materials in such a manner that single-color regions close in color tone to Y, M, and C are selected as the regions to be detected. Further, the image forming apparatus is likely to show different color reproducibility depending on the position of an image; the color reproducibility is different between the upper side and the lower side of a paper even with the same color. Thus, it is insufficient to specify only one region from the entire region of an image as an object region for the respective single colors such as Y, M, and C, but is necessary to specify plural regions appropriately dispersed in the image as object regions. Accordingly, with respect to the respective single colors, it is necessary to specify plural combinations of segment regions showing a relatively high evenness degree and color purity in which the spatial dispersion degrees of the segment regions are relatively high from the entire region of the image.

    [0007] In order to specify combinations of such segment regions, the present inventor has conceived the following method. In other words, the processing of extracting segment regions having a predetermined size from the entire region of an image and then calculating the evenness degree and the color purity of the segment regions is repeatedly performed until the entire image is covered. Next, all possible combinations established when a predetermined number of the segment regions are selected from all segment regions and combined with each other are specified. Then, the evenness degree, the color purity, and the linear sum of the spatial dispersion degree of the respective segment regions are calculated for the respective combinations and regarded as index values. Here, one of the combinations showing the largest index value is specified as an object region for inspecting an output color.

    [0008] However, it turns out that this method is not practical because it requires an enormous processing time for calculating the above-described linear sum for the possible combinations established when the predetermined number of the segment regions are selected from all the segment regions and combined with each other.

    [0009] Patent Document 1: JP-B-3860540

    [0010] US2009/009766A discloses an image information processing apparatus that determines, based on image information, a region suitable for inspecting image forming performance of an image forming apparatus in an entire region of an image represented by the image information, the image information processing apparatus comprising a segment region extraction unit that extracts a segment regions having a predetermined size from the entire region of the image; a color reproducibility prediction unit that predicts a result of color reproducibility of the entire image by using an algorithm in a case where the image forming performance of the image forming apparatus is adjusted based on a color measurement result of the extracted segment region; and an object region determination unit that determined, as an object region, the segment region showing a best one of the plural results obtained by repeatedly performing extraction processing by the segment region extraction unit and prediction processing by the color reproducibility prediction unit.

    [0011] US2005/0094170A discloses correcting image information using a gray level correction table.

    [0012] JP 2000 251 076A discloses a pixel position detection part that obtains an image starting point to be a preference for reading an output image, such as to optimize the correlation between a provided input image and source image data.

    [0013] The present invention is the apparatus of Claim 1 and the medium of Claim 9.

    [0014] The present invention may provide image processing capable of specifying a combination of segment regions having a relatively high evenness degree, color purity, and a spatial dispersion degree from the entire region of an image in a shorter period of time.

    [0015] In addition, the present invention may select an object region suitable for improving the color reproducibility of an entire image.

    Brief Description of Drawings



    [0016] 

    FIG. 1 is a block diagram showing the configuration of a substantial part of an image information processing apparatus according to a first mode of the present invention;

    FIG. 2 is a flowchart showing the processing flow of determining an object region by the image information processing apparatus;

    FIG. 3 is a block diagram showing the configuration of a substantial part of the image information processing apparatus according to a first embodiment;

    FIG. 4 is a flowchart showing the processing flow of object region determination processing by the image information processing apparatus according to the first embodiment;

    FIG. 5 is a block diagram showing the configuration of a substantial part of the image information processing apparatus according to a second embodiment;

    FIG. 6 is a flowchart showing the processing flow of object region determination processing by the image information processing apparatus according to the second embodiment;

    FIG. 7 is a schematic diagram for explaining an example of a relationship between the retention solution of the image information processing apparatus according to the second embodiment and a newly-extracted segment regional group;

    FIG. 8 is a partial flowchart showing a part of the processing flow when a simulated annealing method is used;

    FIG. 9 is a block diagram showing the configuration of a substantial part of an image processing apparatus according to a second mode of the present invention;

    FIG. 10 is a flowchart showing the processing flow of determining an object region by the image processing apparatus;

    FIG. 11 is a schematic diagram showing the shape of a function where color purity f(µ) is defined when the diagonal component of a square matrix Q 1 is positive, the non-diagonal component thereof is negative, w is a zero vector, and the relationship mY = mK = 0 is established;

    FIG. 12 is a schematic diagram for explaining an example of candidate regions selected in step S70 of FIG. 10;

    FIG. 13 is a schematic diagram showing an example of a relationship between the entire region, a combination of four segment regions, and candidate regions of an image;

    FIG. 14 is a schematic diagram for explaining a method for calculating a spatial dispersion degree based on Euclidian distances between gravity centers of segment regions;

    FIG. 15 is a block diagram showing the configuration of a substantial part of the image processing apparatus 100 according to a modification;

    FIG. 16 is a flowchart showing the processing flow of determining an object region by the image processing apparatus according to the modification;

    FIG. 17 is a flowchart specifically showing step S80 in the processing flow shown in FIG. 16, i.e., the step performed when a second or later combination of segment regions is specified;

    FIG. 18 is a flowchart showing another example of the flowchart shown in FIG. 17;

    FIG. 19 is a schematic diagram showing a first example of a relationship between a new combination specified by the image processing apparatus and a retention solution combination; and

    FIG. 20 is a schematic diagram showing a second example of the relationship.


    Best Mode for Carrying out the Invention



    [0017] Next, a description is made of an image information processing apparatus according to a first mode of the present invention.

    [0018] FIG. 1 is a block diagram showing the configuration of a substantial part of an image information processing apparatus 10 according to the first mode of the present invention. As shown in FIG. 1, the image information processing apparatus 10 has an image information acquisition unit 11, a segment regional group extraction unit 12, a color reproducibility prediction unit 13, a stop criterion determination unit 14, an object region determination unit 15, and the like.

    [0019] The image information acquisition unit 11 of the image information processing apparatus 10 acquires image data transmitted from a user via a personal computer or the like. The image data include pixel values expressing the brightness of single-color components of C (cyan), M (magenta), Y (yellow), and K (black) for each of plural pixels constituting an image and arranged in matrix pattern, and are original image data output from the personal computer or the like to a printer. The image information processing apparatus 10 determines which region is specified as an object for color inspection from the entire region of the image data. After the determination by the image information processing apparatus 10, when scanned image data obtained by scanning an output image are input to the image information processing apparatus 10, the image information processing apparatus 10 specifies the object region in the output image based on the matrix position of the respective pixels and compares the color data of the object region with its original color data, thereby evaluating an output color.

    [0020] Prior to determining an object region for color inspection in original image data, the image information processing apparatus 10 first determines the combinations of segment regions suitable for color inspection from the entire region of the image data for each of the four colors C, M, Y, and K.

    [0021] FIG. 2 is a flowchart showing the processing flow of determining an object region by the image information processing apparatus 10. The image information processing apparatus 10 first acquires image data by using the image information acquisition unit 11 (step 1: step is hereinafter represented as S). Then, the segment regional group extraction unit 12 repeatedly performs steps S2 through S4. Specifically, assuming that a pixel placed at a predetermined position of a pixel matrix expressed by the image data is set as a subject pixel, N-pieces of rectangular regions (0.1 through 1.0 mm square) about the subject pixel are randomly extracted (S2). As shown in FIG. 1, this extraction processing is performed by the segment regional group extraction unit 12.

    [0022] After the extraction of the plural segment regions by the segment regional group extraction unit 12, the color reproducibility prediction unit 13 individually predicts a result of color reproducibility as an entire image when it is assumed that image forming performance is adjusted to correspond to colors for each of the plural segment regions (S3). The prediction processing is performed based on a previously-stored algorithm. The algorithm is structured as follows. In other words, the characteristics of the image forming apparatus to be inspected are previously examined. Specifically, a dedicated chart image is output by the image forming apparatus and scanned by a scanner to measure respective colors. Next, any of the plural colors is selected. Here, if the color measurement result shows that the color is different from its original color, the image forming performance of the image forming apparatus is adjusted to restore the color to the original color. Then, after another chart image is output by the image forming apparatus and scanned by the scanner, differences between the previous color measurement result and the current color measurement result are calculated for all the colors other than the previously selected one. Differences of the other colors when the image forming performance is adjusted to correspond to all the colors reproduced by the image forming apparatus are similarly measured. Since a difference amount between the measured color and the original color varies depending on an environment or the like, the measurement is repeatedly performed to calculate an average value of the difference amounts for all the colors. Then, based on the average values, the above-described algorithm is structured. The following formula (1) shows an example of the algorithm thus obtained.



    [0023] In the formula (1), a left side expresses the prediction value of the result of color reproducibility at any position in an entire image. Further, "w" expresses a color (i.e., color represented by a pixel value) at any position in the entire image. Further, "zi" to expresses the color (i.e., color represented by a pixel value) of the i-th segment region among the N-pieces of segment regions extracted by the segment regional group extraction unit 12. Further, "a" and "b" each express a constant. Further, "||" is the symbol of a norm, and the inside of the norm expresses a Euclidean distance between w and zi in a four-dimensional color space using yellow (Y), magenta (M), cyan (C), and black (K) as axes.

    [0024] According to the formula (1), it is possible to predict a result of color reproducibility at any position in the entire image when the image forming performance is adjusted to correspond to the color of the i-th segment region. The color reproducibility prediction unit 13 first sets 1 to i (i = 1), and then calculates ecolor(w|zi) with respect to the first segment region. Next, the color reproducibility prediction unit 13 sets 2 to i (i = 2), and then calculates ecolor(w|zi) in the same manner. The color reproducibility prediction unit 13 repeatedly performs this processing until N is set to i (zi=N). Thus, after the calculation of ecolor(w|zi=1) through ecolor(w|Zi=N), an average value of the calculated results of color reproducibility or the best value thereof is obtained as the prediction value of color reproducibility of the color w when the image forming performance is adjusted to correspond to the first through N-th segment regions. With respect to the position w, the leftmost position in the entire image is selected, and a color at the position is specified as w and substituted into the formula (1) to thereby calculate the prediction value. Then, the position is shifted by one in a right direction, and a color at the position is specified as w and substituted into the formula (1) to thereby calculate the prediction value. The processing of shifting the position and substituting the color into the formula (1) to thereby calculate the prediction value is repeatedly performed until all the positions of the entire image are covered. Then, an average value of the calculated results or the best value thereof is obtained as the prediction value of color reproducibility as the entire image. This prediction value is regarded as the result of color reproducibility of the entire image when the image forming performance is adjusted to correspond to the first through N-th segment regions.

    [0025] After the color reproducibility prediction unit 13 calculates the result of color reproducibility with respect to the first through N-th segment regions extracted by the segment regional group extraction unit 12, the stop criterion determination unit 14 determines whether a predetermined stop criterion is met (S4). An example of such a predetermined stop criterion may be such that the combination of steps S2 and S3 is repeatedly performed predetermined times. Alternatively, another predetermined stop criterion may be such that a result obtained by calculating color reproducibility of the entire image is not continuously improved predetermined times. When the stop criterion is not met, the stop criterion determination unit 14 transmits a reprocessing execution signal to the segment regional group extraction unit 12. Thus, steps S2 and S3 are performed again. On the other hand, when the stop criterion is met, the stop criterion determination unit 14 outputs a determination processing execution signal to the object region determination unit 15. Then, the object region determination unit 15 determines as an object region the segment regional group showing the best one of the results obtained by repeatedly performing step S3 (S5), and outputs the data of the segment regional group to the next step.

    [0026] As described above, the image information processing apparatus 10 according to the first mode of the present invention predicts a result of color reproducibility of an entire image when it is assumed that the image forming performance of the image forming apparatus is adjusted based on a color measurement result of a segment region extracted from the entire image. Then, the image information processing apparatus 10 determines as an object region a segment regional group showing the best one of the results obtained by repeatedly performing this prediction processing for plural segment regional groups, thereby making it possible to select the object region suitable for improving color reproducibility of the entire image.

    [0027] Note that the formula (1) is just an example of the algorithm for predicting a result of color reproducibility of an entire image, but the algorithm according to the first mode of the present invention is not limited to the formula (1). For example, it may be an algorithm in a data table system or a function formula different from the formula (1).

    [0028] The image information processing apparatus 10 according to the first mode of the present invention is composed of a personal computer and a program for causing the personal computer to function as an image information processing apparatus. The program is stored in an optical disk such as a CD-ROM and a DVD-ROM as a recording medium so as to be readable by a machine, and can be installed in the hard disk of the personal computer via the optical disk. Any of the image information acquisition unit 11, the segment regional group extraction unit 12, the color reproducibility prediction unit 13, the stop criterion determination unit 14, and the object region determination unit 15 shown in FIG. 1 is implemented by the arithmetic processing of the CPU of a personal computer as software.

    [0029] Next, descriptions are made of respective embodiments and modifications in which a more characteristic configuration is added to the image information processing apparatus 10 according to the first mode of the present invention. Note that unless otherwise specified, the configuration of the image information processing apparatus 10 according to the respective embodiments and modifications is the same as the configuration of the image information processing apparatus 10 according to the first mode of the present invention.

    (First Embodiment)



    [0030] The segment regional group extraction unit 12 of the image information processing apparatus 10 according to a first embodiment is configured to extract a segment region larger than the segment region extracted by the image information processing apparatus 10 according to the first mode of the present invention. The size of each segment region is more than a square of 1.0 mm side. Selecting a relatively large segment region makes it possible to allow for positional shifts and noise at color measurement. On the other hand, an output image is susceptible to texture. Since the accurate prediction of color reproducibility becomes difficult under the presence of texture, it is necessary to select an even region as a segment region from an output image.

    [0031] FIG. 3 is a block diagram showing the configuration of a substantial part of the image information processing apparatus 10 according to the first embodiment. In FIG. 3, the segment regional group extraction unit 12 has a segment region extraction section 12a, an evenness degree calculation section 12b, a region classification section 12c, and a segment region storage section 12d.

    [0032] FIG. 4 is a flowchart showing the processing flow of object region determination processing by the image information processing apparatus 10 according to the first embodiment. Since steps S1 and S3 through S5 shown in FIG. 4 are the same as those shown in FIG. 2, their descriptions are omitted here. The processing of segment regional group extraction in S2 has five steps of a segment region extraction step (S2a), an evenness degree calculation step (S2b), a classification step based on an evenness degree (S2c), a segment region storage step (S2d), and a region number determination step (S2e).

    [0033] The segment region extraction step (S2a) is performed by the segment region extraction section 12a. The segment region extraction section 12a randomly extracts a segment region from the entire region of an image.

    [0034] After the extraction of the segment region by the segment region extraction section 12a, the evenness degree calculation section 12b calculates an evenness degree showing density evenness of the entirety of the segment region while referring to the pixel values of respective pixels (colors C, M, Y, and K) in the extracted segment region (S2b). The evenness degree may be calculated according to various methods. As a first example, the evenness degree may be calculated as follows. In other words, the dispersion of the respective pixels of the colors C, M, Y, and K is first calculated. Then, the sum of the dispersion with a negative sign is regarded as the evenness degree of the segment region.

    [0035] As a second example, the evenness degree may be calculated according to the determinant of a variance-covariance matrix. Specifically, the variance and covariance of the respective pixels in the segment region are calculated for each of the colors C, M, Y, and K. Then, a 4 x 4 variance-covariance matrix in which the variance is arranged in diagonal components and the covariance is arranged in non-diagonal components is structured, and the determinant of the matrix is calculated. The value of the determinant with a negative sign may be regarded as the evenness degree. This is because the distribution of the respective pixels in a CMYK space can be evaluated with the determinant of the variance-covariance matrix. The second example is superior to the first example in that it can evaluate the spread of the colors between difference components.

    [0036] Moreover, as a third example, the evenness degree may be calculated according to the frequency characteristics of the colors. Specifically, Fourier transform is performed using the respective pixels in a segment region, and the square sum of the absolute value of a Fourier coefficient of a specific frequency is calculated. The sum with a negative sign is regarded as the evenness degree. The specific frequency may include plural frequencies. According to the evenness degree of the first example, an image subjected to halftone processing is influenced by the pattern of halftone processing. Therefore, an even region may not be detected. As opposed to this, according to the evenness degree of the third example, the square sum of the absolute value of a Fourier coefficient of a specific frequency is used. Therefore, the evenness degree free from the influence by halftone processing can be calculated.

    [0037] The calculation of the evenness degree calculated in step S2b is not limited to the first through third examples described above, but known evenness degree calculation techniques are available.

    [0038] After the calculation of the evenness degree in the segment region by the evenness degree extraction section 12a, the region classification section 12c determines whether the segment region should be included in a segment regional group based on whether the evenness degree exceeds a predetermined threshold. Specifically, if the evenness degree does not exceed the threshold, the region classification section 12c determines that the segment region should not be included in the segment regional group and then outputs a signal for extracting a segment region again to the segment region extraction section 12a. Thus, a new segment region is extracted by the segment region extraction section 12a, and steps S2b and S2c are repeatedly performed. On the other hand, if the evenness degree exceeds the threshold, the region classification section 12c determines that the segment region should be included in the segment regional group and then causes the segment region storage section 12d to store the segment region. Then, the region classification section 12c determines whether the number of the segment regions stored in the segment region storage section 12d has reached a predetermined number necessary for the segment regional group. If the number has not reached the predetermined number, the region classification section 12c outputs the signal for extracting a segment region again to the segment region extraction section 12a. Thus, a new segment region is extracted by the segment region extraction section 12a, and steps S2b and S2c are repeatedly performed. On the other hand, if the number has reached the predetermined number, the region classification section 12c outputs to the segment region storage section 12d a signal for outputting the data of the segment regional group to the next step. Thus, the data of the segment regional group are output from the segment region storage section 12d, and the segment regional group extraction step (S12) is completed.

    (Second Embodiment)



    [0039] The image information processing apparatus 10 according to a second embodiment has the following characteristic configuration in addition to the characteristic configuration of the image information processing apparatus 10 according to the first embodiment. In other words, the image information processing apparatus 10 according to the second embodiment stores, as a retention solution, information on a segment regional group showing the best result among plural segment regional groups for which a result of color reproducibility is calculated. Then, in the segment regional group extraction step, the image information processing apparatus 10 extracts a new segment region based on a segment regional group stored as the retention solution so as to extract the segment region before its evenness degree is calculated. More specifically, the image information processing apparatus 10 extracts a new segment region such that at least one of segment regions of a newly-structured segment regional group is the same or close to the segment region of the retention solution. According to such extraction, the segment regional group of the segment region close to the segment region of the retention solution showing the best result is extracted. Thus, it is possible to enhance the likelihood of extracting a segment regional group showing a further excellent result.

    [0040] FIG. 5 is a block diagram showing the configuration of a substantial part of the image information processing apparatus 10 according to the second embodiment. The image information processing apparatus 10 according to the second embodiment is different from the image information processing apparatus 10 according to the first embodiment in that it has a retention solution updating section 16.

    [0041] FIG. 6 is a flowchart showing the processing flow of object region determination processing by the image information processing apparatus 10 according to the second embodiment. The flowchart shown in FIG. 6 is different from the flowchart shown in FIG. 4 in that it has steps S2a1, S6, and S7. Specifically, the segment regional group extraction section 12 refers to the above-described retention solution (S2a1) before extracting a segment region (S2a). Then, the image information processing apparatus 10 extracts the new segment region such that at least one segment region of a newly-structured segment regional group is the same as or very close to the segment region of the retention solution. For example, the image information processing apparatus 10 selects the segment region of the retention solution and randomly adjusts the position of the segment region in an image. In this case, the possibility of setting the position of the segment region near a previous position may be high.

    [0042] FIG. 7 is a schematic diagram for explaining an example of the relationship between the retention solution of the image information processing apparatus 10 according to the second embodiment and a newly-extracted segment regional group. In this example, the segment regional group is composed of four segment regions, and three of the four segment regions of the newly-extracted segment regional group are completely the same as the segment regions of the retention solution. That is, the newly-extracted segment regional group is extracted in which only one of the four segment regions of the retention solution is replaced by another segment region.

    [0043] An example of a method for extracting a segment region very close to the segment region of retention solution may include a hill-climbing method. The hill-climbing method is a search method based on the principle that better solutions are of a similar structure, and can efficiently search for a better solution while changing a part of a retention solution. However, since a retention solution is updated only when a solution is improved, the method is likely to be stuck with a local solution. Therefore, as a method for finding a more comprehensive solution, a multi-start hill-climbing method in which the hill-climbing method is applied to plural initial solutions is known. Further, a simulated annealing method is also known in which a retention solution is updated with a specific probability even when a solution is degraded. When the simulated annealing method is used, step S8 is performed in addition to steps S6 and S7 as shown in FIG. 8. In other word, if a result of color reproducibility of an entire image in a newly-extracted segment regional group is not the best one (N in S6), a difference between the result and the result of a retention solution is regarded as a degraded amount (d). Then, with the probability (exp(-d/t) wherein t is a constant greater than zero) based on the degraded amount, the retention solution is updated with the newly-extracted segment regional group. That is, a segment regional group having a smaller degraded amount would be updated as a retention solution with high probability even if the result is worse than the retention solution. The constant t is used to adjust the probability of updating the retention solution, and set to be a great value at the beginning of search and gradually decrease to zero. Thus, it is possible to widely search a solution space with such as a random search at the beginning of search and gradually adopt the hill-climbing method as the search advances for a better adjacent solution.

    [0044] An optimization method is not limited to the hill-climbing method and the simulated annealing method described above, but various methods such as a genetic algorithm and a taboo search method are available.

    [0045] Next, a description is made of the modifications of the image information processing apparatus 10 according to the first mode of the present invention. Note that unless otherwise specified, the configuration of the image information processing apparatus 10 according to the respective modifications are the same as the configuration of the image information processing apparatus 10 according to the first mode of the present invention.

    (First Modification)



    [0046] Some image forming apparatuses have the characteristic of degrading color reproducibility at an image region far from a specific segment region when adjusting image forming performance to suit the specific segment region. For example, this is caused by the decentering of a drum-shaped photosensitive body.

    [0047] In order to deal with this problem, the image information processing apparatus according to a first modification uses as an algorithm the following formula (2) instead of the formula (1) described above.



    [0048] In the formula (2), a left side expresses the prediction value of the result of color reproducibility at any position in an entire image. Further, "y" expresses any position in the entire image. Further, "xi" expresses the position of the i-th segment region in the entire image among N-pieces of segment regions extracted by the segment regional group extraction unit 12. Further, "c" and "d" each express a constant.

    [0049] The color reproducibility prediction unit 13 first sets 1 to i (i = 1), and then calculates eposition(y|xi) with respect to a first segment region. Next, the color reproducibility prediction unit 13 sets 2 to i (i = 2), and then calculates eposition(y|xi) in the same manner. The color reproducibility prediction unit 13 repeatedly performs this processing until N is set to i (xi=N). Thus, after the calculation of eposition(y|xi=1) through eposition(y|xi-N), an average value of the calculated results of color reproducibility or the best value thereof is obtained as the prediction value of color reproducibility at the position y when the image forming performance is adjusted to correspond to the first through N-th segment regions. With respect to the position y, the leftmost position in the entire image is selected and substituted into the formula (2) to thereby calculate the prediction value. Then, the position is shifted by one in a right direction. The shifted position is regarded as y and substituted into the formula (2) to thereby calculate the prediction value. The processing of shifting the position and substituting the shifted position into the formula (2) to thereby calculate the prediction value is repeatedly performed until all the positions of the entire image are covered. Then, an average value of the calculated results or the best value thereof is obtained as the prediction value of color reproducibility of the entire image. This prediction value is regarded as the result of color reproducibility of the entire image when the image forming performance is adjusted to correspond to the first through N-th segment regions.

    (Second Modification)



    [0050] The image information processing apparatus according to a second modification uses as an algorithm the following formula (3) instead of the formula (1) described above.



    [0051] That is, the result of color reproducibility of an entire image is calculated by multiplying a solution according to the formula (1) by the solution according to the formula (2).

    [0052] The above description exemplifies the processing of color image data including pixel values showing brightness for each of the four color components Y, M, C, and K. However, it is also possible to process binary image data and grayscale images showing the brightness of only black and white depending on pixel values; color image data including pixel values showing brightness for each of the three color components R (red), G (green), and B (blue); spectral image data and color image data including pixel values showing the brightness for each of four or more color components; or the like.

    [0053] As described above, in the image information processing apparatus 10 according to the first embodiment, the evenness degree calculation section 12b is configured to calculate the evenness degree of a segment region based on at least any one of the dispersion degree of pixel values, a difference between the maximum value and the minimum value of the pixel values, and the frequency characteristic of the pixel values as color information of pixels in the segment region. With this configuration, a numerical value having high correlation with the density evenness of the segment region can be regarded as the evenness degree.

    [0054] Further, the image information processing apparatus 10 according to the first embodiment has the evenness degree calculation section 12b that calculates the evenness degree of color density in an extracted segment region, the region classification section 12c that selects only a segment region showing an excellent calculation result of the evenness degree, and the segment region storage section 12d that outputs the image information of the segment region to the color reproducibility prediction section 13 as a prediction object of the result of color reproducibility. Note that the region classification section 12c and the segment region storage section 12d serve as a prediction object selection unit. Thus, even if a segment region having a relatively large area is extracted, the image information processing apparatus 10 can evaluate well the color of the segment region.

    [0055] Further, the image information processing apparatus 10 according to the second embodiment has the segment region extraction unit 12 that performs the processing of extracting a new segment regional group based on a retention solution as a prediction result by the color reproducibility prediction section 13. Thus, by extracting a segment region close to the segment region of a retention solution, the image information processing apparatus can increase the likelihood of selecting a segment regional group showing a better result.

    [0056] Next, a description is made of an image processing apparatus according to a second mode of the present invention.

    [0057] FIG. 9 is a block diagram showing the configuration of a substantial part of an image processing apparatus 100 according to the second mode of the present invention. As shown in FIG. 9, the image processing apparatus 100 has an image information acquisition unit 110, a repeat processing unit 120, a candidate region selection unit 130, a combination specification unit 140, an index value calculation unit 150, a processing stop determination unit 160, an object region determination unit 170, and the like. Further, the repeat processing unit 120 has a segment region extraction section 120a, an evenness degree calculation section 120b, a color purity calculation section 120c, and a quality determination section 120d.

    [0058] The image information acquisition unit 110 of the image processing apparatus 100 acquires image data transmitted from a user via a personal computer or the like. The image data include pixel values expressing the brightness of single-color components of C (cyan), M (magenta), Y (yellow), and K (black) for each of plural pixels constituting an image and arranged in a matrix pattern, and are original image data output from the personal computer or the like to a printer. The image processing apparatus 100 determines which region is specified as an object for color inspection from the entire region of the image data. After this determination by the image processing apparatus 100, when scanned image data obtained by scanning an output image are input to the image processing apparatus 100, the image processing apparatus 100 specifies the object region in the output image based on the matrix position of the respective pixels and compares the color data of the object region with its original color data, thereby evaluating an output color.

    [0059] Prior to determining an object region for color inspection in original image data, the image processing apparatus 100 first determines the combinations of segment regions suitable for color inspection from the entire region of the image data for each of the four colors C, M, Y, and K.

    [0060] FIG. 10 is a flowchart showing the processing flow of determining an object region by the image processing apparatus 100. The image processing apparatus 100 first acquires image data by using the image information acquisition unit 110 (step 10: step is hereinafter represented as S). Then, the repeat processing unit 120 repeatedly performs steps S20 through S60. Specifically, assuming that a pixel placed at a predetermined position of a pixel matrix expressed by the image data is set as a subject pixel, a region having a predetermined size about the subject pixel is extracted as a segment region. For example, the pixel placed at the 51st column and the 51st row from the upper left side of the pixel matrix is set as the subject pixel, and the rectangular region of 101 pixels x 101 pixels (about 4 mm square) is extracted as the segment region at the first time. As shown in FIG. 9, this extraction is performed by the segment regional group extraction section 120a of the repeat processing unit 120.

    [0061] The evenness degree calculation section 120b of the repeat processing unit 120 calculates an evenness degree showing density evenness of the entirety of the segment region while referring to the pixel values of respective pixels (colors C, M, Y, and K) in the extracted segment region (S20). The evenness degree may be calculated according to various methods. As a first example, the evenness degree may be calculated as follows. In other words, the dispersion of the respective pixels of the colors C, M, Y, and K is first calculated. Then, the sum of the dispersion with a negative sign is regarded as the evenness degree of the segment region.

    [0062] As a second example, the evenness degree may be calculated according to the determinant of a variance-covariance matrix. Specifically, the variance and covariance of the respective pixels in the segment region are calculated for each of the colors C, M, Y, and K. Then, a 4 x 4 variance-covariance matrix in which the variance is arranged in diagonal components and the covariance is arranged in non-diagonal components is structured, and the determinant of the matrix is calculated. Further, the value of the determinant with a negative sign may be regarded as the evenness degree. This is because the distribution of the respective pixels in a CMYK space can be evaluated with the determinant of the variance-covariance matrix. The second example is superior to the first example in that it can evaluate the spread of the colors between difference components.

    [0063] Moreover, as a third example, the evenness degree may be calculated according to the frequency characteristics of the colors. Specifically, Fourier transform is performed using the respective pixels in a segment region, and the square sum of the absolute value of a Fourier coefficient of a specific frequency is calculated. The sum with a negative sign added is regarded as the evenness degree. The specific frequency may include plural frequencies. According to the evenness degree of the first example, an image subjected to halftone processing is influenced by the pattern of halftone processing. Therefore, an even region may not be detected. As opposed to this, according to the evenness degree of the third example, the square sum of the absolute value of a Fourier coefficient of a specific frequency is used. Therefore, the evenness degree free from the influence by halftone processing can be calculated.

    [0064] The calculation of the evenness degree calculated in step S30 is not limited to the first through third examples described above, but known evenness degree calculation techniques are available.

    [0065] After the calculation of the evenness degree of the segment region by the evenness degree calculation section 120, the repeat processing unit 120 calculates color purity for each of the colors C, M, Y, and K in the segment region by the color purity calculation section 120c (S4). The color purity may be calculated according to various methods. As a first example, the color purity may be calculated as follows. In other words, an average value of the pixel values of respective pixels in the segment region is calculated, and then the calculated average value is converted into a dot in a uniform color space such as L*a*b* and L*u*v*. After that, Euclidian distances between the converted dot and the dots of the colors C, M, Y, and K in the uniform color space are calculated. As a result, the minimum values of the Euclidian distances are regarded as the color purity of the colors C, M, Y, and K.

    [0066] As a second example, the color purity can be calculated according to the secondary expression of the component amounts of the colors C, M, Y, and K. Specifically, average values mC, mM, mY, and mK are calculated for the colors C, M, Y, and K of respective pixels in the segment region. Then, assuming that a four-dimensional vertical vector using the average values mC, mM, mY, and mK as elements is µ and a four-dimensional vertical vector w and a 4 x 4 square matrix Q are design parameters, the color purity f (µ) is calculated according to the following mathematical formula.



    [0067] A superscript T in the mathematical formula 1 expresses transposition. Setting the non-diagonal component of Q to be negative makes it possible to degrade the color purity with respect to the product of the different components of the colors C, M, Y, and K. On the other hand, setting the diagonal component of Q to be positive makes it possible to improve the color purity with respect to the square value of the colors C, M, Y, and K. Setting w makes it possible to adjust a point at which the color purity becomes the maximum. FIG. 11 shows the shape of a function where the color purity f(µ) is defined when the diagonal component of the square matrix Q in the mathematical formula 1 is positive, the non-diagonal component thereof is negative, w is a zero vector, and the relationship mY = mK = 0 is established. It is found that the color purity becomes high when a color is nearly single and the density of the color is high while the color purity becomes low when the colors C and M are mixed together with the same ratio. In the second example, the color purity is expressed by the secondary expression of the average value of the colors C, M, Y, and K. However, the color purity may be expressed by a cubic or higher expression. In this case also, it is only required to set a coefficient such that the color purity degrades with respect to the product of the different components of the colors C, M, Y, and K and improves with respect to single color light. Note that the color purity is not limited to those described in the first and second examples, but known color-purity calculation techniques are available.

    [0068] After the calculation of the color purity of the colors C, M, Y, and K in the segment region by the color purity calculation section 120c, the repeat processing unit 120 determines whether the segment region is excellent in evenness degree and color purity by the quality determination section 120d (S50). This determination processing is performed for each of the colors C, M, Y, and K. More specifically, for each of the colors C, M, Y, and K, the quality determination section 120d determines that the segment region is an excellent segment region if the evenness degree is equal to or greater than a predetermined threshold and the color purity is equal to or greater than a predetermined threshold, and determines that the segment region is not an excellent segment region if any of the evenness degree and the color purity is less than the threshold.

    [0069] After the determination of the quality of the segment region by the quality determination section 120d, the repeat processing unit 120 determines whether all the segment regions have been extracted (extraction of all the segment regions in the entire image has been completed) (S60). If the repeat processing unit 120 determines that one or more segment regions have not been extracted (N in S60), the repeat processing unit 120 returns the processing flow to step S20 to repeatedly perform steps S20 through S60. At this time, when a segment region is extracted, for example, the second time, the position of the subject pixel is shifted by one pixel in a right direction. As a result, the pixel placed at the 52nd column and the 51st row from the upper left side is regarded as the subject pixel, and the rectangular region of 101 pixels x 101 pixels is extracted as the segment region. Then, in extracting a segment region the third, fourth, ... n-th time, the position of the subject pixel is shifted by one pixel in the right direction. After the position of the subject pixel in a column direction is shifted left to the position at the 51st row from a right end, the position of the subject pixel in the column direction is returned right to the position at the 51st row from a left end and the position of the subject pixel in a row direction is shifted downward by one pixel. Then, the position of the subject pixel is repeatedly shifted right by one pixel. As described above, the position of the subject pixel is successively shifted like raster scanning, thereby covering the entire image.

    [0070] Note that instead of shifting the position of the subject pixel by one pixel, respective segment regions may be extracted in such a manner that the edges of the extracted segment regions are not overlapped with each other. For example, after the extraction of the segment region of 101 pixels x 101 pixels about the subject pixel at the 51st column and the 51st row, a segment region of 101 pixels x 101 pixels about a subject pixel at the 102nd column and the 51st row is extracted.

    [0071] After the determination of the quality and the extraction of the segment regions from the entire image, the repeat processing unit 120 outputs positional information on all the excellent segment regions to the candidate region selection unit 130. Based on the positional information on the excellent segment regions, the candidate region selection unit 130 selects as a candidate region a region having many excellent segment regions from the entire region of the image (S7).

    [0072] FIG. 12 is a schematic diagram for explaining an example of the candidate regions selected in step S70. In this example, three large, medium, and small sized candidate regions are selected from the entire region of an image. After the selection of the candidate regions by the candidate region selection unit 130, the combination specification unit 140 specifies all possible different combinations established when a predetermined number of the segment regions are selected from all the segment regions included in the candidate regions and combined with each other. Here, the predetermined number is set to four. In the example in which the three large, medium, and small sized candidate regions shown in FIG. 12 are selected, all possible different combinations established when four of the segment regions are selected from all the segment regions included in the candidate regions and combined with each other are shown in FIG. 13.

    [0073] Information items on the combinations thus specified are transmitted from the combination specification unit 140 to the index value calculation unit 150. The index value calculation unit 150 randomly selects one of the information items on all the combinations transmitted from the combination specification unit 140, and then calculates a spatial dispersion degree (S90) and an index value (S100) with respect to the segment regions of the selected information.

    [0074] As a first example of calculating the spatial dispersion degree calculated in step S90, the spatial dispersion degree can be calculated according to Euclidian distances between the gravity centers of the respective segment regions. Specifically, as shown in FIG. 14, assuming that the (geographic) gravity centers of the four segment regions included in the combination are representative points, the sum of inverse numbers of the Euclidian distances (d12, d13, d14, d23, d24, and d34) between the representative points is calculated, and then a negative sign is added to the sum. Thus, the spatial dispersion degree is obtained.

    [0075] As a second example of calculating the spatial dispersion degree, the spatial dispersion degree can be calculated according to variance (as a statistical value) between the respective segment regions. Specifically, the coordinates of the representative points (e.g., the gravity centers) of the four segment regions are first calculated, and then a variance-covariance matrix at horizontal and vertical positions is calculated. Next, the trace or the determinant of the variance-covariance matrix is specified as the spatial dispersion degree. Note that the calculation of the spatial dispersion degree is not limited to the first and the second examples described above, but known spatial dispersion degree calculation techniques are available.

    [0076] After the calculation of the spatial dispersion degree with respect to the combination (S90), the index value calculation unit 150 calculates an index value according to the following mathematical formula based on the spatial dispersion degree and the evenness degree and the color purity of the four segment regions with respect to the combination.



    [0077] In this formula, "a" is a weighting coefficient expressing the evenness degree, "b" is a weighting coefficient expressing the color purity, and "c" is a weighting coefficient expressing the spatial dispersion degree. Further, symbols E before the evenness degree, the color purity, and the spatial dispersion degree express that the evenness degrees, the color purities, and the spatial dispersion degrees of the four segment regions are summed. The better the combination of the evenness degree, the color purity, and the spatial dispersion degree is, the larger the index value becomes.

    [0078] After the calculation of the index value, the index value calculation unit 150 transmits the result of the calculation to the object region determination unit 170 via the processing stop determination unit 160. The processing stop determination unit 160 previously stores a determination criterion for determining whether the calculation of an index value should be stopped. Here, the number of times calculating an index value is adopted as the determination criterion. For example, the processing stop determination unit 160 defaults at 1000 times (index values are calculated for each of 1000 different combinations) as a threshold of the number of times calculating an index value, and determines whether the number of times calculating an index value has actually reached the threshold (S110). Then, if the number has reached the threshold, the processing stop determination unit 160 determines that the calculations should be stopped and transmits the result of the determination to the object region determination unit 170. On the other hand, if it is determined that the number of times calculating an index value has not reached the stop criterion (threshold), the processing stop determination unit 160 transmits an instruction signal for calculating index values of other combinations to the index value calculation unit 150. After receiving the instruction signal, the index value calculation unit 150 randomly selects a non-selected one of all combinations previously provided by the combination specification unit 140, and calculates the index value of the selected combination.

    [0079] After receiving the signal for stopping the calculation of an index value, the object region determination unit 170 determines, as the combination of the four segment regions to be inspected, the combination (of the four segment regions) showing the largest index value among all the index values that the object region determination unit 170 have received (S120). Then, the object region determination unit 170 outputs the positional data on the combination as object region data.

    [0080] Note that steps S80 through S120 are performed for each of the colors C, M, Y, and K. Accordingly, the object region determination unit 170 outputs the object region data for each of the colors C, M, Y, and K.

    [0081] The image processing apparatus having the above configuration regards as excellent segment regions only segment regions excellent in evenness degree and color purity among all the segment regions extracted from the entire region of an image. Then, the image processing apparatus specifies all the combinations of four different segment regions with respect to only candidate regions having relatively many excellent segment regions in the entire region of the image, and then calculates an index value for each of the combinations. The image processing apparatus having this configuration reduces time required for calculating index values compared with a case in which all combinations of four segment regions are specified with respect to all regions extracted from the entire region of an image and index values are calculated for each of the combinations. Therefore, the image processing apparatus can specify the combinations of segment regions having relatively a large evenness degree, color purity, and a spatial dispersion degree from the entire region of an image in a shorter period of time.

    [0082] The image processing apparatus 100 according to the first mode of the present invention is composed of a personal computer and a program for causing the personal computer to function as an image processing apparatus. The program is stored in an optical disk such as a CD-ROM and a DVD-ROM as a recording medium so as to be readable by a machine, and can be installed in the hard disk of the personal computer via the optical disk. Any of the repeat processing unit 120, the candidate region selection unit 130, the combination specification unit 140, the index value calculation unit 150, the processing stop determination unit 160, and the object region determination unit 170 shown in FIG. 9 is implemented by the arithmetic processing of a CPU of a personal computer as software.

    [0083] Note here that candidate regions including plural excellent segment regions are selected. However, a part of or all of the candidate regions (the same in size as the segment region) including only one excellent segment region may be selected.

    [0084] Next, a description is made of a modification of the image processing apparatus 100. Note that unless otherwise specified, the image processing apparatus 100 according to the modification is similar in configuration to the image processing apparatus 100 according to the second mode of the present invention.

    [0085] FIG. 15 is a block diagram showing the configuration of a substantial part of the image processing apparatus 100 according to the modification. FIG. 16 is a flowchart showing the processing flow of determining an object region by the image processing apparatus 100 according to the modification. The image processing apparatus 100 according to the modification is different from the image processing apparatus 100 according to the second mode of the present invention in combination specification processing by the combination specification unit 140 and steps after the combination specification processing. The flowchart shown in FIG. 10 is very similar to the flowchart shown in FIG. 16. However, the processing in FIG. 10 returns from step S110 to step S90, while the processing in FIG. 16 returns from step S110 to step S80. Such a difference in returning destinations is attributed to the fact that the index value calculation unit 150 (see FIG. 9) determines a combination of objects for calculating an index value in the processing of FIG. 10 while the combination specification unit 140 (see FIG. 15) determines the same in the processing of FIG. 16.

    [0086] The combination specification unit 140 of the image processing apparatus 100 according to the modification has a retention solution storage section composed of a RAM or the like. The retention solution storage section stores data on the combinations of data items showing a relatively large index value. Every time the combination specification unit 140 selects and combines four of all segment regions included in candidate regions to specify a new combination, it successively outputs a specification result to the index value calculation unit 150. Then, upon receiving data on the new combination from the combination specification unit 140, the index value calculation unit 150 calculates the index value of the combination. That is, in the second mode of the present invention, the index value calculation unit 150 randomly selects which one of all possible combinations of four segment regions is used for calculating an index value. On the other hand, in the modification, selecting a combination of segment regions is performed by the combination specification unit 140.

    [0087] After randomly specifying a first combination of four segment regions and outputting its result to the index value calculation unit 150, the combination specification unit 140 waits for the calculation result of an index value from the index value calculation unit 150. Upon receiving the calculation result from the index value calculation unit 150, the combination specification unit 140 stores it in the retention solution storage section together with data on the combination. Next, in the same manner as the above, the combination specification unit 140 randomly specifies a second combination of segment regions and outputs its result to the index value calculation unit 150. After that, the combination specification unit 140 receives the calculation result of an index value from the index value calculation unit 150, and then compares this calculation result with the calculation result stored in the retention solution storage section. If the index value of the newly-specified combination is greater than the index value stored in the retention solution storage section, the combination specification unit 140 updates the data inside the retention solution storage section with the data on the newly-specified combination. On the other hand, if the index value stored in the retention solution storage section is greater than the index value of the newly-specified combination, the combination specification unit 140 leaves the data inside the retention solution storage section as they are. Subsequently, in order to specify a third combination of segment regions, the combination specification unit 140 refers to the combination that is stored in the retention storage section and close in position to the third combination. Thus, the combination specification unit 140 updates a retention solution as occasion demands and specifies a new combination of segment regions based on a retention solution so as to specify a third or later combination of segment regions.

    [0088] FIG. 17 is a flowchart specifically showing step S80 in the processing flow shown in FIG. 16, i.e., the step performed when a second or later combination of segment regions is specified. As shown in FIG. 17, in order to specify a second or later combination, the combination specification unit 140 determines whether a previous evaluation value (the evaluation value of a first combination when, for example, the second combination is specified) is greater than an evaluation value stored in the retention solution storage section (S80a). If it is determined that the previous evaluation value is greater than the evaluation value stored in the retention solution storage section (Y in S80a), the combination specification unit 140 updates data on the combination and the evaluation value stored in the retention solution storage section with data on the previous evaluation value (S80b). On the other hand, if it is determined that the previous evaluation value is not greater than the evaluation value stored in the retention solution storage section (N in S80a), the combination specification unit 140 maintains the data inside the retention solution storage section as they are. Then, the combination specification unit 140 specifies a combination of segment regions close in position to the combination of segment regions stored in the retention solution storage section as a new combination (S80c).

    [0089] Thus, the combination specification unit 140 specifies the combination of segment regions close in position to the combination of segment regions stored in the retention solution storage section as a new combination, thereby making it possible to increase the likelihood of selecting a combination of segment regions having a relatively large index value. Accordingly, the combination specification unit 140 can efficiently search for a combination of segment regions having a large index value.

    [0090] Note that even if the previous evaluation value is below the evaluation value stored in the retention solution storage section (hereinafter referred to as a retention solution evaluation value) but meets certain conditions, the combination specification unit 140 may update a retention solution. For example, as shown in FIG. 18, assuming that the degraded amount of the previous evaluation value relative to the retention solution evaluation value is d, the retention solution may be updated under the probability exp(-d/t) based on the parameter t. The value of the parameter t is decreased every time the combination specification unit 140 updates the retention solution. This is called a simulated annealing method.

    [0091] Further, a stop criterion in step S110 may be such that the frequency of updating a retention solution becomes equal to or less than a certain value (e.g., calculation of an index value is stopped if the retention solution is not updated for ten consecutive times). A method for increasing the likelihood of specifying a combination having a large evaluation value is not limited to the simulated annealing method described above, but any known optimization techniques are available.

    [0092] As a first example of a method for specifying a combination of segment regions close in position to a combination of segment regions stored in the retention solution storage section as a new combination of the segment regions, the following method can be used. In other words, this method includes selecting three of four segment regions completely the same as the segment regions of a combination (hereinafter referred to as a retention solution combination) stored in the retention solution storage section, and selecting one segment region partially overlapping or adjacent to the rest of the retention solution combination. For example, assuming that the previous combination of the segment regions is the one shown in FIG. 13, segment regions shown in FIG. 19 are specified as a new combination. In the new combination shown in FIG. 19, three of the four segment regions are completely the same as the segment regions of the retention solution combination shown in FIG. 13. Further, the other one of the four segment regions partially overlaps the rest of the segment regions of the retention solution combination as indicated by dotted lines in FIG. 19.

    [0093] Further, as a second example of a method for specifying a combination of segment regions close in position to a combination of segment regions stored in the retention solution storage section as a new combination of the segment regions, the following method can be used. In other words, this method includes selecting some segment regions completely the same as the segment regions of the retention solution combination stored in the retention solution storage section, and randomly selecting the other segment region. For example, assuming that the previous combination of the segment regions is the one shown in FIG. 13, segment regions shown in FIG. 20 are specified as a new combination. In the new combination shown in FIG. 20, three of the four segment regions are completely the same as the segment regions of the retention solution combination shown in FIG. 13. Further, the other one of the four segment regions is randomly selected from candidate regions as a substitute for the rest of the segment regions of the retention solution combination as indicated by dotted lines in FIG. 20.

    [0094] The above description exemplifies the processing of color image data including pixel values showing brightness for each of the four color components Y, M, C, and K. However, it is also possible to process binary image data and grayscale images showing the brightness of only black and white depending on pixel values; color image data including pixel values showing brightness for each of the three color components R (red), G (green), and B (blue); spectral image data and color image data including pixel values showing the brightness for each of four or more color components; or the like. Note that in the method of the first example using Euclidian distances in a uniform color space for calculating color purity, the color purity of colors other than C, M, Y, and K can be calculated by changing target colors. Further, in the method of the second example using the secondary formula, the color purity of colors other than C, M, Y, and K can be calculated by changing the use of axes.

    [0095] In the image processing apparatus 100 according to the second mode of the present invention, the evenness degree calculation unit 120b is configured to calculate the evenness degree of segment regions based on at least any one of the dispersion degree of pixel values, a difference between the maximum value and the minimum value of the pixel values, and the frequency characteristic of the pixel values as color information of pixels of the segment regions. With this configuration, a numerical value having high correlation with the density evenness of the segment regions can be regarded as the evenness degree.

    [0096] Further, as the first example of calculating color purity in the image processing apparatus 100 according to the second mode of the present invention, the color purity calculation unit 120c is configured to calculate as the color purity the Euclidian distances in a uniform color space between an average value of pixel values as the color information of pixels in segment regions and specific colors C, M, Y, and K. With this configuration, the smaller the Euclidian distances between the average color of the segment regions and the specific colors (C, M, Y, and K) in the uniform color space are, the larger the value of the color purity can be made.

    [0097] Further, as the second example of calculating color purity in the image processing apparatus 100 according to the second mode of the present invention, the color purity calculation unit 120c is configured to calculate the color purity in which the sign of an average value corresponding to a color to be inspected (C, M, Y, or K) among the average values of the different color components C, M, Y, and K in segment regions is positive (or may be negative) while the signs of average values corresponding to the other colors are different from the sign of the average value corresponding to the color to be inspected. With this configuration, the value of the color purity can be increased toward the positive side as the average color of the segment regions is closer to the color to be inspected.

    [0098] Further, as the second example of calculating a spatial dispersion degree in the image processing apparatus 100 according to the second mode of the present invention, the index value calculation unit 150 is configured to calculate as the spatial dispersion degree the variance-covariance matrix of representative coordinates of respective segment regions in a combination of four segment regions or an inverse matrix thereof. With this configuration, the dispersibility of the four segment regions can be recognized.

    [0099] Further, as the first example of calculating a spatial dispersion degree in the image processing apparatus 100 according to the second mode of the present invention, the index value calculation unit 150 is configured to calculate as the spatial dispersion degree the sum of inverse numbers of distances between representative coordinates of respective segment regions in a combination of four segment regions. With this configuration, the dispersibility of the four segment regions can be recognized based on a simple numerical value.

    [0100] Further, in the image processing apparatus 100 according to the modification, the index value calculation unit 150 is configured to start calculating the index value of a combination specified by the combination specification unit 14 before all possible combinations of all segment regions included in candidate regions are specified by the combination specification unit 140. With this configuration, timing for starting the calculation of an index value can be made earlier compared to a case where the calculation of an index value of each combination is started after all combinations of segment regions are specified.

    [0101] Further, in the image processing apparatus 100 according to the modification, the index value calculation unit 150 is configured to specify a new combination of segment regions and calculate the index value of the combination based on the index value of a retention solution combination as the history of calculated index values. With this configuration, the likelihood of selecting a combination of segment regions having a relatively large index value can be increased.

    [0102] Further, in the image processing apparatus 100 according to the second mode of the present invention, the index value calculation unit 150 is configured to calculate an index value based on the sum of values obtained by multiplying an evenness degree, color purity, and a spatial dispersion degree by specific weighting coefficients a, b, and c. With this configuration, the evenness degree, color purity, and the spatial dispersion degree that could most affect variations in index value or could least affect the same can be arbitrarily adjusted along with the adjustment of the ratio of the sizes of the weighting coefficients a, b, and c.

    [0103] The present application is based on Japanese Priority Application Nos. 2009-273507 filed on December 1, 2009, and 2010-059123 filed on March 16, 2010, with the Japan Patent office.


    Claims

    1. An image information processing apparatus (10)configured to determine a region suitable for adjusting the image forming performance of an image forming apparatus, the image information processing apparatus (100) comprising:

    a segment region extraction unit (120a) configured to extract a segment region from an entire region of the acquired image data;

    an evenness degree calculation unit (120b) configured to calculate an evenness degree that shows density evenness based on pixel values of the segment region;

    a color purity calculation unit (120c) configured to calculate color purity for color information of the segment region;

    a quality determination unit (120d) configured, with respect to all segment regions of the image data, to determine the segment region as an excellent segment regions if the evenness degree and the color purity are equal to or are greater than or equal to respective predetermined thresholds;

    a candidate region selection unit (130) configured to select, as a candidate region, a region that has a number of the excellent segment regions from among the entire region of the image data based on positional information of the excellent segment regions;

    a combination specification unit (140) configured to select a predetermined number of the segment regions from all the segment regions included in the candidate region, and to specify different combinations cf the segment regions;

    a spatial dispersion degree calculation unit (150) configured to calculate the spatial dispersion degree of the segment regions on the basis of all possible combinations of the segment region;

    an index value calculation unit (150) configured to calculate an index value by summing up the evenness degrees of the segment regions multiplied by a first weighting coefficient, the color purities of the segment regions multiplied by a second weighting coefficient, and the spatial dispersion degree multiplied by a third weighting coefficient on the basis of all the possible combinations of the segment region; and

    an object region determination unit (170) configured to determine, as an object region, the segment regions that correspond to the largest one of the index values.


     
    2. Apparatus according to claim 1, in which the evenness degree calculation unit (120b) is configured to calculate the dispersion of the respective pixels of the colors C, M, Y and K, and to determine the evenness degree to be the negative of the sum of the dispersions.
     
    3. Apparatus according to claim 1, in which the evenness degree calculation unit (120b) is configured to calculate the evenness degree to be the negative of the value of the determinant of a 4 x 4 variance-covariance matrix of the respective pixels for each of the colors C, M, Y and K, in which the variance is arranged in diagonal components and the covariance is arranged in non-diagonal components.
     
    4. Apparatus according to claim 1, in which the evenness degree calculation unit (120b) is configured to calculate the evenness degree to be the negative of the sum of the squares of the absolute value of a Fourier coefficient of a specific frequency or of specific frequencies when a Fourier transformation is performed using the respective pixels in the segment region.
     
    5. Apparatus according to any preceding claim, in which the color purity calculation unit (120c) is configured to calculate for each color C, M, Y and K an average value of the pixel values of respective pixels in the segment region, to convert the average value into a dot in a uniform color space, and to determine the color purity of the colors C, M, Y and K to be the minimum values of the Euclidian distances between the converted dot and the dots of the colors C, M, Y and K.
     
    6. Apparatus according to any of claims 1 to 4, in which the color purity calculation unit (120c) is configured to calculate for each color C, M, Y and K average values mC, mM, mY and mK, and to determine the color purity f(µ) to be:

    where µ is the four-dimensional vertical vector using as elements the average values mC, mM, mY and mK,

    w is a vertical vector,

    and Q is a 4 x 4 square matrix,

    T representing transposition of a matrix.


     
    7. Apparatus according to any preceding claim, in which the spatial dispersion degree calculation unit (150) is configured to determine as the spatial dispersion degree the negative of the sum of inverse numbers of the Euclidian distances between representative points which are the geographic gravity centres of the respective segment regions.
     
    8. Apparatus according to any of claims 1 to 6, in which the spatial dispersion degree calculation unit (150) is configured to determine as the spatial dispersion degree the trace or the determinant of the variance-covariance matrix at horizontal and vertical positions calculated from the coordinates of representative points, such as gravity centres, or the respective segment regions.
     
    9. A non-transitory recording medium having recorded therein a program so as to be readable by a machine, the program causing a computer to function as the image information processing apparatus according to any preceding claim.
     


    Ansprüche

    1. Vorrichtung zur Verarbeitung von Bildinformationen (10), die konfiguriert ist, um einen geeigneten Bereich zum Anpassen der Bildgebungsleistung einer Bildgebungsvorrichtung bestimmen, die Vorrichtung zur Verarbeitung von Bildinformationen (100) umfassend:

    eine Segmentbereich-Extraktionseinheit (120a), die konfiguriert ist, um einen Segmentbereich von einem ganzen Bereich der erlangten Bilddaten zu extrahieren;

    eine Gleichförmigkeitsgrad-Berechnungseinheit (120b), die konfiguriert ist, um einen Gleichförmigkeitsgrad zu berechnen, der eine Dichtegleichförmigkeit aufgrund von Pixel-Werten des Segmentbereichs zeigt;

    eine Farbreinheit-Berechnungseinheit (120c), die konfiguriert ist, um eine Farbreinheit für Farbinformationen des Segmentbereichs zu berechnen;

    eine Qualität-Bestimmungseinheit (120d), die in Bezug auf alle Segmentbereiche der Bilddaten konfiguriert ist, um den Segmentbereich als einen ausgezeichneten Segmentbereich zu bestimmen, wenn der Gleichförmigkeitsgrad und die Farbreinheit gleich oder größer, oder gleich wie jeweilige vordefinierte Schwellenwerte sind;

    eine Kandidatenbereich-Auswahleinheit (130), die konfiguriert ist, um als Kandidatenbereich einen Bereich, der eine Anzahl von ausgezeichneten Segmentbereichen hat, aus dem gesamten Bereich der Bilddaten beruhend auf Positionsinformationen der ausgezeichneten Segmentbereiche auszuwählen;

    eine Kombination-Spezifikationseinheit (140), die konfiguriert ist, um eine vordefinierte Anzahl der Segmentbereiche aus allen enthaltenen Segmentbereichen im Kandidatenbereich auszuwählen, und um verschiedene Kombinationen der Segmentbereiche zu spezifizieren;

    eine Raumstreuungsgrad-Berechnungseinheit (150), die konfiguriert ist, um den Raumstreuungsgrad der Segmentbereiche auf der Grundlage aller möglichen Kombinationen der Segmentbereiche zu berechnen;

    eine Indexwert-Berechnungseinheit (150), die konfiguriert ist, um einen Indexwert durch Addieren der Gleichförmigkeitsgrade der Segmentbereiche multipliziert mit einem ersten Gewichtungskoeffizienten, der Farbreinheiten der Segmentbereiche multipliziert mit einem zweiten Gewichtungskoeffizienten und des Raumstreuungsgrads multipliziert mit einem dritten Gewichtungskoeffizienten auf der Grundlage aller möglichen Kombinationen der Segmentbereiche zu berechnen; und

    eine Objektbereich-Bestimmungseinheit (170), die konfiguriert ist, um als einen Objektbereich die Segmentbereiche zu bestimmen, die dem größten der Indexwerte entsprechen.


     
    2. Vorrichtung nach Anspruch 1, wobei die Gleichförmigkeitsgrad-Berechnungseinheit (120b) konfiguriert ist, um die Streuung der jeweiligen Pixel der Farben C, M, Y und K zu berechnen, und um den Gleichförmigkeitsgrad so zu bestimmen, dass er das Negative der Summe der Streuungen ist.
     
    3. Vorrichtung nach Anspruch 1, wobei die Gleichförmigkeitsgrad-Berechnungseinheit (120b) konfiguriert ist, um den Gleichförmigkeitsgrad so zu berechnen, dass er das Negative des Werts der Determinanten einer 4 x 4 Varianz-Kovarianz-Matrix der jeweiligen Pixel für jede der Farben C, M, Y und K ist, wobei die Varianz in diagonalen Komponenten angeordnet ist und die Kovarianz in nichtdiagonalen Komponenten angeordnet ist.
     
    4. Vorrichtung nach Anspruch 1, wobei die Gleichförmigkeitsgrad-Berechnungseinheit (120b) konfiguriert ist, um den Gleichförmigkeitsgrad so zu berechnen, dass er das Negative der Summe der Quadrate des Absolutwerts eines Fourier-Koeffizienten einer spezifischen Frequenz oder von spezifischen Frequenzen ist, wenn eine Fourier-Transformation unter Verwendung der jeweiligen Pixel im Segmentbereich ausgeführt wird.
     
    5. Vorrichtung nach einem vorherigen Anspruch, wobei die Farbreinheit-Berechnungseinheit (120c) konfiguriert ist, um für jede Farbe C, M, Y und K einen Mittelwert der Pixel-Werte der jeweiligen Pixel im Segmentbereich zu berechnen, um den Mittelwert in einen Punkt in einem gleichförmigen Farbraum zu verwandeln, und um die Farbreinheit der Farben C, M, Y und K so zu bestimmen, dass sie die Mindestwerte der euklidischen Abstände zwischen dem umgewandelten Punkt und den Punkten der Farben C, M, Y und K sind.
     
    6. Vorrichtung nach einem der Ansprüche 1 bis 4, wobei die Farbreinheit-Berechnungseinheit (120c) konfiguriert ist, um für jede Farbe C, M, Y und K Mittelwerte mC, mM, mY und mK zu berechnen, und um die Farbreinheit f(µ) so zu bestimmen, dass sie wie folgt ist:

    wobei µ der vierdimensionale vertikale Vektor ist, der als Elemente die Mittelwerte mC, mM, mY und mK verwendet,

    w ein vertikaler Vektor ist,

    und Q eine 4 x 4 quadratische Matrix ist,

    T eine Transposition einer Matrix darstellt.


     
    7. Vorrichtung nach einem der vorherigen Ansprüche, wobei die Raumstreuungsgrad-Berechnungseinheit (150) konfiguriert ist, um als den Raumstreuungsgrad das Negative der Summe invertierter Zahlen der euklidischen Abstände zwischen repräsentativen Punkten zu bestimmen, die die geographischen Schwerpunkte der jeweiligen Segmentbereiche sind.
     
    8. Vorrichtung nach einem der Ansprüche 1 bis 6, wobei die Raumstreuungsgrad-Berechnungseinheit (150) konfiguriert ist, um als den Raumstreuungsgrad die Spur oder die Determinante der Varianz-Kovarianz-Matrix an horizontalen und vertikalen Punkten zu bestimmen, die von den Koordinaten repräsentativer Punkte, wie z. B. Schwerpunkte, oder der jeweiligen Segmentbereiche berechnet werden.
     
    9. Nicht transitorisches Aufzeichnungsmedium mit einem darin so gespeicherten Programm, dass es von einer Maschine gelesen werden kann, wobei das Programm einen Rechner dazu veranlasst, als die Vorrichtung zur Verarbeitung von Bildinformationen nach einem der vorherigen Ansprüche zu funktionieren.
     


    Revendications

    1. Appareil de traitement d'informations d'image (10) configuré pour déterminer une région appropriée pour ajuster les performances de formation d'image d'un appareil de formation d'image, l'appareil de traitement d'informations d'image (100) comprenant :

    une unité d'extraction de région de segment (120a) configurée pour extraire une région de segment d'une région entière des données d'image acquises ;

    une unité de calcul de degré de régularité (120b) configurée pour calculer un degré de régularité qui montre une régularité de densité basée sur les valeurs de pixel de la région de segment ;

    une unité de calcul de pureté de couleur (120c) configurée pour calculer une pureté de couleur pour les informations de couleur de la région de segment ;

    une unité de détermination de qualité (120d) configurée pour, en relation avec toutes les régions de segment des données d'image, déterminer la région de segment en tant que région de segment excellente si le degré de régularité et la pureté de couleur sont égaux à des seuils prédéterminés respectifs ou supérieurs ou égaux à ceux-ci ;

    une unité de sélection de région candidate (130) configurée pour sélectionner, en tant que région candidate, une région qui comporte un certain nombre des régions de segment excellentes dans la région entière des données d'image sur la base des informations de position des régions de segment excellentes ;

    une unité de spécification de combinaison (140) configurée pour sélectionner un nombre prédéterminé des régions de segment parmi toutes les régions de segment incluses dans la région candidate, et pour spécifier différentes combinaisons des régions de segment ;

    une unité de calcul de degré de dispersion spatiale (150) configurée pour calculer le degré de dispersion spatiale des régions de segment sur la base de toutes les combinaisons possibles des régions de segment ;

    une unité de calcul de valeur d'indice (150) configurée pour calculer une valeur d'indice en sommant les degrés de régularité des régions de segment multipliés par un premier coefficient de pondération, les puretés de couleur des régions de segment multipliées par un deuxième coefficient de pondération, et le degré de dispersion spatiale multiplié par un troisième coefficient de pondération sur la base de toutes les combinaisons possibles des régions de segment ; et

    une unité de détermination de région d'objet (170) configurée pour déterminer, en tant que région d'objet, les régions de segment qui correspondent à la plus grande des valeurs d'indice.


     
    2. Appareil selon la revendication 1, dans lequel l'unité de calcul de degré de régularité (120b) est configurée pour calculer la dispersion des pixels respectifs des couleurs C, M, Y et K, et pour déterminer le degré de régularité pour qu'il soit le négatif de la somme des dispersions.
     
    3. Appareil selon la revendication 1, dans lequel l'unité de calcul de degré de régularité (120b) est configurée pour calculer le degré de régularité pour qu'il soit le négatif de la valeur du déterminant d'une matrice de variance-covariance 4 x 4 des pixels respectifs pour chacune des couleurs C, M, Y et K, dans lequel la variance est agencée dans les composantes diagonales et la covariance est agencée dans les composantes non diagonales.
     
    4. Appareil selon la revendication 1, dans lequel l'unité de calcul de degré de régularité (120b) est configurée pour calculer le degré de régularité pour qu'il soit le négatif de la somme des carrés de la valeur absolue d'un coefficient de Fourier d'une fréquence spécifique ou de fréquences spécifiques lorsqu'une transformation de Fourier est effectuée en utilisant les pixels respectifs dans la région de segment.
     
    5. Appareil selon l'une quelconque des revendications précédentes, dans lequel l'unité de calcul de pureté de couleur (120c) est configurée pour calculer, pour chaque couleur C, M, Y et K, une valeur moyenne des valeurs de pixel des pixels respectifs dans la région de segment, pour convertir la valeur moyenne en un point dans un espace de couleur uniforme, et pour déterminer les puretés de couleur des couleurs C, M, Y et K pour qu'elles soient les valeurs minimums des distances euclidiennes entre le point converti et les points des couleurs C, M, Y et K.
     
    6. Appareil selon l'une quelconque des revendications 1 à 4, dans lequel l'unité de calcul de pureté de couleur (120c) est configurée pour calculer, pour chaque couleur C, M, Y et K, des valeurs moyennes mC, mM, mY et mK, et pour déterminer la pureté de couleur f(µ) pour qu'elle soit :

    où µ est le vecteur vertical quadridimensionnel utilisant en tant qu'éléments les valeurs moyennes mC, mM, mY et mK,

    w est un vecteur vertical,

    et Q est une matrice carrée 4 x 4,

    T représentant une transposition d'une matrice.


     
    7. Appareil selon l'une quelconque des revendications précédentes, dans lequel l'unité de calcul de degré de dispersion spatiale (150) est configurée pour déterminer, en tant que degré de dispersion spatiale, le négatif de la somme des nombres inverses des distances euclidiennes entre des points représentatifs qui sont les centres de gravité géographiques des régions de segment respectives.
     
    8. Appareil selon l'une quelconque des revendications 1 à 6, dans lequel l'unité de calcul de degré de dispersion spatiale (150) est configurée pour déterminer, en tant que degré de dispersion spatiale, la trace ou le déterminant de la matrice de variance-covariance à des positions horizontales et verticales calculées à partir des coordonnées de points représentatifs, tels que les centres de gravité, ou les régions de segment respectives.
     
    9. Support d'enregistrement non transitoire sur lequel un programme est enregistré de manière à pouvoir être lu par une machine, le programme amenant un ordinateur à fonctionner en tant qu'appareil de traitement d'informations d'image selon l'une quelconque des revendications précédentes.
     




    Drawing






























































    Cited references

    REFERENCES CITED IN THE DESCRIPTION



    This list of references cited by the applicant is for the reader's convenience only. It does not form part of the European patent document. Even though great care has been taken in compiling the references, errors or omissions cannot be excluded and the EPO disclaims all liability in this regard.

    Patent documents cited in the description