(19)
(11)EP 2 779 099 B1

(12)EUROPEAN PATENT SPECIFICATION

(45)Mention of the grant of the patent:
29.04.2020 Bulletin 2020/18

(21)Application number: 14158127.2

(22)Date of filing:  06.03.2014
(51)International Patent Classification (IPC): 
G06T 11/60(2006.01)

(54)

Layout editing device, layout editing method and program thereof

Layoutbearbeitungsvorrichtung, Layoutbearbeitungsverfahren und Programm dafür

Dispositif et procédé d'édition de mise en page et programme associé


(84)Designated Contracting States:
AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR

(30)Priority: 13.03.2013 JP 2013050651
10.12.2013 JP 2013254814

(43)Date of publication of application:
17.09.2014 Bulletin 2014/38

(73)Proprietor: FUJIFILM Corporation
Minato-ku Tokyo 106-8620 (JP)

(72)Inventors:
  • Yamaji, Kei
    Tokyo, 107-0052 (JP)
  • Nakashima, Teruyoshi
    Tokyo, 107-0052 (JP)

(74)Representative: Klunker IP Patentanwälte PartG mbB 
Destouchesstraße 68
80796 München
80796 München (DE)


(56)References cited: : 
US-A1- 2013 028 521
  
      
    Note: Within nine months from the publication of the mention of the grant of the European patent, any person may give notice to the European Patent Office of opposition to the European patent granted. Notice of opposition shall be filed in a written reasoned statement. It shall not be deemed to have been filed until the opposition fee has been paid. (Art. 99(1) European Patent Convention).


    Description

    BACKGROUND OF THE INVENTION


    1. Field of the Invention



    [0001] The present invention relates to a layout editing device, a layout editing method, and a program to edit a layout in which a predetermined number of images selected from a plurality of images are disposed at predetermined positions.

    2. Description of the Related Art



    [0002] For a photo book, a user selects a predetermined number of images from a plurality of images (image data) that the user owns, and creates a photo collection (photo album) of the layout that the user desires using the selected predetermined number of images. In recent years, an automatic layout function to automatically select a predetermined number of images from a plurality of images owned by the user and automatically create the layout of each page of a photo book using the predetermined number of selected images is provided.

    [0003] In a known photo book, creating a photo book from about several hundreds of images taken in one event, such as a trip or a wedding ceremony, is assumed. Meanwhile, in recent years, creating a photo book from a large number of images of 1000 to several thousands of images in a year has been performed, for example, as a memorial album for a user who owns a large number of images but has no time to create a photo book.

    [0004] When laying out a photo book without using the automatic layout function, for example, a selection assisting function, such as presenting a recommended image by performing image analysis, is provided. However, when creating the layout of the photo book from a large number of images of 1000 to several thousands of images, there is a problem in that it takes a lot of time and effort for the user to select desired images from them.

    [0005] On the other hand, when the automatic layout function is used, the user performs editing processing, such as the addition or deletion of an image, in the layout created automatically. However, for example, even when 200 images are automatically selected from 1500 images and the layout of the photo book is automatically created, the user should add and delete images while checking the unused 1300 images that have not been used in the photo book. Accordingly, there is a problem in that it takes a lot of time and effort.

    [0006] As a prior art document relevant to the present invention, there is JP2009-265886A.

    [0007] JP2009-265886A discloses an image management device that provides images to information processing apparatuses of a plurality of viewers through a network. The image management device includes setting means for setting the behavior pattern of each viewer with respect to an image, search means for searching for an image in which the operation pattern set for each viewer by the setting means matches the operation history of the viewer with respect to the provided image, and display means for displaying the image searched for by the search means.
    A further image management device of interest is disclosed in US 2013/0028521 A1.

    SUMMARY OF THE INVENTION



    [0008] The image management device disclosed in JP2009-265886A selects images based on the behavior pattern of the viewer with respect to images, and displays preferred images of the viewer selectively. In contrast, the present invention is for estimating the preference of a user based on a layout editing result of the user and assisting the layout editing work of the user based on the estimated user preference. Accordingly, there is a difference in that the work of editing the layout of a photo book can be simplified.

    [0009] In order to solve the problems in the related art, it is an object of the present invention to provide a layout editing device, a layout editing method, and a program allowing a user to select desired unused images easily from a large number of unused images when editing the layout of images.

    [0010] In order to achieve the above-described object, according to an aspect of the present invention, there is provided a layout editing device that edits a layout in which a predetermined number of images selected from a plurality of images are disposed at predetermined positions. The layout editing device includes: a screen display unit that displays an editing screen of the layout; an instruction input unit that inputs an instruction of a user for editing the layout; a layout editing unit that edits the layout, which is displayed on the editing screen of the screen display unit, based on the instruction of the user; an image analysis unit that performs image analysis of each of the plurality of images; a preference estimation unit that estimates a preference of the user based on an editing result of the layout and a result of the image analysis; an image evaluation unit that calculates an evaluation value of each of the plurality of images based on the preference of the user and the image analysis result; and an edit assisting unit that displays assist information, which is for assisting an editing work of the layout by the user, on the editing screen of the screen display unit based on the evaluation value of each of the plurality of images.

    [0011] Preferably, the preference estimation unit calculates importance of each person, as the preference of the user, based on a difference between the number of appearances of each person photographed in one or more added images, which are added to the layout based on the instruction of the user from unused images that have not been used in the layout among the plurality of images, and the number of appearances of the same person as each person photographed in one or more deleted images that have been deleted from the layout based on the instruction of the user.

    [0012] Preferably, the preference estimation unit weights the importance according to a size of a face of each person photographed in each of the added image and the deleted image.

    [0013] Preferably, the preference estimation unit calculates the importance of each person, as the preference of the user, based on the number of appearances of each person photographed in edited images used in the layout.

    [0014] Preferably, the preference estimation unit calculates the importance based on the importance of each person such that importance of a person having a large number of appearances in images in which a person of high importance is photographed, among persons photographed in images in which the person of high importance rather than a person of low importance is photographed, is higher than importance of a person having a small number of appearances in the images in which the person of high importance is photographed.

    [0015] Preferably, the preference estimation unit calculates the importance based on the importance of each person such that importance of a person having a large number of appearances in images photographed on a photographing date of an image in which a person of high importance is photographed, among persons photographed in the images photographed on the photographing date of the image in which the person of high importance rather than a person of low importance is photographed, is higher than importance of a person having a small number of appearances in the images photographed on the photographing date of the image in which the person of high importance is photographed.

    [0016] Preferably, the preference estimation unit calculates the importance based on the importance of each person such that importance of a person having a large number of appearance dates of photographing dates of images in which a person of high importance is photographed, among persons photographed in images photographed on the photographing dates of the images in which the person of high importance rather than a person of low importance is photographed, is higher than importance of a person having a small number of appearance dates.

    [0017] Preferably, the preference estimation unit calculates the importance of each person, as the preference of the user, based on image content photographed in each edited image used in the layout.

    [0018] Preferably, when an edited image used in the layout is exchanged with an unused image that has not been used in the layout of the plurality of images based on the instruction of the user, the preference estimation unit calculates importance of persons photographed in images before and after the exchange and importance of scenes and composition of the images before and after the exchange, as the preference of the user, based on whether or not a face of a person is photographed in the images before and after the exchange, whether or not the same person is photographed in the images before and after the exchange, and whether or not the images before and after the exchange are similar images.

    [0019] Preferably, when an edited image used in the layout is exchanged with an unused image that has not been used in the layout of the plurality of images based on the instruction of the user, the preference estimation unit estimates the preference of the user based on any of photographing times of images before and after exchange, photographing locations of the images before and after the exchange, sizes of faces of persons photographed in the images before and after the exchange, positions of the faces of the persons photographed in the images before and after the exchange, directions of the faces of the persons photographed in the images before and after the exchange, expressions of the persons photographed in the images before and after the exchange, scenes of the images before and after the exchange, colors of entire images before and after the exchange, and whether the images before and after the exchange are landscapes or portraits.

    [0020] Preferably, when only a region including a predetermined person is extracted from an image, in which two or more persons are photographed, of edited images used in the layout and is disposed in the layout based on the instruction of the user, the preference estimation unit calculates the importance such that importance of the predetermined person is higher than importance of a person other than the predetermined person out of two or more persons photographed in the image.

    [0021] Preferably, the screen display unit further displays a list of a predetermined number of unused images, among unused images of the plurality of images that are not disposed in the layout, on the editing screen, and the edit assisting unit displays an unused image having a high evaluation value in preference to an unused image having a low evaluation value, as the assist information, in the list of unused images.

    [0022] Preferably, the edit assisting unit places and displays the unused image having the high evaluation value at a head side of the list of unused images in preference to the unused image having the low evaluation value.

    [0023] Preferably, the edit assisting unit displays the unused image having the high evaluation value distinctively in the list of unused images.

    [0024] Preferably, the edit assisting unit performs the distinctive display in the list of unused images by marking the unused image having the high evaluation value, or by changing a color of a display frame of the unused image having the high evaluation value, or by changing a display size of the unused image having the high evaluation value.

    [0025] Preferably, the edit assisting unit changes the predetermined number of unused images according to predetermined images, which are designated based on the instruction of the user among edited images used in the layout, and displays the result in the list of unused images.

    [0026] Preferably, the preference estimation unit calculates, as the preference of the user, importance of each person or each location photographed in each of the plurality of images. Preferably, when an image in which a person of low importance or a location of low importance is photographed, among edited images used in the layout, is designated based on the instruction of the user, the edit assisting unit displays an unused image in which a person of high importance or a location of high importance is photographed in the list of unused images in precedence to the image in which the person of low importance or the location of low importance is photographed.

    [0027] It is preferable to further include an automatic layout unit that creates the layout automatically based on the preference of the user. Preferably, the edit assisting unit further displays the layout created by the automatic layout unit, as the assist information, on the editing screen of the screen display unit.

    [0028] Preferably, the edit assisting unit displays at least one of a background mount, a frame decoration, clip art, and fonts for text input on the editing screen of the screen display unit, as the assist information, based on the preference of the user.

    [0029] It is preferable to further include an automatic layout unit that creates a layout of each of a plurality of pages automatically. Preferably, the automatic layout unit creates a layout of a page other than a predetermined page of the plurality of pages based on an editing result of a layout of the predetermined page.

    [0030] Preferably, the preference estimation unit estimates the preference of the user based on a layout editing result in two or more of a plurality of pages.

    [0031] Preferably, the preference estimation unit estimates the preference of the user based on a layout editing time in each of a plurality of pages.

    [0032] It is preferable to include a preference storage unit that stores data of the preference of the user. Preferably, the image evaluation unit calculates the evaluation value of each of the plurality of images based on the data of the preference of the user stored in the preference storage unit.

    [0033] In addition, according to another aspect of the present invention, there is provided a layout editing method of editing a layout in which a predetermined number of images selected from a plurality of images are disposed at predetermined positions. The layout editing method includes: a step of editing a layout, which is displayed on an editing screen of a screen display unit, based on an instruction of a user for editing the layout that is input through an instruction input unit; a step of performing image analysis of each of the plurality of images, a step of estimating a preference of the user based on an editing result of the layout and a result of the image analysis; a step of calculating an evaluation value of each of the plurality of images based on the preference of the user and the image analysis result; and a step of displaying assist information, which is for assisting an editing work of the layout by the user, on the editing screen of the screen display unit based on the evaluation value of each of the plurality of images.

    [0034] In addition, according to still another aspect of the present invention, there is provided a program causing a computer to execute each step of the layout editing method described above.

    [0035] In addition, according to still another aspect of the present invention, there is provided a computer-readable recording medium on which a program causing a computer to execute each step of the layout method described above is recorded.

    [0036] According to the aspects of present invention, the user can easily select a desired unused image from a large number of unused images by assisting the layout editing work of the user based on the preference of the user. Therefore, the editing work can be efficiently performed.

    BRIEF DESCRIPTION OF THE DRAWINGS



    [0037] 

    Fig. 1 is a block diagram showing the configuration of a layout editing device according to an embodiment of the present invention.

    Fig. 2 is a flowchart showing an example of the operation of the layout editing device shown in Fig. 1.

    Fig. 3 is a conceptual diagram showing an example of the display screen of the layout of a photo book.

    Fig. 4 is a conceptual diagram showing an example of the editing screen of the layout of a photo book.

    Fig. 5 is a conceptual diagram showing an example when an unused image is added to the layout and an unused image is deleted from an edited image.

    Fig. 6 is a conceptual diagram showing an example of an image in which two persons A and B are photographed.

    Fig. 7 is a conceptual diagram showing an example when an edited image and an unused image are exchanged with each other.

    Fig. 8 is a conceptual diagram showing an example when extracting a region including the face of a person A.

    Fig. 9 is a conceptual diagram showing an example of the state in which a "*" mark is put on an unused image having a high evaluation value.

    Fig. 10 is a conceptual diagram showing an example of the state in which, when an image in which a person of low importance is photographed is selected, an unused image corresponding to this is displayed in a list of unused images.

    Fig. 11 is a conceptual diagram showing an example of the state in which the layouts of the pages 3 and 4 are changed based on the layout editing result of the pages 1 and 2.


    DESCRIPTION OF THE PREFERRED EMBODIMENTS



    [0038] Hereinafter, a layout editing device, a layout editing method, and a program of the present invention will be described in detail based on preferred embodiments shown in the accompanying drawings.

    [0039] Fig. 1 is a block diagram showing the configuration of a layout editing device according to an embodiment of the present invention. A layout editing device 10 shown in Fig. 1 edits the layout of each page of a photo book in which a predetermined number of images selected from a plurality of images are disposed at predetermined positions, and is configured to include an automatic layout unit 12, an instruction input unit 14, a layout editing unit 16, an image analysis unit 18, a preference estimation unit 20, a preference storage unit 22, an image evaluation unit 24, an edit assisting unit 26, and a screen display unit 28.

    [0040] The automatic layout unit 12 creates the layout of each page automatically by selecting a predetermined number of images corresponding to each page from a plurality of images, which can be used in a photo book, and placing the selected images at predetermined positions (automatic layout).

    [0041] For example, the automatic layout unit 12 divides a plurality of images, which can be used in a photo book, into a predetermined number of groups based on the additional information of image data including photographing time, photographing position, and the like, selects a predetermined number of images from images included in each of the divided groups based on the evaluation value of the image and the like, and places a predetermined number of images selected from each group in one or two or more pages corresponding to each group (automatic layout).

    [0042] In addition, there is no limitation on the automatic layout method, and the automatic layout unit 12 can perform automatic layout of each page of a photo book using various kinds of automatic layout methods including known automatic layout methods.

    [0043] The instruction input unit 14 is for inputting the instruction of the user for editing the layout of each page of the photo book and various instructions of the user for operating the layout editing device 10. For example, the instruction input unit 14 is input means, such as a mouse, a keyboard, and a touch panel, and input means capable of inputting the instruction by operating the display screen or the edit screen of the layout displayed on the screen display unit 28 can be used.

    [0044] When creating a photo book, the user inputs an instruction regarding the number of pages of the photo book, a plurality of images that can be used in the photo book, and the like through the instruction input unit 14. In addition, when editing the layout of a photo book, the user inputs an instruction regarding a page whose layout is to be edited, edited images used in the layout of a page to be edited, designation of unused images that are not used in the photo book among a plurality of images that can be used in the photo book, designation of details of editing, and the like.

    [0045] The layout editing unit 16 edits the layout of each page of the photo book, which is automatically created by the automatic layout unit 12 and is displayed on the editing screen of the screen display unit 28, based on the instruction of the user input through the instruction input unit 14.

    [0046] The image analysis unit 18 performs various kinds of image analyses for each of the plurality of images that can be used in a photo book. For example, the image analysis unit 18 checks whether or not there is a face of a person in the image (face recognition). When there is a face of a person in the image, the image analysis unit 18 calculates the size of the face of the person, the position of the face, a face direction, a facial expression, the number of persons included in the image, and the like. In addition, the image analysis unit 18 determines a scene (indoor, outdoor, night view, and the like), the color (brightness, saturation, contrast, and the like) of the entire image, whether each image is a landscape or a portrait, and the like.

    [0047] In order to check whether or not there is a face of a person in an image, for example, a face detection method using a DWT coefficient obtained by wavelet conversion of an image described in H. Schneiderman et al., "A statistical method for 3d object detection applied to faces and cars" in IEEE Conf. on Computer Vision and Pattern Recognition, 2000, pp. 746-51, which is cited in JP2004-348733A, can be used.

    [0048] The size of the face can be calculated by using the number of pixels within the face region, the ratio of the face region to the entire image, the ratio of the face region to the width of the image, and the like, for example.

    [0049] For the position of the face, for example, it is possible to use a value that expresses in percentage the ratio of the coordinate value of the central position (for example, an intersection of diagonals when the face region is a rectangle) of the face region to the length of the image in the horizontal and vertical directions.

    [0050] The face direction can be calculated using information indicating that the direction of the face included in the face region is a front or a side, for example. In addition, it is also possible to further detect the eyes from the face region and determine the face direction to be the front when two eyes are detected and to be the side when one eye is detected. In addition, it is also possible to calculate the feature amount indicating the face direction from the face region and determine whether the face direction is a front or a side using the feature amount.

    [0051] For the facial expression, it is determined whether or not the face included in the image is laughing, for example, using the method disclosed in JP2001-43345A. Specifically, a feature vector for identifying an expression based on the pattern of movement of the epidermis is stored in advance for the image of the face having a variety of expressions, a feature vector is calculated from the target image, a distance between the calculated feature vector and the feature vector stored in advance is calculated, and a facial expression corresponding to the feature vector of the shortest distance is determined to be the expression of the face included in the target image.

    [0052] The number of persons included in an image, a scene, the color of the entire image, whether each image is a landscape or a portrait, and the like can be determined by various kinds of image analyses including known image analyses.

    [0053] The preference estimation unit 20 estimates the preference (edit intention and edit tendency) of the user based on the layout editing result of the layout editing unit 16 and the image analysis result of the image analysis unit 18.

    [0054] The preference storage unit 22 stores the data of the user preference estimated by the preference estimation unit 20.

    [0055] The image evaluation unit 24 calculates the evaluation value of each of a plurality of images, which can be used in a photo book, based on the preference of the user estimated by the preference estimation unit 20 and the image analysis result of the image analysis unit 18. When the data of the user preference is stored in the preference storage unit 22, the image evaluation unit 24 can calculate the evaluation value of each image not from the preference of the user estimated by the preference estimation unit 20 but based on the data of the user preference stored in the preference storage unit 22.

    [0056] The edit assisting unit 26 displays assist information for assisting the layout editing work of the user on the editing screen of the screen display unit 28 based on the evaluation values of a plurality of images, which can be used in a photo book, calculated by the image evaluation unit 24.

    [0057] The screen display unit 28 displays various kinds of screens including the display screen of the layout automatically created by the automatic layout unit 12 and the editing screen of the layout edited by the layout editing unit 16.

    [0058] Next, the operation of the layout editing device 10 when the user performs layout editing will be described with reference to the flowchart shown in Fig. 2.

    [0059] When the user inputs an instruction regarding the photo book creating conditions, for example, an instruction regarding the number of pages of a photo book to be created, an instruction regarding a plurality of images that can be used in a photo book by the designation of the photographing period, and the like through the instruction input unit 14, automatic layout of each page of the photo book is performed by the automatic layout unit 12 (step S1). After the end of the automatic layout, for example, as shown in Fig. 3, the layout of the facing pages 1 and 2 of the photo book created by the automatic layout unit 12 is displayed on the screen display unit 28 as an initial screen of the layout display screen (step S2).

    [0060] Fig. 3 is a conceptual diagram showing an example of the display screen of the layout of a photo book. A layout display screen 30 shown in Fig. 3 is configured to include a layout display area 32 and an instruction input area 36.

    [0061] The layout of each page of the photo book created automatically is displayed on the layout display area 32. In Fig. 3, a predetermined number of images used in the layout of the facing pages 1 and 2 are displayed as an initial screen of the layout display screen 30.

    [0062] Various buttons used when the user inputs various instructions through the instruction input unit 14 are disposed in the instruction input area 36. For example, when the user selects a Right button 38 by clicking it with a mouse or touching it on the touch panel, the layout of the next page is displayed. When a Left button 40 is selected, the layout of the previous page is displayed. In addition, when an "Edit" button 42 is selected, an editing screen of the layout of the page to be edited is displayed. When a "Save" button 44 is selected, data of the current layout is saved. When a "Return" button 46 is selected, an input screen for inputting the photo book creating conditions before automatic layout creation is displayed.

    [0063] Then, when the user selects the "Edit" button 42 through the instruction input unit 14 to input a layout editing instruction, an editing screen 50 of the layout of a page to be edited designated by the user is displayed on the screen display unit 28, as shown in Fig. 4 (step S3).

    [0064] Fig. 4 is a conceptual diagram showing an example of the editing screen of the layout of a photo book. The layout editing screen 50 shown in Fig. 4 is configured to include the layout display area 32, an unused image display area 34, and the instruction input area 36.

    [0065] The layout of the page to be edited is displayed in the layout display area 32. In Fig. 4, a predetermined number of edited images used in the layout of the facing pages 1 and 2 to be edited are displayed as an initial screen for layout editing.

    [0066] Thumbnail display of the list of a predetermined number of unused images, among unused images 52 that have not been used in the photo book of the plurality of images that can be used in the photo book, is performed in the unused image display area 34. Although only a predetermined number of unused images 52 are displayed on the editing screen 50, a predetermined number of next unused images are displayed when the user selects a Down button 54, and a predetermined number of previous unused images are displayed when the user selects an Up button 56.

    [0067] Various buttons used when the user inputs various instructions through the instruction input unit 14 are disposed in the instruction input area 36. The Right button 38, the Left button 40, and the "Save" button 44 are the same as in the case shown in Fig. 3. When a "Layout Change" button 48 is selected, the layout of the page to be edited is changed. When the "Return" button 46 is selected, a screen after automatic layout before layout editing is displayed.

    [0068] For example, the user can select an image to be edited from an edited image 51 of the layout displayed in the layout display area 32 and rotate and enlarge/reduce the selected edited image, delete the selected edited image from the layout, and replace the selected edited image with an unused image by inputting various instructions through the instruction input unit 14 on the editing screen 50. In addition, the user can select a predetermined unused image from the unused images 52 displayed in the unused image display area 34 and add the selected image to the layout. In addition, the user can change the layout, save the data of the layout, and the like.

    [0069] When the user inputs various instructions through the instruction input unit 14 (step S4), the layout of the page to be edited is edited by the layout editing unit 16 based on the user instruction input through the instruction input unit 14 (step S5).

    [0070] Next, the operation of the preference estimation unit 20 will be described.

    [0071] First, as indicated by the arrow shown in Fig. 5, an operation when the preference estimation unit 20 estimates the preference of the user based on the unused image (added image), which has been added to the layout from the unused image display area 34 by the user, and the edited image (deleted image), which has been deleted from the layout by the user, will be described.

    [0072] In this case, the preference estimation unit 20 calculates the importance of each person as the preference of the user based on the layout editing result of the layout editing unit 16, the image analysis result of the image analysis unit 18, and a difference between the number of appearances of each person, who is photographed in one or more added images that have been added to the layout based on the instruction of the user among the unused images, and the number of appearances of the same person as each person, who is photographed in one or more deleted images that have been deleted from the layout based on the instruction of the user.

    [0073] For example, as shown in Table 1, the number of appearances of each person in added images (the number of additions) is 4 (person A), 10 (person B), 1 (person C), 0 (person D), and 12 (person E), and the number of appearances of each person in deleted images (the number of deletions) is 0 (person A), 2 (person B), 3 (person C), 10 (person D), and 7 (person E). Therefore, (the number of additions - the number of deletions) is 4 (person A), 8 (person B), -2 (person C), -10 (person D), and 5 (person E).
    (Table 1)
     Person APerson BPerson CPerson DPerson E...
    The number of appearances of person in added image (the number of additions) 4 10 1 0 12  
    The number of appearances of person in deleted image (the number of deletions) 0 2 3 10 7  
    The number of additions - the number of deletions 4 8 -2 -10 5  


    [0074] In this case, the preference estimation unit 20 determines a person having high (the number of additions - the number of deletions) to be a person of high importance. In the example shown in Table 1, it is determined that the importance of the person B is the highest and the importance becomes low in order of person E, person A, person C, person D, ....

    [0075] Then, the image evaluation unit 24 sets the evaluation value of the image, in which the person B is photographed, to be highest based on the importance of each person and the image analysis result, and then sets the evaluation value of the image, in which each person is photographed, to become low in order of person E, person A, person C, person D, ....

    [0076] For example, when the user adds an image, in which two persons A and B are photographed, to the layout as shown in Fig. 6, the preference estimation unit 20 may add the number of appearances (increase the importance) of each of the persons A and B or may weight the number of appearances (importance) to be added according to the size of the face of the person photographed in each added image. In the example shown in Fig. 6, the number of appearances of the person A with a face size larger than the person B is added by +1, and the number of appearances of the person B is added by +0.5. When deleting an image, the number of appearances is similarly subtracted.

    [0077] In addition, the preference estimation unit 20 may determine the importance of each person, as the preference of the user, based on the number of appearances of each person photographed in edited images used in the photo book (layout) (used images of the photo book).

    [0078] Table 2 shows the number of appearances of each person in used images of a photo book when the number of additions, the number of deletions, and (the number of additions - the number of deletions) are the same as Table 1. In the example shown in Table 2, the number of appearances of each person in used images of the photo book is 20 (person A), 10 (person B), 8 (person C), 20 (person D), and 8 (person E).
    (Table 2)
     Person APerson BPerson CPerson DPerson E...
    The number of appearances of person in added image (the number of additions) 4 10 1 0 12  
    The number of appearances of person in deleted image (the number of deletions) 0 2 3 10 7  
    The number of additions - the number of deletions 4 8 -2 -10 5  
    The number of appearances of person in used image of photo book 20 10 8 20 8  


    [0079] In this case, (the number of additions - the number of deletions) of the person D is -10, but the number of appearances of the person D in the used images of the photo book is 20 that is large. Therefore, the preference estimation unit 20 determines that the importance of the person D is high even though there are many images that the user does not like in terms of a facial expression, a scene, and the like. Similarly, the importance of the person A is also determined to be high. On the other hand, (the number of additions - the number of deletions) of the person B is 8, which is the highest, but the number of appearances of the person B in the used images of the photo book is 10. For this reason, the preference estimation unit 20 determines that the importance of the person B is lower than that of the persons A and D.

    [0080] In addition, the preference estimation unit 20 may determine the importance of other persons based on the relationship with a person of high importance. For example, the preference estimation unit 20 may calculate the importance based on the importance of each person calculated as described above such that the importance of a person having a large number of appearances in images in which a person of high importance is photographed, among persons photographed in images in which a person of high importance rather than a person of low importance is photographed, is higher than the importance of a person having a small number of appearances. In this case, the preference estimation unit 20 determines that a person photographed in the same image as the person of high importance is a person (related person) having a certain relationship with the person of high importance and the importance of the related person is similarly high.

    [0081] In addition, the preference estimation unit 20 may calculate the importance based on the importance of each person calculated as described above such that the importance of a person having a large number of appearances in images photographed on the photographing date of an image in which a person of high importance is photographed, among persons photographed in the images photographed on the photographing date of the image in which the person of high importance rather than a person of low importance is photographed, is higher than the importance of a person having a small number of appearances. For example, when the photographing dates of images in which a person of high importance is photographed are 3/4, 5/4, 5/5, and 7/18, the preference estimation unit 20 determines that persons having a large number of appearances in all images photographed on all of the photographing dates are related persons and the importance of these related persons is similarly high.

    [0082] In addition, the preference estimation unit 20 may calculate the importance based on the importance of each person calculated as described above such that the importance of a person having a large number of appearance dates of the photographing dates of images in which a person of high importance is photographed, among persons photographed in images photographed on the photographing dates of images in which a person of high importance rather than a person of low importance is photographed, is higher than the importance of a person having a small number of appearance dates. For example, when the photographing dates of images in which a person of high importance is photographed are 3/4, 5/4, 5/5, and 7/18, the preference estimation unit 20 determines that a person having a large number of appearance dates of these photographing dates is a related person of the person of high importance and the importance of the related person is similarly high. For example, the preference estimation unit 20 determines that the importance of a person appearing in the images photographed on 3/4 and 5/4 is higher than that of a person appearing only in the image photographed on 3/4. That is, the preference estimation unit 20 determines that a person having a larger number of appearance dates has a higher importance.

    [0083] In addition, the preference estimation unit 20 may calculate the importance of each person, as the preference of the user, based on the image content photographed in each of the edited images used in the layout.

    [0084] Here, the image content is information indicating the state of the contents photographed in the image, and is determined by the image analysis of the image analysis unit 18. There is no limitation on the image content. For example, whether or not a person is photographed in an image, objects (food, toys of a child, and the like) other than a person are photographed, which scene (landscape such as a night view, outdoor, or a sunset) is photographed, and which level of brightness or blurriness an image has can be exemplified.

    [0085] For example, when a "food" image is used in a predetermined number of layouts, the preference estimation unit 20 determines that "food" is important as the preference of the user, and sets the importance of the "food" image to be higher than the importance of an image in which other things are photographed. In addition, for example, when even a slightly blurred image is not included in the layout, the preference estimation unit 20 determines that "blurriness" is important as the preference of the user, and sets the importance of an image with less blur to be higher than the importance of a blurred image.

    [0086] Subsequently, as indicated by the arrow shown in Fig. 7, an operation when the preference estimation unit 20 estimates the preference of the user based on the images before and after the exchange between the edited image and the unused image will be described.

    [0087] In this case, as shown in Table 3, the preference estimation unit 20 calculates the importance of persons photographed in images before and after the exchange and the importance of scenes and compositions of the images before and after the exchange, as the preference of the user, based on whether or not a face of a person is photographed in the images before and after the exchange (whether or not a person is photographed), whether or not the same person is photographed in the images before and after the exchange, and whether or not the images before and after the exchange are similar images.
    (Table 3)
    No.Is there face of person?Comparison between images before and after exchange
    Before exchangeAfter exchangeSame person?Similar?
    1
    2 X
    3 X
    4 X  
    5 X X
    6 X X  
    7 X X
    8 X X X


    [0088] In the case of No. 1, a face of a person is photographed in each of the images before and after the exchange, and the persons are the same person. Therefore, the preference estimation unit 20 determines that the importance of the person photographed in the images before and after the exchange is high. In addition, since the images before and after the exchange are similar images, the user has performed the image exchange because the user did not like the face (expression) of the person photographed in the image before the change. Therefore, since there is no dissatisfaction with the scene or the composition, the preference estimation unit 20 determines that the importance is high.

    [0089] In the case of No. 2, a face of a person is photographed in each of the images before and after the exchange, and the persons are the same person. Therefore, similar to the case of No. 1, the preference estimation unit 20 determines that the importance of the person photographed in the images before and after the exchange is high. In addition, since the images before and after the exchange are not similar images, the user has performed the image exchange because the user did not like the composition or the scene photographed in the image before the change. Therefore, the preference estimation unit 20 determines that the importance of the scene or the composition in the image before the change is low.

    [0090] In the case of No. 3, since a face of a person is photographed in each of the images before and after the exchange but the persons are not the same person, the user has performed the image exchange because the user did not like a person photographed in the image before the change. Therefore, the preference estimation unit 20 determines that the importance of the person photographed in the image before the change is low. In addition, since the images before and after the exchange are similar images, the preference estimation unit 20 determines that the importance of the scene or the composition in each of the images before and after the exchange is high as in the case of No. 1.

    [0091] In the case of No. 4, a face of a person is photographed in each of the images before and after the exchange, but the persons are not the same person. Therefore, similar to the case of No. 3, the preference estimation unit 20 determines that the importance of the person photographed in the image before the change is low. In addition, since the images before and after the exchange are not similar images, the preference estimation unit 20 determines that the importance of the composition or the scene photographed in the image before the change is low as in the case of No. 2.

    [0092] In the case of No. 5, a face of a person is photographed in the image before the change, but a face of a person is not photographed in the image after the change. Therefore, the preference estimation unit 20 determines that the importance of the person photographed in the image before the change is low. In addition, since the images before and after the exchange are similar images, the preference estimation unit 20 determines that the importance of the scene or the composition in each of the images before and after the exchange is high as in the case of No. 1.

    [0093] In the case of No. 6, a face of a person is photographed in the image before the change, but a face of a person is not photographed in the image after the change. Therefore, similar to the case of No. 5, the preference estimation unit 20 determines that the importance of the person photographed in the image before the change is low. In addition, since the images before and after the exchange are not similar images, the preference estimation unit 20 determines that the importance of the composition or the scene photographed in the image before the change is low as in the case of No. 2.

    [0094] In the case of No. 7, a face of a person is not photographed in the image before the change, but a face of a person is photographed in the image after the change. Therefore, the preference estimation unit 20 determines that the importance of the person photographed in the image after the change is high. In addition, since the images before and after the exchange are similar images, the preference estimation unit 20 determines that the importance of the scene or the composition in each of the images before and after the exchange is high as in the case of No. 1.

    [0095] In the case of No. 8, a face of a person is not photographed in the image before the change, but a face of a person is photographed in the image after the change. Therefore, similar to the case of No. 7, the preference estimation unit 20 determines that the importance of the person photographed in the image after the change is high. In addition, since the images before and after the exchange are not similar images, the preference estimation unit 20 determines that the importance of the composition or the scene photographed in the image before the change is low as in the case of No. 6.

    [0096] In addition, the preference estimation unit 20 is not limited to the example described above. Using the analysis result of the image analysis unit 18, the preference estimation unit 20 can estimate the preference of the user from the layout editing result, for example, based on the photographing time of the images before and after the exchange, photographing locations of the images before and after the exchange (GPS information), sizes of the faces of persons photographed in the images before and after the exchange, positions of the faces of persons photographed in the images before and after the exchange, directions of the faces of persons photographed in the images before and after the exchange, expressions of persons photographed in the images before and after the exchange, scenes of the images before and after the exchange, colors of the entire images before and after the exchange, and whether the images before and after the exchange are landscapes or portraits, and can calculate the evaluation value of each image, which can be used in a photo book, based on the estimated preference of the user.

    [0097] For example, the preference estimation unit 20 determines the importance of the scenes photographed in the images before and after the exchange based on whether or not the photographing times of the images before and after the exchange are close to each other (whether or not the photographing times of the images before and after the exchange are within a predetermined time range). For example, when the photographing times of the images before and after the exchange are close to each other, it is determined that the importance of the scenes photographed in the images before and after the exchange is high. On the other hand, when the photographing times of the images before and after the exchange are far from each other, it is determined that the importance of the scene photographed in the image before the change is low.

    [0098] In addition, the preference estimation unit 20 determines the importance of the photographing locations of the images before and after the exchange based on whether or not the photographing locations of the images before and after the exchange are close to each other (whether or not the photographing locations of the images before and after the exchange are within a predetermined range). For example, when the photographing locations of the images before and after the exchange are close to each other, it is determined that the importance of the photographing locations of the images before and after the exchange is high. On the other hand, when the photographing locations of the images before and after the exchange are far from each other, it is determined that the importance of the photographing location of the image before the change is low.

    [0099] The user has a preference, such as "a liking for a close-up of a child's face" and "a dislike of too many close-ups of his or her own face", for example. Therefore, based on the sizes and the like of persons and faces photographed in the images before and after the exchange, the preference estimation unit 20 determines the preference of the user for the size of the face.

    [0100] The user has a preference such as "a liking for a face being located at the center of the screen" and "a liking for a face being slightly shifted from the center of the screen", for example. Therefore, based on the positions of faces photographed in the images before and after the exchange, the preference estimation unit 20 determines the preference of the user for the position of the face.

    [0101] The user has a preference such as "a liking for a face facing the front" and "a liking for a face being slightly inclined", for example. Therefore, based on the directions of faces photographed in the images before and after the exchange, the preference estimation unit 20 determines the preference of the user for the direction of the face.

    [0102] The user has a preference, such as "a liking for a child's face that smiles" and "a dislike of his or her own face that smiles", for example. Therefore, based on persons, facial expressions, and the like photographed in the images before and after the exchange, the preference estimation unit 20 determines the preference of the user for the facial expression.

    [0103] The user has a preference, such as "a liking for an indoor image", "a liking for an outdoor image", and "a liking for a night view", for example. Therefore, based on the scenes of the images before and after the exchange, the preference estimation unit 20 determines the preference of the user for the scene.

    [0104] The user has a preference, such as "a liking for a light image", and "a liking for an image with high contrast", for example. Therefore, based on the brightness, saturation, contrast, and the like of the images before and after the exchange, the preference estimation unit 20 determines the preference of the user for the color of the entire image.

    [0105] The user has a preference, such as "a liking for a landscape", and "a liking for a portrait", for example. Therefore, based on persons, landscape, and the like photographed in the images before and after the exchange, the preference estimation unit 20 determines the preference of the user for the portrait/landscape.

    [0106] In addition, when the user extracts only a region including a predetermined person from an image, in which two or more persons are photographed, of edited images used in the layout and places the extracted region in the layout based on the instruction of the user, the preference estimation unit 20 may calculate the importance such that the importance of the extracted predetermined person is higher than the importance of a person other than the predetermined person of two or more persons photographed in the image.

    [0107] For example, as shown by the dotted line in Fig. 8, when a region of the dotted line including the face of the person A, which is extracted from the image in which two persons A and B are photographed, is enlarged and placed in the layout, the preference estimation unit 20 determines that the importance of the person A is higher than that of the person B.

    [0108] In addition, the preference estimation unit 20 may estimate the preference of the user from the editing result of the layout of a plurality of pages.

    [0109] When the user performs the same layout editing in all pages, for example, when the user adds an image in which the person A is photographed to all pages, the preference estimation unit 20 gives top priority to the editing result of the layout to estimate the preference of the user and preferentially increases the evaluation value of the image in which the person A is photographed. On the other hand, when the user adds the image in which the person A is photographed in a certain page and deletes the image in which the person A is photographed in another page, the preference estimation unit 20 lowers the evaluation value of the image in which the person A is photographed.

    [0110] In addition, the preference estimation unit 20 may determine the importance of each page based on the editing time of each page.

    [0111] For example, it is thought that the user has no hesitation about a page for which layout editing has been completed without spending too much time. For example, when an apparently unrelated person is photographed in an image, the user deletes the image immediately without spending much time. Therefore, the preference estimation unit 20 determines that the importance of the editing result of the layout of the page is high, and increases the priority of the preference of the user estimated from the editing result of the layout of the page.

    [0112] On the other hand, in the case of a page for which the user has spent time for layout editing, it is thought that the user has made a serious determination. For example, assuming that there are two close friends A and B, even if an image in which the person A is photographed is used in a certain page, an image in which the person B is photographed may need to be used in another page. Therefore, the preference estimation unit 20 determines that the importance of the editing result of the layout of the page is low, and decreases the priority of the preference of the user estimated from the editing result of the layout of the page.

    [0113] Next, the operation of the edit assisting unit 26 will be described.

    [0114] The edit assisting unit 26 assists the layout editing work of the user, such as changing the display form of the list of unused images, based on the evaluation values of a plurality of images, which can be used in a photo book, calculated by the image evaluation unit 24.

    [0115] For example, in the list of unused images thumbnail-displayed in the unused image display area 34, the edit assisting unit 26 preferentially displays an image of high importance for the user, that is, an image having a high evaluation value, and lowers the priority to display an unused image having a low evaluation value. In other words, the edit assisting unit 26 displays an unused image having a high evaluation value in the list of unused images in preference to an unused image having a low evaluation value.

    [0116] For example, the edit assisting unit 26 places and displays an unused image having a high evaluation value at the head side of the list of unused images in preference to an unused image having a low evaluation value, or displays an unused image having a high evaluation value distinctively in the list of unused images. For example, as shown in Fig. 9, a "*" mark is put on an unused image having a high evaluation value, or the color of the display frame of an unused image having a high evaluation value is changed, or the display size of an unused image having a high evaluation value is changed (display size of an unused image having a high evaluation value is increased). On the contrary, the edit assisting unit 26 moves an unused image having a low evaluation value to the back side of the list of unused images or does not display the unused image having a low evaluation value, for example.

    [0117] In addition, the edit assisting unit 26 may change an unused image, which is displayed in the list of unused images, according to a predetermined edited image designated based on the instruction of the user among the edited images used in the layout.

    [0118] For example, when the preference estimation unit 20 calculates as the preference of the user the importance of each person photographed in each of a plurality of images that can be used in a photo book, the edit assisting unit 26 displays an unused image in which a person of high importance is photographed in the list of unused images in precedence to an unused image in which a person of low importance is photographed when an image in which a person of low importance is photographed, among the edited images used in the layout, is selected based on the instruction of the user as shown by the thick frame in Fig. 10. This is the same as when a location is applied instead of a person.

    [0119] In addition, the edit assisting unit 26 may display the layout created by the automatic layout unit 12, as assist information, on the editing screen of the screen display unit 28 as well as changing the display form of the list of unused images. For example, when the user is editing the layout of a predetermined page of a photo book, the automatic layout unit 12 selects images automatically based on the preference of the user and creates the layout using the selected images. Then, the edit assisting unit 26 displays the layout created by the automatic layout unit 12, as assist information, on the editing screen of the screen display unit 28. In this case, the user can adopt the layout proposed by the edit assisting unit 26 or can further edit the layout under editing with reference to the layout proposed by the edit assisting unit 26.

    [0120] In addition, the edit assisting unit 26 may display decorative parts, such as a background mount, a frame decoration, clip art, and fonts for text input, on the editing screen of the screen display unit 28, as the assist information, based on the preference of the user. For example, the edit assisting unit 26 displays a background mount for children preferentially when the importance of the "child" is high, or preferentially displays a frame decoration to appeal the image of "food" when the importance of the image of "food" is high. In this manner, the user can decorate the layout under editing by using the decoration parts proposed by the edit assisting unit 26.

    [0121] In addition, when the layout editing device 10 edits a layout including a plurality of pages as in the photo book of the present embodiment, the automatic layout unit 12 may create the layout of a page other than a predetermined page of a plurality of pages based on the editing result of the layout of the predetermined page as shown in Fig. 11. For example, when the user adds an image of the person A at the center of the facing pages 1 and 2, the automatic layout unit 12 changes the layout of each page of the facing pages 3 and 4 and subsequent pages to the layout having the person A at the center.

    [0122] In addition, when the layout editing device 10 edits a layout including a plurality of pages as in the photo book of the present embodiment, the automatic layout unit 20 may estimate the preference of the user based on the layout editing result in two or more of the plurality of pages. Alternatively, the preference estimation unit 20 may estimate the preference of the user based on the layout editing time in each of the plurality of pages.

    [0123] As described above, the user can easily select a desired unused image from a large number of unused images by assisting the layout editing work of the user based on the preference of the user. Therefore, the editing work can be efficiently performed.

    [0124] Although the case where the present invention is applied to a photo book including a plurality of pages has been described in the above embodiment, the present invention is not limited to this. A plurality of pages are not necessarily required, and the present invention can also be similarly applied to the layout includeing one page.

    [0125] In addition, the layout editing method of the present invention can be realized as a program causing a computer to execute each of the steps. In addition, a computer-readable recording medium on which the program is recorded can also be implemented.

    [0126] The present invention is basically as described above. While the present invention has been described in detail, the present invention is not limited to the above-described embodiment, and various improvements and modifications may be made without departing from the scope of the present invention, defined by the appended claims.


    Claims

    1. A layout editing device that edits a layout in which a predetermined number of images selected from a plurality of images are disposed at predetermined positions, comprising:

    a screen display unit that displays an editing screen of the layout;

    an instruction input unit that inputs an instruction of a user for editing the layout;

    a layout editing unit that edits the layout, which is displayed on the editing screen of the screen display unit, based on the instruction of the user;

    an image analysis unit that performs image analysis of each of the plurality of images;

    a preference estimation unit that estimates a preference of the user based on an editing result of the layout and a result of the image analysis;

    an image evaluation unit that calculates an evaluation value of each of the plurality of images based on the preference of the user and the image analysis result; and

    an edit assisting unit that displays assist information, which is for assisting an editing work of the layout by the user, on the editing screen of the screen display unit based on the evaluation value of each of the plurality of images.


     
    2. The layout editing device according to claim 1,
    wherein the preference estimation unit calculates importance of each person, as the preference of the user, based on a difference between the number of appearances of each person photographed in one or more added images, which are added to the layout based on the instruction of the user from unused images that have not been used in the layout among the plurality of images, and the number of appearances of the same person as each person photographed in one or more deleted images that have been deleted from the layout based on the instruction of the user.
     
    3. The layout editing device according to claim 2,
    wherein the preference estimation unit weights the importance according to a size of a face of each person photographed in each of the added image and the deleted image.
     
    4. The layout editing device according to claim 1,
    wherein the preference estimation unit calculates the importance of each person, as the preference of the user, based on the number of appearances of each person photographed in edited images used in the layout.
     
    5. The layout editing device according to claim 4,
    wherein the preference estimation unit calculates the importance based on the importance of each person such that importance of a person having a large number of appearances in images in which a person of high importance is photographed, among persons photographed in images in which the person of high importance rather than a person of low importance is photographed, is higher than importance of a person having a small number of appearances in the images in which the person of high importance is photographed.
     
    6. The layout editing device according to claim 4,
    wherein the preference estimation unit calculates the importance based on the importance of each person such that importance of a person having a large number of appearances in images photographed on a photographing date of an image in which a person of high importance is photographed, among persons photographed in the images photographed on the photographing date of the image in which the person of high importance rather than a person of low importance is photographed, is higher than importance of a person having a small number of appearances in the images photographed on the photographing date of the image in which the person of high importance is photographed.
     
    7. The layout editing device according to claim 4,
    wherein the preference estimation unit calculates the importance based on the importance of each person such that importance of a person having a large number of appearance dates of photographing dates of images in which a person of high importance is photographed, among persons photographed in images photographed on the photographing dates of the images in which the person of high importance rather than a person of low importance is photographed, is higher than importance of a person having a small number of appearance dates.
     
    8. The layout editing device according to claim 1,
    wherein the preference estimation unit calculates the importance of each person, as the preference of the user, based on image content photographed in each edited image used in the layout.
     
    9. The layout editing device according to claim 1,
    wherein, when an edited image used in the layout is exchanged with an unused image that has not been used in the layout of the plurality of images based on the instruction of the user, the preference estimation unit calculates importance of persons photographed in images before and after the exchange and importance of scenes and composition of the images before and after the exchange, as the preference of the user, based on whether or not a face of a person is photographed in the images before and after the exchange, whether or not the same person is photographed in the images before and after the exchange, and whether or not the images before and after the exchange are similar images.
     
    10. The layout editing device according to claim 1,
    wherein, when an edited image used in the layout is exchanged with an unused image that has not been used in the layout of the plurality of images based on the instruction of the user, the preference estimation unit estimates the preference of the user based on any of photographing times of images before and after exchange, photographing locations of the images before and after the exchange, sizes of faces of persons photographed in the images before and after the exchange, positions of the faces of the persons photographed in the images before and after the exchange, directions of the faces of the persons photographed in the images before and after the exchange, expressions of the persons photographed in the images before and after the exchange, scenes of the images before and after the exchange, colors of entire images before and after the exchange, and whether the images before and after the exchange are landscapes or portraits.
     
    11. The layout editing device according to claim 1,
    wherein, when only a region including a predetermined person is extracted from an image, in which two or more persons are photographed, of edited images used in the layout and is disposed in the layout based on the instruction of the user, the preference estimation unit calculates the importance such that importance of the predetermined person is higher than importance of a person other than the predetermined person out of two or more persons photographed in the image.
     
    12. The layout editing device according to any one of claims 1 to 11,
    wherein the screen display unit further displays a list of a predetermined number of unused images, among unused images of the plurality of images that are not disposed in the layout, on the editing screen, and
    the edit assisting unit displays an unused image having a high evaluation value in preference to an unused image having a low evaluation value, as the assist information, in the list of unused images.
     
    13. The layout editing device according to claim 12,
    wherein the edit assisting unit places and displays the unused image having the high evaluation value at a head side of the list of unused images in preference to the unused image having the low evaluation value.
     
    14. The layout editing device according to claim 12,
    wherein the edit assisting unit displays the unused image having the high evaluation value distinctively in the list of unused images.
     
    15. The layout editing device according to claim 14,
    wherein the edit assisting unit performs the distinctive display in the list of unused images by marking the unused image having the high evaluation value, or by changing a color of a display frame of the unused image having the high evaluation value, or by changing a display size of the unused image having the high evaluation value.
     
    16. The layout editing device according to claim 12,
    wherein the edit assisting unit changes the predetermined number of unused images according to predetermined images, which are designated based on the instruction of the user among edited images used in the layout, and displays the result in the list of unused images.
     
    17. The layout editing device according to claim 16,

    wherein the preference estimation unit calculates, as the preference of the user, importance of each person or each location photographed in each of the plurality of images, and

    when an image in which a person of low importance or a location of low importance is photographed, among edited images used in the layout, is designated based on the instruction of the user, the edit assisting unit displays an unused image in which a person of high importance or a location of high importance is photographed in the list of unused images in precedence to the image in which the person of low importance or the location of low importance is photographed.


     
    18. The layout editing device according to any one of claims 12 to 17, further comprising:

    an automatic layout unit that creates the layout automatically based on the preference of the user,

    wherein the edit assisting unit further displays the layout created by the automatic layout unit, as the assist information, on the editing screen of the screen display unit.


     
    19. The layout editing device according to any one of claims 12 to 18,
    wherein the edit assisting unit displays at least one of a background mount, a frame decoration, clip art, and fonts for text input on the editing screen of the screen display unit, as the assist information, based on the preference of the user.
     
    20. The layout editing device according to any one of claims 1 to 17, further comprising:

    an automatic layout unit that creates a layout of each of a plurality of pages automatically,

    wherein the automatic layout unit creates a layout of a page other than a predetermined page of the plurality of pages based on an editing result of a layout of the predetermined page.


     
    21. The layout editing device according to any one of claims 1 to 20,
    wherein the preference estimation unit estimates the preference of the user based on a layout editing result in two or more of a plurality of pages.
     
    22. The layout editing device according to any one of claims 1 to 20,
    wherein the preference estimation unit estimates the preference of the user based on a layout editing time in each of a plurality of pages.
     
    23. The layout editing device according to any one of claims 1 to 22, further comprising:

    a preference storage unit that stores data of the preference of the user,

    wherein the image evaluation unit calculates the evaluation value of each of the plurality of images based on the data of the preference of the user stored in the preference storage unit.


     
    24. A layout editing method of editing a layout in which a predetermined number of images selected from a plurality of images are disposed at predetermined positions, comprising:

    a step of editing a layout, which is displayed on an editing screen of a screen display unit, based on an instruction of a user for editing the layout that is input through an instruction input unit;

    a step of performing image analysis of each of the plurality of images;

    a step of estimating a preference of the user based on an editing result of the layout and a result of the image analysis;

    a step of calculating an evaluation value of each of the plurality of images based on the preference of the user and the image analysis result; and

    a step of displaying assist information, which is for assisting an editing work of the layout by the user, on the editing screen of the screen display unit based on the evaluation value of each of the plurality of images.


     
    25. A program causing a computer to execute each step of the layout editing method according to claim 24.
     
    26. A computer-readable recording medium on which a program causing a computer to execute each step of the layout method according to claim 24 is recorded.
     


    Ansprüche

    1. Layouteditier-Vorrichtung, die ein Layout editiert, in welchem eine vorbestimmte Anzahl von Bildern, die aus einer Vielzahl von Bildern selektiert wurden, an vorbestimmten Positionen angeordnet sind, umfassend:

    eine Bildschirmanzeigeeinheit, die einen Editierbildschirm für das Layout anzeigt;

    eine Instruktions-Eingabeeinheit, die eine Nutzerinstruktion zum Editieren des Layouts eingibt;

    eine Layout-Editiereinheit, die das Layout, basierend auf der Nutzerinstruktion, editiert, das auf dem Editierbildschirm der Bildschirmanzeigeeinheit angezeigt wird;

    eine Bildanalyseeinheit, die eine Bildanalyse von jedem der Vielzahl von Bildern durchführt;

    eine Präferenzabschätzeinheit, die eine Nutzerpräferenz, basierend auf einem Layouteditierresultat und einem Bildanalyseresultat, abschätzt;

    eine Bildevaluierungseinheit, die, basierend auf der Nutzerpräferenz und dem Bildanalyseresultat, einen Evaluierungswert von jedem der Vielzahl von Bildern berechnet; und

    eine Editierassistiereinheit, die auf dem Editierbildschirm der Bildschirmanzeigeeinheit, basierend auf dem Evaluierungswert von jedem der Vielzahl von Bildern, Assistierinformation, zum Assistieren eines Layouteditierarbeitsgangs des Nutzers, anzeigt.


     
    2. Layouteditier-Vorrichtung nach Anspruch 1,
    wobei die Präferenzabschätzeinheit die Wichtigkeit von jeder Person als die Nutzerpräferenz berechnet, basierend auf einer Differenz zwischen der Anzahl der Auftritte von jeder fotografierten Person, in einem oder mehreren hinzugefügten Bildern, die zu dem Layout basierend auf der Nutzerinstruktion addiert werden, von unverwendeten Bildern, die in dem Layout unter der Vielzahl von Bildern nicht verwendet wurden und der Anzahl von Auftritten der gleichen Person als jede in einem oder in mehreren gelöschten Bildern fotografierten Person, die von dem Layout basierend auf der Nutzerinstruktion gelöscht wurden.
     
    3. Layouteditier-Vorrichtung nach Anspruch 2,
    wobei die Präferenzabschätzeinheit die Wichtigkeit gemäß einer Größe eines Gesichts von jeder fotografierten Person in jedem der hinzugefügten Bildern und der gelöschten Bilder gewichtet.
     
    4. Layouteditier-Vorrichtung nach Anspruch 1,
    wobei die Präferenzabschätzeinheit die Wichtigkeit von jeder Person als die Nutzerpräferenz berechnet, basierend auf der Anzahl von Auftritten von jeder in editierten, in dem Layout verwendeten Bildern, fotografierten Person.
     
    5. Layouteditier-Vorrichtung nach Anspruch 4,
    wobei die Präferenzabschätzeinheit die Wichtigkeit berechnet, basierend auf der Wichtigkeit von jeder Person derart, dass die Wichtigkeit einer Person mit einer großen Anzahl von Auftritten in Bildern, in denen eine Person hoher Wichtigkeit fotografiert ist, von Personen, die in Bildern, in denen die Person von eher hoher Wichtigkeit als eine Person von geringer Wichtigkeit fotografiert ist, größer ist als die Wichtigkeit einer Person mit einer geringen Anzahl von Auftritten in den Bildern, in denen die Person hoher Wichtigkeit fotografiert ist.
     
    6. Layouteditier-Vorrichtung nach Anspruch 4,
    wobei die Präferenzabschätzeinheit die Wichtigkeit berechnet, basierend auf der Wichtigkeit von jeder Person derart, dass die Wichtigkeit einer Person mit einer großen Anzahl von Auftritten in Bildern, die an einem Fotografierdatum eines Bildes fotografiert sind, in denen eine Person hoher Wichtigkeit fotografiert ist, von Personen, die in Bildern, die an dem Fotografierdatum des Bildes fotografiert sind, in denen die Person von eher hoher Wichtigkeit als eine Person von geringer Wichtigkeit fotografiert ist, größer ist als die Wichtigkeit einer Person mit einer geringen Anzahl von Auftritten in den Bildern, die an dem Fotografierdatum des Bildes fotografiert sind, in denen die Person hoher Wichtigkeit fotografiert ist.
     
    7. Layouteditier-Vorrichtung nach Anspruch 4,
    wobei die Präferenzabschätzeinheit die Wichtigkeit berechnet, basierend auf der Wichtigkeit von jeder Person derart, dass die Wichtigkeit einer Person mit einer großen Anzahl von Auftrittsdaten von Fotografierdaten von Bildern, in denen eine Person hoher Wichtigkeit fotografiert ist, von Personen, die in Bildern fotografiert sind, die an dem Fotografierdatum des Bildes fotografiert sind, in denen die Person von eher hoher Wichtigkeit als eine Person von geringer Wichtigkeit fotografiert ist, größer ist als die Wichtigkeit einer Person mit einer geringen Anzahl von Auftrittsdaten.
     
    8. Layouteditier-Vorrichtung nach Anspruch 1,
    wobei die Präferenzabschätzeinheit die Wichtigkeit von jeder Person als die Nutzerpräferenz berechnet, basierend auf dem Bildinhalt, der in jedem editierten, in dem Layout verwendeten Bild fotografiert ist.
     
    9. Layouteditier-Vorrichtung nach Anspruch 1,
    wobei wenn ein editiertes, in dem Layout verwendetes Bild mit einem nicht verwendeten Bild, das in dem Layout der Vielzahl von Bildern nicht verwendet wurde, basierend auf der Nutzerinstruktion ausgetauscht wird, die Präferenzabschätzeinheit eine Wichtigkeit von Personen, die in Bildern vor und nach dem Austausch fotografiert sind, und eine Wichtigkeit von Szenen und Kompositionen der Bilder vor und nach dem Austausch, als die Nutzerpräferenz berechnet, basierend darauf, ob ein Gesicht einer Person in den Bildern vor und nach dem Austausch fotografiert ist oder nicht, ob die gleiche Person in den Bildern vor und nach dem Austausch fotografiert ist oder nicht, und ob die Bilder vor und nach dem Austausch ähnliche Bilder sind oder nicht.
     
    10. Layouteditier-Vorrichtung nach Anspruch 1,
    wobei wenn ein editiertes, in dem Layout verwendetes Bild mit einem nicht verwendeten Bild, das in dem Layout der Vielzahl von Bildern nicht verwendet wurde, basierend auf der Nutzerinstruktion ausgetauscht wird, die Präferenzabschätzeinheit die Nutzerpräferenz abschätzt, basierend auf einem von Fotografierzeiten der Bilder vor und nach dem Austausch, Fotografierorten der Bilder vor und nach dem Austausch, Größen von Gesichtern von fotografierten Personen in den Bildern vor und nach dem Austausch, Positionen von Gesichtern von fotografierten Personen in den Bildern vor und nach dem Austausch, Richtungen von Gesichtern von fotografierten Personen in den Bildern vor und nach dem Austausch, Ausdrücke von fotografierten Personen in den Bildern vor und nach dem Austausch, Szenen der Bilder vor und nach dem Austausch, Farben der gesamten Bilder vor und nach dem Austausch, und ob die Bilder vor und nach dem Austausch Hoch- oder Querformate sind.
     
    11. Layouteditier-Vorrichtung nach Anspruch 1,
    wobei wenn nur ein Bereich umfassend eine vorbestimmte Person von einem Bild, in welchem zwei oder mehr Personen fotografiert sind, der in dem Layout verwendeten, editierten Bildern extrahiert wird und in dem Layout basierend auf der Nutzerinstruktion angeordnet wird, die Präferenzabschätzeinheit die Wichtigkeit derart berechnet, dass die Wichtigkeit der vorbestimmten Person höher ist als die Wichtigkeit einer anderen Person als der vorbestimmten Person von zwei oder mehreren in dem Bild fotografierten Personen.
     
    12. Layouteditier-Vorrichtung nach einem der Ansprüche 1 bis 11,
    wobei die Bildschirmanzeigeeinheit weiterhin auf dem Editierbildschirm eine Liste einer vorbestimmten Anzahl von nicht verwendeten Bildern anzeigt von nicht verwendeten Bildern der Vielzahl von Bildern, die nicht in dem Layout angeordnet sind, und
    die Editierassistiereinheit ein nicht verwendetes Bild mit einem hohen Evaluierungswert bevorzugt zu einem nicht verwendeten Bild mit einem niedrigen Evaluierungswert als die Assistierinformation in der Liste von nicht verwendeten Bildern anzeigt.
     
    13. Layouteditier-Vorrichtung nach Anspruch 12,
    wobei die Editierassistiereinheit die nicht verwendeten Bilder mit dem hohen Evaluierungswert an einer Kopfseite der Liste von nicht verwendeten Bildern bevorzugt gegenüber den nicht verwendeten Bildern mit niedrigem Evaluierungswert anzeigt und platziert.
     
    14. Layouteditier-Vorrichtung nach Anspruch 12,
    wobei die Editierassistiereinheit die nicht verwendeten Bilder mit dem hohen Evaluierungswert in der Liste der nicht verwendeten Bilder markant anzeigt.
     
    15. Layouteditier-Vorrichtung nach Anspruch 14,
    wobei die Editierassistiereinheit in der Liste der nicht verwendeten Bildern die markante Anzeige durchführt durch Markieren der nicht verwendeten Bildern mit dem hohen Evaluierungswert oder durch Verändern einer Farbe eines Anzeigerahmens des nicht verwendeten Bilds mit hohem Evaluierungswert oder durch Verändern einer Anzeigegröße des nicht verwendeten Bildes mit dem hohen Evaluierungswert.
     
    16. Layouteditier-Vorrichtung nach Anspruch 12,
    wobei die Editierassistiereinheit die vorbestimmte Anzahl von nicht verwendeten Bildern gemäß vorbestimmten Bildern verändert, die basierend auf der Nutzerinstruktion aus den in dem Layout verwendeten editierten Bildern bezeichnet sind, und das Resultat in der Liste von nicht verwendeten Bildern anzeigt.
     
    17. Layouteditier-Vorrichtung nach Anspruch 16.
    wobei die Präferenzabschätzeinheit als die Nutzerpräferenz die Wichtigkeit von jeder fotografierten Person oder jedem fotografierten Ort in jedem der Vielzahl von Bildern berechnet, und
    wenn ein Bild, in welchem eine Person geringer Wichtigkeit oder ein Ort geringer Wichtigkeit fotografiert ist, von den editierten, in dem Layout verwendeten Bildern, basierend auf der Nutzerinstruktion, bezeichnet wird, zeigt die Editierassistiereinheit ein nicht verwendetes Bild, in welchem eine Person hoher Wichtigkeit oder ein On hoher Wichtigkeit fotografiert ist, in der Liste von nicht verwendeten Bildern bevorzugt zu dem Bild an, in welchem die Person geringer Wichtigkeit oder der Ort geringer Wichtigkeit fotografiert ist.
     
    18. Layouteditier-Vorrichtung nach einem der Ansprüche 12 bis 17, weiterhin umfassend:

    eine automatische Layouteinheit, die das Layout automatisch basierend auf der Nutzerpräferenz, erzeugt,

    wobei die Editierassistiereinheit weiterhin das von der automatischen Layouteinheit erzeugte Layout auf dem Editierbildschirm der Bildschirmeinheit als Assistierinformation anzeigt.


     
    19. Layouteditier-Vorrichtung nach einem der Ansprüche 12 bis 18,
    wobei die Editierassistiereinheit auf dem Editierbildschirm der Bildschirmanzeigeeinheit, basierend auf der Nutzerpräferenz, als Assistierinformation zumindest eines aus einer Hintergrundmontage, einer Rahmendekoration, einem Clipart und Typen für Texteingabe anzeigt.
     
    20. Layouteditier-Vorrichtung nach einem der Ansprüche 1 bis 17, weiterhin umfassend:

    eine automatische Layouteinheit, die ein Layout von jeder einer Vielzahl von Seiten automatisch erzeugt,

    wobei die automatische Layouteinheit ein Layout einer anderen Seite als der vorbestimmten Seite der Vielzahl von Seiten, basierend auf einem Layouteditierresultat der vorbestimmten Seite erzeugt.


     
    21. Layouteditier-Vorrichtung nach einem der Ansprüche 1 bis 20,
    wobei die Präferenzabschätzeinheit die Nutzerpräferenz abschätzt basierend auf einem Layouteditierresultat in zwei oder mehr einer Vielzahl von Seiten.
     
    22. Layouteditier-Vorrichtung nach einem der Ansprüche 1 bis 20,
    wobei die Präferenzabschätzeinheit die Nulzerpräferenz abschätzt basierend auf eineR Layouteditierzeit in zwei oder mehr einer Vielzahl von Seiten.
     
    23. Layouteditier-Vorrichtung nach einem der Ansprüche 1 bis 22, weiterhin umfassend:

    eine Praferenzspeiehereinheit, die Daten der Nutzerpräferenz speichert,

    wobei die Bildevaluierungseinheit den Evaluierungswert von jedem der Vielzahl von Bildern, basierend auf den in der Präferenzspeichereinheit gespeicherten Daten der Nutzerpräferenz berechnet.


     
    24. Layouteditier-Verfahren zum Editieren eines Layouts, in welchem eine vorbestimmte Anzahl von Bildern, die aus einer Vielzahl von Bildern selektiert wurden, an vorbestimmten Positionen angeordnet sind, umfassend:

    einen Schritt des Editierens eines Layouts, das auf einem Editierbildschirm einer Bildschirmanzeigeeinheit angezeigt wird, basierend auf einer Nutzerinstruktion zum Editieren des Layouts, die über eine Instruktions-Eingabeeinheit eingegeben wird;

    einen Schritt des Durchführens einer Bildanalyse von jedem der Vielzahl von Bildern;

    einen Schritt des Abschätzens einer Nutzerpräferenz, basierend auf einem Layouteditierresultat und einem Bildanalyseresultat;

    einen Schritt des Berechnens eines Evaluierungswertes von jedem der Vielzahl von Bildern, basierend auf der Nutzerpräferenz und dem Bildanalyseresultat; und

    einen Schritt des Anzeigens von Assistierinformation, zum Assistieren eines Layouteditierarbeitsgangs des Nutzers, auf dem Editierbildschirm der Bildschirmanzeigeeinheit, basierend auf dem Evaluierungswert von jedem der Vielzahl von Bildern.


     
    25. Programm, das einen Computer dazu veranlasst jeden Schritt des Layouteditier-Verfahrens nach Anspruch 24 durchzuführen.
     
    26. Computerlesbares Speichermedium, auf welchem ein Programm, das einen Computer dazu veranlasst jeden Schritt des Layouteditier-Verfahrens nach Anspruch 24 durchzuführen, gespeichert ist.
     


    Revendications

    1. Dispositif d'édition de mise en page, lequel édite une mise en page, où un nombre prédéterminé d'images sélectionnées parmi une pluralité d'images sont disposées en des positions prédéterminées, comprenant :

    une unité d'affichage d'écran, laquelle affiche un écran d'édition de la mise en page ;

    une unité d'entrée d'instruction, laquelle entre une instruction d'un utilisateur pour éditer la mise en page ;

    une unité d'édition de mise en page, laquelle édite la mise en page, laquelle est affichée sur l'écran d'édition de l'unité d'écran d'affichage, sur la base de l'instruction de l'utilisateur ;

    une unité d'analyse d'image, laquelle réalise une analyse d'image de chaque image parmi la pluralité d'images ;

    une unité d'estimation de préférence, laquelle estime une préférence de l'utilisateur sur la base d'un résultat d'édition de la mise en page et d'un résultat de l'analyse d'image ;

    une unité d'évaluation d'image, laquelle calcule une valeur d'évaluation de chaque image parmi la pluralité d'images sur la base de la préférence de l'utilisateur et du résultat d'analyse d'image, et

    une unité d'aide à l'édition, laquelle affiche des informations d'aide, lesquelles sont destinées à aider un travail d'édition de la mise en page par l'utilisateur, sur l'écran d'édition de l'unité d'affichage d'écran sur la base de la valeur d'évaluation de chaque image parmi la pluralité d'images.


     
    2. Dispositif d'édition de mise en page selon la revendication 1,
    dans lequel l'unité d'estimation de préférence calcule l'importance de chaque personne, comme la préférence de l'utilisateur, sur la base d'une différence entre le nombre d'apparitions de chaque personne photographiée dans une ou plusieurs images ajoutées, lesquelles sont ajoutées à la mise en page sur la base de l'instruction de l'utilisateur à partir d'images non utilisées n'ayant pas été utilisées dans la mise en page parmi la pluralité d'images, et le nombre d'apparitions de la même personne comme chaque personne photographiée dans une ou plusieurs images effacées, lesquelles ont été effacées de la mise en page sur la base de l'instruction de l'utilisateur.
     
    3. Dispositif d'édition de mise en page selon la revendication 2,
    dans lequel l'unité d'estimation de préférence pondère l'importance conformément à une taille d'un visage de chaque personne photographiée dans chaque image parmi l'image ajoutée et l'image effacée.
     
    4. Dispositif d'édition de mise en page selon la revendication 1,
    dans lequel l'unité d'estimation de préférence calcule l'importance de chaque personne, comme la préférence de l'utilisateur, sur la base du nombre d'apparitions de chaque personne photographiée dans les images éditées utilisées dans la mise en page.
     
    5. Dispositif d'édition de mise en page selon la revendication 4,
    dans lequel l'unité d'estimation de préférence calcule l'importance sur la base de l'importance de chaque personne, de telle sorte que l'importance d'une personne présentant un grand nombre d'apparitions dans des images où une personne d'importance élevée est photographiée, parmi des personnes photographiées dans des images où la personne d'importance élevée est photographiée plutôt qu'une personne de faible importance, est supérieure à l'importance d'une personne présentant un petit nombre d'apparitions dans les images où la personne d'importance élevée est photographiée.
     
    6. Dispositif d'édition de mise en page selon la revendication 4,
    dans lequel l'unité d'estimation de préférence calcule l'importance sur la base de l'importance de chaque personne, de telle sorte que l'importance d'une personne présentant un grand nombre d'apparitions dans des images photographiées à une date de photographie de l'image où une personne d'importance élevée est photographiée, parmi des personnes photographiées dans les images photographiées à la date de photographie de l'image où la personne d'importance élevée est photographiée plutôt qu'une personne de faible importance, est supérieure à l'importance d'une personne présentant un petit nombre d'apparitions dans les images photographiées à la date de photographie de l'image où la personne d'importance élevée est photographiée.
     
    7. Dispositif d'édition de mise en page selon la revendication 4,
    dans lequel l'unité d'estimation de préférence calcule l'importance sur la base de l'importance de chaque personne, de telle sorte que l'importance d'une personne présentant un grand nombre de dates d'apparition de dates de photographie d'images où une personne d'importance élevée est photographiée, parmi des personnes photographiées dans des images photographiées à des dates de photographie où la personne d'importance élevée est photographiée plutôt qu'une personne de faible importance, est supérieure à l'importance d'une personne présentant un petit nombre de dates d'apparition.
     
    8. Dispositif d'édition de mise en page selon la revendication 1,
    dans lequel l'unité d'estimation de préférence calcule l'importance de chaque personne, comme la préférence de l'utilisateur, sur la base du contenu d'image photographié dans chaque image éditée utilisée dans la mise en page.
     
    9. Dispositif d'édition de mise en page selon la revendication 1,
    dans lequel lorsqu'une image éditée utilisée dans la mise en page est échangée avec une image non utilisée n'ayant pas été utilisée dans la mise en page de la pluralité d'images sur la base de l'instruction de l'utilisateur, l'unité d'estimation de préférence calcule l'importance de personnes photographiées dans des images avant et après l'échange, et l'importance de scènes et la composition des images avant et après l'échange, comme la préférence de l'utilisateur, sur la base de si oui ou non un visage d'une personne est photographié dans les images avant et après l'échange, de si oui ou non la même personne est photographiée dans les images avant et après l'échange, et de si oui ou non les images avant et après l'échange sont des images similaires.
     
    10. Dispositif d'édition de mise en page selon la revendication 1,
    dans lequel lorsqu'une image éditée utilisée dans la mise en page est échangée avec une image non utilisée n'ayant pas été utilisée dans la mise en page de la pluralité d'images sur la base de l'instruction de l'utilisateur, l'unité d'estimation de préférence estime la préférence de l'utilisateur sur la base de l'un quelconque des éléments parmi des temps de photographie d'images avant et après l'échange, d'endroits de photographie des images avant et après l'échange, de tailles de visages de personnes photographiées dans les images avant et après l'échange, de positions des visages des personnes photographiées dans les images avant et après l'échange, d'orientations des visages des personnes photographiées dans les images avant et après l'échange, d'expressions des personnes photographiées dans les images avant et après l'échange, de scènes des images avant et après l'échange, de couleurs d'images entières avant et après l'échange, et si les images avant et après l'échange sont des paysages ou des portraits.
     
    11. Dispositif d'édition de mise en page selon la revendication 1,
    dans lequel lorsqu'une seule région incluant une personne prédéterminée est extraite d'une image, où deux personnes ou plus sont photographiées, d'images éditées utilisées dans la mise en page, et est disposée dans la mise en page sur la base de l'instruction de l'utilisateur, l'unité d'estimation de préférence calcule l'importance de telle sorte que l'importance de la personne prédéterminée soit supérieure à l'importance d'une personne autre que la personne prédéterminée, parmi deux personnes ou plus photographiées dans l'image.
     
    12. Dispositif d'édition de mise en page selon l'une quelconque des revendications 1 à 11,
    dans lequel l'unité d'affichage d'écran affiche en outre une liste d'un nombre prédéterminé d'images non utilisées, parmi des images non utilisées de la pluralité d'images non disposées dans la mise en page, sur l'écran d'édition, et
    l'unité d'aide à l'édition affiche une image non utilisée présentant une valeur d'évaluation élevée en préférence à une image non utilisée présentant une faible valeur d'évaluation, comme informations d'aide, dans la liste d'images non utilisées.
     
    13. Dispositif d'édition de mise en page selon la revendication 12,
    dans lequel l'unité d'aide à l'édition place et affiche l'image non utilisée présentant la valeur d'évaluation élevée sur un côté en tête de la liste d'images non utilisées en préférence à l'image non utilisée présentant la faible valeur d'évaluation.
     
    14. Dispositif d'édition de mise en page selon la revendication 12,
    dans lequel l'unité d'aide à l'édition affiche l'image non utilisée présentant la valeur d'évaluation élevée de manière distincte dans la liste d'images non utilisées.
     
    15. Dispositif d'édition de mise en page selon la revendication 14,
    dans lequel l'unité d'aide à l'édition réalise l'affichage distinct dans la liste d'images non utilisées en marquant l'image non utilisée présentant la valeur d'évaluation élevée, ou en modifiant une couleur d'une trame d'affichage de l'image non utilisée présentant la valeur d'évaluation élevée, ou en modifiant une taille d'affichage de l'image non utilisée présentant la valeur d'évaluation élevée.
     
    16. Dispositif d'édition de mise en page selon la revendication 12,
    dans lequel l'unité d'aide à l'édition modifie le nombre prédéterminé d'images non utilisées conformément à des images prédéterminées, lesquelles sont désignées sur la base de l'instruction de l'utilisateur parmi des images éditées utilisées dans la mise en page, et affiche le résultat dans la liste d'images non utilisées.
     
    17. Dispositif d'édition de mise en page selon la revendication 16,
    dans lequel l'unité d'estimation de préférence calcule, comme la préférence de l'utilisateur, l'importance de chaque personne ou chaque endroit photographié dans chaque image parmi la pluralité d'images, et
    lorsqu'une image où une personne de faible importance ou un endroit de faible importance est photographié, parmi des images éditées utilisées dans la mise en page, est désignée sur la base de l'instruction de l'utilisateur, l'unité d'aide à l'édition affiche une image non utilisée ou une personne d'importance élevée ou un endroit d'importance élevée est photographié dans la liste d'images non utilisées ayant priorité sur l'image où la personne de faible importance ou l'endroit de faible importance est photographié.
     
    18. Dispositif d'édition de mise en page selon l'une quelconque des revendications 12 à 17, comprenant en outre :

    une unité de mise en page automatique, laquelle crée la mise en page automatiquement sur la base de la préférence de l'utilisateur,

    dans lequel l'unité d'aide à l'édition affiche en outre la mise en page créée par l'unité de mise en page automatique, comme les informations d'aide, sur l'écran d'édition de l'unité d'affichage d'écran.


     
    19. Dispositif d'édition de mise en page selon l'une quelconque des revendications 12 à 18,
    dans lequel l'unité d'aide à l'édition affiche au moins un élément parmi un montage d'arrière-plan, une décoration de cadre, un clipart, et des polices pour l'entrée de texte sur l'écran d'édition de l'unité d'affichage d'écran, comme les informations d'aide, sur la base de la préférence de l'utilisateur.
     
    20. Dispositif d'édition de mise en page selon l'une quelconque des revendications 1 à 17, comprenant en outre :

    l'unité de mise en page automatique, laquelle crée automatiquement une mise en page de chaque page parmi une pluralité de pages,

    dans lequel l'unité de mise en page automatique crée une mise en page d'une page autre qu'une page prédéterminée parmi la pluralité de pages sur la base d'un résultat d'édition d'une mise en page de la page prédéterminée.


     
    21. Dispositif d'édition de mise en page selon l'une quelconque des revendications 1 à 20,
    dans lequel l'unité d'estimation de préférence estime la préférence de l'utilisateur sur la base d'un résultat d'édition de mise en page dans deux pages ou plus parmi une pluralité de pages.
     
    22. Dispositif d'édition de mise en page selon l'une quelconque des revendications 1 à 20,
    dans lequel l'unité d'estimation de préférence estime la préférence de l'utilisateur sur la base d'un temps d'édition de mise en page dans chaque page parmi une pluralité de pages.
     
    23. Dispositif d'édition de mise en page selon l'une quelconque des revendications 1 à 22, comprenant en outre :

    une unité de stockage de préférence, laquelle stocke des données de la préférence de l'utilisateur ;

    dans lequel l'unité d'évaluation d'image calcule la valeur d'évaluation de chaque image parmi la pluralité d'images sur la base des données de la préférence de l'utilisateur stockées dans l'unité de stockage de préférence.


     
    24. Procédé d'édition de mise en page destiné à éditer une mise en page où un nombre prédéterminé d'images sélectionnées parmi une pluralité d'images sont disposées en des positions prédéterminées, comprenant les étapes suivantes :

    une étape pour éditer une mise en page, laquelle est affichée sur un écran d'édition d'une unité d'affichage d'écran, sur la base d'une instruction d'un utilisateur pour éditer la mise en page, laquelle est entrée par le biais d'une unité d'entrée d'instruction ;

    une étape pour réaliser une analyse d'image de chaque image parmi la pluralité d'images ;

    une étape pour estimer une préférence de l'utilisateur sur la base d'un résultat d'édition de la mise en page et d'un résultat de l'analyse d'image ;

    une étape pour calculer une valeur d'évaluation de chaque image parmi la pluralité d'images sur la base de la préférence de l'utilisateur et du résultat d'analyse d'image, et

    une étape pour afficher des informations d'aide, lesquelles sont destinées à aider un travail d'édition de la mise en page par l'utilisateur, sur l'écran d'édition de l'unité d'affichage d'écran sur la base de la valeur d'évaluation de chaque image parmi la pluralité d'images.


     
    25. Programme faisant en sorte qu'un ordinateur exécute chaque étape du procédé d'édition de mise en page selon la revendication 24.
     
    26. Support d'enregistrement lisible par ordinateur sur lequel est enregistré un programme faisant en sorte qu'un ordinateur exécute chaque étape du procédé d'édition de mise en page selon la revendication 24.
     




    Drawing


























    Cited references

    REFERENCES CITED IN THE DESCRIPTION



    This list of references cited by the applicant is for the reader's convenience only. It does not form part of the European patent document. Even though great care has been taken in compiling the references, errors or omissions cannot be excluded and the EPO disclaims all liability in this regard.

    Patent documents cited in the description




    Non-patent literature cited in the description