Display control apparatus, display control method and display control program

TECHNICAL FIELD

0001The present technology relates to a display control apparatus, a display control method and a display control program.

BACKGROUND ART

0002In recent years, a camera is mounted to a smartphone, a mobile phone device, or a tablet terminal. An image quality and a usability of the camera are improved, whereby a general user captures a number of images. In addition, a variety of net services handling the images is spreading. In this way, an amount of the images handled by a user is explosively increased.

0003Then, in order to browse a number of images effectively, a technology to classify and display the images along a time axis of year, month, and day. <ul id="ul0001" list-style="none"><li id="ul0001-0001" num="0004">[Patent Document 1] Japanese Patent Application Laid-open No. 2007-179351</li></ul>

SUMMARY OF INVENTION

Problem to be Solved by the Invention

0005In recent years, as image recognition techniques are improved, it becomes possible to browse images by classifying and organizing images based not only a time but also a type of a photographic subject. It is desirable to further improve the usability of a user interface using the image recognition techniques.

0006The present technology is made in view of the problems, and an object is to provide a display control apparatus, a display control method and a display control program by which a user can easily search and browse images.

Means for Solving the Problem

0007In order to solve the above-described problems, a first technology is a display control apparatus, including a display control unit for controlling a display unit for displaying an image, the display control unit being configured to display a plurality of represented images that represent a plurality of image groups classified depending on related information of the images on the display unit in a first display mode, and display related images relating to the represented images between a plurality of the represented images displayed in the first display mode depending on a user input on the display unit in a second display mode.

0008A second technology is a method of controlling a display, including displaying a plurality of represented images that represent a plurality of image groups classified depending on related information of the images on the display unit for displaying the images in a first display mode, and displaying related images relating to the represented images in a second display mode between a plurality of the represented images displayed in the first display mode depending on a user input.

0009A third technology is a display control program for executing a method of controlling a display by a computer, the method including displaying a plurality of represented images that represent a plurality of image groups classified depending on related information of the images on the display unit for displaying the images in a first display mode, and displaying related images relating to the represented images between a plurality of the represented images displayed in the first display mode depending on a user input.

Effect of the Invention

0010According to the present technology, a user can easily search and browse images.

BRIEF DESCRIPTION OF DRAWINGS

0011<figref idref="DRAWINGS">FIG. 1A</figref> is a block diagram showing a configuration of a display control apparatus, and <figref idref="DRAWINGS">FIG. 1B</figref> is a block diagram showing another configuration of a display control apparatus.

0012<figref idref="DRAWINGS">FIG. 2</figref> is a diagram showing display modes according to the present technology.

0013<figref idref="DRAWINGS">FIG. 3A</figref> is a diagram showing a display mode of a represented image display, and <figref idref="DRAWINGS">FIG. 3B</figref> is a diagram showing a display mode of a represented image display if a screen is scrolled.

0014<figref idref="DRAWINGS">FIG. 4A</figref> is a diagram showing a display mode of a summary hierarchical display, and <figref idref="DRAWINGS">FIG. 4B</figref> is a diagram showing a display mode of a summary hierarchical display if a screen is scrolled.

0015<figref idref="DRAWINGS">FIG. 5</figref> is a diagram showing a display mode of a header display in a group displayed if a summary hierarchical display is scrolled.

0016<figref idref="DRAWINGS">FIG. 6A</figref> is a diagram showing a display mode of a detailed hierarchical display, and <figref idref="DRAWINGS">FIG. 6B</figref> is a diagram showing a display mode of a detailed hierarchical display if a summary hierarchical display is scrolled.

0017<figref idref="DRAWINGS">FIG. 7A</figref> is a diagram showing a first embodiment of an image single display, and <figref idref="DRAWINGS">FIG. 7B</figref> is a diagram showing a second embodiment of an image single display.

0018<figref idref="DRAWINGS">FIG. 8A</figref> is a diagram showing a display example of a represented image display using a specific image classified in an “import time” category, and <figref idref="DRAWINGS">FIG. 8B</figref> is a diagram showing a display example of a summary hierarchical display using a specific image classified in an “import time” category.

0019<figref idref="DRAWINGS">FIG. 9A</figref> is a diagram showing a display example of a detailed hierarchical display using a specific image classified in an “import time” category, and <figref idref="DRAWINGS">FIG. 9B</figref> is a diagram showing a display example of an image single display using a specific image classified in an “import time” category.

0020<figref idref="DRAWINGS">FIG. 10A</figref> is a diagram showing a display example of a represented image display using a specific image classified in a “main photographic subject” category, <figref idref="DRAWINGS">FIG. 10B</figref> is a diagram showing a display example of a summary hierarchical display using a specific image classified in a “main photographic subject” category.

0021<figref idref="DRAWINGS">FIG. 11A</figref> is a diagram showing a display example of a detailed hierarchical display using a specific image classified in a “main photographic subject” category, and <figref idref="DRAWINGS">FIG. 11B</figref> is a diagram showing a display example of an image single display using a specific image classified in a “main photographic subject” category.

0022<figref idref="DRAWINGS">FIG. 12A</figref> is a diagram explaining a switching of category displays, <figref idref="DRAWINGS">FIG. 12B</figref> is a diagram explaining a switching of category displays.

0023<figref idref="DRAWINGS">FIG. 13</figref> is a flowchart showing overall flows of processing in a display control apparatus.

0024<figref idref="DRAWINGS">FIG. 14</figref> is a flowchart showing a flow of a hierarchical switching processing.

0025<figref idref="DRAWINGS">FIG. 15A</figref> is a flowchart showing a flow of a category switching processing, and <figref idref="DRAWINGS">FIG. 15B</figref> is a alternative flowchart showing a flow of a category switching processing.

0026<figref idref="DRAWINGS">FIG. 16A</figref> to <figref idref="DRAWINGS">FIG. 16C</figref> each is a diagram showing a first alternative embodiment of a display according to the present technology.

0027<figref idref="DRAWINGS">FIG. 17A</figref> to <figref idref="DRAWINGS">FIG. 17C</figref> each is a diagram showing a second alternative embodiment of a display according to the present technology.

0028<figref idref="DRAWINGS">FIG. 18A</figref> to <figref idref="DRAWINGS">FIG. 18C</figref> each is a diagram showing a third alternative embodiment of a display according to the present technology.

0029<figref idref="DRAWINGS">FIG. 19A</figref> and <figref idref="DRAWINGS">FIG. 19B</figref> each is a diagram showing a fourth alternative embodiment of a display according to the present technology.

0030<figref idref="DRAWINGS">FIG. 20A</figref> and <figref idref="DRAWINGS">FIG. 20B</figref> each is a diagram showing a fifth alternative embodiment of a display according to the present technology.

0031<figref idref="DRAWINGS">FIG. 21</figref> diagrams each showing an alternative embodiment of the present technology, <figref idref="DRAWINGS">FIG. 21A</figref> is a diagram showing a display example of a represented image display in the case of applying the present technology to a smartphone, <figref idref="DRAWINGS">FIG. 21B</figref> is a diagram showing a display example of a represented image display in the case of applying the present technology to a tablet terminal, and <figref idref="DRAWINGS">FIG. 21C</figref> is a diagram showing a display example of a represented image display in the case of applying the present technology to a personal computer, and <figref idref="DRAWINGS">FIG. 21D</figref> is a diagram showing a display example of a represented image display in the case of applying the present technology to a television receiver.

0032<figref idref="DRAWINGS">FIG. 22A</figref> is a diagram showing a display example of a summary hierarchical display in the case of applying the present technology to a smartphone, <figref idref="DRAWINGS">FIG. 22B</figref> is a diagram showing a display example of a summary hierarchical display in the case of applying the present technology to a tablet terminal, <figref idref="DRAWINGS">FIG. 22C</figref> is a diagram showing a display example of a summary hierarchical display in the case of applying the present technology to a personal computer, and <figref idref="DRAWINGS">FIG. 22D</figref> is a diagram showing a display example of a summary hierarchical display in the case of applying the present technology to a television receiver.

0033<figref idref="DRAWINGS">FIG. 23A</figref> is a diagram showing a display example of an image single display in the case of applying the present technology to a smartphone, <figref idref="DRAWINGS">FIG. 23B</figref> is a diagram showing a display example and application icons in the case of applying the present technology to a tablet terminal, <figref idref="DRAWINGS">FIG. 23C</figref> is a diagram showing a display example and application UIs in the case of applying the present technology to a personal computer, and <figref idref="DRAWINGS">FIG. 23</figref> is a diagram showing a display example and a map in the case of applying the present technology to a television receiver.

MODES FOR CARRYING OUT THE INVENTION

0034Hereinafter, referring to the drawings, embodiments of the present technology will be described in the following orders:

<1. Embodiments>

[1-1. Configuration of Display Control Apparatus]

[1-2. Processing in Display Control Apparatus]

<2. Alternative Embodiment>

1. Embodiments

1-1. Configuration of Display Control Apparatus

0035Firstly, referring to <figref idref="DRAWINGS">FIG. 1</figref>, a configuration of a display control apparatus <b>10</b> is described. <figref idref="DRAWINGS">FIG. 1A</figref> is a block diagram showing a configuration of the display control apparatus <b>10</b>. The display control apparatus <b>10</b> includes an image classification unit <b>11</b> and a display control unit <b>12</b>. The image classification unit <b>11</b> and the display control unit <b>12</b> of the display control apparatus <b>10</b> are operated by executing a predetermined program by a CPU (Central Processing Unit), for example. The display control apparatus <b>10</b> operates in a device such as a smartphone, a tablet terminal, a personal computer, a television receiver, a mobile phone and a server. It should be noted that a display control apparatus may be configured as a single apparatus.

0036To the display control apparatus <b>10</b>, an input unit <b>20</b> and a display unit <b>30</b> included in the above described other devices are connected. Alternatively, the display control apparatus <b>10</b> may include the input unit <b>20</b> and the display unit <b>30</b>. The display control apparatus <b>10</b> is provided with image data held by the above-described other devices. The image data may be provided by importing images already uploaded in an SNS (social networking service), a photo sharing site, etc. on the Internet.

0037The input unit <b>20</b> is an inputting means that receives a user's operation input. The input unit <b>20</b> is a touch panel integrally configured of the display unit <b>30</b>, for example. The touch panel is an electrostatic capacitance touch panel, a pressure sensitive touch panel, or the like, for example. Alternatively, the input unit <b>20</b> may not be the touch panel, but may be a pointing device such as a mouse, a keyboard or the like. The display control apparatus <b>10</b> is provided with input information showing a user input content from the input unit <b>20</b>. It should be noted that the following description is made referring to a touch panel where the input unit <b>20</b> and the display unit <b>30</b> are integrally configured.

0038The touch panel can detect respective operations made at a plurality of points simultaneously on an operation screen, i.e., a screen, and output information showing a contact position. Also, the touch panel can detect familiar and repeating operations on the operation screen, and output information showing respective contact positions.

0039The touch panel can receive a variety of inputs and operations including a so-called tap operation, a double tap operation, a flick operation, a drag operation, a pinch operation, and a tracing operation from a user, and output them.

0040The tap operation is an input operation that a finger of a user allows to be in contact with an operation screen one time for a short time. The double tap operation is an input operation that a finger allows to be in contact with an operation screen twice successively in a short interval. These operations are mainly used in a determination of the input.

0041The drag operation is an input operation that a user's finger is moved on an operation screen while being in contact therewith. The flick operation is an input operation that a user's finger is touched one point on an operation screen and is flicked quickly to any direction. In this way, for example, a plurality of images displayed and viewed on the display unit <b>30</b> can be switched as if the images are flicked.

0042The pinch operation is an input operation that user's two fingers are in contact with an operation screen simultaneously, and then open and close like pinching. The pinch operation allows a frame showing a display area on the display unit <b>30</b> to be enlarged or reduced in size. In the pinch operation, an operation that two fingers contacted are open is called as a pinch-out operation, and an operation that two fingers are closed is called as a pinch-in operation.

0043If an input is made to a touch panel as the input unit <b>20</b>, the display control apparatus <b>10</b> is provided with input information showing a contact position from the input unit <b>20</b>.

0044The display unit <b>30</b> is an image display means configured of an LCD (Liquid Crystal Display), a PDP (Plasma Display Panel), an organic EL (Electro Luminescence) panel or the like, for example. The display unit <b>30</b> displays the images displayed based on the processing by the display control apparatus <b>10</b>, user interfaces according to the present technology or the like.

0045An image classification unit <b>11</b> classifies the image data provided into a plurality of categories, groups, or subgroups based on related information of the image. The category is a largest classification unit in an image classification according to the present technology. The group is an image classification unit included in the category. The subgroup is an image classification unit included in the group. Classification information showing the classification result by the image classification unit <b>11</b> is supplied to the display control unit <b>12</b>.

0046Examples of the category include an “import time”, a “main photographic subject”, an “event”, a “favorite”, a “film location” and an “external image”.

0047The “import time” category is based on a time to import an image to the display control apparatus <b>10</b> for displaying the image. The classification of the “import time” category may be made by recognizing a time to import the image to the display control apparatus <b>10</b> by a clock function. In the “import time” category, if the group is a “month”, the subgroup is a “day”, or if the group is a “year, the subgroup is a “month”, for example.

0048The “main photographic subject” category is based on a main photographic subject in an image. The classification of the “main photographic subject” category may be made by recognizing a photographic subject such as an article and a person in an image using a known image recognition technology. As the image recognition technology, there are a matching method based on a face/person recognition technology by a template matching or brightness distribution information of a photographic subject, a method based on a skin color part or a human face feature amount included in an image, and a method based on a face feature amount. In addition, these methods may be combined to increase a recognition accuracy. In the “main photographic subject” category, the group is a “person” who is the photographic subject, and the subgroup is a “human age”, for example.

0049The “event” category is based on an event where the image is captured. The classification of the “event” category is based on known photographic subject recognition techniques, an image captured time provided by referring to EXIF (Exchangeable image file format) data, and GPS (Global Positioning System) data.

0050For example, as a result of the recognition of the photograph subject, a plurality of the same persons are captured in a plurality of images. If a captured time of a plurality of the images is within a predetermined time range, it may be judged that a plurality of the images are captured at the same event. Furthermore, if it is judged that a plurality of images are captured at the same position by referring to GPS data, it may be judged that a plurality of the images are captured at the same event. Also, it may be judged that the images on which the photograph subject such as an architectural structure is captured are captured at the same event. In the “event” category, a “trip”, a “party” or the like are classified as the group, and a “date of trip”, a “date or time of party” or the like is classified as the subgroup.

0051The “favorite” category is based on a degree of the favorite to a user's image. The classification of the favorite may be made based on a time to display the image by the user, an evaluation point set by the user for each image, or the like. In the “favorite” category, depending on the degree of the favorite, the image may be divided into the group or the subgroup.

0052The “film location” category is based on a position where an image is captured. The classification of the “film location” category may be made based on GPS data corresponding to the image. In the “film location” category, the group is a “country, and the subgroup is a “city”, a “town”, or a “municipality”, for example.

0053The “external image” category is based on a type of a service or an application if the image already uploaded in the Internet service such as the SNS and the photo sharing site or the image already imported to other application is imported to the display control apparatus <b>10</b>. In the “external image” category, a specific service such as the Facebook may be classified as the group, and an album already set within the external service may be classified as the subgroup.

0054Further, a specific internet service such as the Facebook is defined as the category, and a group or album within the Internet service may be the group or the subgroup in the present technology. The images already imported to other application may be divided into the group or the subgroup based on the classification of the images within the application or related information such as a tag within the application.

0055If the SNS, the photo sharing site, or the application where the images are provided with an effect such as sepia and monochrome is defined as the category or the group, the type of the image effect may be defined as the group or the subgroup.

0056If the image data can be imported externally from the existing SNS, the photo sharing site, or the application to the display control apparatus <b>10</b>, it is not necessary that a large amount of images is again imported to the display control apparatus <b>10</b> one by one used for the present technology. In this way, the user who has already uploaded a large amount of data in the external service or the application may easily utilize the present technology.

0057It should be noted that the category is not limited to the above-described content. As long as the images may be classified using any related information of the image, any category, group or subgroup may be used.

0058As shown in <figref idref="DRAWINGS">FIG. 1B</figref>, an image classification unit <b>40</b> may not be included in the display control apparatus <b>10</b> and may be disposed at an external server. In this case, the external image classification unit <b>40</b> may be provided with the image data, and the display control apparatus <b>10</b> may be provided with the image data and classification information from the external image classification unit <b>40</b>. In addition, the display control apparatus <b>10</b> may hold the image data and the external image classification unit <b>40</b> may also hold the image data to perform a classification processing. From the image classification unit <b>11</b>, the display control apparatus <b>10</b> may be provided with only the classification information.

0059The display control unit <b>12</b> controls a user interface display according to the present technology and an image display based on the classification result from the display control unit <b>11</b> in the display unit <b>30</b>. Here, referring to <figref idref="DRAWINGS">FIG. 2</figref> to <figref idref="DRAWINGS">FIG. 12</figref>, an image display mode based on the processing by the display control unit <b>11</b> will be described. In <figref idref="DRAWINGS">FIG. 2</figref> to <figref idref="DRAWINGS">FIG. 12</figref>, the description will be made as an example case that the device where the display control apparatus <b>10</b> is operated is a smartphone, the input unit <b>20</b> is a touch panel of the smartphone, and the display unit <b>30</b> is a display of the smartphone. It should be noted that the present technology may be applicable to a device other than the smartphone as described above.

0060Firstly, referring to <figref idref="DRAWINGS">FIG. 2</figref>, an overview of the display screen embodiment according to the present technology will be described. <figref idref="DRAWINGS">FIG. 2</figref> is a diagram showing the overview of a display and a switching of the display in the display unit <b>30</b> based on the control by the display control apparatus <b>10</b>.

0061In the present technology, a plurality of the images are classified into a plurality of the categories and displayed. Furthermore, the images are classified into the group or the subgroup in each category and displayed. Although <figref idref="DRAWINGS">FIG. 2</figref> shows three categories of a first category, a second category and a third category, the number of the categories are not limited to the three.

0062Furthermore, in the present technology, the image in each category is displayed in three display modes. The three display modes are a represented image display, a summary hierarchical display, and a detailed hierarchical display. In addition to the hierarchical display, an image single display may be made. In the description, the represented image display is defined as the first hierarchical display, the summary hierarchical display is defined as the second hierarchical display, and the detailed hierarchical display is defined as the third hierarchical display.

0063As shown in <figref idref="DRAWINGS">FIG. 2</figref>, the displays can be mutually switched between the respective categories, and the displays can be mutually switched between the hierarchies depending on a user input.

0064Next, specific configuration of the respective display modes will be described. <figref idref="DRAWINGS">FIG. 3A</figref> shows a display mode of a represented image display in the first hierarchical display. The first hierarchical represented image display includes a plurality of represented image display areas <b>100</b>, <b>100</b>, <b>100</b> . . . . On the represented image display area <b>100</b>, an image representing the group (hereinafter referred to as a “represented image”) <b>101</b> is displayed. In <figref idref="DRAWINGS">FIG. 3</figref> to <figref idref="DRAWINGS">FIG. 6</figref>, a square having a diagonal line represents a simplified image.

0065At this time, as shown in <figref idref="DRAWINGS">FIG. 3A</figref>, group names (“group A, group B, and group C” in <figref idref="DRAWINGS">FIG. 3A</figref>) are displayed at positions corresponding to the respective groups. In the represented image display, the image selected from a plurality of the images included in the group is displayed as an image representing the group.

0066In the typical image display mode in <figref idref="DRAWINGS">FIG. 3A</figref>, one represented image <b>101</b> is a background image of the group, and a plurality of images relating to the represented image (herein after referred to as related images) <b>102</b>, <b>102</b>, . . . are superimposed and displayed on the background image. Similarly, in the group B and group C in <figref idref="DRAWINGS">FIG. 3A</figref>, the represented image and related images belonging to the respective groups are selected and displayed.

0067The images contained in the groups are scored by a variety of conditions, and the image having a highest score may be the represented image. The scoring becomes high under the following conditions: if a percentage of a face occupied in the image exceeds a certain level to the size of the image; if there is a smile face; if the face is not profile but front; or if the number of the person as the photographic subject exceeds a predetermined number. These can be attained by using a known image recognition technique, a smile detection technique, or a face direction detection technique.

0068In the embodiment shown in <b>3</b>A, the image having a highest score among the images in the group is displayed large as the represented image <b>101</b>. On the represented image <b>101</b>, a plurality of images having next highest scores are superimposed and displayed as the related images <b>102</b>. Such a display is applied to all groups displayed on the display unit <b>30</b>.

0069If there are a plurality of groups, all groups may be incapable of being displayed in one screen of the display unit <b>30</b>. In this case, if a user inputs (for example, drags in up and down directions) to the touch panel on the represented image display area <b>100</b>, the screen may be scrolled, and other group may be displayed as shown in <figref idref="DRAWINGS">FIG. 3B</figref>. In this way, the user can easily recognize all group with a seamless display. It should be noted that a scroll at this time may be a so-called inertia scroll.

0070Next, referring to <figref idref="DRAWINGS">FIG. 4</figref>, a summary hierarchical display will be described as the second hierarchical display. In the state that the represented image shown in <figref idref="DRAWINGS">FIG. 3</figref> is displayed, if a user inputs (for example, taps) to select any group, the image display is switched to the summary hierarchical display.

0071The summary hierarchical display is to classify the images contained in the group for a summary display. In the state where the represented image is displayed, if the user selects any of the groups, the images contained in the group selected are displayed between the group selected and the group lower than the group selected. In <figref idref="DRAWINGS">FIG. 4A</figref>, the user selects the group A, and a plurality of the images contained in a subgroup a, a subgroup b, a subgroup c contained in the group A are displayed on the area between the group A and the group B. As shown in <figref idref="DRAWINGS">FIG. 4A</figref>, subgroup names (the “subgroup a”, the “subgroup b”, and the “subgroup c” in <figref idref="DRAWINGS">FIG. 4A</figref>) are displayed at positions corresponding to the respective subgroups.

0072The summary hierarchical display is a display mode including a header display area <b>210</b>, and subgroup display areas <b>220</b>, <b>220</b>, . . . . The header display area <b>210</b> displays the group selected by the user in the represented image display at the uppermost column. In <figref idref="DRAWINGS">FIG. 4A</figref>, the represented image <b>101</b> and the related images <b>102</b> of the group A selected by the user are displayed as a header. By the display, the user can easily recognize that which group contains the image now displayed.

0073The subgroup display area <b>220</b> is to display the images contained in the subgroup being present in the group displayed in the represented image display. The subgroup display area <b>220</b> has a large size image display area <b>221</b> and a small size image display area <b>222</b>, The large size image display area <b>221</b> is to display one image contained in the subgroup in a large size. The small size image display area <b>222</b> is to display and arrange a plurality of the images contained in the subgroup in smaller sizes as compared with the large size image display area <b>221</b>. The subgroup display area <b>220</b> corresponds to the represented image display area in the claims.

0074In the embodiment shown in <figref idref="DRAWINGS">FIG. 4A</figref>, in the large size image display area <b>221</b>, one image is displayed, and in the small size image display area <b>222</b>, seven images are displayed. Note that the number of the images displayed in the small size image display area is only an example, and is not limited to seven. The display size may be decreased, and more images may be displayed. Oppositely, the display size may be increased, and less images may be displayed.

0075If the group contains a number of subgroups, all subgroups may not be displayed within one screen of the display unit <b>30</b>. In this case, if the user inputs to the touch panel (for example, drags in up and down directions) on the subgroup display area <b>220</b>, the screen may be scrolled to display other subgroups shown in <figref idref="DRAWINGS">FIG. 4B</figref>. In this way, the user can easily recognize all subgroups with a seamless display. A scroll at this time may be a so-called inertia scroll.

0076The subgroup display area <b>220</b> is displayed between the group selected by the user in the state that the represented image is displayed and the group lower than the group, as described above. Accordingly, for example, if the group selected is the group A and the subgroup display area <b>220</b> of the group A is scrolled to down, the represented image of the group B, i.e., other group is displayed in a display format of a header area <b>100</b>, as shown in <figref idref="DRAWINGS">FIG. 5</figref>. In <figref idref="DRAWINGS">FIG. 5</figref>, a represented image <b>103</b> of the group B is displayed as the background image. In addition, related images <b>104</b>, <b>104</b>, <b>104</b> are superimposed and displayed on the background image. With the seamless display, all groups and subgroups can be easily recognized without switching the screen to other screen. If the screen is scrolled, both of the header display area <b>210</b> and the subgroup display areas <b>220</b> may be scrolled. Alternatively, while the header display area <b>210</b> may be fixed, the subgroup display area <b>220</b><i>s </i>may be scrolled. <figref idref="DRAWINGS">FIG. 5</figref> shows the case that both of the header display area <b>210</b> and the subgroup display areas <b>220</b> are scrolled.

0077Furthermore, in the summary hierarchical display, there is displayed a detailed display instruction button <b>223</b> to instruct switching to the detailed hierarchical display that displays the images contained in the subgroup, but not displayed on the summary hierarchical display. The detailed display instruction button <b>223</b> is present per subgroup displayed on the summary hierarchical display. The detailed display instruction button <b>223</b> is represented by “MORE” in <figref idref="DRAWINGS">FIG. 4</figref>. If the user inputs (for example, taps) the detailed display instruction button <b>223</b>, the display is switched to the detailed hierarchical display, as shown in <figref idref="DRAWINGS">FIG. 6</figref>. Note that the display “MORE” of the detailed display instruction button <b>223</b> in <figref idref="DRAWINGS">FIG. 4</figref> is only an example, and is not limited to the display mode of the detailed display instruction button <b>223</b>.

0078Next, referring to <figref idref="DRAWINGS">FIG. 6</figref>, the detailed hierarchical display, i.e., the third hierarchical display will be described. As described above, in a summary hierarchical display state, if the user inputs (for example, taps) the display instruction button <b>223</b>, the image display is switched to the detailed hierarchical display shown in <figref idref="DRAWINGS">FIG. 6A</figref>.

0079The detailed hierarchical display is to display the images contained in the subgroup corresponding to the display instruction button <b>223</b> inputted. The detailed hierarchical display is a display mode including a header display area <b>310</b> and a detailed display area <b>320</b>. The header display area <b>310</b> is to display the group including the subgroup corresponding to the display instruction button <b>223</b> inputted by the user in the summary hierarchical display in the uppermost column of the display unit <b>30</b>. In <figref idref="DRAWINGS">FIG. 6A</figref>, as the detailed display instruction button <b>223</b> of the subgroup a is inputted by the user, the represented image <b>101</b> and related images <b>102</b> of the group A including the subgroup a are displayed as the header. By the display, the user can easily recognize that which group contains the image now displayed.

0080The detailed image display area <b>320</b> is to display the images contained in the subgroup selected by the input of the user to the detailed display instruction button <b>223</b>. In <figref idref="DRAWINGS">FIG. 6A</figref>, 3×3=9 images (images 1 to 9) are displayed. However, the number of display is not limited thereto.

0081It should be noted that if the subgroup contains a number of images, all images contained in the subgroup cannot be displayed on one screen of the display unit <b>30</b>. In this case, if the user inputs (for example, drags in up and down directions) to the touch panel on the detailed display area <b>320</b>, the screen may be scrolled, and other group may be displayed as shown in <figref idref="DRAWINGS">FIG. 6B</figref>. In this way, the user can easily recognize all images contained in the subgroup. It should be noted that a scroll at this time may be a so-called inertia scroll.

0082In the summary hierarchical display and the detailed hierarchical display, if the user inputs (for example, taps) to a specific image, the display control unit <b>12</b> singly display the image as shown in <figref idref="DRAWINGS">FIG. 7</figref>. The single display includes a header display area <b>410</b> and a single display area <b>420</b>.

0083By singly displaying the image, the user can browse an image requested in a large display state. If the image is singly displayed, the represented image of the group to which the image belongs may be displayed on the header display area <b>410</b> as shown in <figref idref="DRAWINGS">FIG. 7A</figref>, or only the single display area <b>420</b> may be displayed as shown in <figref idref="DRAWINGS">FIG. 7B</figref>.

0084<figref idref="DRAWINGS">FIG. 8</figref> and <figref idref="DRAWINGS">FIG. 9</figref> display the display modes of the above-described represented image display, summary hierarchical display, detailed hierarchical display, enlarged image display and single image display using specific images. <figref idref="DRAWINGS">FIG. 8</figref> and <figref idref="DRAWINGS">FIG. 9</figref> are examples if a category is an “import time”.

0085In the represented image display in <figref idref="DRAWINGS">FIG. 8A</figref>, the group is a “month”, and February, January and December are shown. For example, the represented image <b>101</b> is displayed on the represented image display area <b>100</b> at the uppermost column, and a plurality of represented images <b>102</b> are displayed on the represented image <b>101</b>. The same shall apply to other represented image display areas <b>100</b>. In the state where the represented image is displayed, once an input to select any group is made, the display is switched to the summary hierarchical display, as shown in <figref idref="DRAWINGS">FIG. 8B</figref>.

0086<figref idref="DRAWINGS">FIG. 8B</figref> shows the summary hierarchical display if the group February is selected. In the summary hierarchical display, the images contained in the subgroup contained in the group February are displayed in the subgroup display areas <b>220</b>. If the group is a “month”, the subgroup is a “day” for example. In the embodiment shown in <figref idref="DRAWINGS">FIG. 8B</figref>, three subgroups “26^th”, “25^th” and “22^th” are shown.

0087In the subgroup display area <b>220</b>, one image is displayed on the large size image display area <b>221</b>, and seven images are displayed on the small size image display area <b>222</b>. In addition, the detailed display instruction button <b>223</b> denoting “MORE” is displayed.

0088In the summary hierarchical display, if an input to the detailed display instruction button <b>223</b> is made, the display is switched to the detailed hierarchical display shown in <figref idref="DRAWINGS">FIG. 9A</figref>. <figref idref="DRAWINGS">FIG. 9A</figref> is the detailed hierarchical display if the subgroup “26^th” is selected. In the detailed hierarchical display, the represented image showing the selected group is displayed on the header display area <b>310</b>. In addition, the image contained in the group “26^th” is arranged and displayed on the detailed display area <b>320</b>.

0089In the summary hierarchical display shown in <b>8</b>B and the detailed hierarchical display shown in <figref idref="DRAWINGS">FIG. 9A</figref>, if an input to select a specific image is made, the image selected is enlarged as shown in <b>9</b>B.

0090<figref idref="DRAWINGS">FIG. 10</figref> and <figref idref="DRAWINGS">FIG. 11</figref> show display mode examples in the “main photographic subject” category. In the represented image display in the “main photographic subject” category, the images are grouped per person who is the photographic subject, and the represented image of each group is displayed together with the name of the person. The represented image of the group is displayed by scoring the images contained in the group and selecting the image having a highest score, as described above. The images may be grouped by recognizing a person in the image saved in a storage unit of a smartphone by the image display apparatus using a known photographic subject recognition technique, and by automatically setting the group per person.

0091Thus, in the first hierarchical represented image display of the “main photographic subject” category, the person group is displayed by using the represented image, thereby recognizing which group of the photographic subject at a glance.

0092In the represented image display shown in <figref idref="DRAWINGS">FIG. 10A</figref>, if an input to select a specific group is performed, the display is switched to the summary hierarchical display, as shown in <figref idref="DRAWINGS">FIG. 10B</figref>. <figref idref="DRAWINGS">FIG. 10B</figref> is a summary hierarchical display if a group Emiry shown in <figref idref="DRAWINGS">FIG. 10A</figref> is selected.

0093If the category is the “main photographic subject”, the subgroup is an age of the main photographic subject, for example. In the embodiment shown in <figref idref="DRAWINGS">FIG. 10B</figref>, the group Emiry is selected, and the images of the girl Emiry are displayed as the subgroups by age. If the category is the main photographic subject, the subgroup “New items” where new images added within a predetermined period before now may be formed. In the “main photographic subject” category, the images are classified into the subgroups by recognizing the time of capturing the images provided by referring the image import time and EXIF data.

0094In the summary hierarchical display, if an input to the detailed display instruction button <b>223</b> is made, the display is switched to the detailed hierarchical display as shown in <figref idref="DRAWINGS">FIG. 11A</figref>. <figref idref="DRAWINGS">FIG. 11A</figref> is the detailed hierarchical display if the subgroup “New items” is selected. In the detailed hierarchical display, the images contained in the subgroup “New items” are arranged and displayed on the detailed display area <b>320</b>.

0095In the summary hierarchical display shown in <figref idref="DRAWINGS">FIG. 10B</figref> and the detailed hierarchical display shown in <figref idref="DRAWINGS">FIG. 11A</figref>, if an input to select a specific image is made, the selected image is enlarged as shown in <figref idref="DRAWINGS">FIG. 11B</figref>.

0096In this manner, the three display modes, the represented image display, the summary hierarchical display, and the detailed hierarchical display are switched. If a button for instructing a switch to a high hierarchy is disposed and is an input to the button is made, the display may be switched to the high hierarchy, e.g., from the detailed hierarchical display to the summary hierarchical display, or from the summary hierarchical display to the represented image display.

0097Next, a category switching will be described. Firstly, the category switching in the represented image display as the first hierarchical display will be described. The display control unit <b>12</b> switches the first hierarchical display in the state where the represented image is displayed to other category in the state where the represented image is displayed if a user inputs (for example, flicks in a horizontal direction) to the display unit <b>30</b> as the touch panel, as shown in <figref idref="DRAWINGS">FIG. 12</figref>.

0098In the embodiment shown in <figref idref="DRAWINGS">FIG. 12</figref>, if the flick operation is performed from left to right as shown in <figref idref="DRAWINGS">FIG. 12A</figref>, the display is switched from the “import time” category to the “main photographic subject” category. On the contrary, if the flick operation is performed from right to left as shown in <figref idref="DRAWINGS">FIG. 12B</figref>, the display is switched from the “main photographic subject” category to the “import time” category. The same shall apply to a switch to other category such as the “event” category. Thus, by switching the category, an instinctive category switching is possible.

0099Next, a category switching in the summary hierarchical display as the second hierarchical display will be described. In the summary hierarchical display, a large size image display and a small size image display are provided in the subgroup display. In this state, if a user inputs as predetermined to a specific image, it switches to the category tagged to the specific image. For example, in the summary hierarchical display of the “import time” category, if an input to instruct a category switching to a girl image is performed, the display is switched to the “main photographic subject” category of the girl.

0100There are a variety of input methods to instruct the category switching. For example, as one of the input method, a finger is toughed to an image displayed to flick to right or left direction from the position. In addition, as one of the input method, a double-tap operation is performed on any image. Furthermore, as one of the input method, a button for selecting an image is disposed, a finger is contacted with the button for selecting an image to change into an image selection mode, and a tap operation is performed on any image.

0101Thus, by switching the category, if the image is seen in the “import time” category and the image to be interested is found, the image relating to the image to be interested can be easily seen. In this way, an image can be searched conveniently.

0102As described above, the display control apparatus <b>10</b> is configured. Processing functions of the display control apparatus <b>10</b> can be achieved by a variety of devices such as a computer. In this case, there is provided a program where processing contents of the functions that the display control apparatus <b>10</b> should have are described. By executing the program on the device, the above-described processing functions are achieved on the device.

0103The program where the processing contents are described can be recorded on a computer-readable recording medium such as an optical disk and a semiconductor memory. The recording medium can be sold/distributed as package software. Also, the program is stored in a server, which can be sold/distributed via a network.

0104A variety of devices for executing the program stores the program stored in the storing medium or the program transferred from the server to an own storing apparatus, for example. Then, the device reads the program from the own storing apparatus, and executes processing in accordance with the program. Also, the program may be installed to a memory of a control unit of the device, and executed.

0105Also, the device can read the program directly from the recording medium, and execute the processing in accordance with the program. Furthermore, the device can successively execute the processing in accordance with the program received every time the program is transferred from the server.

0106It should be noted that the display control apparatus <b>10</b> is not only achieved by the program, but also may be achieved by combining dedicated apparatuses having hardware having the respective functions.

0107The processing by the display control apparatus <b>10</b> may be provided to the user by a so-called cloud service. The cloud service is provided by a server present on a network, and is one of computer utilization based on the Internet. All necessary processing is done basically on the server. A user saves data not on own personal computer, smartphone or mobile phone, but on the server of the Internet. Therefore, the service can be used and the data can be browsed, edited or uploaded in a variety of environments including a house, an office, an internet cafe, a school and outside.

0108By saving images on the cloud, displaying the images by the image processing apparatus <b>10</b> on the cloud, and transmitting data showing the display mode and the image data to a user's device, it is possible to browse the images in a variety of environments. Alternatively, the images may be saved on cloud, and the display processing by the image processing apparatus <b>10</b> may be performed on the user's device.

1-2. Processing in Display Control Apparatus

0109Next, processing in the display control apparatus <b>10</b> will be described. <figref idref="DRAWINGS">FIG. 13</figref> is a flowchart showing overall flows of processing in the display control apparatus <b>10</b>. This processing is performed by the display control unit <b>12</b> of the display control apparatus <b>10</b>. Note that images are already classified by the image classification unit <b>11</b>.

0110Firstly, in step S<b>1</b>, an initial screen is displayed on the display unit <b>30</b>. As the initial screen, a predetermined screen (for example, the represented image display of the “import time” category) is displayed if the display is done by the display control apparatus <b>10</b> for the first time. If there is a history that the display was done by the display control apparatus <b>10</b> in the past, a last memory function may be used to display the screen previously displayed as the initial screen.

0111Next, in step S<b>2</b>, it is determined whether or not the input to instruct a hierarchy switching by a user is done. The input to instruct the hierarchy switching is an input (for example, a tap operation) to select any group in the state where the represented image is displayed, as described above. In the case of the summary hierarchical display, an input (for example, a tap operation) to the detailed display instruction button <b>223</b> or an input (for example, a tap operation) to select a specific image.

0112If the user inputs to instruct the hierarchy switching, the processing proceed to step S<b>3</b> (Yes in step S<b>2</b>). In step S<b>3</b>, the hierarchy switching processing is done. A flow of the hierarchy switching processing will be described below referring to <figref idref="DRAWINGS">FIG. 14</figref>.

0113Meanwhile, if it is determined that no input to instruct the hierarchy switching is done in step S<b>2</b>, the processing proceeds to step S<b>4</b> (No in step S<b>3</b>). Next, in step S<b>4</b>, it is determined whether or not the input to instruct the category switching is done. If the category switching is done, processing proceeds to step S<b>5</b> (Yes in step S<b>4</b>). Then, in step S<b>5</b>, the category switching processing is done. A flow of the category switching processing will be described below referring to <figref idref="DRAWINGS">FIG. 15</figref>.

0114If no input to instruct the category switching is done, the processing proceeds to step S<b>2</b> to determine again whether or not the user inputs. Note that the order of the determination whether or not the input to instruct the category switching is done and the determination whether or not the input to instruct the category switching is done is not limited to that shown in the flowchart in <figref idref="DRAWINGS">FIG. 13</figref>, and may be reversed.

0115Next, the flow of the hierarchy switching processing will be described below referring to <figref idref="DRAWINGS">FIG. 14</figref>. <figref idref="DRAWINGS">FIG. 14</figref> is a flowchart showing a flow of the hierarchy switching processing. Firstly, in step S<b>31</b>, it is determined whether or not the input to instruct the hierarchy switching by the user is to instruct a switching to a lower hierarchy. If the represented image display is currently displayed, the lower hierarchy is the summary hierarchical display. If the summary hierarchical display is currently displayed, the lower hierarchy is the detailed hierarchical display.

0116If the input to instruct the switching to the lower hierarchy is done by the user, the processing proceeds to step S<b>32</b> (Yes in step S<b>31</b>). Next, in step S<b>32</b>, it is determined whether or not the lower hierarchy is present. If the represented image display is currently displayed, the lower hierarchy is the summary hierarchical display. Therefore, it is determined that the lower hierarchy is present. If the summary hierarchical display is currently displayed, the lower hierarchy is the detailed hierarchical display. Therefore, it is determined that the lower hierarchy is present. On the other hand, if the detailed hierarchical display is currently displayed, it is determined that no lower hierarchy is present.

0117If the lower hierarchy is present, the processing proceeds to step S<b>33</b> (Yes in step S<b>32</b>). Then, in step S<b>33</b>, the switching processing to the lower hierarchy is done. If the represented image display is currently displayed, it switches to the summary hierarchical display. If the summary hierarchical display is currently displayed, it switches to the detailed hierarchical display.

0118On the other hand, if no lower hierarchy is present in step S<b>32</b>, the processing proceeds to step S<b>34</b> (No in step S<b>32</b>). In this case, although the input to instruct the switching to the lower hierarchy is done, no lower hierarchy is present. Therefore, the switching processing is not done.

0119The description returns to step S<b>31</b>. If the user input is not to instruct the switching to the lower hierarchy, the processing proceeds to step S<b>35</b> (No in step S<b>31</b>). The user input is not to instruct the switching to the lower hierarchy, which means to instruct the switching to an upper hierarchy. Next, in step S<b>35</b>, it is determined whether or not the upper hierarchy is present. If the detailed hierarchical display is currently displayed, the upper hierarchy is the summary hierarchical display. Therefore, it is determined that the upper hierarchy is present. If the summary hierarchical display is currently displayed, the upper hierarchy is the represented image display. Therefore, it is determined that the upper hierarchy is present. On the other hand, if the represented image display is currently displayed, it is determined that no upper hierarchy is present.

0120If the upper hierarchy is present, the processing proceeds to step S<b>36</b> (Yes in step S<b>35</b>). Then, in step S<b>35</b>, the switching processing to the upper hierarchy is done. If the detailed hierarchical display is currently displayed, it switches to the summary hierarchical display. If the summary hierarchical display is currently displayed, it switches to the represented image display.

0121On the other hand, if no upper hierarchy is present in step S<b>35</b>, the processing proceeds to step S<b>34</b> (No in step S<b>35</b>). In this case, although the input to instruct the switching to the upper hierarchy is done, no upper hierarchy is present. Therefore, the switching processing is not done.

0122As described above, the hierarchy switching processing is done by the display control unit <b>12</b>.

0123Next, referring to a flowchart of <figref idref="DRAWINGS">FIG. 15A</figref>, a flow of the category switching processing by the display control unit <b>12</b> will be described. <figref idref="DRAWINGS">FIG. 15A</figref> is a flowchart showing a flow of a category switching processing.

0124As described referring to <figref idref="DRAWINGS">FIG. 2</figref>, the hierarchical display has a relationship in a vertical direction, and the category has a relationship in a horizontal direction. The input to instruct the category switching by the user is done by the flick operation in the horizontal direction, for example. Then, the relationship of the category is taken in the horizontal direction, and the input to instruct the category switching by the user is taken as the switching to a left category or the switching to a right category.

0125Hereinafter, the description is based on an example that there are three categories of the “import time”, the “main photographic subject” and the “event” from left in the order. Note that this is only example for description, and the types of the category and the arrangement of the category are not limited thereto.

0126Firstly, in step S<b>51</b>, it is determined whether or not the input to instruct the category switching by the user is to instruct the switching to the right category. If the “import time” category is currently displayed, the right category is the “main photographic subject” category. If the “main photographic subject” category is currently displayed, the right category is the “event” category.

0127If the user inputs to instruct the switching to the right category, the processing proceeds to step S<b>52</b> (Yes in step S<b>51</b>).

0128Next, in step S<b>52</b>, it is determined whether or not the right category is present. If the “import time” category is currently displayed, the right category is the “main photographic subject” category. Therefore, it is determined that the right category is present. If the “main photographic subject” category is currently displayed, the right category is the “event” category. Therefore, it is determined that the right category is present. On the other hand, if the “event” category is currently displayed, it is determined that no right category is present.

0129If the right category is present, the processing proceeds to step S<b>53</b> (Yes in step S<b>52</b>). Then, in step S<b>53</b>, the switching processing to the right category is done. If the “import time” category is currently displayed, it switches to the “main photographic subject” category. If the “main photographic subject” category is currently displayed, it switches to the “event” category.

0130On the other hand, if no right category is present in step S<b>52</b>, the processing proceeds to step S<b>54</b> (No in step S<b>52</b>). In this case, although the input to instruct the switching to the right category is done, no right category is present. Therefore, the switching processing is not done.

0131The description returns to step S<b>51</b>. If the user input is not to instruct the switching to the right category, the processing proceeds to step S<b>55</b> (No in step S<b>51</b>). The user input is not to instruct the switching to the right category, which means to instruct the switching to a left category.

0132Next, in step S<b>55</b>, it is determined whether or not there is a left category is present. If the “event” category is currently displayed, the left category is the “main photographic subject” category. Therefore, it is determined that the left category is present. If the “main photographic subject” category is currently displayed, the left category is the “import time” category. Therefore, it is determined that the left category is present. On the other hand, if the “import time” category is currently displayed, it is determined that no left category is present.

0133If the left category is present, the processing proceeds to step S<b>56</b> (Yes in step S<b>55</b>). Then, in step S<b>55</b>, the switching processing to the left category is done. If the “event” category is currently displayed, it switches to the “main photographic subject” category. If the “main photographic subject” category is currently displayed, it switches to the “import time” category.

0134On the other hand, if no left category is present in step S<b>55</b>, the processing proceeds to step S<b>54</b> (No in step S<b>55</b>). In this case, although the input to instruct the switching processing to the left category is done, no left category is present. Therefore, the switching is not done. Note that the categories may be arranged to be looped in the horizontal direction. In this case, if the categories are arranged as the “import time”, the “main photographic subject” and the “event” from left, for example, a right side of the “event” is the “main photographic subject”. A left side of the “import time” is the “event”. In this case, the categories are always present at both of right and left sides. Therefore, if the input to instruct the switching to the right category, as shown in the flowchart in <figref idref="DRAWINGS">FIG. 15B</figref>, the switching to the right category is done. If the input to instruct the switching to the left category, the switching to the right category is done. Note that, in step S<b>51</b> in <figref idref="DRAWINGS">FIG. 15B</figref>, it is not determined whether or not the input to instruct the switching to the right category is done, but it is determined whether or not the input to instruct the switching to the left category is done. In this case, step S<b>53</b> will be replaced with step S<b>56</b>.

0135As described above, the category switching processing is done by the display control unit <b>12</b>. According to the present technology, the images are classified into the categories based on the related information, and further classified into groups and subgroups. The groups and subgroups are displayed in three hierarchies of the summary hierarchical display, the summary hierarchical display, and the detailed hierarchical display. In this way, a searching ability and visibility of the images are improved, and the user can easily search the images and recognize the relationship between the images. In the hierarchical display, as the headers that function as indices are displayed in the respective hierarchies, the user can easily recognize that which group or which subgroup is currently displayed. Furthermore, in the hierarchical display, the image is divided and displayed so as to decrease a dot size of the image, whereby the user can easily find the image to be searched.

0136As the user can switch the categories in parallel by the flick operation, the categories can be easily switched without through a menu display operation.

2. Alternative Embodiment

0137While the embodiments according to the present technology is specifically described, the present technology is not limited to the above-described embodiments, and a variety of modifications may be made based on the technical spirit of the present technology.

0138<figref idref="DRAWINGS">FIG. 16</figref> shows a first alternative embodiment of an image display mode according to the present technology. <figref idref="DRAWINGS">FIG. 16A</figref> is a represented image display in the “main photographic subject” category. In <figref idref="DRAWINGS">FIG. 16A</figref>, four groups of Mike, Johan, Rika, and Tom are shown. If a user selects Johan form the group, the display is switched to the state shown in <figref idref="DRAWINGS">FIG. 16B</figref>.

0139In the display state shown in <figref idref="DRAWINGS">FIG. 16B</figref>, dates <b>2013</b>, <b>2012</b>, and <b>2011</b> are displayed as the subgroups in the group “Johan”. The display mode is similar to the represented image display. If a user selects <b>2013</b> from the groups, the display is switched to the state shown in <figref idref="DRAWINGS">FIG. 16C</figref>.

0140In the display state shown in <figref idref="DRAWINGS">FIG. 16C</figref>, the images included in the group “<b>2013</b>” selected are shown in the mode of the summary hierarchical display. All images displayed here are based on the photographic subject John and were captured in <b>2013</b>. In this manner, the image may be displayed in the display mode different from the hierarchical displays such as the represented image display, the summary hierarchical display, and the detailed hierarchical display in the embodiment.

0141<figref idref="DRAWINGS">FIG. 17</figref> shows a second alternative embodiment of an image display mode according to the present technology. <figref idref="DRAWINGS">FIG. 17A</figref> is a represented image display of the “film location” category. <figref idref="DRAWINGS">FIG. 17A</figref> shows four groups of country names Sverige, United States, Japan, and Australia. If a user selects Sverige from the groups, for example, the display is switched to the state shown in <figref idref="DRAWINGS">FIG. 17B</figref>.

0142In the display state shown in <figref idref="DRAWINGS">FIG. 17B</figref>, areas of Malmo, Lund, and Stockholm are shown as the subgroups of the group “Sverige”. The display mode is similar to the represented image display. If a user selects Malmo from the groups, the display is switched to the state shown in <figref idref="DRAWINGS">FIG. 17C</figref>.

0143In the display state shown in <figref idref="DRAWINGS">FIG. 17C</figref>, the images included in the group “Malmo” selected are shown in the mode of the summary hierarchical display. All images displayed here are based on the images captured at the location included in the area Malmo. In this manner, the image may be displayed in the display mode different from the hierarchical displays such as the represented image display, the summary hierarchical display, and the detailed hierarchical display in the embodiment.

0144<figref idref="DRAWINGS">FIG. 18</figref> shows a third alternative embodiment of an image display mode according to the present technology. <figref idref="DRAWINGS">FIG. 18A</figref> is a represented image display and shows groups of People, Object, and Scenery. The People is a group that collects the photographic subject as a person. The Object is a group that collects the photographic subject as an object. The Scenery is a group that collects the photographic subject as a scene.

0145If a user selects the group “Object” from the groups, the display is switched to the state shown in <figref idref="DRAWINGS">FIG. 18B</figref>. In the display state shown in <figref idref="DRAWINGS">FIG. 18B</figref>, Foods, Building, and Figure are displayed as the subgroups in the group “Object”. The display mode is similar to the represented image display. If a user selects Foods from the groups, the display is switched to the state shown in <figref idref="DRAWINGS">FIG. 18C</figref>.

0146In the display state shown in <figref idref="DRAWINGS">FIG. 18C</figref>, the images included in the subgroup “Object” selected are shown in the mode of the summary hierarchical display. All images displayed here are based on the images included in Object. In this manner, the image may be displayed in the display mode different from the hierarchical displays such as the represented image display, the summary hierarchical display, and the detailed hierarchical display in the embodiment.

0147<figref idref="DRAWINGS">FIG. 19</figref> shows a fourth alternative embodiment of an image display mode according to the present technology. <figref idref="DRAWINGS">FIG. 19A</figref> is a represented image display of the “event” category. If the category is the “event”, a map showing the position where the image is captured may be displayed together with the image.

0148If a user selects the group, the display is switched to the state shown in <figref idref="DRAWINGS">FIG. 19B</figref>. Note that the fourth alternative embodiment is applicable to the “film location” category. The images included in the groups “event” or “film location” may be horizontally long or vertically long due to a panoramic photograph. If there is a panoramic photograph, the image may be displayed by changing its size per image, as shown in <figref idref="DRAWINGS">FIG. 19B</figref>.

0149<figref idref="DRAWINGS">FIG. 20</figref> shows a fifth alternative embodiment of an image display mode according to the present technology. <figref idref="DRAWINGS">FIG. 20A</figref> is a represented image display form of the “event” category. In the fifth alternative embodiment, information about persons as the photographic subjects in the image included in the group is displayed on the represented image as icons.

0150If a user selects the group, it switches to the state shown in <figref idref="DRAWINGS">FIG. 20B</figref>. Also in this display mode, the persons as the photographic subjects in the image included in the group are displayed as the icons. In this way, it can be easily recognized which person is captured on a plurality of the images included in the group. Note that the display is done by a photographic subject recognition technique to recognize the person captured on the image based on the recognition result.

0151It should be noted that group names, place names, person names are only illustrative.

0152In the embodiments, the description is based on that the display control apparatus <b>10</b> operates in a smartphone. However, the device on which the display control apparatus <b>10</b> operates is not limited to the smartphone. Other examples of the devices on which the display control apparatus <b>10</b> operates include a tablet terminal, a personal computer, and a television receiver.

0153<figref idref="DRAWINGS">FIG. 21</figref> shows example modes of represented image displays in the case of applying the display control apparatus <b>10</b> to a smartphone <b>1001</b>, a tablet terminal <b>1002</b>, a personal computer <b>1003</b>, and a television receiver <b>1004</b>. The smartphone <b>1001</b> shown in <figref idref="DRAWINGS">FIG. 21A</figref> is similar to the display mode in the embodiment.

0154The tablet terminal <b>1002</b> in <figref idref="DRAWINGS">FIG. 21B</figref>, the personal computer <b>1003</b> in <figref idref="DRAWINGS">FIG. 21C</figref>, and the television receiver <b>1004</b> in <figref idref="DRAWINGS">FIG. 21D</figref> each has a display unit larger than that of the smartphone <b>1001</b>. Accordingly, the image selected by the user can be enlarged to be displayed in addition to the represented image display of each group. In this way, as the image selected is always displayed in a large scale while the category is switched. Therefore, the user can search the image while enjoying the images.

0155In addition, as the personal computer <b>1003</b> in <figref idref="DRAWINGS">FIG. 21C</figref> and the television receiver <b>1004</b> in <figref idref="DRAWINGS">FIG. 21D</figref> each has the display unit larger than that of the smartphone <b>1001</b>, the number of displays of the group in the represented image display can be increased as compared with the number of displays of the smartphone <b>1001</b>. In this way, an image can be searched conveniently.

0156<figref idref="DRAWINGS">FIG. 22A</figref> shows example modes of a summary hierarchical display in the case of applying the display control apparatus <b>10</b> to a smartphone <b>2001</b>, a tablet terminal <b>2002</b>, a personal computer <b>2003</b>, and a television receiver <b>2004</b>. The smartphone <b>2001</b> shown in <figref idref="DRAWINGS">FIG. 22A</figref> is similar to the display mode in the embodiment.

0157As the tablet terminal <b>2002</b> in <figref idref="DRAWINGS">FIG. 22B</figref>, the personal computer <b>2003</b> in <figref idref="DRAWINGS">FIG. 22C</figref> and the television receiver <b>2004</b> in <figref idref="DRAWINGS">FIG. 22D</figref> each has the display unit larger than that of the smartphone <b>2001</b>, the number of displays of the subgroup in the summary hierarchical display can be increased as compared with the number of displays of the smartphone <b>2001</b>. In this way, an image can be searched conveniently.

0158In the television receiver <b>2004</b> having the display unit with the largest size in <figref idref="DRAWINGS">FIG. 22</figref>, the image selected by the user is displayed in a full screen as shown in <figref idref="DRAWINGS">FIG. 22D</figref>, thereby providing the user with a powerful image.

0159<figref idref="DRAWINGS">FIG. 23</figref> shows examples of a combination of the image display and anything other than the image display, if the display control apparatus <b>10</b> is applied to the device having a large-sized display unit. In a tablet terminal <b>3002</b> in <figref idref="DRAWINGS">FIG. 23B</figref>, the images are displayed in the summary hierarchical display at one part of the display, and a group of icons showing applications installed in a tablet terminal <b>3003</b> is displayed at the other part of the display. By the display mode, other applications can be activated without switching the screen, while displaying by the display control apparatus <b>10</b>.

0160In a personal computer <b>3003</b> in <figref idref="DRAWINGS">FIG. 23C</figref>, the images are displayed in the summary hierarchical display at one part of the display, and screens of image edit applications are displayed at the other part of the display. By the display mode, operations on the image edit applications can be performed, while the images are checked with the display by the display control apparatus <b>10</b>.

0161It should be noted that the applications are not limited to the image edit applications, and may be applications not relating to the image such as a moving image creation application and a music application.

0162Furthermore, in a television receiver <b>3004</b> in <figref idref="DRAWINGS">FIG. 23D</figref>, a map is displayed in addition to the display by the display control apparatus <b>10</b>. In this way, it is possible to display the position where the image is captured as a map by referring to GPS data corresponded to the image displayed.

0163It should be noted that the combination of the above-described devices and the display is only example. For example, in the tablet terminal, the display by the display control apparatus <b>10</b> and the image edit applications may be displayed. In the personal computer, the display by the display control apparatus <b>10</b> and the map may be displayed.

0164In the embodiments, the image data is used for description. The present technology is also applicable to moving image data and music content data. In the case of the moving image data, a capture image of the moving image is displayed as an image as described in the embodiment, thereby improving a searching ability of the moving image.

0165In the case of the music content data, icons showing art works are displayed as images as described in the embodiment, thereby improving a searching ability of the music. As a category, a group, and a subgroup of the music, an import time, a genre, a musician, an album, a favorite, and a play list are conceivable.

0166The present technology may have the following configurations.

0167(1) A display control apparatus, including:

0168a display control unit for controlling a display unit for displaying an image,

0169the display control unit being configured to <ul id="ul0002" list-style="none"><li id="ul0002-0001" num="0000"><ul id="ul0003" list-style="none"><li id="ul0003-0001" num="0170">display a plurality of represented images that represent a plurality of image groups classified depending on related information of the images on the display unit in a first display mode, and</li><li id="ul0003-0002" num="0171">display related images relating to the represented images between a plurality of the represented images displayed in the first display mode depending on a user input on the display unit in a second display mode.</li></ul></li></ul>

0172(2) The display control apparatus according to (1), in which

0173the first display mode is to arrange and display a plurality of the represented images representing each of a plurality of the image groups.

0174(3) The display control apparatus according to (1) or (2), in which

0175the user input is to select any of a plurality of the represented images, and

0176the second display mode is to dispose a related image display area between the represented image selected by the user and other represented image, and to display the related image relating to the represented image selected on the represented image display area.

0177(4) The display control apparatus according to (3), in which

0178in the state where the related image is displayed in the second display mode, the related image is displayed in a third display mode depending on the user input.

0179(5) The display control apparatus according to (4), in which

0180the third display mode is to display all the related images relating to the represented image selected.

0181(6) The display control apparatus according to any one of (1) to (5), in which

0182the first display mode is to superimpose and display the related image relating to the represented image on the display of the represented image.

0183(7) The display control apparatus according to any one of (1) to (6), in which

0184the related image selected is singly displayed if any of the related images displayed in the second display mode is selected by the user.

0185(8) The display control apparatus according to (4) or (5), in which

0186the related image selected is singly displayed if any of the related images displayed in the third display mode is selected by the user.

0187(9) The display control apparatus according to any one of (1) to (8), further including:

0188an image classification unit for classifying the images depending on the related information.

0189(10) The display control apparatus according to (3) or (4), in which,

0190in the second display mode, there are a predetermined number of the images displayed on the represented image display area.

0191(11) The display control apparatus according to any one of (1) to (10), in which

0192the related images are determined based on a predetermined evaluation value.

0193(12) The display control apparatus according to any one of (1) to (11), in which

0194the display control unit collectively displays the images, and switches the display of the images from one category to the other category depending on the user input.

0195(13) The display control apparatus according to any one of (1) to (12), in which

0196the display control unit collectively displays the images, and

0197in the state where a plurality of the represented image are displayed in the second display mode, the image related to the related image selected is displayed in the second display mode depending on an input to instruct a category switching under the state that any of a plurality of the related images is selected.

0198(14) The display control apparatus according to any one of (1) to (13), in which

0199the user input is to be done to a touch panel.

0200(15) The display control apparatus according to (14), in which

0201an input to instruct a switch of the image display from one category to the other category is made by a flick operation to the tough panel.

0202(16) The display control apparatus according to (14), in which

0203the input to select any of a plurality of the represented images is performed by a tap operation to the touch panel.

0204(17) The display control apparatus according to any one of (1) to (16), in which

0205the images are already uploaded in the Internet service, and

0206the display control unit collectively displays the images already uploaded in the Internet service.

0207(18) The display control apparatus according to any one of (1) to (17), in which

0208the images are already imported to an application, and

0209the display control unit collectively displays the images already imported to the application.

0210(19) A method of controlling a display, including:

0211displaying a plurality of represented images that represent a plurality of image groups classified depending on related information of the images on the display unit for displaying the images in a first display mode, and

0212displaying related images relating to the represented images in a second display mode between a plurality of the represented images displayed in the first display mode depending on a user input.

0213(20) A display control program for executing a method of controlling a display by a computer, the method including:

0214displaying a plurality of represented images that represent a plurality of image groups classified depending on related information of the images on the display unit for displaying the images in a first display mode, and

0215displaying related images relating to the represented images between a plurality of the represented images displayed in the first display mode depending on a user input.

DESCRIPTION OF SYMBOLS

0000<ul id="ul0004" list-style="none"><li id="ul0004-0001" num="0216"><b>10</b> display control apparatus</li><li id="ul0004-0002" num="0217"><b>11</b> display control unit</li><li id="ul0004-0003" num="0218"><b>20</b> display unit</li><li id="ul0004-0004" num="0219"><b>12</b>,<b>40</b> image classification unit</li></ul>