Image identifier, order processor and image identifying method
Abstract
[Task] It is possible to easily identify a person as a subject in an image or an image in which a specific person is the subject.
Solution.In tourist spots, theme parks, etc., the photographer 12 shoots an arbitrary customer 16 as a subject. The captured image data is stored in the HDD 30 of the order processing device 24 together with the shooting date and time and the shooting location. The location information service center 50 periodically notifies the order processing device 24 of the position of the mobile phone 18 owned by each customer 16, and the notification information is stored in the HDD 30 as a movement history of each customer together with the date and time. When an image order is requested by the customer 16 via the order receiving terminal 42 or the like, the order processing device 24 collates the movement history of the corresponding customer with the shooting date and time and shooting location of the individual shot image data, and sets the customer as the subject. Only the images to be used are extracted and displayed in a list on the display 44.

Term
Term ended
Projected expiry passed 27 September 2022, 4 years ago.
- Priority
- Filed
- Published
- Projected expiry
- Today
12 claims: 2 independent, 10 dependent
- 1[Claims] 1. An acquisition means for acquiring a shooting date and time and a shooting location in shooting with an unspecified person as a subject. An image data storage means for storing the image data obtained by the photographing, and an image data storage means. By collating the shooting date and time and shooting location corresponding to the image data stored in the image data storage means with the movement history of the person shot as the subject, the person or the person as the subject in the image represented by the image data can be specified. Identification means for identifying image data of an image of a person as a subject, Image identification device including. 【特許請求の範囲】 【請求項1】 不特定の人物を被写体とする撮影における撮影日時及び撮影場所を取得する取得手段と、 前記撮影によって得られた画像データを記憶する画像データ記憶手段と、 前記画像データ記憶手段に記憶された画像データに対応する撮影日時及び撮影場所と、被写体として撮影された人物の移動履歴を照合することで、前記画像データが表す画像における被写体としての人物、又は特定の人物を被写体とする画像の画像データを識別する識別手段と、 を含む画像識別装置。
- 12Acquire the shooting date and time and the shooting location when shooting is performed with an unspecified person as a subject. The image data obtained by the shooting is stored in the image data storage means, and the image data is stored in the image data storage means. By collating the shooting date and time and shooting location corresponding to the image data with the movement history of the person shot as the subject, the person as the subject in the image represented by the image data or the image in which the specific person is the subject. An image identification method for identifying image data. 【請求項12】 不特定の人物を被写体として撮影が行われた際の撮影日時及び撮影場所を取得し、 前記撮影によって得られた画像データを画像データ記憶手段に記憶し、 前記画像データに対応する撮影日時及び撮影場所と、被写体として撮影された人物の移動履歴を照合することで、前記画像データが表す画像における被写体としての人物、又は特定の人物を被写体とする画像の画像データを識別する画像識別方法。
Independent claims2
253 paragraphs in 1 section, as filed
Description: TECHNICAL FIELD [Detailed description of the invention]
【0001】
[Technical field to which the invention belongs]
The present invention relates to an image identification device, an order processing device, and an image identification method, and is particularly identified by an image identification device, an image identification device that identifies a person as a subject in an image, or an image having a specific person as a subject. The present invention relates to an order processing device for processing a customer's order for an image, and an image identification method applicable to the image identification device.
【0002】
[Conventional technology]
If you bring a camera or other means of photography to a sightseeing spot or theme park and take a commemorative photo at a major location, even if you bring a tripod with the camera, the photographer may have trouble setting up. Images taken with oneself as the subject tend to be few. Also, for example, when trying to shoot a scene that is being enjoyed at a specific attraction in a theme park, only the companion as the subject participates in the attraction, and the photographer himself does not participate in the attraction and concentrates on shooting. As such, shooting often involves a great deal of difficulty.
【0003】
As a method for solving the above-mentioned inconvenience, for example, a participant of a specific attraction in a theme park is automatically photographed, and the photographed image is presented to the participant as a subject at the exit of the specific attraction. It has been conventionally practiced to create a photographic print and hand it over to a participant (customer) if there is an order from (see, for example, Non-Patent Document 1). In addition, at tourist spots, photographers take pictures of unspecified tourists, and photographic prints of the images taken can be presented near the exit of tourist spots so that tourists (customers) as subjects can purchase them. It has been.
【0004】
[Non-Patent Document 1]
FUJIFILM Corporation, "Jurassic Park The Ride (R) Photo (R)", [online], [Searched on September 20, 2002], Internet <URL: http: //www.fujifilm .co.jp/usj/check/phtride.html> [0005]
[Problems to be Solved by the Invention]
However, in the above method, it is necessary for the customer himself / herself to search for an image in which the customer appears as a subject from a plurality of presented images. Therefore, as the number of presented images increases, there is a drawback that the burden on the customer for finding a desired image becomes remarkable, which may lead to a decrease in the customer's purchasing motivation.
【0006】
In relation to the above, when the photographer photographed the customer, the applicant of the present application transmitted the customer information from the PDA (Personal Digital Assistants) possessed by the customer to the camera side by wireless communication, and received the customer information on the camera side. We are proposing a technique for associating customer information with a photographed image as ancillary information of a photographed image and identifying a customer as a subject of the photographed image based on the ancillary information (Japanese Patent Application No. 2000-320382: unknown). However, with the above technology, when the distance between the customer and the camera becomes large, it becomes difficult to transmit the customer information from the PDA to the camera, and the customer needs to have a special PDA having a function of transmitting the customer information. There was a need for further improvement.
【0007】
The present invention has been made in consideration of the above facts, and obtains an image identification device and an image identification method capable of easily identifying a person as a subject in an image or an image having a specific person as a subject. That is the first purpose.
【0008】
A second object of the present invention is to obtain an order processing device that allows a customer to easily place an order for an image of a specific person as a subject.
【0009】
[Means for solving problems]
In order to achieve the first object, the image identification device according to the invention according to claim 1 is obtained by the acquisition means for acquiring the shooting date and time and the shooting location in shooting with an unspecified person as a subject, and the shooting. The image data is obtained by collating the image data storage means for storing the image data, the shooting date and time and the shooting location corresponding to the image data stored in the image data storage means, and the movement history of the person shot as the subject. It is configured to include a person as a subject in the image represented by the above, or an identification means for identifying image data of an image in which a specific person is the subject.
【0010】
In the invention according to claim 1, the shooting date and time and the shooting location in shooting with an unspecified person as a subject are acquired by the acquisition means, and the image data obtained by the shooting is stored in the image data storage means. Specifically, as for the shooting date and time and the shooting location, specifically, as described in claim 2, the current date and time is detected by the shooting means (for example, a camera, a digital still camera, a digital video camera, etc.) used for shooting. It can be detected by providing a date and time detecting means for detecting the current position and a position detecting means for detecting the current position (for example, a means for detecting the current position using a GPS system). Further, the shooting date and time and the shooting location may be acquired online from the shooting means by wireless communication, or may be acquired offline (for example, the shooting date and time and the shooting location once recorded on the recording medium may be read out. You can also get it at).
【0011】
By the way, in an image in which a person is a subject, identifying the person as the subject of the image can be performed by determining the person who was present at the shooting location at the time of shooting the image. Further, the identification of an image with a specific person as a subject can also be performed by determining whether or not the specific person was present at the shooting location at the time of shooting the image to be determined. Then, the above judgment (identification) is performed without acquiring the information for identifying the person as the subject at the time of shooting as in Japanese Patent Application No. 2000-320382, and the shooting date and time and the shooting location of the image and the person as the subject. It can be realized by collating the movement history of.
【0012】
Based on the above, the identification means according to the invention according to claim 1 collates the shooting date and time and shooting location corresponding to the image data stored in the image data storage means with the movement history of the person shot as the subject. , The image data of a person as a subject in an image represented by the image data stored in the image data storage means, or an image of a specific person as a subject is identified. The movement history of the person may be, for example, information that represents the position (place) where the person existed in the past and the date and time in a time series at a substantially fixed time cycle, or may be the information that represents the person in the past at one time. It may be information indicating the position (place) where the person existed and the date and time (for example, information such as "I was at the place y around x o'clock on the XX day").
【0013】
As described above, in the invention according to claim 1, by collating the shooting date and time and the shooting location with the movement history of the person, the person as the subject in the image or the image data of the image with the specific person as the subject can be identified. Therefore, it is not necessary for the person as the subject to possess a special device having a function of transmitting information for identifying the person, and the person as the subject in the image or the image in which the specific person is the subject. Can be easily identified.
【0014】
In the invention according to claim 1, the movement history of a person can be held, for example, on the side of the person as a subject. Specifically, for example, the movement history of a person is automatically set on a recording medium possessed by the person. The movement history may be simply stored by the person himself / herself. As described above, when the movement history of a person is retained on the person side, for example, as described in claim 3, a plurality of image data are stored in the image data storage means, and the identification means is a method of identifying. By collating the movement history of a specific person input via the input means with a plurality of shooting dates and times and a plurality of shooting locations corresponding to any of the plurality of image data stored in the image data storage means. It can be configured to identify image data of an image in which a specific person is the subject.
【0015】
In a mode in which the movement history of a person is automatically recorded on a recording medium, the input means can be configured by a reading device or the like that reads information from the recording medium. Further, in the mode in which the person himself / herself stores the movement history, the input means can be configured by a keyboard or the like for the person himself / herself to input the movement history. In the invention according to claim 3, since it is not necessary to provide the image identification device according to the present invention with a function of collecting the movement history of each person, the configuration of the image identification device according to the present invention can be simplified. ..
【0016】
Further, in the invention according to claim 1, the movement history of a person can be collected and retained, for example, on the image identification device side according to the present invention. For example, as described in claim 4, a plurality of persons A collection means for collecting each movement history and a movement history storage means for storing the movement history of a plurality of persons collected by the collection means are provided, and the identification means determines the shooting date and time and the shooting location corresponding to the image data. By collating with the movement history of a plurality of persons stored in the movement history storage means, it is possible to identify the person as the subject in the image represented by the image data.
【0017】
In this case, since the information related to the captured image (image data, shooting date and time, shooting location, etc.) and the movement history of a plurality of persons are centrally managed by the image identification device according to the present invention, a predetermined identification result using the identification means is used. In an embodiment in which instructions (for example, instructions for extracting all image data of an image of a specific person as a subject) are given from the outside, the shooting date and time and the shooting date and time and It is also possible to collate the shooting location with the movement history of a plurality of persons and perform identification by identification means such as identifying each person as a subject in each image before the instruction is given. Even when a predetermined instruction using the identification result by the identification means is given from the outside, it is possible to respond to the instruction from the outside in a short time.
【0018】
Further, in the invention according to claim 4, collecting the movement history of each of a plurality of persons means that the current position of each person is periodically notified to the collecting means and collected, for example, as described in claim 5. The means can be performed by storing the current position of each person who is periodically notified in the movement history storage means in association with the information for identifying the individual person and the current date and time.
【0019】
Further, in the invention according to claim 5, the current position of each person is, for example, as described in claim 6, the portable communication device (for example, PDA, mobile phone, etc.) possessed by each person. , It can be detected by communication with base stations provided at substantially regular intervals. If the portable communication device is a mobile phone, the current location of each person can be obtained by using the location information service (service that notifies the current location of the owner of the mobile phone) provided by the mobile phone telephone company. It is also possible to have the location notified on a regular basis.
【0020】
Further, as for the current position of each person, for example, as described in claim 7, the current position is detected by using a position detecting means (for example, a GPS system) provided in the portable device possessed by each person. It is also possible to detect by means). As described above, even in a mode in which the movement history of a person is automatically recorded on a recording medium possessed by the person, the invention is periodically detected by applying the invention according to claim 6 or 7. By sequentially recording the current position of the person on the recording medium, the movement history of the person can be recorded.
【0021】
Further, in the invention according to claim 1, for example, as described in claim 8, the acquisition means acquires at least one of the shooting direction and the shooting magnification when shooting is performed with an unspecified person as a subject. The identification means uses at least one of the shooting orientation and the shooting magnification acquired by the acquisition means, and is a person as a subject in the image represented by the image data stored in the image data storage means, or an image in which a specific person is the subject. It is preferable to identify the image data of.
【0022】
Especially when shooting at a high shooting magnification, the shooting range becomes narrow, so as a result of collating the shooting date and time and shooting location of a specific image with the movement history of a specific person, a specific person is assigned to the shooting location when shooting a specific image. Even if it turns out to be present, it may happen that a particular person is not actually the subject in a particular image. On the other hand, in the invention according to claim 8, since a person as a subject or an image having a specific person as the subject is identified by using at least one of the shooting direction and the shooting magnification, the identification accuracy of the person or the image is improved. Can be made to.
【0023】
Further, in order to achieve the second object, the order processing device according to the invention according to claim 9 is based on the image identification device according to any one of claims 1 to 8 and the identification result by the identification means. Based on this, a display control means for displaying an image of a designated person as a subject on a display means, and a processing means for performing a predetermined process according to an order from a customer for the image displayed on the display means. , Is included.
【0024】
Since the order processing device according to the invention according to claim 9 includes the image identification device according to any one of claims 1 to 8, the subject in the image is similar to the invention according to claim 1. It is possible to easily identify an image of a person or a specific person as a subject. Then, in the invention according to claim 9, based on the identification result by the identification means, the display control means causes the display means to display an image of the designated person as the subject, and the processing means displays the image displayed on the display means. Since the predetermined processing is performed according to the order from the target customer, it is possible to respond to the customer's order for the image displayed on the display means.
【0025】
As described above, according to the invention of claim 9, if the customer specifies a person to be ordered, an image of the specified person as a subject is displayed on the display means, and an order targeting the displayed image is placed. Since this can be done, it is possible to easily place an order for an image in which a specific person is the subject.
【0026】
Further, in order to achieve the second object, the order processing device according to the invention according to claim 10 is based on the image identification device according to any one of claims 1 to 8 and the identification result by the identification means. Based on this, a delivery means for delivering an image of a certain person as a subject to a customer, and a processing means for performing a predetermined process according to an order from the customer for the image delivered by the delivery means are included. It is composed of.
【0027】
Since the order processing device according to the invention according to claim 10 includes the image identification device according to any one of claims 1 to 8, the same as the invention according to claims 1 and 9. It is possible to easily identify a person as a subject in an image or an image in which a specific person is the subject. In the invention according to claim 10, based on the identification result by the identification means, an image of a certain person as a subject is delivered to the customer by the delivery means, and the processing means is the customer targeting the image delivered by the delivery means. Since the predetermined processing is performed according to the order from the customer, it is possible to respond to the customer's order for the delivered image.
【0028】
The certain person may be the customer himself or herself, or may be a person registered in advance by the customer (for example, a family member of the customer). Further, the distribution of the image can be realized by, for example, transmitting the image to a computer, a mobile device, or the like owned by the customer. According to the invention of claim 10, an image of a certain person as a subject is automatically delivered to the customer, and the customer can place an order for the delivered image. Therefore, the subject is a specific person. The customer can easily place an order for the image.
【0029】
As the predetermined processing in the invention according to claim 9 or 10, for example, as described in claim 11, among the image data stored in the image data storage means, the image designated by the customer is used. Examples include a process of creating a print using image data or requesting the creation of the print, and a process of delivering or distributing the image data of the specified image to a customer. It should be noted that predetermined image processing (for example, enlargement / reduction, trimming, image processing for improving image quality) may be performed when the image data is delivered or distributed to the customer .
【0030】
Further, in order to achieve the first object, the image identification method according to the invention according to claim 12 acquires the shooting date and time and the shooting location when shooting is performed with an unspecified person as a subject, and by the shooting. By storing the obtained image data in the image data storage means and collating the shooting date and time and shooting location corresponding to the image data with the movement history of the person shot as the subject, the subject in the image represented by the image data. Because the image data of the image of the person or the specific person as the subject is identified, the person as the subject in the image or the image of the specific person as the subject is identified as in the invention of claim 1. Can be easily performed.
【0031】
BEST MODE FOR CARRYING OUT THE INVENTION
Hereinafter, an example of the embodiment of the present invention will be described in detail with reference to the drawings.
【0032】
[First Embodiment] FIG. 1 shows an image ordering system 10 according to the first embodiment. In the first embodiment, the photographer 12 shoots an arbitrary person who is present at an arbitrary shooting place such as a tourist spot, a theme park, an event venue, or a park as a subject. In the image ordering system 10 according to the first embodiment, a person (customer 16) photographed as a subject in the above shooting orders a photographed image (for details, an order for creating a photographic print or image data of the photographed image). It is a system that makes it possible to order the delivery of.
【0033】
That is, the image ordering system 10 includes the order processing device 24 according to the present invention. The order processing device 24 also has a function as an image identification device according to the present invention. The order processing device 24 consists of a computer such as a workstation, and the CPU 24A, ROM 24B, RAM 24C, and input / output port 24D are connected to each other via the bus 24E, and the communication control device (for example, modem or router) 26 and media are connected to the input / output port 24D. The driver 28 and the hard disk device (HDD) 30 are connected to each other.
【0034】
An image ordering program for executing the image order processing (details will be described later) according to the present invention by the CPU 24A of the order processing device 24 is pre-installed in the HDD 30 of the order processing device 24, and the CPU 24A executes the image ordering program. As a result, the computer constituting the order processing device 24 functions as the order processing device according to the present invention.
【0035】
In addition, the photographer 12 who takes an image that can be ordered via the image ordering system 10 is a digital still camera 14 (which is equipped with a GPS function that detects the current position using a GPS system and a timekeeping function that detects the current date and time. Hereafter, it is simply referred to as DSC14), and shooting is performed using this DSC14. Every time the photographer 12 shoots, the captured image data and other information are recorded by the DSC 14 on the recording media 20 (for example, SmartMedia (R), CompactFlash (R), Memory Stick (R), etc.), and the media driver 28 , Reads information such as captured image data from the recording medium 20 brought in by the photographer 12.
【0036】
The DSC14 corresponds to the photographing means according to claim 2, the GPS function mounted on the DSC14 is the position detecting means according to claim 2, and the timekeeping function is the date and time detecting means according to claim 2. It corresponds to.
【0037】
Further, the communication control device 26 of the order processing device 24 is connected to the communication network 32. This communication network 32 includes a mobile phone network and a public telephone network, and is configured to include a high-speed and large-capacity dedicated communication network or a computer network such as the Internet, and forms a part of the mobile phone network. A large number of constituent base stations 34 are connected. In addition, the communication network 32 includes computers (PCs) 38 owned by a large number of print finishing companies 36 nationwide, multiple order receiving terminals 42, and computers (PCs) owned by customers 16 of the image ordering system 10. 48 and the location information service center 50 of the mobile phone company are connected respectively.
【0038】
The print finisher 36 is a digital print system 40 consisting of a film scanner that reads an image recorded on photographic film, a digital printer that performs a print finish process that records an image represented by image data on a recording material such as photographic paper, and the like. I have. The digital print system 40 is connected to the PC 38, and it is also possible to perform print finishing processing using the image data received by the PC 38 via the communication network 32.
【0039】
Further, the order receiving terminal 42 is a terminal for receiving an order from a customer, and may be near an arbitrary place (a place where the photographer 12 is shooting, or a place unrelated to the shooting place (for example, a convenience store or a DPE). It may be installed at a storefront, etc.). The order receiving terminal 42 includes a display 44 composed of a CRT, an LCD, or the like and capable of displaying an image or the like, and an input unit 46 including a keyboard or the like for a customer to input arbitrary information, and is composed of a communication network 32. It also has a function of communicating with the order processing device 24 via.
【0040】
Further, in the first embodiment, each customer of the image ordering system 10 (customer to be photographed by the photographer 12) has a mobile phone 18 and subscribes to the location information service provided by the mobile phone company. .. In this location information service, the location information service center 50 determines the location of the mobile phone 18 by communicating with the mobile phone 18 (for example, the mobile phone of PHS (Personal Handy-phone System)) carried by the customer and the base station 34. A service that recognizes the current position of a customer by searching (determining the nearest base station 34 of the mobile phone 18) and notifies a third party of the recognized current position on a regular basis for each individual customer. Therefore, in the first embodiment, the current position of each customer is periodically notified from the location information service center 50 to the order processing device 24. As described above, the mobile phone 18 corresponds to the portable communication device according to claim 6.
【0041】
Next, the operation of the first embodiment will be described. In the first embodiment, the cameraman 12 stays at a certain position in the above-mentioned arbitrary shooting location, or wanders around the shooting location, waits for the arrival of a person as a subject, and possesses the person when the person arrives. Repeatedly shooting the incoming person using DSC14. The DSC14 possessed by the photographer 12 detects the current position by the GPS function every time a picture is taken, and also detects the current date and time by the timekeeping function, and the detected current position and the current date and time are used as the shooting location information and shooting. As the position information, it is recorded on the recording medium 20 in association with the photographed image data obtained by the photographing.
【0042】
At the timing when a certain number of images are taken or the shooting of one day is finished, the photographer 12 sends the recording medium 20 to the management center where the order processing device 24 is installed, and the operator of the management center is the photographer 12. The recording media 20 sent from is set in the media driver 28 of the order processing device 24.
【0043】
In the order processing device 24, when the recording medium 20 is set in the media driver 28 or some information is received from the outside (location information service center 50, order receiving terminal 42, etc.), the image order processing shown in FIG. 2 is activated. .. In this image order processing, the type of input information is determined in step 100. When the recording media 20 is set in the media driver 28 and started, it is determined that the input information is captured image data, and the process proceeds to step 102.
【0044】
In step 102, a single captured image data is read from the recording medium 20, and in the next step 104, the shooting date / time information and the shooting location information stored in association with the captured image data read in step 102 are read out. In addition, this step 104 corresponds to the acquisition means of the present invention. Then, in step 106, the captured image data read in step 102 is stored in the image DB provided in the HDD 30 in association with the shooting date / time information and shooting location information read in step 104. As described above, the HDD 30 corresponds to the image data storage means of the present invention.
【0045】
In the next step 108, it is determined whether or not all the captured image data recorded on the recording medium 20 are stored in the image DB. If the determination is denied, the process returns to step 102, and steps 102 to 108 are repeated until the determination in step 108 is affirmed. Then, when the determination in step 108 is affirmed, the image order processing is terminated. By performing the above processing each time the recording medium 20 is received from the cameraman 12, as shown in Table 1 below, the image DB contains the captured image data and the shooting date / time information for all the images captured by the photographer 12. And the shooting location information will be recorded respectively.
【0046】
[table 1]
<img file="JP2003199032A_D0001.tif" />【0047】
The photographed image data, the photographed date and time information, and the photographed place information are not limited to being acquired via the recording medium 20 as described above, and for example, communication of a mobile phone or the like possessed by the photographer 12. Depending on the device, for example, every time shooting is performed, every time a predetermined number of shootings are performed, or at the end of one day's shooting, the shot image data, the shooting date / time information, and the shooting location information are transmitted to the order processing device 24. It goes without saying that it is okay to do so.
【0048】
Next, the collection of the movement history of each customer will be described. As described above, each customer of the image ordering system 10 owns a mobile phone 18, subscribes to the location information service provided by the mobile phone company, and is an individual customer from the location information service center 50 to the order processing device 24. You will be notified of your current location on a regular basis. When notifying the customer's current position, in addition to the location information indicating the customer's current position, information for identifying the customer (for example, a customer number uniquely assigned to each customer by the mobile phone company). Will be notified at the same time.
【0049】
In the order processing device 24, the image order processing is also activated when the information notifying the current position of the customer is received from the location information service center 50, and in this case, the process proceeds from step 100 to step 110. In step 110, the current date and time updated / held by the timekeeping function of the order processing device 24 is read out.
【0050】
Then, in step 112, the customer ID of the customer to be notified (the ID uniquely assigned to each customer by the image ordering system) based on the information received from the location information service center 50 for identifying the customer. To judge. For the determination of the customer ID, for example, the table in which the information for identifying the customer transmitted from the location information service center 50 is registered in association with the customer ID for each customer is stored in the HDD 30 and received. It can be done by searching this table using the information provided as a key. Then, in the customer movement information DB provided in the HDD 30, the location information received from the location information service center 50 and the date and time information representing the current date and time read in step 110 are stored as the movement history information corresponding to the customer ID determined earlier. It is memorized and the image order processing is completed.
【0051】
Note that step 112 corresponds to the collection means according to claim 4 (specifically, the collection means according to claim 5), and the HDD 30 also corresponds to the movement history storage means according to claim 4.
【0052】
By performing the above processing each time the current location of each customer is notified from the location information service center 50, as shown in Table 2 below, the customer movement information DB has a movement history for each customer as a unit. Multiple pieces of information (a set of date and time information and location information representing the customer's position at a certain date and time) are stored, and by referring to the movement history information group stored in the customer movement information DB, each customer's It becomes possible to judge the movement history.
【0053】
[Table 2]
<img file="JP2003199032A_D0002.tif" />【0054】
Next, a case where the customer 16 orders an image obtained by taking a picture by the photographer 12 will be described. In the first embodiment, the order receiving terminal 42 is installed as a terminal for receiving an order from the customer 16. When placing an image order using the order receiving terminal 42, the customer 16 requests the order processing device 24 to order an image in which the customer 16 himself is a subject by inputting the customer ID via the input unit 46. To do.
【0055】
In addition, a customer card or the like recording the customer ID of each customer is distributed to each customer in advance, and a card reader or the like for reading the customer ID from the customer card is provided in the order receiving terminal 42 to place an order. Occasionally, the customer ID may be automatically input to the order receiving terminal 42 by inserting the customer card possessed by the customer into the card reader or the like. Further, for example, an IC tag that records information such as a customer ID of each customer is attached to a customer card or the like possessed by the customer, and an IC tag sensor that reads information from this IC tag is provided on the order receiving terminal 42. When a customer arrives at the installation location of the order reception terminal 42, the IC tag sensor is configured to read information such as the customer ID from the IC tag attached to the customer card or the like possessed by the arriving customer. The incoming customer may be automatically recognized without having the customer enter the customer ID or insert the customer card into the card reader.
【0056】
Further, in the first embodiment, the image order by the customer 16 can be performed by using the mobile phone 18 or the PC 48 owned by the customer 16 in addition to using the order receiving terminal 42. An order using the mobile phone 18 or PC48 accesses a predetermined web page prepared in advance for image ordering and stored in a predetermined web server, and is displayed on the display unit of the mobile phone 18 or the display of the PC 48. This can be done by entering the customer ID in the customer ID input field provided on the predetermined web page while the web page is displayed.
【0057】
When the customer 16 performs an operation for ordering an image as described above, information requesting an image order is transmitted from the order receiving terminal 42 or the mobile phone 18 or the PC 48 to the order processing device 24 together with the customer ID, and the order is placed. In the processing device 24, the image order processing is activated, and in this case, the process proceeds from step 100 to step 114. In step 114, the customer movement information DB is searched using the received customer ID as a key, and all the customer movement history information corresponding to the received customer ID is extracted from the customer movement information DB.
【0058】
In step 116, a single movement history information (a set of position information and date and time information) is extracted from the movement history information group extracted in step 114, and in the next step 118, the movement history information extracted in step 116 is extracted. , It is stored in the image DB that it is collated with the shooting date / time information and the shooting location information stored in the image DB in association with the captured image data, and it is determined whether or not the date / time and the location are substantially the same. By performing this for all the captured image data, whether or not the captured image data in which the shooting date and time and the shooting location substantially match the position and date and time represented by the movement history information extracted in step 116 is stored in the image DB Search for. Then, when the captured image data that matches the search condition exists in the image DB, the captured image data is read from the image DB and temporarily stored in the RAM 24C or the like. This step 118 corresponds to the identification means of the present invention (specifically, the identification means according to claims 3 and 4).
【0059】
In the next step 120, it is determined whether or not the above processing has been performed on all the movement history information extracted in step 114. If the determination is denied, the process returns to step 116, and steps 116 to 120 are repeated until the determination in step 120 is affirmed. As a result, all the captured image data of the image that is likely to be the subject of the customer requesting the order of the image is extracted.
【0060】
If the determination in step 120 is affirmed, the process proceeds to step 122, and the images represented by each captured image data are displayed as an index (reduced and arranged in a matrix) using the captured image data extracted by the search in step 118. ) The index image data representing the image is generated, and the generated index image data is transferred to the order requesting device (order receiving terminal 42 or mobile phone 18 or PC 48) to display the display unit (order receiving terminal 42 or mobile phone 18 or PC 48) of the order requesting device. The index image is displayed on the display 44 of the order receiving terminal 42, the display unit of the mobile phone 18, or the display of the PC 48). Note that step 122 corresponds to the display control means according to claim 9.
【0061】
Further, the order processing device 24 displays a message requesting the customer 16 to select an image to be ordered together with the above index image on the display unit of the device of the order requesting source, and in the next step 124, the order target is displayed. Determine if the image was selected by customer 16 and wait until the determination is affirmed. Customer 16 refers to the index image displayed on the display of the device that requested the order. Since each of the individual images displayed as the index image is an image in which the customer 16 is likely to be the subject, the customer 16 can easily find the image to be ordered. Then, the customer 16 operates the input unit of the device of the order requesting source (the input unit 46 of the order receiving terminal 42, the operation key of the mobile phone 18, the keyboard of the PC 48, etc.) to select the image to be ordered, and at the same time, the customer 16 selects the image to be ordered. At the same time, the order type (whether to create a photo print or deliver the image data of the captured image) for the selected image is also instructed.
【0062】
If the order type is "Photo print creation", the "Number of prints" and "Print receiving method" (for example, whether you want to deliver to the customer 16's home or receive it at the nearest convenience store, etc.) are also displayed at the same time. It is specified. When the order type is "image data delivery", information for specifying the destination of the image data to be ordered (for example, the e-mail address of the customer 16) is also specified at the same time.
【0063】
When the image to be ordered is selected by the customer 16, the determination in step 124 is affirmed, the process proceeds to step 126, and the order content by the customer 16 is determined. If the order by customer 16 is "photo print creation", the process proceeds to step 128. In step 128, it is most suitable for ordering this print order from among a large number of print finishing companies 36 based on the "print receiving method" received from the device of the order requesting device, the customer's address specified from the customer ID, and the like. The print finisher 36 is selected, and the captured image data of the image selected by the customer 16 as the order target, the information representing the order contents specified by the customer 16, and the customer ID of the customer 16 are selected. Place a print order from a customer by sending it to PC38.
【0064】
The print finishing company 36, which has received the above information by the PC 38 via the communication network 32, uses the received photographed image data to obtain a photograph of the size specified by the "print size" in the information representing the received order details. Create as many prints as the number of prints specified in "Number of prints", and deliver the created photo prints to the specified destination so that the photo prints will be received by the customer 16 by the receiving method specified in "Print receiving method". .. As a result, the customer 16 can receive a photographic print of the image selected as the order target (the image in which the customer 16 itself appears as a subject) under the conditions (size, number of sheets, receiving method) that match the specified order contents. it can.
【0065】
If the order by the customer 16 is "delivery of image data", the process proceeds from step 126 to step 130, and the captured image data of the image selected as the order target by the customer 16 is sent to the destination specified by the customer 16. Send to. As a result, the customer 16 can receive the captured image data of the image selected as the order target (the image in which the customer 16 itself appears as a subject) via the PC 48 or the mobile phone 18. When handing over the captured image data to the customer 16, predetermined image processing (for example, enlargement / reduction, trimming, image processing for improving image quality) may be performed. Steps 126 to 130 described above correspond to the processing means according to claim 9.
【0066】
In the first embodiment described above, when a customer ID is specified, a case where an image in which the customer 16 corresponding to the customer ID is a subject is searched has been described, but the present invention is not limited to this, and the order is not limited to this. When the processing device 24 is on standby when information is not received from the outside, the order processing device 24 sets the shooting date and time and shooting location stored in the image DB in association with the individual shot image data of each customer. By collating each with the movement history information, a person as a subject in the image represented by each captured image data may be identified (the subject is any one of a large number of customers 16).
【0067】
Further, in the first embodiment described above, the case where the movement history of each customer is acquired by using the location information service provided by the mobile phone company has been described, but the present invention is not limited to this, and the individual customer is not limited to this. Have at least a mobile device (corresponding to the mobile device according to claim 7) equipped with a GPS function (position detection means according to claim 7) that detects the current position using a GPS system. The GPS function of the mobile device may acquire the movement history of each customer generated by detecting the current position at regular intervals. In this aspect, as the movement history acquisition method, for example, a method of acquiring the movement history by periodically transmitting the movement history information from the mobile device owned by each customer to the order processing device 24 is adopted. Alternatively, for example, when a customer places an order via the order receiving terminal 42 or the like, the movement history is acquired by the order receiving terminal 42 or the like reading the movement history information stored and stored in the mobile device. It is also possible to do.
【0068】
Further, when the range in which the photographer 12 shoots is limited to a certain area such as in a theme park or a park, for example, in the same area as in the second embodiment described below. Each customer in the area has a transmitter that transmits a signal containing a predetermined ID (this transmitter can be embedded in an admission ticket to a certain area, etc.), and is transmitted from the transmitter. A large number of base stations that receive signals are provided in the fixed area at substantially regular intervals, and the current position of each customer is determined by determining which base station the signal transmitted from each customer is received. By repeating the detection at regular time intervals, the movement history of each customer may be acquired.
【0069】
Further, in the first embodiment, the case where the shooting location and the shooting date and time are detected by the GPS function and the timing function mounted on the DSC14 possessed by the cameraman 12 has been described, but the range in which the cameraman 12 shoots is a certain area. In the case of limiting to the inside, as in the second embodiment described below, a large number of base stations are provided in the fixed area at substantially constant intervals, and an image ID for identifying each shot image at the time of shooting is provided. A predetermined signal including the above is transmitted from the DSC 14 to the base station, and the order processing device 24 detects the shooting location by determining which base station received the signal, and the base station receives the signal. The shooting date and time may be determined by determining the date and time, and may be stored and stored in the image DB or the like in association with the received image ID.
【0070】
Further, in the first embodiment, an example in which the order processing device 24 collects the movement history of each customer and stores and stores it in the customer movement information DB has been described, but the present invention is not limited to this. , Information representing the customer's own movement history entered based on the customer's memory without collecting the customer's movement history (for example, information such as "I went to on XX days": This is also in the present invention. By collating the relevant "person's movement history") with the shooting date and time and shooting location of each shot image data, it is possible to search for an image that is likely to be the subject of the customer. Good.
【0071】
Further, in the first embodiment, the image having a high possibility that the customer is the subject is extracted based only on the collation of the date and time and the place, but the corresponding image should be extracted by using other information as well. It may be. For example, the customer is asked to input the color of the clothes on the day, and the area (face area) estimated to correspond to the customer's face is extracted from the image extracted by collating the date and time and the place by a known face area extraction process. Based on the position and size of the extracted face area, the area estimated to correspond to the customer's body part (body area) is determined, and the color of the body area matches or resembles the color of the clothes input by the customer. By performing a process of determining whether or not the image is present, the image that is likely to be the subject of the customer may be narrowed down.
【0072】
Further, in the first embodiment, when there is an order request from the customer, the photographed image data of the image that is likely to be the subject of the customer requesting the image order is extracted, and the order request source. The example of displaying on the display unit of the device is not limited to this, and a certain person (customer himself or a person registered in advance by the customer) is a subject without waiting for an order request from the customer. The image to be used may be extracted and automatically distributed to the mobile phone 18 or PC 48 owned by the customer via a communication network such as the Internet. This aspect corresponds to the invention of claim 10. At this time, it is desirable to attach a program for the customer to order the image.
【0073】
According to the above aspect, for example, when a customer goes to a specific facility such as a tourist spot, a theme park, an event venue, or a park, the photographer 12 takes a picture of the customer as a subject. The image and the program are attached to, for example, an e-mail and sent (delivered) to a mobile phone 18 or PC 48 owned by the customer, and when the customer who recognizes the incoming e-mail opens the attached file, the photograph is taken. The image obtained by the above is displayed on the display unit, and then the program is executed, so that a message prompting the customer to place an order is displayed, and the customer can order the delivered image. In the above aspect, since the image is delivered to the customer's mobile phone 18 or PC 48, the opportunity for the customer to order the image can be increased.
【0074】
In the above aspect, the image to be distributed is not limited to the index image obtained by reducing the still image described above and arranging it in a matrix, and may be edited and distributed in a screen configuration like an album. , Combining data such as images, characters, sounds, texts (for example, explanatory messages about shooting date and place, image modification such as border decoration, adding advertisements, etc.), special processing (for example, blurring, watercolor / Even if an image with oil-colored style, monochrome, etc.) is illustrated, moving image data is added, and multiple still images are sequentially reproduced and displayed on the display unit at predetermined time intervals like a slide show. Good. In addition, images, characters, sounds, texts, etc. to be combined with the images to be distributed, moving images to be added to the images to be distributed, etc., were held at the shooting date and time, the shooting location, or at the time of shooting (this event is It may be selected according to the shooting date and time and the shooting location (for example, if the shooting location is in a specific theme park, a video that synthesizes an image character of the specific theme park or promotes the specific theme park). Add an image, etc.). Further, the image to be distributed may be a moving image, and when the moving image is distributed, the screen configuration may be edited and distributed like a commemorative movie, or the above data may be combined (combined). It is also preferable that the data to be generated is a moving image) and the like may be performed for distribution. In addition, the customer may be able to select in advance whether or not there is an example of an image that has been subjected to data composition and special processing, and the type thereof. By processing the distributed image described above, the entertainment of the image distribution can be improved, and the customer's willingness to order the image can be increased.
【0075】
[Second Embodiment] Next, the second embodiment of the present invention will be described. The same parts as those in the first embodiment are designated by the same reference numerals, and the description thereof will be omitted. FIG. 3 shows the image ordering system 11 according to the second embodiment. In the second embodiment, the photographer 12 takes a picture of the athlete 17 as a subject in the stadium 52 where an arbitrary competition (for example, baseball, soccer, athletics, etc.) is held. The image ordering system 11 according to the second embodiment is a system that enables the customer 16 to order the image obtained by the above shooting.
【0076】
Each of the athletes 17 as a subject in the second embodiment possesses a transmitter 19 that constantly transmits a predetermined signal including an athlete ID for identifying each athlete 17. The transmitter 19 is embedded in, for example, a uniform, a bib, or shoes so as not to interfere with the competition of the athlete 17. In the basement of the stadium 52, a large number of position sensors 35 that receive signals transmitted from the transmitter 19 are buried at regular intervals (for example, at intervals of several meters). A large number of position sensors 35 are each connected to an external I / F unit 29 of the order processing device 24.
【0077】
Further, in the second embodiment, the cameraman 12 has a digital still camera (DSC) 15 having a built-in transmitter that constantly transmits a predetermined signal including a camera ID, similarly to the transmitter 19 described above. There is. The position sensor 35 described above also receives the signal transmitted from the DSC 15. The DSC15 also has a function of wirelessly communicating with the external I / F unit 29 of the order processing device 24, and a function of detecting the direction and the shooting magnification at the time of shooting.
【0078】
Further, the image ordering system 11 according to the second embodiment includes an electronic signboard 43 installed in a place such as near the entrance / exit of the stadium 52 instead of the order receiving terminal 42 described in the first embodiment. .. This electronic signboard 43 also includes a large-screen display 44 capable of displaying an image or the like, an input unit 46 including a keyboard or the like for a customer to input arbitrary information, and an order processing device 24 via a communication network 32. It also has a function to communicate.
【0079】
Next, the operation of the second embodiment will be described. When the competition by the athlete 17 is started in the stadium 52, the photographer 12 takes a picture of the athlete 17 as a subject while moving in the stadium 52. During this period, the transmitter 19 possessed by the competitor 17 and the DSC 15 possessed by the cameraman 12 always transmit a predetermined signal, and the transmitted signal exists at the position closest to the current position of the competitor 17 and the cameraman 12. Received by the position sensor 35.
【0080】
The HDD 30 of the order processing device 24 is provided with a subject movement information DB instead of the customer movement information DB described in the first embodiment, and the order processing device 24 transmits from the transmitter 19 of each competitor 17. The current position of each competitor 17 is detected by constantly determining which of the position sensors 35 provided with a large number of the signals is received, and the detected current position corresponds to the date and time information indicating the current date and time. It is attached and stored in the subject movement information DB as the subject position information repeatedly at a predetermined cycle.
【0081】
As described above, the transmitter 19 possessed by the athlete 17 corresponds to the portable communication device according to claim 6, and the position sensor 35 corresponds to the base station according to claim 6. The positions of the individual photographers 12 (and DSC15) may also be constantly detected and stored as information in the same manner as described above.
【0082】
Next, the image order processing executed by the order processing device 24 according to the second embodiment will be described with reference to the flowchart of FIG. In step 150, it is determined whether or not the competition at the stadium 52 has ended. If the determination is denied, the process proceeds to step 152, and it is determined whether or not the shooting information has been received from the DSC15 of the photographer 12. If the determination is denied, the process returns to step 150, and steps 150 and 152 are repeated until any of the determinations is affirmed.
【0083】
When the photographer 12 takes a picture (shooting with the athlete 17 as a subject), the DSC 15 according to the second embodiment detects the direction at the time of shooting and also detects the shooting magnification, and the shooting direction indicating the detected direction. The information and the shooting magnification information representing the detected shooting magnification are transmitted to the order processing device 24 together with the shooting image data obtained by shooting. When the above information (referred to as shooting information) is received via the external I / F unit 29, the determination in step 152 is affirmed and the process proceeds to step 154. The photographing direction can be detected by using, for example, a gyro (any of various methods such as mechanical type, optical type, fluid type, vibration type, etc.) or by detecting geomagnetism.
【0084】
In step 154, the current positions (shooting positions) of the photographer 12 and the DSC 15 are based on which of the many position sensors 35 the predetermined signal transmitted from the DSC 15 that transmitted the shooting information is received. ) Is determined, and the current date and time is detected as the shooting date and time. Note that this step 154 corresponds to the acquisition means of the present invention (specifically, the acquisition means according to claim 8), including the process of receiving shooting information from the DSC15. In the next step 156, the shooting position information and the shooting date / time information representing the shooting position and the shooting date / time detected in step 154 are temporarily stored in the RAM 24C or the like together with the shooting image data, the shooting direction information, and the shooting magnification information received from the DSC15.
【0085】
In the next step 158, among the information temporarily stored in step 156, the range shot by the current shooting of the stadium 52 is determined based on the shooting position information, the shooting direction information, and the shooting magnification information. Then, in step 160, from the information stored in the subject movement information DB, information representing the position of each athlete 17 at the shooting date and time is extracted as subject position information, and the subject position information is determined in step 158. By collating with the information indicating the range and determining whether or not the competitor 17 was within the shooting range at the time of shooting for each individual player 17, this shooting (the shot image represented by the received shot image data) ) Identifies the athlete 17 as the subject. This step 160 corresponds to the identification means of the present invention (specifically, the identification means according to claim 8).
【0086】
In shooting group competitions, etc., a plurality of athletes 17 are often photographed as the main subject, but when another athlete who is not the main subject falls within the shooting range, the other athlete is the background of the photographed image. It may be reflected as. In identifying a player as a subject for such a shot image, if it is desired to avoid recognizing another player reflected as a background as a subject, for example, it is determined that the player was within the shooting range at the time of shooting. Of the multiple athletes 17, the athletes whose shooting position and shooting location are significantly different from other athletes are excluded, or the distance between the shooting position and shooting location is the shooting location. Occasionally, athletes who are significantly different from the distance to the subject measured by the AF mechanism may be excluded.
【0087】
In the next step 162, the received captured image data is stored in the image DB in association with the ID of the athlete 17 determined to be the subject in step 160, and the process returns to step 150. As a result, while the competition is being held in the stadium 52, steps 154 to 162 are repeated every time the photographer 12 takes a picture, the athlete 17 as the subject is identified, and the ID of the athlete 17 is used. The captured image data is accumulated and stored repeatedly in association with each other.
【0088】
When the competition in the stadium 52 is completed (shooting by the photographer 12 is completed), the judgment of step 150 is affirmed and the process proceeds to step 164, and all the athletes 17 who have competed in the stadium 52 A list of names, facial photographs, etc. is displayed on the display 44 of the electronic signboard 43. In the next step 166, it is determined whether or not one of the competitors has been selected by the customer 16 (for example, a person who has watched the competition held in the stadium 52) who has arrived at the installation position of the electronic signboard 43, and the determination is made. Wait until affirmed.
【0089】
When the customer 16 who arrives at the installation position of the electronic signboard 43 selects a specific competitor 17 from all the listed competitors 17 in order to order an image of a specific competitor, the determination in step 166 is made. Is affirmed and the process proceeds to step 168, the image DB is searched using the ID of the specific athlete 17 selected by the customer 16 as a key, and the captured image data stored in association with the ID of the specific athlete is stored. Are all extracted. Then, in the next step 170, the images represented by the captured image data extracted by the search are displayed in a list on the display 44. As a result, only the images of the specific athlete 17 as the subject are displayed in a list on the display 44, so that the customer 16 can easily find the image to be ordered. Note that this step 170 corresponds to the display control means according to claim 9.
【0090】
The following steps 172 to 178 are substantially the same as steps 124 to 130 described in the first embodiment. To briefly explain, it is determined whether or not the image to be ordered is selected by the customer 16 (step 172). ), When the image to be ordered is selected by the customer 16, the order contents by the customer 16 are determined (step 174), and if the order by the customer 16 is "photo print creation", in step 176, the print finisher 36 Is selected, and the image data of the image to be ordered, the information representing the order contents specified by the customer 16, and the customer ID of the customer 16 are sent to the PC38 of the selected print finishing company 36 to print from the customer. Place an order. When the order by the customer 16 is "delivery of image data", in step 178, the captured image data of the image to be ordered is transmitted from the customer 16 to the designated destination. Steps 174 to 178 also correspond to the processing means according to claim 9.
【0091】
In the next step 180, it is determined whether or not to end the process. This step 180 is unconditionally denied for a predetermined time after the end of the competition, for example, and returns to step 164. As a result, the customer 16 who visited the stadium 52 and watched the competition can obtain an image of the desired athlete 17 as a subject.
【0092】
In the second embodiment, for the sake of simplicity, only the electronic signboard 43 has been described as a device for ordering images, but as in the first embodiment, a web page for customers to order images. Needless to say, you may be able to order images by accessing.
【0093】
Further, in the second embodiment, the competitor 17 is made to possess the transmitter 19, and the position of the competitor 17 is detected by the position sensor 35, but the position is not limited to this, and the transmitter is on the stadium 52 side. Is installed, a signal including position information indicating the position of each transmitter is transmitted from each transmitter, a signal from the transmitter is received, and the position information included in the received signal is used as the current date and time. Each athlete 17 has a receiver having a function of repeating recording in association with the above at a predetermined cycle, and after the competition in the stadium 52, the receiver is collected and recorded information (individual). The movement history of each competitor may be acquired by reading out the movement history of the competitor 17). Further, instead of reading the information from the receiver after the competition, the recorded information may be periodically transmitted from the receiver.
【0094】
Further, the method for detecting the shooting location is not limited to the method described in each of the above embodiments, and a signal including location information indicating the installation location of each base station is transmitted to a large number of base stations different from each other. The shooting location may be detected by transmitting from each of the signals and receiving this signal on the DSC side.
【0095】
Further, in the above description, DSC14 has been described as an example of the shooting means possessed by the cameraman 12, but the shooting means is not limited to this, and a normal camera for exposing and recording an image on a photographic film or a digital video camera is used as a shooting means. Needless to say, it may be used as.
【0096】
In particular, when a digital video camera is used as the photographing means, the present invention is applied to individual images of the moving images obtained by photographing to discriminate the subject, and the information for identifying the discriminated subject ( By storing the subject ID) in association with each image, it is possible to easily search for a scene in which a specific subject appears and edit a moving image for each subject.
【0097】
In addition, when a digital video camera is used as a shooting means, a moving image is ordered from the customer, but the moving image can be distributed by recording the moving image on a video tape and shipping it to the customer. Alternatively, it may be outsourced to a cable television (CATV) company or the video may be distributed using the Internet. Specifically, for example, when a moving image of a specific athlete is ordered by a customer via an electronic signboard 43, a recording means (for example, a video recorder, a PC, etc.) in which the customer owns the moving image of the order. In addition to notifying the recording means of information for recording reservation (broadcast channel, broadcast date and time, etc.), for example, a key for descrambling a moving image to be scrambled and broadcast is also notified at the same time. In this case, the recording means receives the broadcast of the notified broadcast channel at the notified broadcast date and time, descrambles using the notified key, and then records. As a result, the customer can obtain the moving image ordered by the customer.
【0098】
Further, the case where the cameraman 12 shoots is described above, but the present invention is not limited to this, and the camera is provided with a sensor for detecting a person as a subject as a shooting means, and detects when the person is detected by the sensor. Needless to say, a camera that automatically captures the person being photographed (this camera may be a DSC, a normal camera that exposes and records an image on photographic film, or a digital video camera as described above) may be used. ..
【0099】
Further, in the second embodiment, there is a slight time lag between the time when the cameraman 12 takes a picture and the time when the order processing device 24 recognizes that the picture was taken by receiving the shooting information from the DSC 15. In the second embodiment, the position of the detected subject (athlete 17) is moved because the above time lag may reduce the subject identification accuracy, especially in a highly moving competition. Although the case of sequentially storing in the information DB has been described, the subject position detection method itself described in the second embodiment detects the position of each subject (individual athlete 17 in the example of the second embodiment) in real time. It is also possible to use this to detect the position of a specific subject in real time so that the specific subject is always in the proper size within the imaging range (automatically the specific subject). It is also possible to control the shooting direction, focusing position, and shooting magnification of the shooting means in real time based on the position of a specific subject detected in real time (as in tracking).
【0100】
As described above, the position of a specific subject is detected in real time, and the shooting direction, focusing position, and shooting magnification of the shooting means are set in real time so that the specific subject always exists in the imaging range in an appropriate size. Control is applicable to, for example, automatic shooting by a shooting means, but the result of detecting the position of the subject in real time is obtained by the photographer (for example, the photographer 12 or the customer 16 who visited the stadium 52). When shooting a specific subject, it can also be used to support the shooting.
【0101】
Specifically, for example, when shooting is performed with the athlete 17 as a subject in the stadium 52 as in the second embodiment, information is centrally managed as in the order processing device 24 or the like described in the second embodiment. The device (hereinafter referred to as a management device) is the transmitter 19 and the position sensor 35 (instead of the transmitter 19 and the IC tag possessed by each competitor 17 and the position sensor 35) described in the second embodiment. The IC tag sensor embedded in the stadium 52 may be used) to detect the position of each individual athlete 17 as a subject in real time, and by a predetermined signal transmitted from the DSC 15 possessed by each photographer. The position of each photographer (and DSC15) is also detected in real time. Instead of the predetermined signal transmitted from the DSC15, the position of each photographer (and DSC15) is detected by the IC tag possessed by each photographer and the IC tag sensor embedded in the stadium 52. May be good.
【0102】
In addition, the management device adds identification information for identifying each athlete 17 to the position information indicating the position of each individual athlete 17 detected in real time, and attaches identification information to each DSC15 possessed by each photographer. In addition to transmitting periodically (for example, in a cycle of several milliseconds to several seconds), position information indicating the position of the DSC15 itself (the position of the photographer who possesses the DSC15) is also transmitted. It should be noted that the position information of the athlete 17 is not limited to transmitting the position information of all the athlete 17 to each DSC15, and the specific athlete notified by each photographer as a shooting target. Only 17 location information may be transmitted to the individual photographer's DSC15.
【0103】
Further, in the DSC15, every time the position information of the athlete 17 and the position information of the DSC15 itself are received from the management device, the shooting support process shown in FIG. 5 is executed. Hereinafter, this shooting support process will be described. In step 200, the position information of the athlete 17 (target subject) to be photographed registered in advance in the DSC 15 is extracted from the position information of the athlete 17 received from the management device (as described above, the athlete 17 to be photographed). If only the position information of is transmitted from the management device, it is not necessary to extract this position information), based on the position information of the athlete 17 to be photographed and the position information of the DSC15 itself. Calculate the direction (shooting direction for shooting the target subject) of the competitor 17 to be shot when viewed from the person.
【0104】
The above-mentioned shooting direction may be the shooting direction in the horizontal plane (shooting azimuth), but it is desirable that the shooting direction in the vertical plane (shooting elevation angle) is included in addition to the azimuth. The shooting elevation angle can be calculated if the altitudes of the competitor 17 (target subject) and the photographer (DSC15) to be shot can be detected. The altitudes of the target subject and the photographer can be detected at the same time by detecting the positions of the target subject and the photographer using, for example, a GPS system. Further, if the altitude at each position of the stadium 52 is known, it is possible to detect the altitude of the target subject and the photographer from the positions of the target subject and the photographer (positions in the horizontal plane).
【0105】
The DSC15 has a built-in gyro sensor that detects the shooting direction, and in step 202, the current shooting direction of the DSC15 is captured from the gyro sensor, and the captured current shooting direction is calculated in step 200 to shoot the target subject. By comparing with the shooting direction of, it is determined whether or not the target subject is within the shooting image frame representing the predetermined shooting range in the current shooting direction of the DSC15.
【0106】
As an example, as shown in FIG. 6B, if the target subject deviates from the captured image frame in the current shooting direction, the determination in step 202 is denied and the process proceeds to step 204 to set the target subject. Calculate the direction of changing the shooting direction (for example, the horizontal direction and the vertical direction) so as to fit within the shot image frame. Then, in the next step 206, a direction indicating arrow indicating the changing direction of the shooting direction calculated in step 204 is displayed on the display unit of the DSC15 made of an LCD or the like, and the process returns to step 202. Therefore, in step 202, steps 204 and 206 are repeated until it is determined that the target subject is within the captured image frame.
【0107】
FIG. 6B shows an example of a screen image displayed on the display unit of the DSC15 by the process of step 206. In the example of FIG. 6B, an image corresponding to the current shooting range is displayed in the shot image frame W, and corresponds to the changing direction of the shooting direction calculated in step 204 outside the shot image frame W. A directional arrow D indicating the change direction is displayed at the position. As a result, the photographer can change (move) the shooting direction of the DSC15 so that the DSC15 points in the direction indicated by the direction arrow D, so that the target subject can be contained in the shooting image frame W, and the target subject can be set. You can shoot easily and surely. The display size of the direction indicator arrow D may be changed according to the deviation between the current shooting direction of the DSC15 and the shooting direction for shooting the target subject.
【0108】
In step 202, when it is determined that the target subject is within the captured image frame (for example, the state as shown in FIG. 6A), the process proceeds to step 208. At this time, information related to the target subject (for example, information such as the profile of a specific athlete 17 as the target subject) is acquired from a management device or the like, and as shown in FIG. 6 (A) as an example, the related information I It may be displayed on the display unit of the DSC15. This makes it possible to improve the convenience for the photographer.
【0109】
In step 208, the distance from the DSC15 to the target subject is calculated based on the position information of the target subject and the position information of the DSC15 itself, and in the next step 210, the distance to the target subject obtained by the calculation is calculated. Shooting to fit the target subject in the captured image frame W and to set the size of the target subject in the captured image frame W to an appropriate size (for example, about 1/4 of the area ratio to the captured image frame W). Calculate the magnification. Then, in the next step 212, the DSC15 is photographed by changing at least one of the optical magnification of the zoom lens of the DSC15 and the electronic variable magnification of the electronic zoom of the DSC15 according to the photographing magnification obtained by the calculation. Change the magnification and end the shooting support process.
【0110】
Every time the position information of the athlete 17 and the position information of the DSC15 itself are received from the management device, the above-mentioned shooting support process is executed by the DSC15, so that the photographer can perform the direction indicating arrow even if he / she loses sight of the target subject. By simply pointing the DSC15 in the direction indicated by, the target subject can be contained in the shooting image frame W, and the target subject can be reliably shot.
【0111】
[Effect of the invention]
As described above, the invention according to claim 1 and claim 12 acquires the shooting date and time and the shooting location in shooting with an unspecified person as a subject, stores the image data obtained by the shooting, and stores the image data in the image data. By collating the corresponding shooting date and time and shooting location with the movement history of the person shot as the subject, the image data of the person as the subject in the image represented by the image data or the image data of the image with the specific person as the subject is identified. Therefore, it has an excellent effect that a person as a subject in an image or an image having a specific person as a subject can be easily identified.
【0112】
The invention according to claim 3 is the invention according to claim 1, wherein the movement history of a specific person input via the input means has a plurality of shooting dates and times corresponding to any of a plurality of stored image data. In addition to the above effects, the configuration of the image identification device can be simplified because the image data of the image in which a specific person is the subject is identified by collating each of the plurality of shooting locations. ..
【0113】
The invention according to claim 4 corresponds to the image data by collecting the movement history of a plurality of persons and storing the collected movement history of the plurality of persons in the movement history storage means in the invention according to claim 1. By collating the shooting date and time and the shooting location with each of the movement histories of a plurality of people, the person as the subject in the image represented by the image data can be identified. Even when the instruction is given from the outside, it has the effect of being able to respond to the instruction from the outside in a short time.
【0114】
The invention according to claim 8 is the invention according to claim 1, wherein at least one of the shooting orientation and the shooting magnification is acquired, and at least one of the acquired shooting orientation and the shooting magnification is used as a subject in the image represented by the image data. Since the image data of the image of the person or the specific person as the subject is identified, there is an effect that the identification accuracy of the person or the image can be improved in addition to the above effect.
【0115】
The invention according to claim 9 is provided with the image identification device according to any one of claims 1 to 8, and uses an image of a designated person as a subject as a display means based on the identification result by the identification means. Since it is displayed and a predetermined process is performed according to an order from a customer for the displayed image, the customer can easily place an order for an image with a specific person as a subject, which is an excellent effect. Has.
【0116】
The invention according to claim 10 is provided with the image identification device according to any one of claims 1 to 8, and delivers an image of a certain person as a subject to a customer based on the identification result by the identification means. m Since the predetermined processing is performed according to the order from the customer for the delivered image, the customer can easily place an order for the image with a specific person as the subject, which is an excellent effect. ..
[Simple explanation of drawings]
[Figure 1]
It is a schematic block diagram of the image ordering system which concerns on 1st Embodiment.
[Figure 2]
It is a flowchart which shows the content of the image order processing which concerns on 1st Embodiment.
[Fig. 3]
It is a schematic block diagram of the image ordering system which concerns on 2nd Embodiment.
[Fig. 4]
It is a flowchart which shows the content of the image order processing which concerns on 2nd Embodiment.
[Fig. 5]
It is a flowchart which shows the content of the shooting support processing executed by a camera based on the result of detecting the position of a subject in real time.
[Fig. 6]
It is an image diagram which shows an example of the image displayed on the display part of a camera by the shooting support process of FIG.
[Explanation of symbols]
10 Image ordering system 11 Image ordering system 14 Digital Still Camera 15 Digital Still Camera 18 mobile phone 19 transmitter 20 Recording media 24 Order processing equipment 32 Communication network 34 base station 35 Position sensor 42 Order reception terminal 43 Electronic sign 50 Location-based service center
2 sheets
Sheet 1 Sheet 2
Every citation, both ways
| Document | Relation | Office | Cited during |
|---|---|---|---|
| JP2007142866A | Cited by | Japan | Examiner |
| WO2020095648A1 | Cited by | World Intellectual Property Organization (WIPO) | International search |
| WO2006068312A1 | Cited by | World Intellectual Property Organization (WIPO) | International search |
| JP2005286377A | Cited by | Japan | Search report |
| JP2018156437A | Cited by | Japan | Search report |
| JP2021047483A | Cited by | Japan | Search report |
| JP2005301677A | Cited by | Japan | Search report |
| JP2015179377A | Cited by | Japan | Search report |
| CN113302906A | Cited by | China | Search report |
| JP2018156437A | Cited by | Japan | Search report |
| JP2011239179A | Cited by | Japan | Search report |
| JP2005286394A | Cited by | Japan | Search report |
| JP2005107358A | Cited by | Japan | Search report |
| US7868917B2 | Cited by | United States of America | Applicant |
| JP2012194598A | Cited by | Japan | Examiner |
| JP2006253774A | Cited by | Japan | Search report |
| JP2012190425A | Cited by | Japan | Search report |
| JP2006287656A | Cited by | Japan | Examiner |
| JP2020077954A | Cited by | Japan | Search report |
| JP2007088611A | Cited by | Japan | Search report |
| WO2005062616A1 | Cited by | World Intellectual Property Organization (WIPO) | International search |
| JP2012133526A | Cited by | Japan | Search report |
| JP2008219696A | Cited by | Japan | Examiner |
| JP2009010967A | Cited by | Japan | Examiner |
6 members in 2 offices
Priority claims2
| Document | Office | Kind | Date |
|---|---|---|---|
| 2001303527(P2001303527) | Japan | – | |
| 2001303527 | Japan | A |
Members6
| Document | Office | Kind | |
|---|---|---|---|
| US2003103149A1 | United States of America | A1 | |
| JP2003199032AThis record | Japan | A | |
| US7301569B2 | United States of America | B2 | |
| JP2009010967A | Japan | A | |
| JP4256655B2 | Japan | B2 | |
| JP4750158B2 | Japan | B2 |
26 legal events, as the office reported them to INPADOC
Over the term
Point at a mark for the eventEvents
| Event | Code | |
|---|---|---|
| Cancellation because of completion of termEXPY | EXPY | |
| Receipt of annual feesJAPANESE INTERMEDIATE CODE: R250R250 | R250 | |
| Receipt of annual feesJAPANESE INTERMEDIATE CODE: R250R250 | R250 | |
| Receipt of annual feesJAPANESE INTERMEDIATE CODE: R250R250 | R250 | |
| Receipt of annual feesJAPANESE INTERMEDIATE CODE: R250R250 | R250 | |
| Receipt of annual feesJAPANESE INTERMEDIATE CODE: R250R250 | R250 | |
| Receipt of annual feesJAPANESE INTERMEDIATE CODE: R250R250 | R250 | |
| Receipt of annual feesJAPANESE INTERMEDIATE CODE: R250R250 | R250 | |
| Receipt of annual feesJAPANESE INTERMEDIATE CODE: R250R250 | R250 | |
| Receipt of annual feesJAPANESE INTERMEDIATE CODE: R250R250 | R250 | |
| Renewal fee payment (event date is renewal date of database)FPAY | FPAY | |
| Receipt of annual feesJAPANESE INTERMEDIATE CODE: R250R250 | R250 | |
| Renewal fee payment (event date is renewal date of database)FPAY | FPAY | |
| Receipt of annual feesJAPANESE INTERMEDIATE CODE: R250R250 | R250 | |
| Renewal fee payment (event date is renewal date of database)FPAY | FPAY | |
| Renewal fee payment (event date is renewal date of database)FPAY | FPAY | |
| Certificate of patent or registration of utility modelJAPANESE INTERMEDIATE CODE: R150R150 | R150 | |
| Certificate of patent or registration of utility modelJAPANESE INTERMEDIATE CODE: R150R150 | R150 | |
| First payment of annual fees (during grant procedure)JAPANESE INTERMEDIATE CODE: A61A61 | A61 | |
| Written decision to grant a patent or to grant a registration (utility model)JAPANESE INTERMEDIATE CODE: A01A01 | A01 | |
| Written decision to grant a patent or to grant a registration (utility model)JAPANESE INTERMEDIATE CODE: A01A01 | A01 | |
| Decision of grant or rejection writtenTRDD | TRDD | |
| Request for written amendment filedJAPANESE INTERMEDIATE CODE: A523A521 | A521 | |
| Notification of reasons for refusalJAPANESE INTERMEDIATE CODE: A131A131 | A131 | |
| Notification of change in applicantJAPANESE INTERMEDIATE CODE: A712A711 | A711 | |
| Written request for application examinationJAPANESE INTERMEDIATE CODE: A621A621 | A621 |
Numbers
- Publication
- 2003-199032
- Publication, DOCDB
- 2003199032
- Publication, EPODOC
- JP2003199032
- Application
- 283908
- Application, DOCDB
- 2002283908
- Application, EPODOC
- JP20020283908
Titles2
- Japanese
- 【発明の名称】画像識別装置、注文処理装置及び画像識別方法
- English
- INDUSTRIAL APPLICABILITY: Image identification device, order processing device, and image identification method.
Classification
- IPC, 11
- G06T1 00
- G06Q30 06
- G06Q50 00
- H04N5 232
- H04N5 76
- H04N5 91
- H04N7 173
- H04N7 18
- H04N21 24
- H04N21 258
- H04W4 02