Image synthesizer and its method

The present invention relates to an apparatus and a method for synthesizing a target image with a template image and generating a composite image in which the target image is combined.

With the development of digital image technology, it has become possible to read a photograph taken by a user with a scanner and capture and save it as digital image data in a personal computer. It is also possible to import multiple images into a personal computer and combine the images using the personal computer.

However, such image composition is still difficult for inexperienced people and beginners of personal computers. For this reason, a technique capable of relatively easily synthesizing images has been desired.

An object of the present invention is to make the operation of image composition relatively easy.

The image synthesizer according to the present invention corresponds to the template image data storage means, which stores the template image data representing the template image which is the background image of the target image to be synthesized in advance, and the template image. A mask image data storage means for storing mask image data representing a mask image for defining the composite position and the size of the composite area of the target image to be synthesized in the above, and a template stored in the template image data storage means. The target image represented by the given target image data is positioned on the image at the composite position and composite area defined by the mask image data stored in the mask image data storage means, and a composite image is generated. It is characterized in that it is provided with an image synthesizing means.

The present invention also provides an image compositing method. That is, the image composition method of the present invention corresponds to the template image data representing the template image which is the background image of the target image to be combined, and the composition position of the target image to be combined with the template image. And the mask image data representing the mask image for defining the size of the composite area is stored in advance, and the composite position and composite area defined by the mask image data on the pre-stored template image. In addition, it is characterized in that the target image represented by the given target image data is positioned and a composite image is generated.

According to the present invention, the template image data and the mask image data are stored in advance. When the target image data representing the target image to be combined is given, the composite image is obtained by positioning the target image represented by the target image data at the composite position defined by the mask image. Since it is only necessary to position the target image to be combined at the above-mentioned composition position, even a user who is unfamiliar with the operation of the personal computer can generate the composition image relatively easily.

Data representing the generated composite image may be stored in a storage medium. By reading the data representing the composite image stored in the storage medium, the composite image can be displayed or printed.

The screen display template image data and the print template image data having a resolution higher than the resolution of the screen display template image data are stored in advance, and the screen display mask image data and the screen display mask image are stored. The print mask image data having a resolution higher than the data resolution may be stored in advance. At this time, in the image composition process, when the image composition for the screen display is performed, the stored screen display template image data, the stored screen display mask image data, and a given target are used. When a composite image for screen display is generated from the image data and the image composition for image printing is performed, the stored print template image data and the stored print mask image data are given. A composite image for printing is generated from the obtained target image data.

In this case, the composite image for screen display will be displayed on the display device, and the composite image for printing will be printed.

High-resolution image data is required for high-quality composite image printing. On the other hand, high resolution required for printing is generally not required for display. If only high-resolution image data exists, thinning out of the image data is required for display. Then, the image cannot be displayed quickly. Although quick display is possible by using image data that matches the resolution of the display device, high-quality image printing cannot be expected.

The screen display template image data, the print template image data, the screen display mask image data, and the print template image data are stored in advance, and when the screen display is performed, various data for screen display are stored. When performing the above printing, image composition processing is performed using various data for printing, so that it can be performed quickly even in the case of screen display, and high-quality printing is also performed in the case of printing. Can be realized.

In this case, the positioning information used for positioning the target image for generating the composite image for screen display is used to position the target image for generating the composite image for printing, and the printing is performed. It is preferable to generate a composite image of.

This makes it possible to quickly generate a composite image for printing.

When there are a plurality of types of target image data representing the target image and there are a plurality of composite positions of the target image defined by the mask image represented by the stored mask image data, the image composition process is performed. The target image selected from the plurality of types of the target images represented by the given target image data may be positioned at the selected composite position among the plurality of composite positions, and the image composite process may be performed. ..

When the template image data stored in advance represents a plurality of types of template images, the mask image data also corresponds to the above-mentioned multiple types of template image data and represents a plurality of types of mask images. The target image represented by the given target image data is positioned on the selected template image among the template images at the position defined by the mask image corresponding to this template image, and a composite image is generated. ..

As a result, a plurality of target images can be positioned on one template image to generate a composite image.

Character image data representing a character may be input, and the input character may be further synthesized on the composite image.

Composite information including the size of the target image that can be combined with the template image is stored in advance corresponding to the template image data, and the target image represented by the given target image data is the size that can be combined. It may be determined whether or not the image has a template, and when it is determined that the image does not have a size that can be synthesized, a notification to that effect may be given.

If the target image to be combined with the template image is smaller than the size of the composition area defined by the mask image, a white frame or a black frame will be created in the combined image. The composite information is stored in advance, and if the target image does not have the size that can be composited, a notification to that effect is given. Therefore, the target image to be composited with the template image is defined by the mask image. Even if the size of the composited area is smaller than the size of the composited area, it is possible to prevent a white frame or a black frame from being formed in the composited image.

The image compositing device may be provided with an image medium reading device that reads the target image recorded on the visible image medium and outputs an image signal representing the target image. In this case, the image composition process will be performed using the image data generated from the target image signal output from the image medium reader. Here, the visible image medium means a medium such as a photograph, a film (including both a negative film and a positive film), a poster, and the like on which an image displayed therein can be viewed.

Since the image compositing device is provided with an image medium reading device, the user can perform image compositing using a desired image of the visible image medium as a target image.

The image synthesizer may be provided with a digital medium reader that reads and outputs the target image data from the digital medium. In this case, the image composition process will be performed using the target image data output from the digital media reader. Here, the digital medium refers to a medium for recording digital data representing an image, such as a magnetic disk, an optical disk, or a memory card.

Since the image synthesizer is provided with a digital medium reader, the user can synthesize a desired image stored in the digital medium as a target image.

An image memory is provided in the image synthesizer, and the target image data output from the image medium reader is DMA (Direct) to the image memory at a speed equal to or higher than the transfer speed of the target image signal output from the image medium reader. Memory Access) Good to transfer. The target image data stored in the image memory is given to the image compositing means.

Since it is not necessary to provide the image reader with a buffer memory for transferring the target image data, the cost can be reduced. The target image signal output from the image reader can be directly transferred to the image memory of the image synthesizer, and high-speed transfer of the target image signal can be realized.

The image medium reading device is configured by using a line sensor that reads an image from the visible image medium and outputs the target image signal, and a conveying means that relatively conveys the visible image medium and the line sensor. can do. When the image medium reader is configured in this way, the line sensor control means for controlling the output of the target image signal from the line sensor to the image synthesizer, and the target image output from the line sensor. A control means for controlling the transport means and the line sensor drive means is provided so that the signal transfer speed is kept below the write speed to the image memory.

When the visible image medium and the image pickup device are relatively transported, the transport speed can be relatively low. The above-mentioned transport means can be configured by using a relatively low-priced motor, and the cost can be reduced.

A photographic film having an elongated strip-shaped information recording unit made of a transparent magnetic material is being studied. In addition to images, various information (film information, frame information, etc.) can be magnetically recorded on this photographic film. It is also possible to record optical information (for example, barcodes, information indicating the size of an image depending on the presence or absence of dots, etc.) on a photographic film. An image medium reader that reads an image appearing on such a photographic film can be used for at least one of magnetically recorded information and optically recorded information from a photographic film with an information recording unit. It will be a film scanner that reads the images that are appearing. This makes it possible to synthesize an image using an image recorded on a photographic film provided with an information recording unit.

In addition, the photographic film equipped with an information recording unit is put in the cartridge so that it can be pulled out freely even after development in consideration of handling.

When the developed photographic film is freely pulled out and put in the cartridge, the film reading device stores the cartridge in the storage portion, the cover formed in the storage portion, and the storage portion. The storage detecting means for detecting that the cover is closed, the cover closing control means for closing the cover in response to the detection by the storage detecting means, and the cover closing control means for closing the cover in response to the closing of the cover. A film drawing means for pulling out the film from the cartridge is provided.

Then, the image and the information of each piece are read from the film drawn from the film drawing means.

When the cartridge containing the photo film is stored in the storage section, it is detected and the cover is closed. When the cover is closed, the photographic film is pulled out from the cartridge and the image recorded on the photographic film is read.

Since the cover is closed when the cartridge is stored, the photo film can be protected from dust and dirt even if the photo film is pulled out from the cartridge. The detection that the cartridge containing the photo film is stored in the storage unit may be based on a command from the user.

In still another embodiment of the present invention, the image synthesizer reads the target image displayed on the visible image medium and represents the target image in order to generate the target image data to be given to the image compositing means. An image reading device that outputs an image signal is further provided. Then, the template image data storage means, the mask image data storage means, the image composition means, and the image reading device are built in one housing.

Since many configurations of an image compositing device including an image reading device are built in one housing, it is sufficient to handle this housing, and it is easy to install the device and handle other devices. This image synthesizer is suitable for installation in various stores.

In still another embodiment, the image reader is housed in one case and unitized. The case is provided with a first connector. On the other hand, the housing is formed with a recess for accommodating the case of the image reading device, and a second connector is provided in this recess. The case of the image reader is detachably housed in the recess of the housing, and the first connector and the second connector are detachably connected to each other.

Since the image reader is unitized and built into the housing so that it can be freely inserted and removed, maintenance of the image reader (for example, replacement of light sources and other members, cleaning of magnetic heads and other members, etc.) is facilitated and a failure occurs. Sometimes the unit can be replaced and dealt with quickly.

Preferably, a cover that closes the recess of the housing is detachably attached to the housing.

An example of the image reading device is a film scanner that reads magnetically recorded information from a photographic film with an information recording unit and an image appearing on the film.

In still another embodiment, the image reader is a film scanner that reads an image appearing in a photographic film that is freely pulled out into a cartridge and outputs an image signal. The image synthesizer is provided with a display device that displays an image represented by an image signal output from the film scanner. The film scanner is provided with a storage recess for storing the cartridges, and is provided with a first cover for closing the opening of the storage recess. A patrone is inserted into the storage recess in the display device to indicate that the first cover should be closed.

As a result, the user can know the handling of the device (particularly the loading and unloading of the cartridge) by looking at the display device for displaying the image, and it is not necessary to separately instruct the user for guidance.

If a housing for accommodating the film scanner is provided, an opening is made at a position corresponding to the storage recess of the housing, and a second cover for closing the opening is provided. The display device displays the opening and closing of the second cover.

More preferably, the opening / closing device for the second cover and the input device for commanding the opening / closing of the second cover are further provided. After displaying on the display device, the switchgear opens or closes the second cover in response to a command input from the input device. This makes it possible to automate the opening and closing of the cover, and the user only needs to input the opening / closing command.

(1) Photo film with information recording unit Conventional type photo film (so-called 35 mm film) is a roll film that takes 12 frames, 24 frames, or 36 frames. After development, this photographic film is cut to a length of 6 pieces and is generally stored in a sheath. The conventional type photographic film only records the captured image and its frame number. Information about the target image (for example, information that simply represents the image, shooting date, shutter speed, etc.) is not recorded except for the frame number. Therefore, information about the target image other than the piece number must be written on the sheath or written down on another piece of paper. A new type of photographic film has been developed that can record information related to the target image such as information that simply represents an image that could not be recorded with a conventional photographic film, shooting date, shutter speed, and the like. In this embodiment, a case where a new type of photographic film is used will be described. Of course, it goes without saying that conventional types of photographic films, photographs, etc. can be used in image compositing devices.

FIG. 1 shows a new type of photographic film, that is, a photographic film with an information recording unit.

The terminal of the photo film 1 is fixed to a spool rotatably provided in the cartridge 5. FIG. 1 shows the state in which the photo film 1 is pulled out from the cartridge 5.

At the tip of the photographic film 1, several perforations 2a (or one or more notches) are formed to engage a part of the photographic film take-up shaft of the camera.

Except for the appropriate length of the tip, the entire photographic film 1 has an area 4 for recording images (this area is formed by photography and is shown in FIG. 1 for convenience of explanation. (Indicated by the chain line). In addition, an elongated strip-shaped optical information recording unit 6 is provided below the image recording area 4 (this area 6 is also formed by exposure, and is shown by a chain line in FIG. 1 for convenience of explanation. Has been).

Elongated strip-shaped information recording units 3b and 3d are provided on both sides of the image recording area 4. One of the information recording units 3d overlaps with the optical information recording unit 6. Further, one (or two or more) perforations 2b are formed between the other information recording units 3b corresponding to each image recording area 4. This perforation 2b is mainly used to position the image recording area 4 at the imaging position in the camera.

Information recording units 3a and 3c are also provided on both sides of the tip of the photo film 1.

The information recording units 3a, 3b, 3c and 3d are magnetic recording layers generally formed by applying a transparent magnetic material on a film. The information recording units 3a and 3b provided on one side of the photo film 1 are generally used in the laboratory. Information recording units 3c and 3d provided on the other side of the photo film 1 are generally used to record information (data) automatically in response to user input or by the camera. The optical information recording unit 6 is generally used by a manufacturer to record information.

The information recording unit (reader information recording unit) 3a and 3c at the tip is used for recording information (film information) related to one film 1. The information recording units (frame information recording units) 3b and 3d provided corresponding to each image recording area 4 are used for recording information (frame information) related to the image recorded in each area 4. The optical information recording unit 6 records information such as a manufacturer code.

As an example, the reader information recording unit 3c used by the user records comprehensive information related to the entire image taken using the photographic film. This information is called IX1.

The information recorded in the frame information recording unit 3d used by the user includes title information that the user inputs to the camera (the title simply represents an image, for example, "flower photograph", "animal photograph". , "Children's picture", "travel", etc.) and information automatically recorded by the camera (for example, the shutter speed used to take the image of the piece). This information is called information IX2. Only the information input by the user may be used as information IX2.

FIG. 2 shows the data arrangement (format) in the information recording units 3a, 3b, 3c and 3d of the photographic film. This data format applies to both information IX1 and IX2 and includes SS, VER, ID, LNG, DATA, LCR and ES.

SS is an abbreviation for Start Sentinal, which is a code that indicates the start of a data string. VER indicates the version of the recording format (standard). The ID represents the type of information recorded (IX1, IX2, etc.). LNG indicates the length of data that follows. DATA is data that represents information that you want to record or should record. LCR is a CRC check code. ES is an abbreviation for End Sentinal, which is a code that indicates the end of a data string.

One or more data strings in such a format are provided in one information recording unit 3a, 3b, 3c or 3d. For example, the frame information recording unit 3d records a data string representing data input by the user and a data string representing data to be written by the camera. If necessary, the same data string is recorded in parallel in the information recording unit in order to improve reliability.

(2) Camera for Photofilm with Information Recording Unit Fig. 3 shows a part of the configuration of a camera that can handle such a photofilm with an information recording unit. In this figure, the configuration related to recording in the information recording units 3a, 3b, 3c and 3d of the photographic film is mainly shown, and the configuration of the imaging optical system and the like is omitted.

The cartridge 5 is rotatably supported by a fork inside the camera. The tip of the photographic film 1 drawn from the cartridge 5 is wound around the photographic film winding shaft 16. A photoelectric sensor 12 for detecting perforations 2b is provided, and this detection signal is given to the control device 10. The control device 10 drives the motor 14 to rotate the take-up shaft 16 to sequentially take up the photographic film 1, and the photograph is taken so that the image recording area 4 comes to the image formation position based on the detection signal of the photoelectric sensor 12. Position film 1 for each shot.

A magnetic head 11 is provided on the traveling path of the magnetic information recording units 3c and 3d in order to record information in the magnetic information recording units 3c and 3d for the user. In the process of winding (running) the photofilm 1, the information input from the input device 15 by the magnetic head 11 or the control device 10 is generated under the control of the control device 10 via the head drive circuit 13. The information will be magnetically recorded in the magnetic information recording units 3c and 3d.

The input device 15 inputs numbers and characters. For example, the input device 15 includes a numerical key, an alphabet key, and the like. If necessary, the input device 15 includes a display device, and the key input information is displayed on the display device. In order to reduce the number of keys, the displayed character changes each time one key is pressed, and the user can select the displayed character.

(3) Image composition system 1) Overall configuration of the image composition system Fig. 4 is a perspective view of the entire image composition system.

This image composition system is installed in various places. For example, film photo labs (stores), photo stores, department stores, convenience stores, and other stores. This image composition system is generally operated by a customer (user). The operator may operate the image composition system in a place where an operator is resident, such as a film developing laboratory.

There are roughly two types of input media handled by this image composition system. One of them is to visually represent images such as photographic films (conventional type photographic films and photographic films with an information recording unit), photographs printed on photographic paper, and printed materials (photographs of posters, calendars, etc.). These are called visible image media. The second is to record (or store) digital data representing images of optical disks, magneto-optical disks, magnetic disks, memory cards, and the like. These are called digital media.

The image appearing on the photo film 1 with an information recording unit is read by a film scanner 42 (see FIGS. 7, 8, 10, 15, etc.) described later. There are two types of magnetic disks: ordinary floppy disks and large-capacity (high-density recording) floppy disks, and disk drivers 39,41 (see Fig. 15) are provided to read the image data recorded on these disks. ..

The image on a conventional type photographic film is read by a film scanner. Photos and printed matter printed on photographic paper are read by a flatbed scanner. The image data recorded on the optical disk is read by the optical disk driver. The image data recorded on the magneto-optical disk is read by the magneto-optical disk driver. The image data recorded in the semiconductor memory in the memory card is read by the memory card reader. These conventional photofilm scanners, optical disk drivers, magneto-optical disk drivers and memory card readers can be detachably connected to the image synthesizer 300 described below (Fig. 15 shows photomagnetism). Disk driver 46 and memory card reader 47 are shown).

The output medium of the image composition system is basically paper on which the composite image is printed. A printer 37 is provided for this purpose. Data representing a composite image can also be recorded on a magnetic disk by disk driver 39 or 41. In this case, the output medium includes a magnetic disk (normal floppy disk or large-capacity floppy disk).

The image compositing system includes an image compositing device 300, a monitor display device 33, and a printer 37. The image synthesizer 300 is placed on the rack 600, and the monitor display device 33 is placed on the image synthesizer 300. In the image synthesizer 300, a composite image is generated as described in detail later. This composite image is displayed on the monitor display device 33. The printer 37 is housed in a rack 600. The printer 37 is provided with a paper feed tray 520 and a paper output tray 510. The composite image generated by the image synthesizer 300 is printed by the printer 37 on the paper stored in the input tray 520. The paper on which the composite image is printed is ejected from the output tray 510.

FIG. 5 is a perspective view of the monitor display device 33.

A touch panel 32 (see FIG. 15) is provided on the display surface of the monitor display device 33. The display surface of the monitor display device 33 displays one or more sections to be touched by the user, operator, or maintenance man, as will be described in detail later. The user, operator or maintenance man inputs a desired command by touching any of the compartments. The signal representing the command given from the touch panel 32 is output through the signal cable 202 and given to the image synthesizer 300.

A signal cable 203 for inputting composite image data and other data provided by the image synthesizer 300 is connected to the monitor display device 33. The image represented by the image data given through the signal cable 203 is displayed on the display screen of the monitor display device 33.

A power cord 204 for supplying power is also connected to the monitor display device 33.

In addition, a brightness adjustment button and a bezel cover 201 for protecting other buttons are detachably provided at the bottom of the monitor display device 33.

2) Mechanical configuration of the image synthesizer Fig. 6 is a perspective view of the image synthesizer 300.

The front of the housing of the image synthesizer 300 has a floppy disk insertion slot 302 (which constitutes a part of the disk driver 39) and a large-capacity floppy disk insertion slot 303 (which constitutes a part of the disk driver 41). ) Are opened respectively. A front panel cover 301 for protecting these insertion slots 302 and 303 is detachably provided in the housing of the device 300.

A film scanner 42 is detachably built in the housing of the image synthesizer 300. In order to remove this film scanner from the housing of the image synthesizer 300, a part of the right side surface of the housing of the image synthesizer 300 is opened. This opening is closed by screwing the side plate 304 to the housing of the image synthesizer 300.

An opening is made in one side of the upper surface of the housing of the image synthesizer 300, and this opening is covered by a slide cover (outer lid) 305. The slide cover 305 can be opened and closed by a motor as described later. Opening the slide cover 305 exposes the film scanner 42 built into the housing of the image synthesizer 300.

A power cord 306 for inputting power is also connected to the image synthesizer 300.

7 to 9 are assembly perspective views of the image synthesizer 300.

With reference to Figure 7, the frame 400 includes a floppy disk driver 39, a high capacity floppy disk driver 41, a power supply circuit 330, a hard disk driver 40, and an MPU30, PCI48 (see Figure 15) and others. The main circuit board 420 in which the circuit is arranged is fixed. Screws 401 and 402 attach the beam 410 to approximately the center of the frame 400.

The scanner storage frame 390 is formed with a storage recess 395 for storing the film scanner 42. A mounting port 397 is formed at the back of the storage recess 395.

The scanner storage frame 390 is secured to the beam 410 by screws 394. The connector unit 396 is also fixed to the scanner storage frame 390 by screws 393. The connector unit 396 is provided with a connector 396A, which protrudes inside the scanner storage frame 390 through the mounting port 397. Another 396B electrically connected to this connector 396A is provided on the connector unit 396, and this connector 396B is connected to a connector provided on the circuit board 420.

The film scanner 42 is unitized within the case. The front of the case of the film scanner 42 is provided with a handle 352 for pulling the film scanner 42 out of the storage recess 395 of the scanner storage frame 390 and pushing it into the storage recess 395. A connector 354 is provided on the rear surface of the case of the film scanner 42. When the film scanner 42 is housed in the storage recess 395 of the scanner storage frame 390, the connector 354 is connected to the connector 396A of the connector unit 396. Data transmission and other signals can be transmitted and received between the film scanner 42 and each circuit of the circuit board 420. Preferably, the scanner storage recess 395 is made approximately the same size as the case of the film scanner 42, or just slightly larger. As a result, the film scanner 42 hardly moves in the recess 395 even if vibration or the like is applied.

As shown in Figure 8, the cover holder 360 is secured to the scanner storage frame 390 by screws 361. Two guide grooves 363 are formed on both sides of the cover holder 360. The slide cover 305 has a downwardly bent bend 308 on both sides of the slide cover 305. The bend 308 of the slide cover 305 enters the guide groove 363 of the cover holder 360. The slide cover 305 slides along the guide groove 363. A light-shielding piece 308 is provided on the back surface of the slide cover 305 so as to project downward.

A gear unit 380 is fixed to the underside of the cover holder 360 by screws 385. The gear unit 380 also includes a drive motor 381 for opening and closing the slide cover 305. The drive motor 381 is driven and controlled by power and control signals provided through a cable containing connector 384. A pinion 383 meshes with a gear 382 attached to the rotating shaft of the drive motor 381. On the other hand, the rack 309 is fixed to the lower surface of the slide cover 305. Pinion 383 meshes with rack 309 through opening 362 of cover holder 360. The slide cover 305 moves by rotating the drive motor 381 in the forward and reverse directions, and opens and closes the opening 305A opened in the cover frame 310.

A sensor unit 370 is further fixed to the underside of the cover holder 360 by screws 374. The sensor unit 370 detects whether the slide cover 305 is open or closed. The sensor unit 370 contains two photoelectric sensors 372 and 373, looking into opening 362. The photoelectric sensor 372 is composed of a light emitting element 372A and a light receiving element 372B that receives the emitted light of the light emitting element 372A. The photoelectric sensor 373 is also composed of a light emitting element 373A and a light receiving element 373B that receives the emitted light of the light receiving element 373A. When the slide cover 305 closes the opening 305A, a shading piece 308 enters between the light emitting element 373A and the light receiving element 373B to block the optical path, so that the slide cover 305 is closed from the photoelectric sensor 373. Is output as a detection signal. When the opening 305A is open, a light-shielding piece 308 is inserted between the light-emitting element 372A and the light-receiving element 372B, and the slide cover 305 is inserted from the photoelectric sensor 372. A detection signal indicating that is open is output. In this way, the open / closed state of the slide cover 305 is detected by the two photoelectric sensors 372 and 373. The output signals of the photoelectric sensors 372 and 373 are output to the outside by a cable having a connector 371.

The cables of the gear unit 360 and the cables of the sensor unit 370 are connected to the main circuit board 420 by their connectors 384 and 371, and from this circuit board 420 of the connector 396B, connector 396A, and film scanner 42 of the connector unit 396. It is connected to CPU 20 (see Figure 14) of the film scanner 42 through connector 354 (see also Figure 15).

With reference to FIG. 9, the image composition processing apparatus 300 is provided with a cover frame 310. As described above, an opening 304A for inserting and removing the film scanner 42 into and out of the image processing device 300 is formed on the right side surface of the cover frame 310. This opening 304A is covered by a side plate 304 that is screwed. An opening 305A is provided on the upper surface side of the cover frame 310. The slide cover 305 opens and closes this opening 305A.

There are openings 302A and 303A on the front of the cover frame 310. One opening 302 A is for exposing the insertion slot 302 of the floppy disk driver 39, and the other opening 303A is for exposing the insertion slot of the large capacity floppy disk driver 41.

3) Film scanner Fig. 10 is an assembled perspective view of the film scanner 42.

The cover 351 of the film scanner 42 is screwed to the case 354 by screws 357. An opening 353 is formed in front of the upper surface of the cover 351 to load the cartridge 5 of the photo film with an information recording unit and to take out the cartridge 5. When the film scanner 354 is stowed in the storage recess 395 of the scanner storage frame 390, this opening 353 coincides with the opening 305A of the cover frame 310 of the image synthesizer 300.

At the position corresponding to the opening 353 of the case 354, that is, on the left side of the front part of the case 354, the storage part 355 of the cartridge of the photo film with the information recording part is formed. The upper opening of the storage unit 355 is provided with an inner lid 355A that can be opened and closed by hand. On the right side of the front part of the case 354, the reel 24 for winding the photo film is arranged.

A film transport path is provided between the storage unit 355 and the reel 24. An optical path for the reading light of the film image is provided in an arrangement orthogonal to the transport path. That is, the light source assembly 359 is arranged in front of the transport path, and the reading optical system 356 is arranged behind.

FIG. 11 shows the configuration of the cartridge 5 of the photo film with the information recording unit. A spool 51 is rotatably supported in the center of the cartridge 5. In addition, one side of the cartridge 5 protrudes slightly, and the film outlet 52 is formed in this part. The outlet 52 is provided with a light-shielding lid 53. The ends of the shaft 54 for opening and closing the light-shielding lid 53 are exposed at both ends of the cartridge 5.

12 and 13 show the film storage unit 355 provided in the case 354 of the film scanner 42. The storage portion 355 has almost the same shape as the outer shape of the cartridge 5 and is a recess in which the cartridge 5 can be loosely inserted.

A pop-up mechanism, an inner lid 355A, and a lock mechanism for the pop-up mechanism (both not shown) are provided in the storage portion 355. The pop-up mechanism gently pops the cartridges 5 out of the compartment 355 and includes a spring that urges the cartridges 5 upwards. When the cartridge 5 is pushed into the storage portion 355 against the force of the spring, the pop-up mechanism is locked at a predetermined position. If the inner lid 355A is closed by hand in this state, the pop-up mechanism goes down one step and is locked to the final position. The cartridge 5 is positioned at this position.

The inner lid 355A is always kept open by a spring (not shown). When the inner lid 355A is closed by the user's finger against the force of this spring, the inner lid 355A is locked in the closed position by the locking mechanism. The closing of the inner lid 355A is detected by the inner lid closing detection sensor 28 (see FIG. 14).

By driving the inner lid opening motor 29 (see FIG. 14), the inner lid 355A and the pop-up mechanism are unlocked, the inner lid 355A is opened, and the pop-up mechanism brings the cartridge 5 upward. Therefore, the user can retrieve the cartridge 5 through openings 305A, 353. Pop-up and lock mechanisms are already known. Details of such an example are disclosed in a patent application by the same applicant (Japanese Patent Application No. 8-33632).

At the bottom of the storage section 355, a spindle 355B for winding the film drawer and a pin 355C for opening the light-shielding lid are provided. When the cartridge 5 is positioned in its final position within the housing 355, the spindle 355B engages the hole in the spool 51 and the pin 355C engages the hole in the shaft 54. By driving the film drawer storage motor 55 (see FIG. 14), the pin 355C rotates by a predetermined angle via a cam mechanism (not shown) to open the light-shielding lid 53 of the cartridge 5. Subsequently, the spool 51 is rotated by the rotation of the spindle 355B, and the film 1 in the cartridge 5 is extruded to the outside through the outlet 52 opened from the tip thereof. An introduction guide 57 is formed at the entrance and exit of the film of the storage portion 355 to guide the tip of the film extruded to the outside to the film transport guide 56 (see FIG. 14).

If the film drawer storage motor 55 is rotated in the reverse direction, the spool 51 is also rotated in the reverse direction, and the film 1 pulled out to the outside is stored in the cartridge 5. The light-shielding lid 53 is closed when the pin 355C is rotated in the reverse direction by a predetermined angle by a cam mechanism (not shown).

FIG. 14 shows the internal configuration of the film scanner 42. The transport path for film 1 is between the position of the storage section 355 where the cartridge 5 is stored and the position of the take-up reel 24. A transport guide 56 is provided in this transport path. The transport guide 56 corrects the bending of the film 1 which is housed in the cartridge 5 and has a bend, and is curved in an arc shape.

The light source assembly 359 and the reading optical system 356 are arranged so as to face each other with the transport guide 56 in between. The light source assembly 359 includes a light source 21 and an infrared cut filter 58. The reading optical system 356 includes a lens 22 and a CCD line sensor 23.

Further, a magnetic head 25 facing the roller, an optical information reading sensor 63, a capstan 62 facing each other, and a pinch roller 61 are arranged in the transport path of the film 1. Spindle 355B, film drawer / storage motor 55, pinch roller 61, capstan 62, etc. make up the film feeding mechanism.

The photo film 1 is pulled out from the cartridge 5 as described above, and is wound on a reel 24 via a transport path. Photofilm 1 is conveyed at a predetermined speed by the film feeding mechanism.

The film 1 to which the light from the light source 21 is carried is irradiated. The light representing the image represented in the image recording area of film 1 is imaged on the CCD line sensor 23 by the lens 22. The CCD line sensor 23 includes a large number (for example, 2048) photoelectric conversion elements arranged in a direction orthogonal to the longitudinal direction of the photographic film 1. In the process of sending the film 1, the image processing device 26 is given a video signal for each line from the CCD line sensor 23. When film 1 is sent for the length of one image recording area, image data for one frame is obtained (for example, when the film 1 is sent at the finest pitch, an image with a resolution of 2048 x 3584 pixels for the image recording area 4). Data is available).

The image processing device 26 is a signal processing circuit (white balance circuit, gamma correction circuit, negative / positive inversion circuit, etc.) that processes a video signal (or digital image data after A / D conversion) obtained from the CCD line sensor 23. (Including the necessary ones), A / D conversion circuit, etc. The digital image data obtained when the photographic film 1 is sent at the finest pitch is called the original digital image data. The original image data is given to the image memory 35 described later via the connector 354.

The feed rate of film 1 and the drive of the CCD line sensor 23 are controlled so that the transfer speed of the video signal output from the CCD line sensor 23 is kept below the speed at which the image data is written to the image memory 35. To.

The original image data is for printing. By reducing this original image data to 1/2 vertically and 1/2 horizontally, so-called high-definition image data can be obtained. Standard image data can be obtained by further reducing the high-definition image data to 1/2 in the vertical direction and 1/2 in the horizontal direction. Reduced image data can be obtained by further reducing this standard image data to 1/8 in height and 1/8 in width. Image reduction is performed by thinning out processing or averaging processing for each of a plurality of adjacent pixels. This reduction process is performed by the enlargement / reduction circuit 44 described later. Image data with different resolutions can also be obtained by changing the feed pitch of film 1 in the film scanner.

In the process of sending the film 1, the information magnetically recorded in the information recording units 3c and 3d is read by the magnetic head 25. The read signal is sent to the magnetic reading circuit 27. The magnetic reading circuit 27 adds necessary processing (demodulation, encoding, etc.) to the reading signal, and supplies it to the MPU30 described later via the connector 354. Further, the information recorded in the optical information recording unit 6 (this information is recorded in the film 1 by exposure in the form of the presence / absence of a point, a bar code, etc.) is read by the optical information reading sensor 63. This read signal is given to the MPU30 via the connector 354.

The CPU 20 included in the film scanner 42 controls the inner lid opening motor 29, the film drawer / storage motor 55, the film feeding mechanism, and other controls under the control of the MPU30. Further, the detection signal of the inner lid closed detection sensor 28 is sent to the MPU 30 via the CPU 20.

4) Electrical configuration of the image synthesizer Fig. 15 is a block diagram showing the electrical configuration of the image synthesizer.

This image synthesizer has two main functions. It is a photojoy print service (image composition processing) and a digital output service (image conversion processing).

In the photojoy print service, both visible image media and digital media are used as input media. A print, memory card, magneto-optical disk or magnetic disk is used as the output medium. In the photojoy print service, the template image stored in advance in the image synthesizer is combined with the image recorded on the input medium brought by the user and output.

In the digital output service, a visible image medium is used as an input medium. A digital medium is used as the output medium. In the digital output service, an image recorded on a visible image medium is read, converted into digital image data representing the read image, and recorded on the digital medium.

In this embodiment, the photojoy print service will be mainly described.

The overall operation of the image synthesizer is controlled by the MPU30.

The image synthesizer includes the above-mentioned floppy disk driver 39, hard disk driver 40, large-capacity floppy disk driver 41, and the interface (video interface) 34 of the scanner 42 and the display device 33, and the touch panel. -Interface 31, image memory 35 that temporarily stores image data and SCSI (Small Computer System Interface) 36, scanner interface 43, enlargement / reduction circuit 44 that enlarges and reduces the image represented by image data, PCI (Preipheral Component) Includes Interconnect) 48 and RAM 45 to temporarily store data.

The user performs the image composition processing according to the display of the display device 33. That is, the touch panel 32 is formed on the display screen of the display device 33. The touch panel 32 is connected to the MPU 30 via the interface 31. Guidance (consisting of illustrations, sentences, etc.) for guiding the operation and one or more sections to be touched are displayed on the display surface of the display device 33. Key functions (including numerical values) are displayed in each section. As a result, function keys and numeric keys are realized. An input signal indicating the position of the compartment touched by the operator or the user with a finger is given to the MPU30. Using this touch panel, the user selects the type of processing (service) (photojoy print service or digital output service), specifies the input medium, specifies the piece to be recorded or printed on the output medium, and the like.

The scanner interface 43 includes a DMAC (Direct Memory Access Controller) 43a, which controls the transfer of image data output from the scanner 42.

The enlargement / reduction circuit 44 is a circuit that performs enlargement / reduction processing of the image represented by the image data, and compression / decompression processing of the image data.

The scanner interface 43, scaling circuit 44 and PCI48 are interconnected by a PCI bus. The DMA controller 43A enables high-speed transfer of image data through the PCI bus. As a result, the image data output from the scanner 42 can be directly stored in the image memory 35 without providing a memory in the scanner 42. Since it is not necessary to incorporate the image memory in the scanner 42, the price of the scanner 42 can be kept low.

RAM45 stores data at one time. The image memory 35 stores image data read from the scanner 42 and the disk drivers 39 and 40.

The hard disk driver 40 writes data to the hard disk and reads data stored on the hard disk.

Floppy disk driver 39 and large capacity floppy disk driver 41 are input, from magnetic disk and large capacity magnetic disk as output medium, writing data including image data, or from magnetic disk, and large capacity magnetic disk, respectively. Is read, data is rewritten, etc.

The printer 37 prints an image represented by the given image data.

As described above, a film scanner for using a conventional photographic film as an input medium may be provided, and a flatbed scanner may be provided for using other visible image media.

A conventional photographic film scanner includes a light source, an imaging optical system, a line sensor (or a two-dimensional image sensor), a film or line sensor transfer mechanism, a signal processing circuit, an A / D conversion circuit, and the like. Flat bed scanner for the reflective original is flat with bets bed, reflective original to be read on the flat bed is placed. The light from the light source is projected onto the reflected document, and the reflected light from the reflected document is input to the line sensor or the two-dimensional image sensor. The video signal output from the line sensor or the image sensor is stored in the image memory 35 as digital image data after a predetermined process.

Further, as described above, a magneto-optical disk driver 46, a memory card reader 47, and the like can also be provided in the image synthesizer 300, if necessary.

(4) Hard disk file structure Figures 16 to 18 show the hard disk file structure (data structure) included in the image synthesizer. This shows the logical file structure, not the physical structure. The various data shown in FIGS. 16 to 18 may not be in a continuous state as a group, but may be in a dispersed state. If the image synthesizer has multiple hard disks, the data will be distributed on the multiple hard disks even if all the data shown in FIGS. 16 to 18 do not exist on one hard disk. It may be recorded.

The hard disk is for the directory management area that manages all the data recorded on the hard disk, the OS recording area where the OS (Operating System) is recorded, the photojoy print service, and the digital output service. Application software recording area where the software is recorded, template data recording area where template image data representing the template image that is the background image of the target image to be combined is recorded, target image to be combined on the template image Includes a mask data recording area where mask image data representing a mask image that defines the composite position and composite area of the software is recorded, a composite information recording area that stores composite information used for image synthesis, and an unused area. It has been.

Figure 17 shows the details of the template data recording area.

The template image data includes the screen display template image data used when generating the composite image displayed on the display screen of the display device 33, and the screen display used when printing the composite image using the printer 37. There is template image data for printing with a higher resolution than the template image data for printing. The template image data recording area includes a screen display template image data recording area and a print template image data recording area. The screen display template image data and the print template image data are recorded in the screen display template image data recording area and the print template image data recording area, respectively.

The screen display template image data recording area and the print template image data recording area are further recorded areas according to the type of template image (decoration screen display template image data recording area, photo frame screen display template image data recording area, respectively. Etc.), and template image data corresponding to the type of template is recorded in each of these areas.

In addition, there are multiple types of templates within the same type. For example, decoration templates have types (types 1, 2, etc.) such as the number of target images and whether the display direction is vertical or horizontal, and template image data is stored for each type.

There are several different decoration types within the same template type. For example, if it is a decoration template and the target image is placed three frames horizontally, there are different decoration types (for example, wedding decoration, entrance ceremony decoration, etc.). Template image data is stored for each type of decoration.

Templates are therefore hierarchically categorized into types, types and decoration types, all of which need to be defined. When all the types, types and decoration types are determined, one type of template image is selected, and the target image is combined with the selected template image.

Similar to the screen display template image data, the print template image data is also recorded as a hard disk print template image data according to the number of screen display template image data for each type, type, and decoration type. Recorded in the area.

Figure 18 shows the details of the mask data recording area.

The mask image data also has a type, type, and decoration type corresponding to each of the template image data, and an area for recording each data is provided.

In the template data recording area and the mask data recording area, template image data and mask image data compressed in the form of bit map data are recorded.

Refer to FIG. 16 again, and in the directory management area, the path to the template image data for displaying each screen (the path is the information necessary for the computer to access the storage location where each data is stored),. The path to each print template image data, the path to each screen display mask data, the path to each print mask image data, and other data are stored. By referring to these paths stored in the directory management area, it is possible to access each image data.

Information used for image composition is stored in the composite information recording area. The composite information includes the number of composite images, the position information of the composite specified range (the position and range where the target image to be composited should be placed on the template), the number of titles, the title composite position, the title / font type / face name, and the title. -There are font size, title font color, and title layout.

The number of composite images represents the number of target images to be composited in the template. The position information of the composite specified range represents the position and size of the composite specified range that defines the size required for the target image to be synthesized in the template image (details will be described later). The number of titles represents the number of titles when a title is added to the template image as described later. The title composition position indicates the start position of the title when the title is added on the template image (details will be described later). Title font type The face name indicates whether the title is Gothic. The title font size represents the size of the font used for the title (size, number of points, etc.). The title font color represents the color that represents the title. The title layout indicates whether the title is left-justified, centered, or right-justified.

Such composite information is stored in the composite information recording area as code data corresponding to the template image data (template image data of all combinations of types, types and decoration types) recorded in the template data recording area. It has been recorded.

Figure 19 (A) shows an example of a template image. An example of a mask image is shown in FIG. 19 (B). Figure 19 (C) shows an example of synthetic information. Template image data representing such a template image is recorded in the template data recording area, mask image data representing the mask image is recorded in the mask data recording area, and data representing the composite information is recorded in the composite information recording area. To.

20 and 21 are for explaining the position information of the synthesis regulation range and the title composition position information included in the composition information. Synthesis regulation range S_yn(N is the number of the synthetic specified range, which is 1 to 3 in the examples shown in FIGS. 20 and 21) is determined by the starting position and size. The start position is the composite specified range S when the origin (0,0) is the upper left corner of the template image._ynIt is indicated by the coordinates (xsf, ysf) of the upper left corner of (f is also the number of the composition specified range and is 1 to 3 in the example shown in FIGS. 20 and 21). The size of the composite specified range is represented by the number of dots, the horizontal size is xnf, and the vertical size is ynf (f is the number of the composite specified range).

If the target image to be combined with the template image is smaller than the size of the corresponding composition specified range, a white frame or a black frame will be created in the combined image. Therefore, when the target image is smaller than the size of the composite specified range, a notification to that effect is given. As a result, when the target image to be combined with the template image is smaller than the size of the above-mentioned composition specified range, it is possible to prevent a white frame or a black frame from being formed in the combined image.

The title composition position and size are also defined by the start position (xst, yst) and the horizontal size xnt and the vertical size ynt (expressed by the number of dots).

(5) Image composition Fig. 22 schematically shows the relationship between the template image, the mask image, the target image to be combined, and the composite image in order to explain the image composition process.

In image composition, a template image is selected by the user, and template image data representing the selected template image is read from the hard disk. Also, the mask image data corresponding to the selected template image data is read from the hard disk. Subsequently, the target image data to be synthesized is read out from the visible image medium or digital medium brought by the user.

When the target image to be combined and the mask image are superimposed, the composition area part A_W (Mask part A indicated by hatching_M The target image of the part corresponding to (other than) is composited on the template image, and a composite image is generated. Mask part A_M The target image of the part corresponding to is not combined on the template image. On the other hand, the composite image area part A of the mask image_W The positional relationship between the image and the target image to be combined is adjusted by the user who operates the image composition device. The detailed operation of image composition will be clarified by the following explanation.

(6) Various processes in the image synthesizer FIGS. 23 to 29 are flowcharts showing processing procedures of various processes including a photojoy print service in the image synthesizer. 30 to 57 show an example of a screen displayed on the display device 33 of the image synthesizer. The data for displaying the screen of the display device 33 is recorded in the application software recording area unless otherwise specified.

1) Setting the security code The security code is stored in the memory of the image synthesizer in advance. When the maintenance man inputs the password and the entered password matches the password stored in the memory, the display device 33 displays a predetermined start screen for canceling or changing various processes in the image composition system. It can be displayed. The security code is set by the maintenance man. The setting of this password will be described.

In the initial state, the start screen as shown in FIG. 30 is displayed on the display device 33 (step 121). Section A on the start screen_S1~ A_S5It is included. Maintenance man's finger is compartment A_S1Touch to move to various service processing (photojoy print service, digital output service, etc.) described later. Maintenance man's finger is compartment A_S2Touch to move to various maintenance processes such as adjusting the color of the image displayed on the display device 33. Maintenance man's finger is compartment A_S3Touch to move to the security code setting process. Maintenance man's finger is compartment A_S4Touch to move to the OS menu display screen. Maintenance man's finger is compartment A_S5Touch to move to service management processing such as fee collection for using the image composition system.

The maintenance man's finger is in compartment A to set the PIN_S3Touch (YES in steps 122 and 123). Then, the environment setting screen shown in FIG. 31 is displayed on the display device 33 (step 124).

Partition A on the environment setting screen₀₁~ A₀₄It is included. The image composition system can connect peripheral devices of different manufacturers even if they are the same type of peripheral devices. For example, a film scanner made by company A can be connected, or a film scanner made by company B can be connected. When connecting peripheral devices of different manufacturers, it is necessary to set the output speed of image data, etc. according to the manufacturer of the peripheral device. In this way, the section touched by the maintenance man's finger to set the peripheral device is A.₀₁Is. Maintenance man's finger is compartment A₀₂By touching, the process shifts to the process of setting various processes in the image synthesizer. Maintenance man's finger is compartment A₀₃By touching, the process shifts to the password setting process. Maintenance man's finger is compartment A₀₄Touch to return to the start screen shown in Fig. 30.

Partition A by the maintenance man's finger to set the PIN₀₃Is touched (YES in step 125). Then, the password setting screen shown in FIG. 32 is displayed on the display device 33 (step 126).

Section A on the PIN setting screen₀₅, A₀₆And A₀₇In addition, a message prompting you to enter a numeric key from 0 to 1 and a password is displayed. The PIN is entered by the maintenance man using the numeric keys (step 127). Section A in response to the PIN being entered₀₅An asterisk is displayed in. Parcel A₀₅Is displayed as an asterisk instead of the entered number, so partition A₀₅It is possible to prevent the password from being known to others by seeing it. Maintenance man's finger is compartment A₀₆By touching, you can correct the entered security code. Maintenance man's finger is compartment A₀₇By touching, the security code entered by the maintenance man is confirmed.

The PIN is entered by the maintenance man using the numeric keys, and compartment A is entered by the maintenance man's finger.₀₇When is touched and the security code is confirmed, the security code reset screen is displayed as shown in Fig. 33 (step 128). The maintenance man re-enters the PIN using the numeric keys (step 129). It is determined whether the re-entered PIN is the same as the already entered PIN (step 130). If it is determined that the already entered PIN and the re-entered PIN are the same number (YES in step 130), it is stored in RAM45 as a valid PIN (step 132). This completes the password setting process. The display screen of the display device 33 returns to the start screen shown in FIG. If the already entered PIN and the re-entered PIN are different (NO in step 130), the display screen of the display device 33 becomes a screen prompting the reset of the PIN as shown in FIG. 34 (NO). Step 131). According to this message, the maintenance man resets the password (steps 127 to 130).

2) Image compositing process When the start screen as shown in Fig. 30 is displayed (step 121), the maintenance man (or the operator of the store where the image compositing device is placed) fingers the compartment A._S1By touching (NO in step 123, YES in 143). The display of the display device 33 becomes the general service screen shown in FIG. 35 (step 144).

On the general service screen, partition A touched by the finger of the maintenance man (or operator) when starting the process.₀₈And compartment A touched by the finger of the maintenance man (or operator) when terminating the process in the image compositing system₀₉And are included. Partition A by the finger of the maintenance man (or operator)₀₈Is touched to display the service selection screen as shown in Fig. 36 (YES in step 145, step 147).

This service selection screen has three compartments A surrounded by a frame₁₀, A₁₁And A₁₂Is displayed. These compartments A₁₀, A₁₁And A₁₂Of which compartment A₁₁When the user touches the top, the photojoy print service is started, and the screen of the display device 33 is switched to the input medium selection screen as shown in FIG. 37 (step 148, FIG. 24, step 48).

Section A in Figure 36₁₂Is touched by the user when performing a digital output service on the image synthesizer 300. Parcel A₁₀Is touched by the user when returning to the previous screen. Parcel A₁₂When is touched, the screen is switched to a screen suitable for digital output service, but since it has nothing to do with image composition processing, further explanation is omitted.

Refer to FIG. 37, and on the input medium selection screen, the section A surrounded by a frame₂₁, A₂₂, A₂₃, A₂₄, A₂₅And A₂₆Is displayed. Parcel A₂₁Is a section touched by the user when the input medium is a photo film with an information recording unit, and section A₂₂Is the compartment touched by the user when the input medium is a conventional type photo film, compartment A₂₃Is the section touched by the user when the input medium is a reflective document, and section A₂₄Is the compartment touched by the user when the input medium is a magneto-optical disk, compartment A₂₅Is the partition touched by the user when the input medium is a magnetic disk, partition A₂₆Is a partition touched by the user when the input medium is a memory card.

Parcel A₂₁~ A₂₆The section that matches the input medium is touched by the user (step 49). The scanner 42, floppy disk driver 39, magneto-optical disk driver 46, or memory card reader 47, which is suitable for the input medium, is selected by the user, and the input medium is mounted.

Here, partition A by the user₂₁Is touched, and it is assumed that Photofilm 1 with an information recording unit is selected as the input medium (YES in step 50). When the new photo film is selected as the input medium, a guide (first insertion guide) for mounting the new photo film on the image synthesizer is displayed on the display device 33 as shown in FIG. 38 (step 51). .. This first insertion guidance screen has a framed section A₁₃And A₁₄It is included. Parcel A₁₄Is the compartment touched by the user when opening the slide cover 305. Parcel A₁₃Is the section touched by the user when canceling the reading of the image represented on the photographic film. Partition A by user₁₄When is touched, that fact is notified to the CPU 20 via the MPU30. The CPU 20 drives the drive motor 381 included in the film scanner 42. This opens the slide cover 305 (step 52). Section A on the first insertion guidance screen₁₄A message prompting you to touch is also displayed.

When the slide cover 305 is opened, the display device 33 displays a second insertion guidance screen as shown in FIG. 39 (step 53). On the second insertion guidance screen, a message and an image prompting the user to open the inner lid 356 of the film scanner 42 and store the photographic film in the storage unit 355 are displayed. While watching this second insertion guide, the user pushes the cartridge 5 into the storage unit 355.

The display screen of the display device 33 switches to the third insertion guidance screen as shown in FIG. 40 (step 54). A message and an image prompting the film scanner 42 to close the inner lid 355A are displayed on the third insertion guidance screen. The user closes the inner lid 355A of the film scanner 42 while watching this third insertion guide.

When the inner lid 355A of the film scanner 42 is closed (YES in step 55), it is detected by the inner lid closed detection sensor 28 and the detection signal is input to the CPU 20. As a result, it is detected that the inner lid 355A is closed, and a fourth insertion guide is displayed on the display screen of the display device 33 as shown in FIG. 41 (step 56). Section A for the fourth insertion guide₁₅Is also included. Parcel A₁₅Is the compartment touched by the user when giving a command to close the slide cover 305. Section A on the screen of the 4th insertion guide₁₅A message prompting you to touch is also displayed.

Partition A by user₁₅When is touched (YES in step 57), the CPU 20 drives the drive motor 381 and closes the slide cover 305. Then, the display screen of the display device 33 switches to the template type selection screen shown in FIG. 42 (step 58). Whether the inner lid 355A of the film scanner 42 is detected by the inner lid closing detection sensor 28 (NO in step 55), or compartment A included in the screen of the fourth insertion guide shown in FIG.₁₅If is not touched for a certain period of time (NO in step 57), the display of the second insertion guide shown in FIG. 39 and the third insertion guide shown in FIG. 40 is repeated (steps 53 and 54).

All images recorded on the new photo film mounted on the film scanner 42 are read. The image data representing the read image is thinned out in the enlargement / reduction circuit 44 to obtain the image data representing the reduced image. This reduced image data is stored on the hard disk.

In the template type selection screen shown in Fig. 42, section A₃₀, A₃₁, A₃₂, A₃₃, A₃₄, A₃₅, A₃₆, A₃₇, A₃₈And A₃₉Is displayed. Parcel A₃₀Is a section touched by the user when printing with a large index (a large index is a list of a plurality of images recorded on an input medium). Parcel A₃₁Is a section touched by the user when printing with a photo frame (a photo frame represents an image recorded on an input medium like a photo displayed on a photo stand). Parcel A₃₂Is a section touched by the user when printing on a cover poster (a cover poster represents an image recorded on an input medium such as a magazine or a poster). Parcel A₃₃Is a section touched by the user when printing with a calendar (a calendar represents an image recorded on an input medium as a part of the calendar). Parcel A₃₄Is a section touched by the user when printing with decoration (decoration represents an image in which a part or all of an image recorded on an input medium is extracted and the extracted image is decorated).

Parcel A₃₅Is a section touched by the user when printing with a large stretch (a large stretch is an enlargement of an image recorded on an input medium). Parcel A₃₆Is a section touched by the user when printing with art (art is to decorate an image recorded on an input medium). Parcel A₃₇Is a section that is touched by the user when printing in multi-size (multi-size represents multiple identical target images of different sizes). Parcel A₃₈Is a section touched by the user when printing with digital direct (digital direct represents an image represented by image data read from the digital medium when the input medium is a digital medium). Parcel A₃₉Is a partition that is touched by the user when a template type description is needed.

Partition A by user₃₄Is touched and the decoration is selected (YES in step 59). Parcel A₃₄When a section other than the above is touched by the user, the display of the display device 33 is switched according to the touched section.

Parcel A₃₄When is touched by the user, the display screen of the display device 33 switches to the menu explanation screen shown in FIG. 43 (step 60). Area A is displayed on the menu explanation screen.₄₁, Section A₄₂, A₄₃And A₄₄Is displayed. Area A₄₁A descriptive text is displayed indicating what the template selected by the user looks like and what kind of target image is suitable for compositing. When there are many descriptive texts, all the descriptive texts of the selected template are displayed in area A.₄₁Cannot be displayed on. For this reason, it is the section A that is touched to scroll the screen and read the explanation.₄₃Or A₄₄Is. Also section A₄₂When the user touches, the screen returns to the template type screen shown in FIG. 40. A new section (not shown) is displayed on the last page of the menu description. When the user touches this section, the display screen of the display device 33 switches to the template type selection screen shown in FIG. 44 (step 61).

There are many types of templates such as decorations, calendars, cover posters, etc., and one of them has a template type. When selecting the template type, the template type selection screen shown in FIG. 44 is displayed on the display device 33.

Partition A on the template type selection screen₅₁, A₅₂, A₅₃, A₅₄, A₅₅And A₅₆And A₄₂Is displayed. Parcel A₅₁Is a section touched by the user when arranging the images of three frames vertically on the template and synthesizing the images. Parcel A₅₂Is a section that is touched by the user when the images of 5 frames are arranged vertically on the template and the images are combined. Parcel A₅₃Is a section that is touched by the user when the images of 8 frames are arranged vertically on the template and the images are combined. Parcel A₅₄Is a section that is touched by the user when arranging the images of three frames horizontally on the template and synthesizing the images. Parcel A₅₅Is a section that is touched by the user when the images of 5 frames are arranged horizontally on the template and the images are combined. Parcel A₅₆Is a section that is touched by the user when the images of 8 frames are arranged horizontally on the template and the images are combined. Parcel A₅₁~ A₅₆When any of the sections is touched by the user (step 62), the display screen of the display device 33 switches to the template decoration type selection screen shown in FIG. 45 (step 63).

There are many types of selected templates (number of frames and placement direction of images to be combined with the template), and one of them is a template decoration type. When selecting this decoration type, the decoration selection screen shown in FIG. 45 is displayed on the display device 33 (step 63).

Area A on the decoration selection screen₆₀And compartment A₁₀And A₁₃Is displayed. Area A₆₀Has multiple compartments for selecting template decorations. The user is in area A₆₀Touch the compartment that represents the desired decoration among the compartments inside (step 64).

By selecting all the template types, types and decoration types in this way, the template used for image composition is specified.

When the template is specified, the template image data is expanded, the target image to be combined with the template is selected, the target image is combined with the template image, and the composite image data for printing is generated (step 65, FIG. 46). ~ Figure 51). Each of these processes will be described in detail later.

When the image composition is completed on the display screen of the display device 33 (when the process of step 65 is completed), a screen for confirming whether to insert characters in the composite image is displayed on the display screen of the display device 33 as shown in FIG. Is done (step 66). In this confirmation screen, in addition to the combined image, section A₁₀, A₄₂, A₇₆And A₇₇Is displayed. When adding characters, partition A by the user₇₇Is touched, and if no characters are added, the user will use partition A.₇₆Is touched. Parcel A₇₇When is touched (YES in step 67), keys such as hiragana, katakana, alphabet, and symbols are displayed on the display screen of the display device 33 (step 68). The user can add characters to the synthesized image by touching those keys displayed on the display screen of the display device 33.

When the character input to the combined image is completed or the character input is unnecessary, the print confirmation screen shown in FIG. 53 is displayed on the display screen of the display device 33 (step 69). Partition A when confirmed by the user₁₃Is touched. If the image displayed on the display screen of the display device 33 is not printed, the user may use section A.₁₀Is touched, and the display screen of the display device 33 is returned. Partition A by user₁₃When is touched, the display screen of the display device 33 switches to the print number confirmation screen shown in FIG. 54 (step 70).

On the print sheet confirmation screen, section A₁₀, A₁₃, A₆₁And A₈₁And area A₈₀Is displayed. Area A₈₀Displays numeric keys from 0 to 9. When these numerical keys are touched by the user, the number of printed sheets is input. The number of printed sheets entered is section A₈₁Is displayed in. If the user makes a mistake, partition A₆₁Is touched and the number of prints is input again. When the number of prints is confirmed, section A₁₃Is touched by the user. Parcel A₁₃When is touched, the display screen of the display device 33 switches to the printing display screen shown in FIG. 55 (step 71).

Area A on the printing display screen₈₆, Section A₈₃, A₈₄And A₈₅Is displayed. Area A₈₆Shows a simple animation during printing. When you stop printing, you can use partition A₈₃Is touched, and when the template is changed and another print is performed, the user divides the section A.₈₄Is touched. Partition A by the user when printing is complete₈₅Is touched. Parcel A₈₅Is touched by the user, the display screen of the display device 33 becomes the print end screen shown in FIG. 56 (step 73).

Section A on the print end screen₇₆And A₇₇Is displayed. Parcel A₇₆Is the partition touched by the user when printing ends, partition A₇₇Is a section that is touched by the user when printing continues. Parcel A₇₆When is touched (NO in step 74), the display screen of the display device 33 is switched to the guide screen to take out the new photo film attached to the image synthesizer (step 75). When the new photo film is taken out from the image synthesizer, the display screen of the display device 33 switches to the general service screen shown in FIG. 35 (Fig. 23, step 144). Parcel A₇₇When is touched (YES in step 74), the display screen of the display device 33 is switched to the template type selection screen shown in FIG. 42 (step 58 in FIG. 24). This allows the user to select the template again and print it.

In this embodiment, only the composite image synthesized on the template is printed, but the image data representing the composite image may be recorded on a digital medium. In this case, when the user brings a digital medium as an input medium, it may be recorded on the digital medium brought by the user, or it may be a different digital medium.

3) Termination of service using the PIN code The service is terminated by the maintenance man using the PIN code. This is to prevent the user from terminating the service without permission.

When the general service screen shown in FIG. 35 is displayed on the display screen of the display device 33, the maintenance man's finger is used to plot A.₀₉When is touched, the process shifts to the termination process of the service using the password. Section A by maintenance man's finger₀₉When is touched (YES in step 146 of FIG. 23), the password input screen shown in FIG. 57 is displayed on the display screen of the display device 33 (step 153 of FIG. 26).

Refer to Fig. 57, and the password entry screen is displayed in Section A.₀₅, A₀₆, A₀₇And A₁₀In addition, a message prompting you to enter a numeric key from 0 to 1 and a password is displayed. Section A in response to the PIN being entered₀₅An asterisk is displayed in. Parcel A₀₆Can be touched by the maintenance man's finger to correct the entered PIN. Parcel A₀₇Is touched by the maintenance man's finger to confirm the entered PIN. Parcel A₁₀Is touched by the maintenance man's finger to cancel the service termination process and return to the general service screen (Fig. 35) of Fig. 35.

When the PIN code entered by the maintenance man matches the PIN code stored in RAM45 (YES in step 155), the service is terminated and the start screen (Fig. 30) is displayed on the display screen of the display device 33. Is done (step 157). If the PIN entered by the maintenance man does not match the PIN stored in RAM45 (NO in step 155), the PIN is incorrect on the display screen of display device 33 as shown in Figure 34. Is displayed (step 156). If the PIN code entered by the maintenance man is incorrect multiple times in a row, the PIN code entry will be prohibited.

4) Details of image composition processing FIGS. 28 and 29 are flowcharts showing detailed processing procedures of image composition processing, and correspond to the processing of FIG. 27, step 65.

When the template image is specified by the user as described above (Fig. 25, step 58 to Fig. 27, step 64), it corresponds to the screen display template image data representing the specified template image and the screen display template image data. The print template image data is read from each hard disk. The read screen display template image data and print template image data are given to the image memory 35 and temporarily stored. The print template image data is read from the image memory 35 and given to the enlargement / reduction circuit 44. Since the print template image data stored in the hard disk is data-compressed, the data is decompressed in the enlargement / reduction circuit 44 (step 81). The data-stretched print template image data is again given to the image memory 35 and stored.

The screen display mask image data and the print mask image data corresponding to the screen display template image data and the print template image data read from the hard disk are read from the hard disk. Since the print mask image data is also data-compressed, the data is decompressed in the enlargement / reduction circuit 44 (step 82). The expanded print mask image data is also given to the image memory 35 and temporarily stored.

Furthermore, the composite information corresponding to the template image specified by the user is also read from the hard disk and temporarily stored in the RAM 45 (step 83).

Subsequently, the image selection screen shown in FIG. 46 is displayed on the display screen of the display device 33 (step 84). Area A on this image selection screen₆₂And A₆₃And compartment A₁₀, A₁₃, A₁₄, A₁₅, A₁₆, A₆₁And A₆₄Is displayed.

Area A₆₂Lists the reduced images represented by the reduced image data of the image read from the new photo film brought by the user (already stored on the hard disk as described above). That is, all the images recorded in the new photographic film are read out, image data representing the read images is given to the enlargement / reduction circuit 44, and reduction processing is performed to obtain a reduced image. The image data representing this reduced image is stored in advance on the hard disk. Since the reduced image data representing the reduced image is stored in the hard disk in this way, it is read from the hard disk and given to the display device 33, and the area A₆₂Will be displayed in. Area A₆₂When the user touches the desired reduced image among the reduced images displayed in, the image to be combined on the template image is selected. The image selected by the user is in area A₆₃It will be displayed in the section of.

Since the number of target images that can be combined with the template image is determined by the type of template (see Fig. 44), the user can select as many target images as the number corresponding to this type. The number of pieces that can be selected by the user is division A₆₄Is displayed in.

Parcel A₁₅And A₁₆Is region A due to the large number of images₆₂This is the section that is touched by the user when all the images recorded in the new photo film cannot be displayed. Parcel A₁₅Or A₁₆Area A by touching₆₂The reduced image displayed in changes. When the image to be displayed in the template image (3 frames in this embodiment) is selected by the user, the partition A is selected by the user.₁₃Is touched. As a result, the target image to be combined with the template image is determined. When the desired image is in the cartridge of a new photo film other than the new photo film mounted in the storage section 355 of the scanner 42, the section A by the user.₁₄Is touched.

Partition A by user₁₃When is touched, the display screen of the display device 33 switches to the inset screen as shown in FIG. 47 (step 89). Area A on the inset screen₇₁, A₇₂, A₇₃, A₇₄And A₇₅In addition to compartment A₁₀, A₁₃And A₆₁Is displayed.

Area A₇₁Displays a section for adjusting the size of the target image to be combined with the template image. The user is in area A₇₁By touching the section of, the size of the target image becomes larger or smaller. Area A₇₂Displays a section that defines the angular positional relationship between the target image to be combined with the template image and the template image. The user is in area A₇₂By touching the section of, the target image is rotated by a desired angle. Area A₇₃Displays a section for adjusting the position of the target image to be combined with the template image and the composition area of the template image. The user is in area A₇₃By touching the inner section, the target image moves up, down, left or right. Area A₇₄Displays the reduced image selected in FIGS. 46 (steps 85-87). Area A₇₅Displays the template image selected by the user. Area A₇₅As the template image displayed in, the template image data for screen display stored in the image memory 35 is used. Since the resolutions of the template image data for screen display and the mask image data for screen display are defined in advance for screen display, it is not necessary to reduce or enlarge the image in order to display it on the display device. Therefore, quick display is possible. Needless to say, the enlargement or reduction process may be performed.

Area A₇₄The target image of the first frame to be combined with the template image is selected by the user from the target images displayed in. This selection is in area A₇₄This is done by the user touching on the image displayed in (step 90). When the selection of the image of the first frame is completed, the message displayed on the screen is changed as shown in FIG. 48, and the position of the area for synthesizing the selected target image is specified. This position designation is performed by the user touching on the desired composite area of the template image. Area A if necessary when location is specified₇₁, A₇₂And A₇₃The size, angle (rotation), and alignment of the target image to be combined with the template image are adjusted using the section of (steps 91, 92). When these processes are completed, the display screen of the display device 33 displays the target image selected by the user as shown in FIG. 49 in a desired composite area of the template image. Furthermore, the information of position designation, size adjustment, angle (rotation) adjustment, and alignment performed at this time is stored in the RAM 45 corresponding to the selected image.

The images of the second and third frames are selected and combined with the template image in the same manner as the composition of the image selected in the first frame with the template image (steps 93 to 97, FIGS. 49, 50). For the second and third frames, the position designation, size adjustment, angle (rotation) adjustment, and alignment information are stored in the RAM 45 corresponding to the selected image in the same manner as for the first frame.

As described above, the image composition on the display screen of the display device 33 is completed (FIG. 51).

Next, image composition for printing will be described.

FIG. 58 shows an example of the image recorded on the new photo film brought by the user. Figures 59 (A), (B) and (C) show an example of an image used in image composition for printing. FIG. 60 shows an example of a printed composite image.

In the image composition for printing, among the images recorded in the new photo film brought by the user, the target image selected in the image composition of the display screen of the display device 33 (Fig. 28, steps 85 to 87) is the scanner 42. Is read from the new photo film and the image data representing the image is stored in the image memory 35 (step 101). The IX information recorded in the new photo film is used to determine which image should be read. That is, an image having IX information that identifies the reduced image selected by the user is read from the new photo film. Except for the new photo film, images will be selected frame by frame, composited on the screen, and composited images will be printed.

The size of the target image represented by the image data stored in the image memory 35 usually does not match the size of the template image represented by the print template image data. Therefore, the size of the target image is resized from the size adjustment and angle (rotation) adjustment information obtained in the image composition on the display screen of the display device 33 so as to match the size of the template image for printing. (Step 102). The target image after this resizing is shown in Fig. 59 (A).

Next, the range of the image to be combined with the template image is the size adjustment and angle (rotation) adjustment information or the composition specified range S obtained in the image composition on the display screen of the display device 33._y It is determined by referring to. The range of images to be combined is shown by the dashed line for the image shown in Fig. 59 (B). This range is defined by the mask image._y If it is smaller than the size of, a white frame or a black frame will be created in the composited image, so this range is the specified range S._y (The examples in Figures 59 (B) and (C) match). As a result, it is possible to prevent a white frame or a black frame from being formed in the combined image.

Composite range of the target image indicated by the broken line (combined specified range S_y ) Part is extracted as shown in Figure 59 (C) (step 103). The image composition process is performed based on the position designation and the position information obtained in the image composition on the display screen of the display device 33 (step 104).

By performing the image composition processing in such printing from the first frame to the third frame, the composite image as shown in FIG. 60 is printed. Since high-resolution printing template image data and printing mask image data are used at the time of printing, high-quality composite images can be printed. The data representing the composite image may be recorded on a hard disk, floppy disk, or the like. As a result, the data representing the composite image can be read out again, and the composite image can be obtained again relatively easily. The data representing the composite image to be recorded may be either one of the composite image data for printing and the composite image data for display, or both.

You can also add a title to the template image. At this time, a title may be input or a predetermined title may be used. In any case, when adding a title to the template image, the title display position, font, etc. are determined using the information contained in the composite information.

<figref num="1">A photo film with an information recording unit is shown.</figref><figref num="2">The format of the data recorded in the information recording unit is shown.</figref><figref num="3">A part of a camera that can handle a photo film with an information recording unit is shown.</figref><figref num="4">It is a perspective view which shows the image composition apparatus, the display apparatus connected to the image composition apparatus, and the printer as a whole.</figref><figref num="5">It is a perspective view of a display device.</figref><figref num="6">It is a perspective view of an image synthesizer.</figref><figref num="7">It is an assembly perspective view of an image composition apparatus.</figref><figref num="8">It is an assembly perspective view of an image composition apparatus.</figref><figref num="9">It is an assembly perspective view of an image composition apparatus.</figref><figref num="10">It is an assembly perspective view of a film scanner.</figref><figref num="11">It is a perspective view of the photograph film with an information recording part.</figref><figref num="12">It is a horizontal sectional view which shows the storage part of a photographic film.</figref><figref num="13">It is a vertical cross-sectional view which shows the storage part of a photographic film.</figref><figref num="14">The configuration of the film scanner is shown.</figref><figref num="15">It is a block diagram which shows the electrical structure of an image synthesizer.</figref><figref num="16">The file structure of the hard disk included in the image synthesizer is shown.</figref><figref num="17">The contents of the template image data recording area are shown.</figref><figref num="18">The contents of the mask image data recording area are shown.</figref><figref num="19">(A) shows an example of a template image, (B) shows an example of a mask image, and (C) shows an example of composite information.</figref><figref num="20">Shows the relationship between the position of the specified composition range and the composition position of the title and the template image.</figref><figref num="21">Shows the relationship between the position of the specified composition range and the composition position of the title and the template image.</figref><figref num="22">It is a perspective view for demonstrating image composition.</figref><figref num="23">It is a flowchart which shows the processing procedure in an image synthesizer.</figref><figref num="24">It is a flowchart which shows the processing procedure in an image synthesizer.</figref><figref num="25">It is a flowchart which shows the processing procedure in an image synthesizer.</figref><figref num="26">It is a flowchart which shows the processing procedure in an image synthesizer.</figref><figref num="27">It is a flowchart which shows the processing procedure in image composition processing.</figref><figref num="28">It is a flowchart which shows the processing procedure in image composition processing.</figref><figref num="29">It is a flowchart which shows the processing procedure in image composition processing.</figref><figref num="30">An example of the display screen of the display device connected to the image synthesizer is shown.</figref><figref num="31">An example of the display screen of the display device connected to the image synthesizer is shown.</figref><figref num="32">An example of the display screen of the display device connected to the image synthesizer is shown.</figref><figref num="33">An example of the display screen of the display device connected to the image synthesizer is shown.</figref><figref num="34">An example of the display screen of the display device connected to the image synthesizer is shown.</figref><figref num="35">An example of the display screen of the display device connected to the image synthesizer is shown.</figref><figref num="36">An example of the display screen of the display device connected to the image synthesizer is shown.</figref><figref num="37">An example of the display screen of the display device connected to the image synthesizer is shown.</figref><figref num="38">An example of the display screen of the display device connected to the image synthesizer is shown.</figref><figref num="39">An example of the display screen of the display device connected to the image synthesizer is shown.</figref><figref num="40">An example of the display screen of the display device connected to the image synthesizer is shown.</figref><figref num="41">An example of the display screen of the display device connected to the image synthesizer is shown.</figref><figref num="42">An example of the display screen of the display device connected to the image synthesizer is shown.</figref><figref num="43">An example of the display screen of the display device connected to the image synthesizer is shown.</figref><figref num="44">An example of the display screen of the display device connected to the image synthesizer is shown.</figref><figref num="45">An example of the display screen of the display device connected to the image synthesizer is shown.</figref><figref num="46">An example of the display screen of the display device connected to the image synthesizer is shown.</figref><figref num="47">An example of the display screen of the display device connected to the image synthesizer is shown.</figref><figref num="48">An example of the display screen of the display device connected to the image synthesizer is shown.</figref><figref num="49">An example of the display screen of the display device connected to the image synthesizer is shown.</figref><figref num="50">An example of the display screen of the display device connected to the image synthesizer is shown.</figref><figref num="51">An example of the display screen of the display device connected to the image synthesizer is shown.</figref><figref num="52">An example of the display screen of the display device connected to the image synthesizer is shown.</figref><figref num="53">An example of the display screen of the display device connected to the image synthesizer is shown.</figref><figref num="54">An example of the display screen of the display device connected to the image synthesizer is shown.</figref><figref num="55">An example of the display screen of the display device connected to the image synthesizer is shown.</figref><figref num="56">An example of the display screen of the display device connected to the image synthesizer is shown.</figref><figref num="57">An example of the display screen of the display device connected to the image synthesizer is shown.</figref><figref num="58">An example of the image recorded on the photographic film is shown.</figref><figref num="59">(A), (B) and (C) show the state of the image composition process in the print process.</figref><figref num="60">An example of a composite image to be printed is shown.</figref>

Code description

30 MPU 32 Touch panel 33 Display 35 Image memory 37 Printer 39 Floppy disk driver 40 Hard disk driver 42 Scanner 45 RAM 46 Magneto-optical disk driver