Three-dimensional image producing method and apparatus therefor

【0001】<u style="single">[</u>Technical field<u style="single">]</u> The present invention relates to a stereoscopic image creation method and an apparatus thereof, and relates to a stereoscopic image photographing apparatus for obtaining a stereoscopic image, a signal processing method for obtaining a stereoscopic image, and the apparatus thereof. [0002]<u style="single">[</u>Background technology<u style="single">]</u> FIG. 22 shows an example of a conventional stereoscopic image capturing apparatus. FIG. 22 shows a shooting state of a stereoscopic image called a horizontal running stereoscopic image, FIG. 22A shows the relationship between the camera before moving and the shooting target, and FIG. 22B shows the relationship between the camera after moving and the shooting target. First, the object A and the object B are photographed by the camera 1 before moving (Fig. 22A). The object B exists farther than the object A, and the common axis (one-dot chain line in the figure) passing through the objects A and B is perpendicular to the image pickup surface of the CCD2 image sensor. The optical axis of the camera 1 (the line passing through the lens 3; the alternate long and short dash line in the figure) is a distance l to the left of the common axis (the alternate long and short dash line in the figure).₁Only apart. In this state, object A and object B are a on the imaging surface of CCD2, respectively.₁, b₁Image is formed on. Next, the camera 1 is translated as shown in FIG. 22B, and the optical axis of the camera 1 is a distance l to the right of the common axis passing through the objects A and B.₁Only separated. In this state, object A and object B are a on the imaging surface of CCD2, respectively.₂, b₂Image is formed on. When the images taken before and after the movement of the camera 1 as described above are displayed on a display device using, for example, shutter glasses in which light transmission and light blocking are controlled, the displayed images are as shown in FIG. 23. In FIG. 23, 11 shows an image taken before the movement of the camera 1, 12 shows an image taken after the movement of the camera 1, and 13 shows a state (display image) in which these images are alternately displayed. The shutter 14a is controlled so that the observer sees the image before the movement with the left eye L and the image after the movement with the right eye R. As a result, the objects A and B are viewed as a stereoscopic image in a state of protruding to the front of the screen due to the relationship between the parallax. FIG. 24 is an example of a device for viewing the stereoscopic image, in which 20 is a video camera, 21 is a playback device, 22 is a control device, and 23 is a display device. The display device 23 displays the above-mentioned pre-movement image 11 in an even-numbered field and the post-movement image 12 in an odd-numbered field. The observer wears the shutter glasses 14 and looks at the displayed image. The shutter 14a is controlled by the control device 22 so that the left eye L is light-transmitting and the right eye R is light-blocking in the even field, while the left eye L is light-blocking and the right eye R is light-transmitting in the odd field. The three-dimensional diagram shown in FIG. 24 can be seen. However, in the above-mentioned horizontal running stereoscopic image shooting, it is necessary to accurately translate the camera 1 in the horizontal direction, which makes shooting difficult. In addition, as can be seen from FIG. 23, the objects A and B were viewed in a state of protruding from the display surface (infinity is on the display surface), which was visually unnatural and accompanied by fatigue. [0003]<u style="single">[</u>Disclosure of invention<u style="single">]</u> An object of the present invention is to be able to take a stereoscopic display image without moving the camera accurately or without moving the camera, and a natural stereoscopic image without all the images popping out from the display screen. It is an object of the present invention to provide a stereoscopic image creation method and an apparatus thereof, which can obtain the above and reduce the visual fatigue. [0004] The stereoscopic image creation method of the present invention<u style="single">The first, second, and third objects to be photographed at different positions in the front-back direction</u>The first image taken by the photographing device in the predetermined first state, and<u style="single">Each of the objects to be photographed</u>A second image taken by the photographing apparatus in a second state different from the first state.<u style="single">With</u>At least one<u style="single">Image of</u>To<u style="single">correction</u>And<u style="single">When a stereoscopic image based on the first and second images is displayed on the display device, the first, second, and third objects to be photographed are displayed on the display surface of the display device and with respect to the display surface. So that the stereoscopic view can be seen as separate positions for the front position and the rear position.</u>In the first and second images<u style="single">Each shooting target of</u>Adjust the fusion position of the object<u style="single">Ta</u>It is characterized by creating a stereoscopic image. Further, the second state is characterized in that the photographing apparatus photographed in the first state is translated with respect to the imaging surface. Further, in the second state, the optical axis of the photographing device is at a predetermined angle with respect to the connection centered on an arbitrary point on the extension line on the photographing device side of the connection connecting the photographing device and the object to be photographed. It is characterized in that the photographing apparatus photographed in the first state is rotated to the position. Further, a condensing optical means that can move to an arbitrary position holding an optical axis parallel to the optical axis of the photographing device is disposed between the image pickup element of the photographing device and the object to be photographed. The first state is a state before the movement of the condensing optical means, and the second state is a state after the movement of the condensing optical means. Further, an angle control means for controlling the emission angle of the light emitted to the imaging surface of the imaging element is provided between the imaging element of the imaging device and the imaging object, and the first state is the angle. The emission angle of the control means is controlled to the first angle, and the second state is a state in which the emission angle of the angle control means is controlled to a second angle different from the first angle. It is characterized by being. Further, the angle control means is characterized by having an apex angle variable prism. Further, in the path connecting the image pickup element of the photographing apparatus and the object to be photographed, a light transmitting means having an incoming light surface and an outgoing light surface formed in parallel is provided so as to be intervenable at a predetermined angle, and the first state is described. Is a state in which the light transmitting means is not inserted in the path, and the second state is characterized in that the light transmitting means is inserted in the path. Further, the light transmitting means is characterized by having a transparent parallel plate. [0005] Further, the stereoscopic image creating apparatus of the present invention is<u style="single">The first, second, and third objects to be photographed at different positions in the front-back direction</u>The first image taken by the photographing device in the predetermined first state, and<u style="single">Each of the objects to be photographed</u>A second image taken by the photographing apparatus in a second state different from the first state.<u style="single">With</u>At least one<u style="single">Image of</u>To<u style="single">correction</u>And<u style="single">When a stereoscopic image based on the first and second images is displayed on the display device, the first, second, and third objects to be photographed are displayed on the display surface of the display device and with respect to the display surface. So that the stereoscopic view can be seen as separate positions for the front position and the rear position.</u>In the first and second images<u style="single">Each shooting target of</u>It is provided with an image moving means for adjusting the fusion position of an object, and is characterized in that a stereoscopic image is created. Further, it is characterized in that it is provided with a frame image creating means for generating a frame image based on the first and second images to which at least one of them has been moved by the image moving means. Further, it is characterized in that it is provided with a movement amount setting means for setting the movement amount of the first and second images. Further, it is characterized in that it is provided with a mode selection means for selecting the movement method of the first and second images. Further, the second state is characterized in that the photographing apparatus photographed in the first state is translated with respect to the imaging surface. Further, in the second state, the optical axis of the photographing device is set at a predetermined angle with respect to the connection, centering on an arbitrary point on the extension line on the photographing device side of the connection connecting the photographing device and the object to be photographed. It is characterized in that the photographing apparatus photographed in the first state is rotated to the position. Further, a condensing optical means that can move to an arbitrary position holding an optical axis parallel to the optical axis of the photographing device is disposed between the image pickup element of the photographing device and the object to be photographed. The first state is a state before the movement of the condensing optical means, and the second state is a state after the movement of the condensing optical means. Further, an angle control means for controlling the emission angle of the light emitted to the imaging surface of the imaging element is provided between the imaging element of the imaging device and the imaging object, and the first state is the angle. The emission angle of the control means is controlled to the first angle, and the second state is a state in which the emission angle of the angle control means is controlled to a second angle different from the first angle. It is characterized by being. Further, the angle control means is characterized by having an apex angle variable prism. Further, in the path connecting the image pickup element of the photographing apparatus and the object to be photographed, a light transmitting means having an incoming light surface and an outgoing light surface formed in parallel is provided so as to be intervenable at a predetermined angle, and the first state is described. Is a state in which the light transmitting means is not inserted in the path, and the second state is characterized in that the light transmitting means is inserted in the path. Further, the light transmitting means is characterized by having a transparent parallel plate. [0006]<u style="single">[</u>The best mode for carrying out the invention<u style="single">]</u>[0007] Hereinafter, embodiments of the present invention will be described with reference to the accompanying drawings. 1 to 3 are examples of the first embodiment, FIGS. 4 to 8 are examples of the second embodiment, FIG. 9 is a block diagram of the stereoscopic image creating apparatus of the present invention, and FIGS. 10 to 12 are the third embodiment. Examples of embodiments, FIGS. 13 to 17, show a fourth embodiment, and FIGS. 18 to 21 show a fifth embodiment. [0008] (Example of the first embodiment) FIG. 1 shows a shooting state when the present invention is applied to a stereoscopic image called a lateral running stereoscopic image. FIG. 1A shows the relationship between the camera before moving and the shooting target, and FIG. 1B shows the relationship between the camera after moving and the shooting target. Each relationship is shown. First, before moving (Fig. 1A), the objects A, B, and C to be photographed are photographed by the camera 1. The object B exists farther than the object A, the object C exists farther than the object B, and the optical axis (line passing through the lens 3; the one-point chain line in the figure) 30 of the camera 1 is the objects A and B to be photographed. It is located in between. In this state, the objects A, B, and C to be photographed are a on the imaging surface 2a of CCD2, respectively.₁, b₁, c₁Image is formed on. Next, the camera 1 is translated as shown in FIG. 1B so that the optical axis of the camera 1 is located between the objects B and C to be photographed. In this state, the objects A, B, and C to be photographed are a on the imaging surface 2a of CCD2, respectively.₂, b₂, c₂Image is formed on. FIG. 2 shows the formation of a stereoscopic image based on the shooting information, 31 is an image taken before moving the camera 1 (first image), and 32 is an image taken after moving the camera 1 (second image). Image). The objects A, B, and C to be photographed have moved by Δa, Δb, and Δc on the display screen (or on the imaging surface), respectively. Reference numeral 33 denotes a stereoscopic view in the above-mentioned state, and each object appears to protrude forward at positions A', B', and C'because of the relationship of parallax. [0009] In the present invention, it is corrected by the method shown in FIG. 3 that all the objects A, B, and C to be photographed appear to protrude forward as described above. That is, for example, the image b of the image 32 after the movement of the camera 1.₂However, the image of image 31 before moving b₁The image 32 is moved laterally to be a corrected image (shifted image) 40 so as to match with. Then, by using these images 31 and 40 and displaying them on the display device described with reference to FIG. 24, for example, they can be viewed as a stereoscopic image. 41 in FIG. 3B shows a state in which the images 31 and 40 are displayed alternately. Imaging of image 31 taken before moving camera 1 a₁, b₁, c₁With the observer's left eye L, the image 32 taken after the camera 1 was moved was moved laterally to the corrected image 40 a.₂, b₂, c₂The transmission and blocking of light from the shutter 14a are controlled so that each can be seen by the observer's right eye R. In this way, for example, b of the image 32 after the movement of the camera 1.₂However, b in image 31 before moving₁Since the image 32 is moved laterally to obtain the corrected images 40 and the images 31 and 40 are displayed so as to match with, the fusion position of the object specified in the image is adjusted. As a result, the object A to be photographed is at the position of A'in the front of the screen, the object B to be photographed is at the position of B'on the screen, and the object C to be photographed is at the position of C'at the rear of the screen. Can be seen in. Therefore, unlike the conventional case, all the objects A, B, and C to be photographed do not appear to protrude forward, a natural stereoscopic image can be obtained, and the visual fatigue can be reduced or eliminated. The image b of the object B₁, b₂Not limited to matching any other object (eg a)₁, a₂And c₁, c₂) May be matched. Further, the image 31 taken before the movement of the camera 1 may be moved (corrected image is obtained) to match the image 32 taken after the movement of the camera 1, and both the images 31 and 32 may be further moved. Of course, it's okay. [0010] (Example of the second embodiment) It has been confirmed by the present inventors that the camera is rotated to obtain a stereoscopic image based on the images before and after the rotation, but the present invention obtains a stereoscopic image by the rotation. By applying to the above, a more suitable stereoscopic image can be obtained as in the case of the lateral running stereoscopic image. FIG. 4 is a schematic diagram of stereoscopic photography in the case where the camera 10 is rotated to obtain a stereoscopic image when there are two objects to be photographed, A and B. FIG. 4A shows the relationship between the objects A and B to be photographed before rotation and the camera 10, and the center of rotation O of the camera 10 is the axis 45 passing through the objects A and B to be photographed in the direction from the lens 3 to CCD2. Suppose it is on top. First, before rotation, the optical axis 30 of the camera 10 is in a state of swinging to the left at an angle θ with the axis 45 passing through the objects A and B to be photographed with the point O as the center of rotation, and the objects A and B to be photographed are respectively. A on the imaging surface 2a of CCD2₁, b₁Is imaged in. Next, the camera 10 is rotated as shown in FIG. 4B so that the optical axis 30 swings to the right with an angle θ from the axis 45 about the point O. At this time, the objects A and B to be photographed are a on the imaging surface 2a of CCD2, respectively.₂, b₂Image is formed on. FIG. 5 shows the formation of a stereoscopic image based on the shooting information. 46 is an image taken before the rotation of the camera 10 (first image), and 47 is an image taken after the rotation (second image). is there. Reference numeral 48 indicates a state in which the images 46 and 47 are displayed alternately, and the observer is controlled by the shutter 14a so that the image before rotation is viewed by the left eye L and the image after rotation is viewed by the right eye R. As a result, the objects A and B are viewed as a stereoscopic image in a state of protruding to the front of the screen. As a device for viewing a stereoscopic image, for example, the device shown in FIG. 24 is used. FIG. 6 shows how the camera 10 is rotated to obtain a stereoscopic image when there are three objects to be photographed, A, B, and C. FIG. 6A shows the relationship between the objects A, B, and C to be photographed before rotation and the camera 10, and the center of rotation O of the camera 10 is between the objects A and B to be photographed in the direction from the lens 3 to CCD2. Suppose it is on axis 45 through its position and camera 10. First, before rotation, the optical axis 30 of the camera 10 is in a state of swinging to the left with an angle θ with the axis 45 with the point O as the center of rotation, and the objects A, B, and C to be photographed are the imaging surfaces 2a of CCD2, respectively. Above a₁, b₁, c₁Is imaged in. Next, the camera 10 is rotated as shown in FIG. 6B so that the optical axis 30 swings to the right with an angle θ from the axis 45 with the point O as the center of rotation. At this time, the objects A, B, and C to be photographed are a on the imaging surface 2a of CCD2, respectively.₂, b₂, c₂Image is formed on. FIG. 7 shows the formation of a stereoscopic image based on the shooting information. 51 is an image taken before the rotation of the camera 10 (first image), and 52 is an image taken after the rotation (second image). is there. The objects A, B, and C to be photographed have moved by Δa, Δb, and Δc on the display screen (or on the imaging surface), respectively. Reference numeral 53 denotes a stereoscopic view in the above-mentioned state, and each object appears to protrude forward at positions A', B', and C'because of the relationship of parallax. [0011] In the present invention, it is corrected by the method shown in FIG. 8 that all the objects A, B, and C to be photographed appear to protrude forward as described above. That is, for example, the image b of the image 52 after the rotation of the camera 10.₂However, the image of the image 51 before rotation b₁The image 52 is moved laterally to be a corrected image (shifted image) 60 so as to match with. Then, by using these images 51 and 60 and displaying them on the display device described with reference to FIG. 24, for example, they can be viewed as a stereoscopic image. FIG. 55 in FIG. 8B shows a state in which the images 51 and 60 are alternately displayed. Imaging of image 51 taken before rotation of camera 10 a₁, b₁, c₁With the observer's left eye L, a of the corrected image 60 in which the image 52 taken after rotation is moved laterally.₂, b₂, c₂The transmission and blocking of light from the shutter 14a are controlled so that each can be seen by the observer's right eye R. In this way, for example, b of the image 52 after the rotation of the camera 10.₂However, b in image 51 before rotation₁Since the image 52 is moved laterally to obtain the corrected images 60 and the images 51 and 60 are displayed so as to match with, the fusion position of the object specified in the image is adjusted. As a result, the object A to be photographed is at the position of A'in the front of the screen, the object B to be photographed is at the position of B'on the screen, and the object C to be photographed is at the position of C'at the rear of the screen. Can be seen in. Therefore, unlike the conventional case, all the objects A, B, and C to be photographed do not appear to protrude forward, a natural stereoscopic image can be obtained, and the visual fatigue can be reduced or eliminated. The image b of the object B₁, b₂Not limited to matching any other object (eg a)₁, a₂And c₁, c₂) May be matched. Further, the image 51 taken before the rotation of the camera 10 may be moved (corrected image is obtained) to match the image 52 taken after the rotation, and both the images 51 and 52 may be further moved. Of course, it is also good. [0012] Next, a configuration example of the stereoscopic image creating apparatus based on the stereoscopic image creating method of the present invention will be described together with the block diagram of FIG. First, the above-mentioned image 31 or 51 taken before the parallel movement of the camera or before the rotation of the camera is stored in the image memory 61 as an image signal (1), and after the parallel movement of the camera or the camera. For example, the above-mentioned image 32 or 52 taken after rotation is stored in the image memory 62 as an image signal (2). The image shift circuit 63 is a circuit that moves the object of interest from the image signals (1) and (2) of the image memories 61 and 62 so as to be at the same position on the display screen (for example, moves it in the horizontal direction). Yes, there is a shift amount instructed from the outside by the shift amount input device 64, and a shift mode instructed from the outside by the mode selection means 65 (a mode in which the image signal (1) is moved relative to the image signal (2), an image signal. Movement control is performed based on the mode in which (2) is moved with respect to the image signal (1), the mode in which both the image signals (1) and (2) are moved, etc.), before the camera is translated or the camera is moved. The fusion position of the object photographed before the rotation of the camera and the object photographed after the camera is translated or after the camera is rotated is adjusted. Then, the image signal (1) and the image signal (2) whose movement amount is adjusted are input to the frame signalizing device 66, and in the frame signalizing device 66, for example, the image signal (1) is set to an even field and the image signal (2). ) Is generated corresponding to each odd field. At this time, the frame signalizing device 66 outputs a signal for switching the shutter 14a of the shutter glasses 14 in response to the field switching, and alternately opens and closes and drives the shutters 14a for the right eye and the left eye. The television signal from the frame signalizing device 66 is input to the display device 67 and displayed, and a stereoscopic image can be obtained by viewing through the shutter 14a. Further, the television signal output from the frame signalizing device 66 can be recorded and stored on a recording medium by the recording device 68. [0013] (Example of Third Embodiment) FIG. 10 is a schematic diagram of stereoscopic photography when an image is taken using a moving lens 71 formed of a convex lens as a movable condensing optical means. In FIG. 10, the moving lens 71 of the camera 10 has an optical axis 30 parallel to the optical axis 30 of the camera 10 between the image pickup surface 2a of the CCD2 image sensor and the objects A, B, and C to be photographed. It is arranged so as to be movable (horizontally in the figure) at any held position. FIG. 10A shows the state before the moving lens 71 moves, and the objects A, B, and C to be photographed are a on the imaging surface 2a, respectively.₁, b₁, c₁Is imaged in. FIG. 10B shows a state in which the moving lens 71 has moved by the amount of movement x, and the objects A, B, and C to be photographed are a on the imaging surface 2a, respectively.₂, b₂, c₂Is imaged in. FIG. 11 shows the formation of a stereoscopic image based on the shooting information, 31 is an image taken before the moving lens 71 moves (first image), and 32 is an image taken after the moving lens moves (second image). Image). The objects A, B, and C to be photographed have moved by Δa, Δb, and Δc on the display screen (or on the imaging surface), respectively. Reference numeral 33 denotes a stereoscopic view in the above-mentioned state, and each object appears to protrude forward at positions A', B', and C'because of the relationship of parallax. [0014] In the present invention, it is corrected by the method shown in FIG. 12 that all the objects A, B, and C to be photographed appear to protrude forward as described above. That is, for example, the image b of the image 32 after the movement of the moving lens 71.₂However, the image of image 31 before moving b₁The image 32 is moved laterally to be the corrected image 40 so as to match with. Then, by using these images 31 and 40 and displaying them on the display device described with reference to FIG. 24, for example, they can be viewed as a stereoscopic image. 41 in FIG. 12B shows a state in which the images 31 and 40 are displayed alternately. Imaging of image 31 taken before moving of moving lens 71 a₁, b₁, c₁With the observer's left eye L, the image 32 taken after the moving lens 71 was moved was moved laterally to the corrected image 40 a.₂, b₂, c₂The transmission and blocking of light from the shutter 14a are controlled so that each can be seen by the observer's right eye R. In this way, for example, b of the image 32 after the movement of the moving lens 71.₂However, b in image 31 before moving₁Since the image 32 is moved laterally to obtain the corrected images 40 and the images 31 and 40 are displayed so as to match with, the fusion position of the object specified in the image is adjusted. As a result, the object A to be photographed is at the position of A'in the front of the screen, the object B to be photographed is at the position of B'on the screen, and the object C to be photographed is at the position of C'at the rear of the screen. Can be seen in. Therefore, unlike the conventional case, all the objects A, B, and C to be photographed do not appear to protrude forward, a natural stereoscopic image can be obtained, and the visual fatigue can be reduced or eliminated. The image b of the object B₁, b₂Not limited to matching any other object (eg a)₁, a₂And c₁, c₂) May be matched. Further, the image 31 taken before moving the lens may be moved (corrected image is obtained) to match the image 32 taken after moving the lens, and both the images 31 and 32 may be moved. Is natural. [0015] In order to create a stereoscopic image as described above, the device of FIG. 9 is used in the same manner as described above. That is, first, for example, the above-mentioned image 31 taken before moving the lens is stored in the image memory 61 as an image signal (1), and the above-mentioned image 32 taken after moving the lens, for example, is used as an image signal (2) in the image memory 62. Accumulate in. The image shift circuit 63 is a circuit that moves the object of interest from the image signals (1) and (2) of the image memories 61 and 62 so as to be at the same position on the display screen (for example, moves it in the horizontal direction). Yes, there is a shift amount instructed from the outside by the shift amount input device 64, and a shift mode instructed from the outside by the mode selection means 65 (a mode in which the image signal (1) is moved with respect to the image signal (2), an image signal. An object photographed before moving the lens by performing movement control based on a mode in which (2) is moved with respect to the image signal (1), a mode in which both image signals (1) and (2) are moved, etc.). And adjust the fusion position of the object taken after moving the lens. Then, the image signal (1) and the image signal (2) whose movement amount is adjusted are input to the frame signalizing device 66, and in the frame signalizing device 66, for example, the image signal (1) is set to an even field and the image signal (2). ) Is generated corresponding to each odd field. At this time, the frame signalizing device 66 outputs a signal for switching the shutter 14a of the shutter glasses 14 in response to the field switching, and alternately opens and closes and drives the shutters 14a for the right eye and the left eye. The television signal from the frame signalizing device 66 is input to the display device 67 and displayed, and a stereoscopic image can be obtained by viewing through the shutter 14a. Further, the television signal output from the frame signalizing device 66 can be recorded and stored on a recording medium by the recording device 68. Further, in the above-described embodiment, the moving lens 71 formed of the convex lens is used as the movable condensing optical means, but the present invention is not limited to this, and other optical means having the same function may be used. .. [0016] (Example of Fourth Embodiment) FIG. 13 is a schematic diagram of stereoscopic photography when an apex angle variable prism is used as an angle control means for controlling the light emission angle. In FIG. 13, the prism 73 (73') whose apex angle can be changed is arranged on the optical axis 30 of the camera between the lens 3 of the camera and the objects A, B, and C to be photographed. FIG. 13A shows a state in which the apex angle of the prism (73) is arranged in the right direction (hereinafter referred to as the first state), and the objects A, B, and C to be photographed are a on the imaging surface 2a of CCD2, respectively.₁, b₁, c₁Is imaged in. FIG. 13B shows a state in which the apex angle of the prism (73') is arranged in the left direction (hereinafter referred to as a second state), and the objects A, B, and C to be photographed are a on the imaging surface 2a, respectively.₂, b₂, c₂Is imaged in. FIG. 14 shows the formation of a stereoscopic image based on the shooting information, 31 is an image taken when the prism 73 is in the first state (first image), and 32 is the second image taken by the prism 73'. It is an image (second image) taken when it is in the state of. The objects A, B, and C to be photographed have moved by Δa, Δb, and Δc on the display screen (or on the imaging surface), respectively. Reference numeral 33 denotes a stereoscopic view in the above-mentioned state, and each object appears to protrude forward at positions A', B', and C'because of the relationship of parallax. [0017] In the present invention, it is corrected by the method shown in FIG. 15 that all the objects A, B, and C to be photographed appear to protrude forward as described above. That is, for example, the image b of the image 32 taken when the prism 73'is in the second state (FIG. 13B).₂The image b of the image 31 taken when the prism 73 is in the first state (FIG. 13A).₁The image 32 is moved laterally to be the corrected image 40 so as to match with. Then, by using these images 31 and 40 and displaying them on the display device described with reference to FIG. 24, for example, they can be viewed as a stereoscopic image. 41 in FIG. 15B shows a state in which the images 31 and 40 are displayed alternately. Imaging of image 31 taken when prism 73 is in the first state a₁, b₁, c₁With the observer's left eye L, a of the corrected image 40 in which the image 32 taken when the prism 73'is in the second state is moved laterally.₂, b₂, c₂The transmission and blocking of light from the shutter 14a are controlled so that the observer can see each with the right eye R of the observer. In this way, for example, b of the image 32 taken when the prism 73'is in the second state.₂B of image 31 taken when prism 73 is in the first state₁Since the image 32 is moved laterally to obtain the corrected images 40 and the images 31 and 40 are displayed so as to match with, the fusion position of the object specified in the image is adjusted. As a result, the object A to be photographed is at the position of A'in the front of the screen, the object B to be photographed is at the position of B'on the screen, and the object C to be photographed is at the position of C'at the rear of the screen. Can be seen in. Therefore, unlike the conventional case, all the objects A, B, and C to be photographed do not appear to protrude forward, a natural stereoscopic image can be obtained, and the visual fatigue can be reduced or eliminated. The image b of the object B₁, b₂Not limited to matching any other object (eg a)₁, a₂And c₁, c₂) May be matched. It is also possible to move the image 31 taken when the prism 73 is in the first state (obtain a corrected image) to match the image 32 taken when the prism 73'is in the second state. Of course, both images 31 and 32 may be moved. [0018] FIG. 16 shows a first configuration example of the apex angle variable prism used in the present invention, in which a liquid 75 is sealed between plate glasses 74a and 74b arranged in parallel at a predetermined distance, and the plate glass 74a and 74b It has a sealed structure by a bellows sealing member 76 arranged between the ends. In FIG. 16A, the two plate glasses 74a and 74b are in a parallel state, and the light L perpendicularly incident on the plate glass 74a is shown.₁Go straight and light L₂It emits like. Further, FIG. 16B shows a state in which the two plate glasses 74a and 74b have an angle θ (apical angle), and the incident light L₁Emits at an angle α (light L₂). By controlling the apex angles of the two plate glasses 74a and 74b in this way, the emitted light L₂It controls the emission angle of. [0019] FIG. 17 shows a second configuration example of the apex angle variable prism used in the present invention, in which curved surfaces of the plano-concave lens 77 and the plano-convex lens 78 having the same curvature are arranged to face each other, and one of them faces the other. By rotating along the curved surface, the planes of the two lenses 77 and 78 are controlled from a parallel state to a state having a predetermined angle θ. In FIG. 17A, the planes of the two lenses 77 and 78 are parallel, and the light L perpendicularly incident on the plano-concave lens 77.₁Go straight and light L₂It emits like. Further, FIG. 17B shows a state in which the planes of the two lenses 77 and 78 have an angle θ (apical angle), and the incident light L₁Emits at an angle α (light L₂). By controlling the apex angle formed by the planes of the two lenses 77 and 78 in this way, the emitted light L₂It controls the emission angle of. [0020] In order to create a stereoscopic image as described above, the device of FIG. 9 is used in the same manner as described above. That is, first, the image 31 taken when the prism 73 is in the first state (FIG. 13A) is stored in the image memory 61 as an image signal (1), and the prism 73'is put into the second state. For example, the image 32 taken at a certain time (FIG. 13B) is stored in the image memory 62 as an image signal (2). The image shift circuit 63 is a circuit that moves the object of interest from the image signals (1) and (2) of the image memories 61 and 62 so as to be at the same position on the display screen (for example, moves it in the horizontal direction). Yes, there is a shift amount instructed from the outside by the shift amount input device 64, and a shift mode instructed from the outside by the mode selection means 65 (a mode in which the image signal (1) is moved with respect to the image signal (2), an image signal. Movement control is performed based on the mode in which (2) is moved with respect to the image signal (1), the mode in which both the image signals (1) and (2) are moved, etc.), and the prism 73 is in the first state. Adjusts the fusion position of the object photographed when it is in the second state and the object photographed when the prism 73'is in the second state. Then, the image signal (1) and the image signal (2) whose movement amount is adjusted are input to the frame signalizing device 66, and in the frame signalizing device 66, for example, the image signal (1) is set to an even field and the image signal (2). ) Is generated corresponding to each odd field. At this time, the frame signalizing device 66 outputs a signal for switching the shutter 14a of the shutter glasses 14 in response to the field switching, and alternately opens and closes and drives the shutters 14a for the right eye and the left eye. The television signal from the frame signalizing device 66 is input to the display device 67 and displayed, and a stereoscopic image can be obtained by viewing through the shutter 14a. Further, the television signal output from the frame signalizing device 66 can be recorded and stored on a recording medium by the recording device 68. Further, in the above-described embodiment, the prisms 73, 73'are arranged between the lens 3 of the camera and the objects A, B, C to be photographed, but the present invention is not limited to this, and the prism 73, 73'is not limited to this, but is between the lens 3 of the camera and the imaging surface 2a. Therefore, it may be arranged on the optical axis 30 of the camera. Further, the angle control means for controlling the emission angle of the light emitted to the image pickup surface of the image pickup device of the photographing apparatus is not limited to the prisms 73, 73'with variable apex angles, and other means having the same function can be used. You may use it. [0021] [0021] (Example of Fifth Embodiment) FIG. 18 is a schematic view of stereoscopic photography in the case where a transparent parallel plate is used as the light transmitting means of the present invention. In FIG. 18, reference numeral 83 denotes a transparent parallel plate that is freely inserted and excluded on the optical axis 30 of the camera in the path connecting the lens 3 of the camera and the objects A, B, and C to be photographed. FIG. 18A shows a state in which the transparent parallel plate 83 is not inserted, and the objects A, B, and C to be photographed are a on the imaging surface 2a of CCD2, respectively.₁, b₁, c₁Is imaged in. FIG. 18B shows a state in which the transparent parallel plate 83 is inserted on the optical axis 30 of the path, and the objects A, B, and C to be photographed are a on the imaging surface 2a, respectively.₂, b₂, c₂Is imaged in. In FIG. 18, the imaging position a is shown for ease of understanding.₂, b₂, c₂Shows an example of the arrangement of objects A, B, and C that are at the same position on the imaging surface. It is easy to understand based on the explanation. FIG. 19 shows the formation of a stereoscopic image based on the above-mentioned shooting information, 31 is an image taken with the transparent parallel plate 83 not inserted as shown in FIG. 18A (first image), and 32 is shown in FIG. 18B. This is an image (second image) taken with the transparent parallel plate 83 inserted in the image. Note that a₂, b₂, c₂Is shown to be offset from each other in the vertical direction for convenience of explanation, but in reality, a₂, c₂Is b₂Will be in the same position as. The objects A, B, and C to be photographed have moved by Δa, Δb, and Δc on the display screen (or on the imaging surface), respectively. Reference numeral 33 denotes a stereoscopic view in the above-mentioned state, and each object appears to protrude forward at positions A', B', and C'because of the relationship of parallax. [0022] In the present invention, it is corrected by the method shown in FIG. 20 that all the objects A, B, and C to be photographed appear to protrude forward as described above. That is, for example, the image b of the image 32 taken with the transparent parallel plate 83 inserted (FIG. 18B).₂Image b of image 31 taken with the transparent parallel plate 83 not inserted (Fig. 18A).₁The image 32 is moved laterally to be the corrected image 40 so as to match with. Then, by using these images 31 and 40 and displaying them on the display device described with reference to FIG. 24, for example, they can be viewed as a stereoscopic image. 41 in FIG. 20B shows a state in which the images 31 and 40 are displayed alternately. Image formation of image 31 taken without the transparent parallel plate 83 inserted a₁, b₁, c₁With the observer's right eye R, the image 32 taken with the transparent parallel plate 83 inserted is moved laterally to the corrected image 40 a.₂, b₂, c₂The light transmission and blocking of the shutter 14a are controlled so that the observer can see the light with the left eye L of the observer. In this way, for example, b of the image 32 taken with the transparent parallel plate 83 inserted.₂B of image 31 taken with the transparent parallel plate 83 not inserted₁Since the image 32 is moved laterally to obtain the corrected images 40 and the images 31 and 40 are displayed so as to match with, the fusion position of the object specified in the image is adjusted. As a result, the object A to be photographed is at the position of A'in the front of the screen, the object B to be photographed is at the position of B'on the screen, and the object C to be photographed is at the position of C'at the rear of the screen. Can be seen in. Therefore, unlike the conventional case, all the objects A, B, and C to be photographed do not appear to protrude forward, a natural stereoscopic image can be obtained, and the visual fatigue can be reduced or eliminated. The image b of the object B₁, b₂Not limited to matching any other object (eg a)₁, a₂And c₁, c₂) May be matched. In that case, the matched object (for example, A or C) will be located on the screen (on the display surface). Alternatively, the image 31 taken without the transparent parallel plate 83 may be moved (corrected image obtained) to match the image 32 taken with the transparent parallel plate 83 inserted. Further, it is natural that both the images 31 and 32 may be moved. [0023] Next, a specific example of the transparent parallel plate 83 is shown in FIG. For example, the transparent parallel plate 83 is constructed by cutting a part of a disk-shaped transparent glass at equal intervals as shown in 83a of FIG. 21A and 83b of FIG. 21B, and the center thereof is attached to the motor 84 as shown in FIG. 21C. , Attached to the front side of the camera 1 so as to have a predetermined angle θ (for example, 45 °) with respect to the optical axis 30 of the camera 1. By rotating the transparent parallel plate 83a (83b) in this state, the transparent parallel plate 83a (83b) can be taken in and out (inserted and removed from the path connecting the camera 1 and the projection object) in front of the lens 3. .. For example, when the present invention is applied to a video camera, the transparent parallel plate 83a (83b) may be taken in and out in synchronization with the vertical synchronization signal. Further, the shape of the transparent parallel plate 83 and the insertion / exclusion in the front of the lens are not limited to the configuration of 83a (83b) described above. [0024] In order to create a stereoscopic image as described above, the apparatus of FIG. 9 is used in the same manner as described above. That is, first, a state in which the transparent parallel plate 83 is not inserted (FIG. 18A) is taken, for example, the image 31 is stored in the image memory 61 as an image signal (1), and the transparent parallel plate 83 is inserted (FIG. 18A). For example, the image 32 taken in 18B) is stored in the image memory 62 as an image signal (2). The image shift circuit 63 is a circuit that moves the object of interest from the image signals (1) and (2) of the image memories 61 and 62 so as to be at the same position on the display screen (for example, moves it in the horizontal direction). Yes, there is a shift amount instructed from the outside by the shift amount input device 64, and a shift mode instructed from the outside by the mode selection means 65 (a mode in which the image signal (1) is moved with respect to the image signal (2), an image signal. The transparent parallel plate 83 is inserted by performing movement control based on the mode in which (2) is moved with respect to the image signal (1), the mode in which both the image signals (1) and (2) are moved, etc.). The fusion position of the object photographed without the image and the object photographed with the transparent parallel plate 83 inserted is adjusted. Then, the image signal (1) and the image signal (2) whose movement amount is adjusted are input to the frame signalizing device 66, and in the frame signalizing device 66, for example, the image signal (1) is set to an even field and the image signal (2). ) Is generated corresponding to each odd field. At this time, the frame signalizing device 66 outputs a signal for switching the shutter 14a of the shutter glasses 14 in response to the field switching, and alternately opens and closes and drives the shutters 14a for the right eye and the left eye. The television signal from the frame signalizing device 66 is input to the display device 67 and displayed, and a stereoscopic image can be obtained by viewing through the shutter 14a. Further, the television signal output from the frame signalizing device 66 can be recorded and stored on a recording medium by the recording device 68. [0025] Further, in the above embodiment, the transparent parallel plate 83 is freely inserted and removed between the lens 3 of the camera and the objects A, B, and C to be photographed, but the present invention is not limited to this, and the lens 3 of the camera and the imaging surface are not limited to this. It may be freely inserted and removed on the optical axis 30 of the camera between 2a. Further, the light transmitting means of the present invention is not limited to the transparent parallel plate 83, and for example, another member that is substantially transparent and transmits light may be used, and the light entering surface and the light emitting surface of the member may be formed in parallel. good. Further, the means for inserting and removing the light transmitting means at a predetermined angle into the path connecting the image pickup element of the photographing device and the object to be photographed may be not limited to the motor 84, but other means may be used. [0026] As described above, according to the present invention according to the first and second embodiments, the captured image is moved by the image moving means to adjust the display position, and thus the display screen is adjusted as in the conventional case. Not all images appear to pop out from the image, a natural stereoscopic image can be obtained, and visual fatigue can be reduced or eliminated. [0027] Further, according to the present invention according to the third embodiment, since the condensing optical means is provided so as to be movable, it is possible to take an image that can be displayed in three dimensions without moving the camera. Therefore, it becomes extremely easy to take a stereoscopic image. In addition, since the captured image is moved and the display position is adjusted by the image moving means, all the images do not appear to pop out from the display screen as in the conventional case, and a natural stereoscopic image can be obtained and visually. The above feeling of fatigue can be reduced or eliminated. [0028] Further, according to the present invention according to the fourth embodiment, since an angle control means such as an apex angle variable prism is provided, it is possible to take an image that can be displayed in three dimensions without moving the camera. Therefore, it becomes extremely easy to take a stereoscopic image. In addition, since the captured image is moved and the display position is adjusted by the image moving means, all the images do not appear to pop out from the display screen as in the conventional case, and a natural stereoscopic image can be obtained and visually. The above feeling of fatigue can be reduced or eliminated. [0029] Further, according to the present invention according to the fifth embodiment, the light transmitting means is provided so as to be intervenable at a predetermined angle in the path connecting the image sensor of the photographing device and the object to be photographed. Based on the images taken in each state of whether or not the light is inserted in the path, it is possible to take an image that can be stereoscopically displayed without moving the camera. Therefore, it becomes extremely easy to take a stereoscopic image. In addition, since the captured image is moved and the display position is adjusted by the image moving means, all the images do not appear to pop out from the display screen as in the conventional case, and a natural stereoscopic image can be obtained and visually. The above feeling of fatigue can be reduced or eliminated. [0030]<u style="single">[</u>Industrial applicability<u style="single">]</u> The present invention is not limited to the display system using the shutter 14a, and can be applied to other display devices capable of stereoscopic viewing by binocular parallax. [Simple explanation of drawings] FIG. 1 shows an example of an embodiment of the present invention, FIG. 2 is a schematic diagram of lateral running stereoscopic photography, FIG. 2 is an explanatory view showing a conventional stereoscopic image in lateral running stereoscopic photography, and FIG. Explanatory drawing showing that a natural stereoscopic image can be obtained, FIG. 4 shows a schematic view of another embodiment of the present invention, and FIG. 5 is an explanatory view showing a conventional stereoscopic image in rotational stereoscopic photography. FIG. 6 shows an example of another embodiment of the present invention, FIG. 7 is a schematic diagram of rotational stereoscopic imaging, FIG. 7 is an explanatory diagram showing a conventional stereoscopic image in rotational stereoscopic imaging, and FIG. An explanatory view showing that a stereoscopic image can be obtained, FIG. 9 is a block diagram showing an example of an embodiment of the stereoscopic image creating apparatus of the present invention, and FIG. 10 shows another example of another embodiment of the present invention, in which a laterally moving lens is used. Schematic diagram of stereoscopic photography, FIG. 11 is an explanatory view showing that stereoscopic photography is possible using a laterally moving lens, FIG. 12 is an explanatory view showing that a natural stereoscopic image can be obtained by the present invention, and FIG. 13 is a book. An example of another embodiment of the present invention is shown, a schematic view of stereoscopic photography using a variable apex angle prism, FIG. 14 is an explanatory view showing that stereoscopic photography is possible using a variable apex angle prism, and FIG. 15 is an explanatory view of the present invention. An explanatory view showing that a natural stereoscopic image can be obtained by the above, FIG. 16 is a cross-sectional view showing a first configuration example of the apex angle variable prism used in the present invention, and FIG. 17 is a second apex angle variable prism used in the present invention. FIG. 18 is a sectional view showing a configuration example of the above, FIG. 18 is a schematic view of stereoscopic photography using a transparent parallel plate, and FIG. 19 is a schematic view of stereoscopic photography using a transparent parallel plate. FIG. 20 is an explanatory view showing that a natural stereoscopic image can be obtained by the present invention, FIG. 21 shows a configuration example of the transparent parallel plate used in the present invention, and FIGS. 21A and 21B show the transparent parallel plate. A plan view, FIG. 21C is an explanatory view showing an arrangement state, FIG. 22 is a schematic view showing the principle of conventional horizontal running stereoscopic photography, FIG. 23 is an explanatory view showing a three-dimensional configuration of conventional horizontal running stereoscopic photography, and FIG. 24 is an explanatory view. It is a block diagram which shows an example of the apparatus for seeing a three-dimensional figure.