Electronic equipment, input device and input method

The present invention relates to an electronic device that operates according to a predetermined control signal input by a user, an input device for the control signal, and an input method.

Conventionally, there is an input device in the shape of a car steering wheel, a pistol, or the like, like an input device for a game. Such a pseudo input device improves the reality of the game. When the user inputs information while moving his / her body, a sense of unity between the user and the information is created. The shape of the game input device is fixed, and the content to be input is limited. However, if there is an input device whose input content is the movement of the user's body, various information can be input. Conventionally, as an example of such an input device, there is a wristband type input device. This input device is composed of a plurality of electrodes. This power supply is mounted around the user's wrist. A capacitor is formed between this electrode and the surface of the human body, and gestures such as "grasping", "twisting", and "releasing" are detected based on the change in the capacitance of the capacitor. In this input device, a sensor is also attached to the sole of the foot, and walking and movement of the center of gravity can be detected (see, for example, Patent Document 1).

The invention described in Patent Document 1 detects human movements such as "grasping", "twisting", and "releasing". However, human movements are not always constant, and fluctuations occur in the detection signal. Accurate analysis of such data is very cumbersome.

<patcit num="1"><text>Japanese Unexamined Patent Publication No. 2002-358149</text></patcit>

<p> An object of the present invention is to provide an input device, an input method, and an electronic device that convert a simple movement of a user's leg into a complicated input.</p>

<p> According to the input device according to the present invention, the detection means detects the movement of the user's leg, the signal conversion means converts the movement of the user's leg into a control signal, and the output means outputs the control signal to the external device. To do. This control signal serves as a command for controlling the external device.</p><p> Further, according to the electronic device according to the present invention, the detection means detects the movement of the user's leg, the signal conversion means converts the movement of the user's leg into a control signal, and the control means responds to the control signal. Have the electronic device perform the operation.</p><p> Further, according to the input method according to the present invention, the movement of the user's leg is detected in the detection step, the movement of the user's leg is converted into a control signal in the signal conversion step, and the control signal is converted into an external device in the output step. Output to.</p>

<p> According to the present invention, by using the detection means for detecting the movement of the user's foot, the control signal can be input by the movement of the leg while ensuring the degree of freedom of the hand. Control signals can be input by moving the legs even when you cannot hold your hands, such as when talking on a mobile phone, working in a factory, carrying luggage, operating a keyboard or mouse, or in a crowded train. ..</p><p> In addition, since the input is performed by moving the body, it is possible to obtain a sense of unity with the input content. With this input device, you can enjoy the movements of your legs, such as walking and dancing, by reflecting them in music content and video content.</p>

Hereinafter, an input device to which the present invention is applied will be described with reference to the drawings. This input device includes a sensor that detects the movement of a human leg. The sensor detects the movement of the leg based on the stepping on the human foot and the vertical movement of the body. The input device converts the movement of the human leg detected by the sensor into a command and outputs it.

FIG. 1 shows an example of the input device 1. The input device 1 includes a walking sensor 2 that detects the stepping on the user's foot, a command conversion unit 3 that converts the output of the walking sensor 2 into a command, and a wireless communication unit 4 that outputs the command to the content playback device 10. ..

The content playback device 10 includes a portable MD (minidisc; registered trademark) player, a portable DVD player, a portable television, a PDA (Personal Digital Assistants), and the like. The input device 1 outputs commands such as record, play, and stop to the content playback device 10.

The walking sensor 2 is attached to the sole of the shoe. The walking sensor 2 shown in FIG. 2 is a general-purpose foil strain gauge, and is attached to a phosphor bronze plate 21. General-purpose foil strain gauges convert bending force into electrical signals. The plus and minus of the electric signal correspond to the bending direction. The gait sensor 2 is attached so as to output a positive electric signal when the foot is stepped on and a negative electric signal when the foot is released from the ground. The gait sensor 2 is provided in a portion corresponding to the vicinity of the base of each big toe (hereinafter referred to as the front portion) and a portion corresponding to the vicinity of the heel (hereinafter referred to as the rear portion). Hereinafter, the walking sensor R1 attached to the rear part of the right foot, the walking sensor R2 attached to the front part of the right foot, the walking sensor L1 attached to the rear part of the left foot, the walking sensor L2 attached to the front part of the left foot, and so on. The code is changed.

The output terminal 23 of the walking sensor 2 is reinforced with a reinforcing material 22 and extends to the outside of the phosphor bronze plate 21. The detection result of the walking sensor L1 (hereinafter referred to as a walking signal) is output to the amplifier 24L1 as shown in FIG. The amplifier 24L1 amplifies the output of the walking sensor L1 and outputs the amplified value to the high-pass filter (HPF) 25L1. HPF25L1 removes the DC component of the output from amplifier 24L1. The output of the HPF25L1 is digitized by the A / D conversion circuit 26L1. The outputs of the other walking sensors L2, R1, R2 are also converted into digital signals by the amplifiers 24L2, 24R1, 24R2, HPF25L2, 25R1, 25R2, and the A / D conversion circuit 26L2, 26R1, 26R2, similar to the walking sensor L1.

The command conversion unit 3 converts the walking signal into a command by referring to the command database 31. The wireless communication unit 4 outputs a command to the content playback device 10. The command conversion unit 3 converts the detection result of the walking sensor 2 into a command as follows. When the command conversion unit 3 inputs a walking signal, the command conversion unit 3 searches the command database 31 for a command corresponding to the input walking signal. FIG. 4 (a) is an example of the command database 31. This command database 31 stores six types of walking signal patterns and commands corresponding to each pattern. Figure 4 (b) shows the pattern of walking signals. Pattern 1 is a pattern in which the left foot is stepped on in the order of toes and heels, and pattern 2 is a pattern in which the right foot is stepped on in the order of toes and heels. Pattern 3 is a pattern in which the left foot is stepped on in the order of toes, heels, and toes, and pattern 4 is a pattern in which the right foot is stepped on in the order of toes, heels, and toes. Pattern 5 is a pattern in which the left foot is stepped on in the order of toes, heels, heels, and toes, and pattern 6 is a pattern in which the right foot is stepped on in the order of toes, heels, heels, and toes.

Pattern 1 is a "play" command, pattern 2 is a "stop" command, pattern 3 is a "pause" command, pattern 4 is a "rewind" command, pattern 5 is a "record" command, and pattern 6 is a "timestamp" command. Corresponds to.

The command conversion unit 3 determines whether or not the user is performing a normal walking motion, and if the user is not performing a normal walking motion, the pattern of the walking signal detected by the walking sensor 2 and the command database are displayed. Match the pattern of the memorized walking signal. Then, when there is a matching pattern in the command database, the command corresponding to the pattern is output to the content playback device 10.

Here, the pattern registered in the command database 31 will be described. In the command database 31, do not register patterns generated from daily movements such as when a person is walking or stopping. This is to prevent the user from accidentally entering a command. However, even patterns generated by daily operations can be associated with commands by setting the generation interval and intensity to appropriate values.

FIG. 5 shows the configuration of the content playback device 10. The content playback device 10 is a device that reproduces audio and video. The content playback device 10 includes an audio output unit 12 that outputs audio content and a display unit 11 that outputs image content. Audio content and image content are stored in the storage 13. The storage 13 includes an HD (Hard Disk), an optical disk, a semiconductor memory, and the like. This content can also be downloaded via the Internet via the network connection 14.

The content playback device 10 also includes a key input unit 15 and a microphone 16. The key input unit 15 accepts the input of commands such as "play", "stop", "pause", and "song selection", and outputs the input commands to the CPU 18.

The wireless communication unit 17 performs wireless communication with the input device 1. The information received from the input device 1 includes a command for controlling the content playback device 10. The commands include "play", "record", "pause", and "fast forward" the content.

The CPU (Central Processing Unit) 18 controls the content playback device 10 in response to the input command. Programs and setting information necessary for controlling the content playback device 10 are recorded in the ROM (Read Only Memory) 19 and the storage 13. The CPU 18 uses the RAM (Random Access Memory) 20 as a work area to perform processing such as recording, playing back, and pausing content.

As described above, the input device 1 to which the present invention is applied converts the movement of the user's leg into a command and outputs it to the content playback device 10.

FIG. 6 shows the operation of the input device 1. Although not shown, the input device 1 is provided with a CPU, a memory, and the like that perform signal processing and the like in the input device 1. The input device 1 starts the operation according to the instruction of the user. When the user instructs the start of operation of the input device 1 (step S11), the walking sensor 2 detects the walking signal. The walking signal is stored in the memory for a certain period of time (step S12). When the walking signal stored in the memory is similar to the pattern of normal walking shown in FIG. 7, the CPU determines that the user is walking normally. The method of determining the walking motion will be described. In human walking, the heel of the stepped foot touches the ground, and the toe of the stepped foot touches the ground. Then, when the toe of the stepped foot touches the ground, the action of stepping on the other foot is repeated. The walking sensor 2 detects the walking motion of the user by detecting the ground contact of the heel and the toe. The output of the walking sensor 2 during normal walking is as shown in FIG. 7 (step S13; YES).

On the other hand, when a pattern different from the walking signal shown in FIG. 7 is detected (step S13; NO), the command conversion unit 3 determines the walking signal pattern stored in the memory and the walking signal stored in the command database. Compare with the pattern and search for the command corresponding to the walking signal (step S14).

Then, when the walking signal pattern stored in the memory exists in the command database 31, the command corresponding to this pattern is output to the wireless communication unit 17. The wireless communication unit 17 outputs the input command to the content playback device 10 (step S15). The content playback device 10 performs processing such as playback, stop, fast forward, and rewind of the content in response to a command received from the input device 1. An electronic sound is emitted from the voice output unit 20 to indicate that the command from the user has been accepted.

The input device 1 ends the process when the user stops the operation of the input device 1 (step S16; YES). On the other hand, if the user does not stop the operation of the input device 1 (step S16; NO), the process shifts to step S12, and the processes of steps S12 to S16 are repeated.

As described above, if the input device 1 to which the present invention is applied is used, the device can be operated by using the foot. By operating with the feet, it is possible to save the trouble of taking out the device main body and the remote controller and operating the key input unit 15.

In addition, even when you cannot use your hands during conversation on a mobile phone, working in a factory, carrying luggage, operating a keyboard or mouse, or in a crowded train, you can operate the device with just the movement of your feet. it can.

Although the input device 1 shown in FIGS. 1 and 3 is configured to include a memory, a command conversion unit 3, and a command database 31, these elements may be included in the content playback device 10. That is, in the configuration example described here, the input device 1 includes a walking sensor 2, an amplifier and HPF that shape the walking signal from the walking sensor 2, and a wireless communication unit 4 that transmits the obtained walking signal to the content reproduction device 10. Be prepared.

The configuration of the content playback device 10 will be described with reference to FIG. That is, it is assumed that the memory in the above configuration example is configured by using a part of RAM20, the command database 31 is stored in ROM19, RAM20, or a part of storage 13, and the command conversion unit 3 has CPU18. The process is supposed to be executed. The walking signal transmitted from the wireless communication unit 4 of the input device 1 is received by the wireless communication unit 17 of the content reproduction device 10, and the received walking signal is stored in the RAM 20 for a certain period of time. The CPU 18 compares the walking signal pattern stored in the RAM 20 with, for example, the walking signal pattern stored in the storage 13, converts it into a command as a command conversion unit, and plays, stops, fast forwards, and rewinds the content. And so on.

Since the operation as a whole is the same as the operation in the above-described configuration example, detailed description thereof will be omitted. However, in this configuration example, the walking signal transmitted from the input device 1 is a walking sensor L1 shaped by an amplifier, HPF, or the like. The output signals of L2, R1 and R2 may be multiplexed and transmitted, or for example, the output signals of the walking sensors L1 and L2 and R1 and R2 may be mixed and transmitted. Further, it goes without saying that the analog signal may be transmitted as it is, or may be converted into a digital signal and transmitted as in FIG.

Next, another usage of the input device 1 described above will be described. The input device 1 introduced here has a function of inputting a rhythm. The input device 1 converts the user's steps into musical rhythms. FIG. 8 shows an example of rhythm input. When the command to start the rhythm input is input, the input device 1 recognizes the walking signal as a rhythm, not as a command.

In the following example, the walking signal of stepping on the toe of the right foot and the heel of the left foot is the command Rhy that instructs the start and end of the rhythm input. The input device 1 recognizes the walking signal input between the time when the command Rhy is input and the time when the next command Rhy is input as a rhythm. In this example, the walking signal is input as a rhythm called "tantan tatata".

If the rhythm can be input with the foot like this input device 1, music can be generated based on the user's steps, and the tempo and pitch of existing music can be changed based on the user's steps. it can. In addition, commands for changing the timbre and atmosphere of music may be provided.

In addition to the general-purpose foil strain gauge described above, the walking sensor 2 includes a distance measuring sensor, a CCD (Charge Coupled Device) camera, a CMOS (Complementary MOS) camera, a pressure sensor, a bending sensor, an acceleration sensor, and a capacitance sensor. Some have been used.

The walking sensor 5 shown in FIG. 9A detects stepping on the foot based on the distance between the ground and the shoe. The gait sensor 5 is attached to the toes and heels of shoes. As such a walking sensor 5, an infrared distance measuring sensor, a CCD camera, a CMOS camera, or the like can be used. The walking sensor 6 shown in FIG. 9B detects the stepping on the foot based on the pressure applied from the foot to the shoe. The pressure sensor 6 attached to the toe and heel of the shoe detects the pressure generated when the foot touches the ground. In addition, the bending sensor 7 is attached to the instep of the shoe. The output of the bending sensor 7 increases according to the amount of bending of the instep. The bending sensor 7 can be used for linear control, for example, sound volume adjustment, video camera zoom adjustment, and the like.

The walking sensor 8 shown in FIG. 9 (c) is an acceleration sensor 8. The accelerometer 8 is attached to the toe and heel of the shoe and detects the impact when the foot touches the ground. In addition to the walking sensor described above, there are a voice microphone that detects the ground contact by the contact sound with the ground and a capacitance sensor that detects the ground contact by the change in the capacitance of the human body.

Further, by attaching a vibration sensor or an acceleration sensor to a part of the user's body, the movement of the user's leg can be detected. When the user moves the legs, the user's body is displaced up and down. A vibration sensor or an acceleration sensor that detects the vertical movement of the user can be used as a walking sensor. The detection accuracy of such a walking sensor is higher when it is attached to the trunk, head, waist, or the like of the human body. Therefore, it is advisable to attach it to headphones that are attached to the user's head.

Further, the walking sensor 2 may be attached to a human leg such as the instep, toes, ankles, calves, knees, and thighs. Such walking sensors include, for example, an acceleration sensor, an inclination sensor, a position sensor, an optical sensor, an electromagnetic guidance sensor, a charging position sensor, a wind speed sensor, a pressure pressure sensor, and a current sensor. Further, the sensor may be attached to an animal or the like accompanying a human without being attached to the human body.

The input device 1 described so far can be applied to command input of various electronic devices. For example, when the input device 1 is used to control the video camera, record, stop, zoom, wide, and the like are set as commands that can be input. By using the input device 1 as the input device of the video camera, it is possible to avoid camera shake of the video camera and to operate when the hand is occupied during shooting.

Further, the input device 1 can also be used as an input means to the so-called wearable computer. A wearable computer is a computer that has been miniaturized to the extent that it can be worn by the user. A wearable computer has functions such as sending / receiving e-mails, displaying a television, displaying a video, and an Internet browser, just like a normal personal computer. The wearable computer can also constantly capture the scenery and situation around the user by installing a small video camera in the glasses or the like. The content shot by the video camera is a record of the user's experience.

The amount of user experience records by wearable computers is expected to be enormous. By associating the command of the input device 1 with the ON / OFF of the video camera and the time stamp, the user can record the necessary part from the huge amount of experience records simply by moving the leg.

<figref num="1">It is a block diagram which shows the structure of the input device to which this invention is applied.</figref><figref num="2">It is a figure which shows the structure and the mounting position of the walking sensor using the general-purpose foil strain gauge.</figref><figref num="3">It is a block diagram which shows the structure of the input device when a general-purpose foil strain gauge is used as a walking sensor.</figref><figref num="4">It is a figure which shows an example of a command database and a walking signal corresponding to a command.</figref><figref num="5">It is a block diagram which shows the structure of the content reproduction apparatus.</figref><figref num="6">It is a flowchart explaining the operation of an input device and a content reproduction device.</figref><figref num="7">It is a figure which shows the output of the walking sensor at the time of walking.</figref><figref num="8">It is a figure which shows the output of the walking sensor at the time of rhythm input.</figref><figref num="9">It is a figure which shows another specific example of a walking sensor.</figref>

Code description

1 input device, 2 walking sensor, 3 command converter, 4 wireless communication unit, 10 content playback device, 11 display unit, 12 audio output unit, 13 storage, 14 network connection unit, 15 key input unit, 16 microphone, 17 wireless Communication unit, 18 CPU, 19 ROM, 20 RAM