Information presentation apparatus and method

The present invention relates to an information presenting device and an information presenting method for presenting information suitable for a user.

Conventionally, portable music playback devices have become widespread, and users can enjoy music while moving, such as while traveling by train, walking, or jogging. Portable music playback devices include those that play music content recorded on recording media such as MD (Mini Disc; registered trademark) and CD (Compact Disc), and HD (hard disk) and semiconductor memory that record music content. Some have built-in such as.

By the way, the music playback environment of the portable music playback device changes depending on the place and time when the user moves. Also, the mood of the user is constantly changing. Correspondingly, the music suitable for the user is also changing.

As described above, the music playback device reproduces the music content recorded on the recording medium or the recording device as it is, but if the music content already recorded is continuously reproduced in the recording order, the place where the user is located. It is not possible to present music that suits the time and mood of the user. Therefore, conventionally, in order to allow the user to obtain a sense of unity with the music, there is a music playback device that detects the walking pitch of the user and synchronizes the walking pitch of the user with the music tempo of the reproduced music (for example). , See Patent Document 1.).

However, simply synchronizing the music tempo of the reproduced music with the walking pitch of the user does not mean that the music suitable for the user's environment such as the place and time of the user is presented. This applies not only to music content, but also to video and other information.

<patcit num="1"><text>Japanese Unexamined Patent Publication No. 2003-85888</text></patcit>

<p> The present invention has been made in view of the above-mentioned problems, and an object of the present invention is to present an information presenting device and an information presenting method for presenting information suitable for the user's environment to the user.</p>

<p> In order to achieve the above-mentioned object, the information presenting apparatus according to the present invention detects the position of the user in the position detecting means and detects the movement of the user's body in the motion detecting means. The information generation means generates information suitable for the user based on the position of the user and the action of the user. The generated information is presented to the user by the information presenting means.</p><p> Further, the information presenting method according to the present invention detects the position of the user in the position detection step and detects the movement of the user's body in the motion detection step. In the information generation step, information suitable for the user is generated based on the position of the user and the movement of the user's body, and the information generated in the information presentation step is presented to the user.</p>

<p> According to the present invention, since information is generated based on the position of the user and the movement of the user's body, the information changes according to the walking speed of the user and the surrounding environment when the user moves such as walking or jogging. However, it is possible to present information suitable for the user. In addition, since the information changes according to the movement and operation of the user, the user can obtain a sense of unity with the information and the entertainment property is improved.</p>

The present invention is applied to portable information presentation devices such as music playback devices, video playback devices, mobile phones, PDAs, laptop computers, and wearable computers. The present invention is characterized in that the information presenting device is carried and the information presented to the user is generated or the information presented to the user is changed according to the movement of the moving user and the position of the user. ..

Hereinafter, an example in which the present invention is applied to the content reproduction device 1 will be described with reference to FIG. The content playback device 1 is a device that reproduces audio content and video content. The content playback device 1 includes an audio output unit 10 that outputs audio and a display unit 11 that outputs an image. Audio content, video content, etc. are stored in the storage 12. The storage 12 includes an HD (Hard Disk), an optical disk, a semiconductor memory, and the like. Audio content and video content can also be downloaded via the Internet via the network connection unit 13.

The content playback device 1 includes a key input unit 14 and a microphone 15. The key input unit 14 accepts input of commands such as "play", "stop", "pause", and "song selection". The wireless interface 16 wirelessly communicates with the walking sensor 2 and the GPS unit 3, which will be described later, and receives walking data and position data.

The CPU (Central Processing Unit) 17 controls the content playback device 1. The ROM (Read Only Memory) 18 and the storage 12 store programs and setting information necessary for controlling the content playback device 1. The CPU 17 uses the RAM (Random Access Memory) 19 as a work area to analyze the walking motion of the user, analyze the environment of the user, and create and process information according to the environment of the user.

FIG. 2 shows the software configuration of the content playback device 1. The content playback device 1 is a gait analysis unit 20 that analyzes the user's walking motion based on the output of the gait sensor 2, and a position identification unit that identifies the location where the user exists based on the output of the GPS unit 3 and map data. 21, a schedule input unit 22 that accepts the user's schedule input, an environment analysis unit 23 that analyzes the user's environment based on the user's walking motion, the user's position, and the user's schedule, and the environment analysis unit 23 according to the user's environment. It is provided with a presentation information generation unit 24 that generates information and processes information according to the user's environment.

The walking analysis unit 20 analyzes the walking motion of the user based on the walking data output from the walking sensor 2. Specific examples of the walking sensor 2 include an acceleration sensor 4 that detects the vertical movement of the user and a general-purpose foil strain gauge 5 that detects the stepping on the user's foot.

The acceleration sensor 4 is attached to the headphones 40 of the content playback device 1. The headphone 40 is one of the audio output units 10 shown in FIG. FIG. 3 shows an example of mounting the acceleration sensor 4. In the overhead headphone 40a, which is a type of headphone in which the connecting portion 33 connecting the left and right speakers 41 and 42 is hung on the top of the user's head, the acceleration sensor 4 is attached to the center of the connecting portion 43, that is, the upper part of the top of the user's head. .. In the neckband type headphones 40b, which is a type of headphone in which the connecting portion 46 connecting the left and right speakers 44 and 45 is hung on the back of the head of the user, the acceleration sensor 4 is attached to the center of the connecting portion 46, that is, behind the back of the head of the user. .. In the earbud headphone 40c, which is a type of headphone in which a speaker is inserted into a user's ear hole, acceleration sensors 4 are attached to the left and right speakers 47 and 48, respectively.

The accelerometer 4 detects vertical uniaxial vibration. FIG. 4 is an output example of the acceleration sensor 12 during walking. In this figure, the horizontal axis plots the time and the vertical axis plots the acceleration value. In Fig. 4, "fast and small vibration" is detected between 0 and 6 seconds, "slow and small vibration" is detected between 6 and 15 seconds, and "slow and small vibration" is detected between 18 and 22 seconds. "Fast and strong vibration" is detected, "slow and large vibration" is detected between 23 and 32 seconds, and "fast and strong vibration" is detected between 32 and 34 seconds.

The walking motion analysis unit analyzes the walking motion of the user based on the vibration cycle and the swing width. For example, "fast and small vibration" is a small walk, "slow and small vibration" is a slow walk, "fast and strong vibration" is a small run, "slow and large vibration" is skipped, and "fast and strong vibration" is a sprint. to decide. If no vibration is detected, it is judged to be stationary.

In addition, the GPS unit 3 is attached to the headphones 40. If the GPS unit 3 is installed overhead, the radio waves will be less blocked and the accuracy will be improved. In addition to the radio waves output from the satellite, the GPS unit 3 also receives radio waves emitted from the wireless communication network and the satellite communication network for mobile phones as position information.

The GPS unit 3 and the acceleration sensor 4 may be attached to a head-mounted display, a wristwatch, shoes, clothes, accessories, or the like.

FIG. 5 shows a general-purpose foil strain gauge 5 as a specific example of the walking sensor 2. The general-purpose foil strain gauge 5 converts the force in the bending direction into an electric signal. The plus and minus of the electric signal correspond to the bending direction. The walking sensor 2 is attached so as to output a positive electric signal when the foot is stepped on and a negative electric signal when the foot is released from the ground. The general-purpose foil strain gauge 5 is attached to the phosphor bronze plate 51. The output terminal 52 of the general-purpose foil strain gauge 5 is reinforced with a reinforcing material 53 and extends to the outside of the phosphor bronze plate 51. The output terminal 52 of the general-purpose foil strain gauge 5 is connected to the amplifier 54, and the amplifier 54 is connected to the wireless interface 55. The wireless interface 55 transmits the walking data of the user to the content playback device 1.

FIG. 6 shows an output example of the general-purpose foil strain gauge 5. In this example, the output when the user walks at a normal walking tempo, the output when walking at a slow walking tempo, and the output when walking at a fast walking tempo are displayed. The output of the general-purpose foil strain gauge 5 is maximized the moment the user's foot touches the ground, and is minimized the moment the user's foot is off the ground. The general-purpose foil strain gauge 5 may be provided on each of the left and right feet, or may be attached to only one foot and half of the ground contact interval may be used as the walking tempo. FIG. 6 (a) shows the output of the general-purpose foil strain gauge 5 attached to the sole of the left leg, and FIG. 6 (b) shows the output of the general-purpose foil strain gauge 5 attached to the sole of the right leg. There is. The walking tempo of the user is the time interval from the contact of one foot to the contact of the other foot, that is, the general purpose of the other foot from the time when the value of the general purpose foil strain gauge 5 of one foot reaches the maximum. This is the time interval until the value of the foil strain gauge 5 becomes maximum.

The walking data can also be detected by an accelerometer attached to the arm or wrist or an azimuth meter attached to a part of the user's body. Accelerometers attached to the arms and wrists detect hand sway that is synchronized with the stepping on the foot, and the azimuth meter can detect the direction of movement of the user.

When the position identification unit 21 inputs the user's position information from the GPS unit 3, the position identification unit 21 reads out the map information recorded in the storage 12 and compares the position information with the map information. Identify where the user is.

The schedule input unit 22 accepts the user's schedule input. In addition to the schedule to be entered in the normal schedule book such as when, where, and what to do, the user's schedule includes which song to play when doing what and which song to play when feeling. You can enter the schedule of the content such as.

Music schedules are recorded in association with location, time of day, day of the week, mood, and so on. As an example of a music schedule, a jogging course and a schedule of songs played during jogging will be described. In this schedule, you can specify the jogging course, the place (building, signpost) that triggers to change the music, and the song to be played in the meantime. In this schedule, the same song is set to be played repeatedly between one point and the next. Even if the same song is played, the tone of the song changes according to the walking tempo of the user, so that the user does not get bored.

Also, as a schedule, in addition to the song to be played, information on which element of the music to be changed can be input. Input items include tempo, tune, pitch, timbre, and strength. As a result, the user can choose to change only the tempo, change only the pitch, change only the tune, change the content itself, etc., and the degree of freedom of selection is expanded.

In addition, the entered schedule is updated by learning. When the user gives an instruction to stop the played song, change the tone of the song, change the song to be played, etc., this instruction is used as learning data, and it is a judgment material when selecting and changing the music when playing the music in the same environment. It becomes.

The environment analysis unit 23 is based on the user's position specified by the position identification unit 21, the user's schedule input to the schedule input unit 22, and the user's walking motion analyzed by the gait analysis unit 20, the environment around the user and the user. Analyze the psychological state of. For example, suppose a schedule of meeting at the entrance of a department store is recorded at 6 o'clock. When the clock time is 5:50, the user is in the vicinity of the department store, and the user's walking motion is trotting, the environmental analysis unit 23 rushes to the meeting place based on this information. Judge that there is.

The presentation information generation unit 24 generates information suitable for the analysis result of the environment analysis unit 23 and processes the information. As in the above example, when the analysis determines that the user is in a hurry, the rhythm of the music is increased or music with a fast beat is selected in order to increase the walking pace of the user. When the music content is MIDI (Music Instruments Digital Interface), it is possible to easily control the tempo and tone of the music. In addition, the presentation information generation unit 24 creates and presents useful information such as the time required until the meeting time and the current time.

The operation of the content playback device 1 will be described with reference to the flowchart of FIG. The operation of the content playback device 1 starts from the input of the schedule by the user. The schedule input unit 22 records the input from the user in the storage 12 (step S11). Then, the user carries the content playback device 1 and starts moving. The content playback device 1 plays music content or video content while the user is moving (step S12).

Further, the content playback device 1 detects the walking data by the walking sensor 2 and the position data by the GPS unit 3 (step S13). The walking analysis unit 20 analyzes the walking motion of the user based on the walking data. The position specifying unit 21 identifies the user's position based on the output of the GPS unit 3 (step S14).

The environment analysis unit 23 analyzes the user's psychological state and the environment around the user based on the user's walking motion, the user's whereabouts, and the user's schedule, and outputs the analysis result to the presentation information generation unit 24. To do. The presentation information generation unit 24 changes the tune and rhythm of the content currently being played according to the user's psychological state and the surrounding environment, generates appropriate information, and presents it to the user. The information presented to the user may be character data or image data. In addition, information may be presented to the user by vibrating function or blinking or lighting of LED (Light-Emitting Diode) (step S15).

When the user does not instruct to stop the operation (step S16; NO), the content playback device 1 shifts the process to step S12. The content being played by the content playback device 1 is dynamically changed by this process. On the other hand, when the user instructs to stop the operation (step S16; YES), the content playback device 1 completes the process.

The above operation will be described more specifically. In this example, it is assumed that a schedule is recorded in which a user must drop in at a library and a friend's house and return home by a certain time. The user stops at the library and then heads to his friend's house, as shown in Figure 8. However, there is a park between the library and the friend's house, and the user stops at the park on the way to the friend's house. While moving along the above-mentioned route, it is assumed that the user wears the earphone of the content playback device 1 in his / her ear and listens to music.

First, the operation of the content playback device in the section from the user's home, which is the starting point, to the library will be described. The content playback device 1 detects the pace and where the user is heading while moving to the library. The road from my home to the library is flat and there are no outstanding buildings or landscapes. Therefore, the pace of the user becomes monotonous. The environment analysis unit 23 determines that the user is in a normal state. The presentation information generation unit 24 also performs normal continuous playback without changing the music being listened to by the user according to the judgment of the environment analysis unit 23. Then, when the location identification unit 21 detects the arrival of the library, the presentation information generation unit 24 fades out the volume of the music content.

The presentation information generation unit stops playing the music content while the user is in the library. Then, when the position identification unit 21 detects that the user has left the library, the presentation information generation unit 24 fades in the volume of the music content and plays the music at the original volume. When the user has a book or the like to be returned to the library, a message prompting the user to return the book is displayed on the display unit 11. On the contrary, when there is a necessary book, the title of the book and related keywords are displayed on the display unit 11. It is assumed that such a warning message has been entered in the schedule by the user in advance.

When the user leaves the library and starts walking toward the park, the positioning unit 21 detects that the user has started walking along the river, and the gait analysis unit 20 detects that the walking tempo of the user has decreased. From this detection result, the environmental analysis unit 23 determines that the user feels comfortable and is walking slowly. The presentation information generation unit 24 lowers the tempo of the music according to the walking tempo or selects a song that matches the walking tempo of the user according to the analysis result of the environment analysis unit 23. Contrary to the above, when the user is trotting along the road along the river, the song with a fast tempo is selected or the tempo of the song being played is increased according to the walking motion of the user.

When the user arrives at the park and the walking motion stops, the environmental analysis unit 23 determines that the user is resting in the park. The presentation information generation unit 24 plays music suitable for a break in the park, for example, healing music. Further, when the user is taking a break, a video, a television, an e-mail, a weather forecast, or the like may be displayed on the display unit 11.

The road from the park to my friend's house is a spacious road with a lot of greenery. If the walking tempo of the user becomes faster despite such a road, the environmental analysis unit 23 determines that the user is in a hurry. The presentation information generation unit 24 plays a song that accelerates the user's walking, an up-tempo song, or speeds up the tempo of the music being played, according to the analysis result. When there is a place with heavy traffic in the direction of movement of the user, a warning such as "Be careful of the car" is displayed on the display unit 11, or an alert sound is inserted into the song being played.

Upon arriving at a friend's house, the presentation information generator 24 fades out the music being played. And while I'm at my friend's house, I stop the music. When the user leaves the friend's house, the presentation information generation unit 24 fades in the stopped music and plays the music in the state before the stop.

When the user leaves a friend's house, the user finishes the day's schedule. The environmental analysis unit 23 analyzes that the user has digested the schedule and is on the way home. The presentation information generation unit 24 selects and plays music suitable for the end of the day according to the analysis result of the environment analysis unit 23. Also, when the time to return home is fixed, an alert sound is inserted or music with a fast tempo is selected in time for the time to return home.

As described above, the content reproduction device 1 to which the present invention is applied presents to the user information suitable for the walking motion of the user and the position of the user. The information changes according to the walking motion of the user and the position of the user. Therefore, it is possible to improve the entertainment property of the music presented while going out such as jogging or walking.

In addition, since the information to be presented is changed according to the mood and schedule of the user, it is possible to present information that makes the user comfortable, or to present information so that the user acts according to the schedule.

<figref num="1">It is a block diagram which shows the structure of the content reproduction apparatus.</figref><figref num="2">It is a block diagram which shows the software structure of the content reproduction apparatus.</figref><figref num="3">It is a figure which shows the mounting position of an acceleration sensor and a GPS unit.</figref><figref num="4">It is a figure which shows the output example of an acceleration sensor.</figref><figref num="5">It is a figure which shows the structure and the mounting position of the general-purpose foil strain gauge.</figref><figref num="6">It is a figure which shows the output example of the general-purpose foil strain gauge.</figref><figref num="7">It is a flowchart which shows the operation of a content reproduction apparatus.</figref><figref num="8">It is a figure which shows the movement route of a user.</figref>

Code description

1 Content playback device, 2 Walking sensor, 3 GPS unit, 11 Display, 12 Storage, 14 Key input, 16 Wireless interface, 17 CPU, 18 ROM, 19 RAM, 20 Walking analysis, 21 Positioning, 22 Schedule Input section, 23 environment analysis section, 24 presentation information generation section