Operation terminal, electronic unit, and electronic unit system

BACKGROUND OF THE INVENTION

p-0002The present disclosure relates to an operation terminal, an electronic unit operated by the operation terminal, and an electronic unit system including the operation terminal and the electronic unit.

p-0003In recent years, attention has been paid to electronic units which incorporate a sensor such as a gravity sensor and an acceleration sensor, and can carry out an operation on the basis of information obtained from the sensor. The electronic units equipped with the sensor can be intuitively operated by varying its posture, for example. Therefore, with the increasing high functionality, multi functionality, and complicated user operation of recent electronic units, its utilization is expanding.

p-0004For example, Japanese Unexamined Patent Application Publication No. 2002-73247 discloses a portable information terminal which incorporates a tilt detection sensor. When the portable information terminal is tilted, the tilt detection sensor detects its tilt direction. For example, by operating a function switch provided on the portable information terminal in a tilted state, the cursor can be moved to the tilt direction.

SUMMARY OF TEE INVENTION

p-0005In remote controls for electronic units, the number of buttons disposed thereon is increasing due to the high functionality and the multi functionality of electronic units of the recent years. Therefore, the user has to look for a button for an operation from many buttons disposed on the remote control, which is troublesome for the user. In view of this, if the above-mentioned sensor such as the gravity sensor and the acceleration sensor is incorporated in a remote control so that the operation can be carried out by changing the posture of the remote control, the number of buttons can be reduced and a remote operation of the electronic unit can be intuitively carried out, which is very convenient for the user.

p-0006However, in the case where an input operation is carried out by utilizing the sensor incorporated in the remote control, unlike a case where the user operates the electronic unit by consciously pressing the button, there is a fear that the change of the posture is detected even when the user is not conscious and that the remote operation of the electronic unit is automatically or unintentionally carried out.

p-0007It is desirable to provide an operation terminal, an electronic unit, and an electronic unit system, which can reduce a possibility that, when a remote operation of the electronic unit is carried out such as by an orientation and a movement of the operation terminal, an operation is carried out when a user is not conscious.

p-0008An operation terminal according to an embodiment of the present disclosure includes: a posture detection section detecting a posture of the operation terminal, a change of the posture, or both thereof; a mode selection section selecting, based on a detection result of the posture detection section, an operation mode from a plurality of operation modes including a gesture mode and a non-gesture mode; and a transmission section sending a control command corresponding to the detection result of the posture detection section to an electronic unit when the gesture mode is currently selected.

p-0009As used herein, the wording such as “a posture, a change of the posture, or both thereof” is a broad concept including information obtained from a state of the posture of its own or a change in the state thereof. The wording such as “a posture, a change of the posture, or both thereof” includes, for example but not limited to, a stationary state of the posture of its own (orientation), presence or absence of the change of the posture, a direction of the change, an amount of the change, or a speed of the change (acceleration), or any combination thereof.

p-0010An electronic unit according to an embodiment of the present disclosure includes: a reception section receiving a control command as well as control command information from an operation terminal, in which the control command is generated based on a posture of the operation terminal, a change of the posture, or both thereof, and the control command information represents a relationship between the control command and contents of operation to be executed in response to the control command by the electronic unit; and a control section interpreting, based on the control command information, the control command received by the reception section, to carry out a predetermined processing.

p-0011An electronic unit system according to an embodiment of the present disclosure includes: an electronic unit; and an operation terminal performing an operation to allow the electronic unit to work. The operation terminal includes: a posture detection section detecting a posture of the operation terminal, a change of the posture, or both thereof; a mode selection section selecting, based on a detection result of the posture detection section, an operation mode from a plurality of operation modes including a gesture mode and a non-gesture mode; and a transmission section sending a control command corresponding to the detection result of the posture detection section to the electronic unit when the gesture mode is currently selected.

p-0012In the operation terminal, the electronic unit, and the electronic unit system of the embodiments of the present disclosure, the electronic unit is remotely operated such as by an orientation and a movement of the operation terminal. After switching to the gesture mode is carried out on the basis of the detection result from the posture detection section, the control command corresponding to the detection result is sent to the electronic unit, and then the electronic unit is operated on the basis of the control command.

p-0013Advantageously, the operation terminal is a mobile terminal.

p-0014Advantageously, while staying in the non-gesture mode, the mode selection section switches the operation modes from the non-gesture mode to the gesture mode when the detection result of the posture detection section is unlikely to occur in a normal use.

p-0015Advantageously, the mode selection section switches the operation modes from a current operation mode to a predetermined operation mode, when the posture detection section detects that the posture of the operation terminal is maintained in a state for more than a time period.

p-0016Advantageously, the operation terminal further include: a touch panel capturing information through a panel-touch operation; and a control command generation section generating the control command, based on both the detection result of the posture detection section and the information captured through the touch panel.

p-0017Advantageously, the plurality of operation modes include a plurality of gesture modes different from one another.

p-0018Advantageously, the transmission section sends control command information representing a relationship between the control command and contents of operation to be executed in response to the control command by the electronic unit.

p-0019Advantageously, the control command information further includes information related to the posture of the operation terminal, information related to the change of the posture, or both thereof.

p-0020Advantageously, the electronic unit further includes a display section performing a display, based on the control command information, and the control command information includes information of the posture of the operation terminal, information of the change of the posture, or both thereof.

p-0021According to the operation terminal, the electronic unit, and the electronic unit system of the embodiments of the present disclosure, the operation mode is switched to the gesture mode on the basis of the detection result of the posture detection section and then the electronic unit is remotely operated. Therefore, the possibility that the remote operation of the electronic unit is carried out when the user is not conscious can be reduced.

p-0022It is to be understood that both the foregoing general description and the following detailed description are exemplary, and are intended to provide further explanation of the technology as claimed.

BRIEF DESCRIPTION OF THE DRAWINGS

p-0023The accompanying drawings are included to provide a further understanding of the disclosure, and are incorporated in and constitute a part of this specification. The drawings illustrate embodiments and, together with the specification, serve to explain the principles of the technology.

p-0024<figref idrefs="DRAWINGS">FIG. 1</figref> is a configuration diagram illustrating an exemplary configuration of an electronic unit system according to a first embodiment of the present disclosure.

p-0025<figref idrefs="DRAWINGS">FIG. 2</figref> is a block diagram illustrating an exemplary configuration of the electronic unit system shown in <figref idrefs="DRAWINGS">FIG. 1</figref>.

p-0026<figref idrefs="DRAWINGS">FIG. 3</figref> is a state transition view illustrating an exemplary operation of the electronic unit system shown in <figref idrefs="DRAWINGS">FIG. 1</figref>.

p-0027<figref idrefs="DRAWINGS">FIG. 4</figref> is an explanatory view illustrating an exemplary operation of a normal mode N of the electronic unit system shown in <figref idrefs="DRAWINGS">FIG. 1</figref>.

p-0028<figref idrefs="DRAWINGS">FIG. 5</figref> is an explanatory view illustrating an exemplary operation of a gesture mode G of the electronic unit system shown in <figref idrefs="DRAWINGS">FIG. 1</figref>.

p-0029<figref idrefs="DRAWINGS">FIGS. 6A to 6C</figref> are explanatory views illustrating examples of a posture of a mobile device shown in <figref idrefs="DRAWINGS">FIG. 1</figref>.

p-0030<figref idrefs="DRAWINGS">FIG. 7</figref> is a flow chart illustrating an exemplary operation of the electronic unit system shown in <figref idrefs="DRAWINGS">FIG. 1</figref>.

p-0031<figref idrefs="DRAWINGS">FIGS. 8A and 8B</figref> are explanatory views illustrating another exemplary operation of the electronic unit system shown in <figref idrefs="DRAWINGS">FIG. 1</figref>.

p-0032<figref idrefs="DRAWINGS">FIG. 9</figref> is a flow chart illustrating an exemplary operation of the electronic unit system according to a first modification example of the first embodiment of the present disclosure.

p-0033<figref idrefs="DRAWINGS">FIG. 10</figref> is a configuration diagram illustrating an exemplary configuration of the electronic unit system according to a second modification example of the first embodiment of the present disclosure.

p-0034<figref idrefs="DRAWINGS">FIGS. 11A and 11B</figref> are explanatory views illustrating an exemplary operation of the mobile device according to a third modification example of the first embodiment of the present disclosure.

p-0035<figref idrefs="DRAWINGS">FIG. 12</figref> is a state transition view illustrating an exemplary operation of the electronic unit system according to a fourth modification example of the first embodiment of the present disclosure.

p-0036<figref idrefs="DRAWINGS">FIG. 13</figref> is a block diagram illustrating an exemplary configuration of the electronic unit system according to a second embodiment of the present disclosure.

p-0037<figref idrefs="DRAWINGS">FIG. 14</figref> is a block diagram illustrating an exemplary configuration of the electronic unit system according to a third embodiment of the present disclosure.

p-0038<figref idrefs="DRAWINGS">FIG. 15</figref> is a table illustrating an exemplary configuration of a gesture motion correspondence table according to the electronic unit system shown in <figref idrefs="DRAWINGS">FIG. 14</figref>.

p-0039<figref idrefs="DRAWINGS">FIG. 16</figref> is an explanatory view illustrating an exemplary display of the electronic unit system shown in <figref idrefs="DRAWINGS">FIG. 14</figref>.

p-0040<figref idrefs="DRAWINGS">FIG. 17</figref> is an explanatory view illustrating an exemplary display of the electronic unit system according to a modification example of the third embodiment of the present disclosure.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

p-0041Hereinafter, embodiments of the present disclosure will be described in detail with reference to the drawings.

p-0042It should be noted that, description will be made in the following order. <ul><li id="ul0001-0001" num="0000"><ul><li id="ul0002-0001" num="0042">1. First embodiment</li><li id="ul0002-0002" num="0043">2. Second embodiment</li><li id="ul0002-0003" num="0044">3. Third embodiment</li><li id="ul0002-0004" num="0045">1. First embodiment</li><li id="ul0002-0005" num="0046">[Exemplary Configuration]</li><li id="ul0002-0006" num="0047">(Exemplary General Configuration)</li></ul></li></ul>

p-0043<figref idrefs="DRAWINGS">FIG. 1</figref> illustrates an exemplary configuration of an electronic unit system according to a first embodiment of the present disclosure. It is to be noted that, since an operation terminal and an electronic unit according to embodiments of the present disclosure are embodied by the embodiments, the operation terminal and the electronic unit will also be described collectively.

p-0044An electronic unit system <b>1</b> includes a display device <b>10</b> and a mobile device <b>20</b>. As described later, the display device <b>10</b> in this example is a display device which displays a television broadcast received at an antenna. The mobile device <b>20</b> is an electronic unit such as a mobile phone, a PDA (Personal Digital Assistant), and a portable music player, although it is not limited thereto. The mobile device <b>20</b> has a function of sending information to display device <b>10</b> through a communication mechanism A. The communication mechanism A is preferably a mechanism which is equipped in commonly-used display devices, and, for example, a wireless communication using an infrared ray is preferred, although it is not limited thereto. Also, the communication mechanism A may be wireless communications such as the wireless LAN (Local Area Network) and the Bluetooth as well as wire communications such as the LAN and the USB (Universal Serial Bus), although it is not limited thereto. As described later, the mobile device <b>20</b> includes a gravity sensor and a gyro sensor, and functions as a remote control which can operate the display device <b>10</b> by the posture of the mobile device <b>20</b> and a movement of the posture. In other words, by making a gesture motion with the mobile device <b>20</b> in hand, for example, the user can remotely operate the display device <b>10</b>.

p-0045<figref idrefs="DRAWINGS">FIG. 2</figref> illustrates an exemplary configuration of the mobile device <b>20</b> and the display device <b>10</b> of the electronic unit system <b>1</b>.

p-0046The mobile device <b>20</b> includes a posture acquisition section <b>21</b>, an operation mode determination section <b>22</b>, a gesture determination section <b>23</b>, an operation input section <b>24</b>, a display output section <b>25</b>, a transmission section <b>26</b>, and a control section <b>27</b>.

p-0047The posture acquisition section <b>21</b> includes the gravity sensor and the gyro sensor, and detects the posture and the movements of the posture of the mobile device <b>20</b>. The gravity sensor detects an orientation (posture) of the mobile device <b>20</b> relative to gravity. The gyro sensor in this example detects an angular velocity of a rotation of the mobile device <b>20</b> and an acceleration of the movement of the mobile device <b>20</b>. That is, the gyro sensor detects the movement of the posture.

p-0048The operation mode determination section <b>22</b> has a function of determining an operation mode on the basis of the posture of the mobile device <b>20</b> obtained by the posture acquisition section <b>21</b>. The operation mode has a normal mode N (non-gesture mode) in which the remote operation of the display device <b>10</b> using the sensor is not carried out, and a gesture mode G in which the remote operation of the display device <b>10</b> using the sensor is carried out by using the gesture motion. The normal mode N in this example is a mode in which the remote operation of the display device <b>10</b> is carried out without using the sensor. It is to be noted that, the normal mode N may be a mode in which an operation irrelevant to the remote operation of the display device <b>10</b> is carried out. In that case, the normal mode N includes, in a case where the mobile device <b>20</b> is the mobile phone, a state in which the phone is in a standby mode, and in a case where the mobile device <b>20</b> is the portable music player, a state in which the music is being reproduced, for example. The operation mode determination section <b>22</b> distinguishes between the normal mode N and the gesture mode G, for example.

p-0049The gesture determination section <b>23</b> has a function of determining the gesture motion of the user on the basis of the posture and the movement of the posture of the mobile device <b>20</b> which are acquired by the posture acquisition section <b>21</b>.

p-0050The operation input section <b>24</b> is an interface through which the user inputs information, and, in this example, includes mechanical buttons, a touch panel disposed in an overlapping fashion on the display output section <b>25</b>, and the like. The display output section <b>25</b> displays states of the mobile device <b>20</b>, instructions to the user, and the like. The transmission section <b>26</b> generates a control command by which the display device <b>10</b> is remotely operated, and sends the control command as a remote control signal by using the communication mechanism A. The remote control signal is used between the mobile device <b>20</b> and the commonly-used display devices. The control section <b>27</b> controls the circuit blocks thereof so that the circuit blocks operate in cooperation with one another.

p-0051The display device <b>10</b> includes a tuner <b>11</b>, an image processing section <b>12</b>, a display output section <b>13</b>, a sound processing section <b>14</b>, a sound outputting section <b>15</b>, a reception section <b>16</b>, and a control section <b>17</b>.

p-0052The tuner <b>11</b> selects a desired signal from a broadcast wave received at the antenna <b>9</b>, and outputs an image signal and a sound signal. The image processing section <b>12</b> has a function of subjecting the image signal supplied from the tuner <b>11</b> to an image signal processing such as a gamma correction. The display output section <b>13</b> carries out a displaying operation on the basis of the image signal processed in the image processing section <b>12</b>. The sound processing section <b>14</b> has a function of subjecting the sound signal supplied from the tuner <b>11</b> to a sound signal processing such as a volume control and a surround-sound treatment. The sound outputting section <b>15</b> includes a speaker, for example, and outputs a sound on the basis of the sound signal processed in the sound processing section <b>14</b>. The reception section <b>16</b> receives the remote control signal sent from the mobile device <b>20</b> using the communication mechanism A. The control section <b>17</b> has a function of controlling the circuit blocks thereof on the basis of the remote control signal received by the reception section <b>16</b>.

p-0053By this configuration, in the mobile device <b>20</b>, the operation mode determination section <b>22</b> determines the operation mode on the basis of the posture of the mobile device <b>20</b>. In a case where the operation mode is the gesture mode G, when the user makes a gesture motion using the mobile device <b>20</b>, the gesture determination section <b>23</b> determines the gesture motion, and then the remote control signal corresponding to the gesture motion is sent out. In the display device <b>10</b>, various operations are carried out on the basis of the remote control signal.

p-0054Here, the mobile device <b>20</b> is an illustrative embodiment of the “operation terminal” according to the embodiments of the present disclosure. The display device <b>10</b> is an illustrative embodiment of the “electronic unit” according to the embodiments of the present disclosure. The posture acquisition section <b>21</b> is an illustrative embodiment of the “posture detection section” according to the embodiments of the present disclosure. The operation mode determination section <b>22</b> is an illustrative embodiment of the “mode selection section” according to the embodiments of the present disclosure.

[Operation and Function]

p-0055Now, an operation and a function of the electronic unit system <b>1</b> of the present embodiment will be described.

(Overview of General Operation)

p-0056In the mobile device <b>20</b>, the posture acquisition section <b>21</b> detects the posture and the movement of the posture of the mobile device <b>20</b>. The operation mode determination section <b>22</b> determines the operation mode (the normal mode N or the gesture mode G), on the basis of information supplied from the posture acquisition section <b>21</b>. The gesture determination section <b>23</b> determines the gesture motion, on the basis of the information supplied from the posture acquisition section <b>21</b>. The operation input section <b>24</b> receives an input of information by the user. The display output section <b>25</b> displays the states of the mobile device <b>20</b>, the instructions for the user, and the like. The transmission section <b>26</b> generates a control command by which the display device <b>10</b> is remotely operated, and sends the control command as the remote control signal. The control section <b>27</b> controls the circuit blocks thereof so that the circuit blocks operate in cooperation with one another.

p-0057In the display device <b>10</b>, the tuner <b>11</b> selects a desired signal from the broadcast wave received at the antenna <b>9</b>, and outputs the image signal and the sound signal. The image processing section <b>12</b> subjects the image signal supplied from the tuner <b>11</b> to the image signal processing. The display output section <b>13</b> carries out the displaying operation on the basis of the image signal processed in the image processing section <b>12</b>. The sound processing section <b>14</b> subjects the sound signal supplied from the tuner <b>11</b> to the sound signal processing. The sound outputting section <b>15</b> outputs the sound on the basis of the sound signal processed in the sound processing section <b>14</b>. The reception section <b>16</b> receives the remote control signal from the mobile device <b>20</b>. The control section <b>17</b> controls the circuit blocks thereof on the basis of the remote control signal received by the reception section <b>16</b>.

(Specifics of Operation)

p-0058Referring to <figref idrefs="DRAWINGS">FIG. 3</figref> to <figref idrefs="DRAWINGS">FIG. 5</figref>, each operation mode of the electronic unit system <b>1</b> and transitions between each operation mode will be described first.

p-0059<figref idrefs="DRAWINGS">FIG. 3</figref> illustrates a state transition of the operation modes of the electronic unit system <b>1</b>. <figref idrefs="DRAWINGS">FIG. 4</figref> illustrates an exemplary operation of the electronic unit system <b>1</b> in the normal mode. <figref idrefs="DRAWINGS">FIG. 5</figref> illustrates an exemplary operation of the electronic unit system <b>1</b> in the gesture mode.

p-0060As illustrated in <figref idrefs="DRAWINGS">FIG. 3</figref>, the electronic unit system <b>1</b> has two operation modes: the normal mode N and the gesture mode G. In the normal mode N, as illustrated in <figref idrefs="DRAWINGS">FIG. 4</figref>, a display screen <b>29</b> of the mobile device <b>20</b> is facing the user. In this example, buttons indicating functions of the display device <b>10</b> are displayed on the display screen <b>29</b>, and the display device <b>10</b> can be remotely operated by the user by operating these buttons through the touch panel. In the gesture mode G, as illustrated in <figref idrefs="DRAWINGS">FIG. 5</figref>, the display screen <b>29</b> of the mobile device <b>20</b> is not facing the user. In other words, the mobile device <b>20</b> is set to operate in the gesture mode G when the mobile device <b>20</b> in the normal mode N is in a posture which is unlikely to occur in a normal use state. In <figref idrefs="DRAWINGS">FIG. 3</figref>, a transition C<b>1</b> is a transition from the normal mode N to the gesture mode G. That is, the transition C<b>1</b> is performed such that the posture of the mobile device <b>20</b> is changed from the state illustrated in <figref idrefs="DRAWINGS">FIG. 4</figref> to the state illustrated in <figref idrefs="DRAWINGS">FIG. 5</figref>. Likewise, in <figref idrefs="DRAWINGS">FIG. 3</figref>, a transition C<b>2</b> is a transition from the gesture mode G to the normal mode N. That is, the transition C<b>2</b> is performed such that the posture of the mobile device <b>20</b> is changed from the state illustrated in <figref idrefs="DRAWINGS">FIG. 5</figref> to the state illustrated in <figref idrefs="DRAWINGS">FIG. 4</figref>. In <figref idrefs="DRAWINGS">FIG. 3</figref>, a transition D corresponds to various operations in the normal mode N. For example, the transition D is performed by operating the buttons illustrated in <figref idrefs="DRAWINGS">FIG. 4</figref>. A transition E corresponds to various operations in the gesture mode G, and such operations include an operation in which the mobile device <b>20</b> is moved up, down, left and right while the posture of the mobile device <b>20</b> is maintained as illustrated in <figref idrefs="DRAWINGS">FIG. 5</figref>, for example.

p-0061As described below, one reason that the posture of the mobile device <b>20</b> is in the state as illustrated in <figref idrefs="DRAWINGS">FIG. 5</figref> when the mode is switched from the normal mode N to the gesture mode G, is to reduce a possibility that the operation mode is accidentally or unintentionally switched when the user is not conscious.

p-0062<figref idrefs="DRAWINGS">FIGS. 6A to 6C</figref> illustrate postures of the mobile device <b>20</b>. <figref idrefs="DRAWINGS">FIG. 6A</figref> illustrates a case where the display screen <b>29</b> of the mobile device <b>20</b> is facing the user. <figref idrefs="DRAWINGS">FIG. 6B</figref> illustrates a case where the mobile device <b>20</b> is rotated around the x axis. <figref idrefs="DRAWINGS">FIG. 6C</figref> illustrates a case where the mobile device <b>20</b> is rotated around the y axis. The rotation around the x axis illustrated in <figref idrefs="DRAWINGS">FIG. 6B</figref> frequently occurs when the mobile device <b>20</b> is ordinarily operated. For example, such ordinary operation includes an operation of the touch panel and a hardware key. On the other hand, the rotation around the y axis illustrated in <figref idrefs="DRAWINGS">FIG. 6C</figref> is less likely to occur in comparison with the rotation around the x axis. That is, the posture which is rotated around the y axis is unlikely to occur in the normal use state in the normal mode N. In view of this, by switching to the gesture mode G when the posture of the mobile device <b>20</b> is the one which is unlikely to occur in the normal use state, the possibility that the operation mode is accidentally or unintentionally switched when the user is not conscious can be reduced. It is to be noted that, the above-mentioned posture which is unlikely to occur in the normal use state is postures other than a posture in which an operation screen is facing upward, for example. More specifically, the above-mentioned posture which is unlikely to occur in the normal use state is not limited to the posture in which the display screen <b>29</b> is facing the right side of the figure as illustrated in <figref idrefs="DRAWINGS">FIG. 6C</figref>, and may be a posture in which the display screen <b>29</b> is facing the left side or the reverse side of the figure.

p-0063In gesture mode G, as described above, the user holds the mobile device <b>20</b> and moves the mobile device <b>20</b> up, down, left and right, for example. In this case, as illustrated in <figref idrefs="DRAWINGS">FIG. 6C</figref>, in comparison with the mobile device <b>20</b> rotated around the x axis (<figref idrefs="DRAWINGS">FIG. 6B</figref>), the mobile device <b>20</b> rotated around the y axis is easier to hold. That is, for the user, it is easier to move the mobile device <b>20</b> rotated around the y axis (illustrated in <figref idrefs="DRAWINGS">FIG. 6C</figref>) than to move the mobile device <b>20</b> rotated around the x axis (illustrated in <figref idrefs="DRAWINGS">FIG. 6B</figref>). For this reason, from the viewpoint of user-friendliness, in the gesture mode G, the postures illustrated in <figref idrefs="DRAWINGS">FIGS. 5 and 6C</figref> are preferred, although it is not limited thereto.

p-0064Next, the switching of the operation mode in the mobile device <b>20</b> will be specifically described.

p-0065<figref idrefs="DRAWINGS">FIG. 7</figref> is a flowchart illustrating the switching of the operation mode. In the mobile device <b>20</b>, its posture may be detected at a predetermined time interval and when the posture is changed, the switching of the mode is carried out. In the following, each step in the flow is specifically described.

p-0066Firstly, the mobile device <b>20</b> acquires an initial posture (step S<b>1</b>). More specifically, the posture acquisition section <b>21</b> acquires the posture of the mobile device <b>20</b>, and the operation mode determination section <b>22</b> determines the operation mode at that time (initial operation mode) on the basis of the acquired posture.

p-0067Next, the mobile device <b>20</b> acquires a present posture (step S<b>2</b>). More specifically, in the same way as in step S<b>1</b>, the posture acquisition section <b>21</b> acquires the posture of the mobile device <b>20</b>, and the operation mode determination section <b>22</b> determines the operation mode at that time (present operation mode) on the basis of the acquired posture.

p-0068Next, the mobile device <b>20</b> checks whether the posture is changed (step S<b>3</b>). More specifically, the operation mode determination section <b>22</b> checks whether the operation mode determined in step S<b>1</b> is different from the operation mode determined in the step S<b>2</b>. That is, in step S<b>3</b>, whether the present posture (step S<b>2</b>) is changed from the initial posture (step S<b>1</b>) is checked. When the operation mode is different between the step S<b>1</b> and step S<b>2</b>, the flow proceeds to step S<b>4</b>. When there is no change in the operation mode, the flow returns to step S<b>2</b>.

p-0069Next, the mobile device <b>20</b> switches the mode (step S<b>4</b>). More specifically, in the case where the operation mode is switched from the normal mode N to the gesture mode G, each time the gesture motion is determined in the gesture determination section <b>23</b> and the information regarding the gesture motion is supplied from the gesture determination section <b>23</b>, the control section <b>27</b> supplies the information to the transmission section <b>26</b>. Then, the transmission section generates, each time the information is supplied, the control command and sends the control command as the remote control signal. On the other hand, in the case where the operation mode is switched from the gesture mode G to the normal mode N, the control section <b>27</b> does not supply to the transmission section <b>26</b> the information regarding the gesture motion supplied from the gesture determination section <b>23</b>. Alternatively, the control section <b>27</b> may stop the operation of the gesture determination section <b>23</b>. It is to be noted that, when the operation mode is switched, the mobile device <b>20</b> may output a sound or may operate a vibrator, for example, to notify the user that the switching of the operation mode is successfully carried out.

p-0070Then the flow is ended. Thereafter, in the case where the mobile device <b>20</b> is in the gesture mode G, the user can remotely operate the display device <b>10</b> by moving the mobile device <b>20</b> up, down, left, and right as illustrated in <figref idrefs="DRAWINGS">FIG. 5</figref>, for example. On the other hand, in the case where the mobile device <b>20</b> is in the normal mode N, the user can remotely operate the display device <b>10</b> by operating the buttons displayed on the touch panel as illustrated in <figref idrefs="DRAWINGS">FIG. 4</figref>, for example.

(Application Example)

p-0071<figref idrefs="DRAWINGS">FIGS. 8A and 8B</figref> illustrate application examples of the gesture motion. <figref idrefs="DRAWINGS">FIG. 8A</figref> illustrates an operation using up, down, left and right motions, and <figref idrefs="DRAWINGS">FIG. 8B</figref> illustrates an operation by a free cursor.

p-0072In the electronic unit system <b>1</b>, by moving the mobile device <b>20</b> up, down, left, and right as illustrated in <figref idrefs="DRAWINGS">FIG. 8A</figref>, the remote operation of the display device <b>10</b> can be carried out. Thereby, the electronic program guide (EPG) displayed on the display device <b>10</b> can be operated, for example. It is to be noted that the gesture motion is not limited to the operation accompanied by the display on the display device <b>10</b>. For example, a channel of the display device <b>10</b> may be changed by a horizontal movement, and the sound volume may be changed by a vertical movement. Further, the direction of the gesture motion is not limited to the up, down, left and right, and a diagonal movement may be included, for example.

p-0073In addition, in the electronic unit system <b>1</b>, by moving the mobile device <b>20</b> as illustrated in <figref idrefs="DRAWINGS">FIG. 8B</figref>, for example, a function of free cursor in which a position of a cursor displayed on the display device <b>10</b> can be optionally set can be implemented.

[Effect]

p-0074As described above, in the present embodiment, since the two modes of the normal mode and the gesture mode are provided and they can be switched to one another, the user can switch the mode to the gesture mode only when the user wants to carry out the remote operation using the gesture motion. Therefore, the possibility that the remote operation is carried out when the user is not conscious can be reduced.

p-0075In addition, in the present embodiment, since the switching of the operation mode is carried out when the posture of the mobile device is in a posture which is unlikely to occur in the normal use state, the possibility that the operation mode is accidentally or unintentionally switched when the user is not conscious can be reduced.

p-0076In addition, in the present embodiment, since the mobile device employs the commonly-used communication mechanism A and remote control signal, it is not necessary for the display device to have a special function and the display device may be a commonly-used display device.

Modification Example 1-1

p-0077In the above-mentioned embodiment, the switching of the operation mode is carried out when the change of the posture of the mobile device <b>20</b> is detected. However, this is not restrictive. An example is described below.

p-0078<figref idrefs="DRAWINGS">FIG. 9</figref> is a flow chart illustrating a case where the switching of the operation mode is carried out according to a present modification example. Operations in steps S<b>11</b> to S<b>13</b> and step S<b>15</b> are the same as those in steps S<b>1</b> to S<b>3</b> and step S<b>4</b> according to the above-mentioned first embodiment (<figref idrefs="DRAWINGS">FIG. 7</figref>), respectively. That is, the flow chart of the present modification example is a flow chart in which step S<b>14</b> is added to the flow illustrated in <figref idrefs="DRAWINGS">FIG. 7</figref>. Below, step S<b>14</b> is described.

p-0079In step S<b>14</b>, the mobile device <b>20</b> checks whether the posture of the mobile device <b>20</b> is unchanged (is the same) for more than a predetermined time period. More specifically, the operation mode determination section <b>22</b> checks, by using determination results of previous operation modes determined in steps S<b>11</b> and S<b>12</b>, whether the posture of the mobile device <b>20</b> is unchanged after the change of the posture for more than the predetermined time period (e.g., one second or more). When the posture is unchanged for more than the predetermined time period, the flow proceeds to step S<b>15</b>, and when the posture is changed (is not the same posture) in the predetermined time period, the flow returns to step S<b>12</b>.

p-0080As above, the switching of the operation mode is carried out after the posture is kept (is kept unchanged) from the previous change of the posture for the predetermined time period. Thus, there is no switching of the mode caused by an instantaneous change in the posture and the possibility that the operation mode is accidentally or unintentionally switched when the user is not conscious can be reduced.

Modification Example 1-2

p-0081In the above-mentioned embodiment, in the gesture mode G, the mobile device <b>20</b> remotely operates only the display device <b>10</b>. However, this is not restrictive. Alternatively, two devices, the display device <b>10</b> and a recording and reproducing device <b>70</b>, may be remotely operated by the mobile device <b>20</b> as illustrated in <figref idrefs="DRAWINGS">FIG. 10</figref>. In this case, the two devices may be operated in the gesture mode G such that, for example, a fast-forward and a rewind of the recording and reproducing device <b>70</b> are carried out by moving the mobile device <b>20</b> left and right, and that an adjustment of a sound volume of the display device <b>10</b> is carried out by moving the mobile device <b>20</b> up and down.

Modification Example 1-3

p-0082In the above-mentioned embodiment, in the gesture mode G, the mobile device <b>20</b> remotely operates the display device <b>10</b> only by the gesture motion. However, this is not restrictive. For example, a touch panel (operation input section <b>24</b>) disposed in an overlapping fashion on the display output section <b>25</b> of the mobile device <b>20</b> may be used. An example is described below.

p-0083<figref idrefs="DRAWINGS">FIGS. 11A and 11B</figref> illustrate exemplary displays of the display output section <b>25</b> in the gesture mode G according to a present modification example. <figref idrefs="DRAWINGS">FIG. 11A</figref> illustrates a case in which the display device <b>10</b> is remotely operated, and <figref idrefs="DRAWINGS">FIG. 11B</figref> illustrates, in relation to the modification example 1-2, a case in which the display device <b>10</b> and the recording and reproducing device <b>70</b> are remotely operated. In the present modification example, as illustrated in <figref idrefs="DRAWINGS">FIGS. 11A and 11B</figref>, items by which the devices are operated are displayed on the display screen <b>29</b>, and the user carries out the gesture motion while pressing the buttons of the items in order to remotely operate the devices. Namely, in this example, items for a sound volume operation and a channel operation of the display device <b>10</b>, and items for a chapter operation and a reproducing speed operation of the recording and reproducing device <b>70</b> are displayed, and instructions for increasing or decreasing the items (e.g., instructions for increasing or decreasing the sound volume) are carried out by the gesture motion. Thus, the user can intuitively carry out various kinds of operations.

Modification Example 1-4

p-0084In the above-mentioned embodiment, the operation mode includes the two modes of the normal mode N and the gesture mode G. However, this is not restrictive. Alternatively, for example, the operation mode may include three modes of a normal mode N and two gesture modes G<b>1</b> and G<b>2</b>.

p-0085<figref idrefs="DRAWINGS">FIG. 12</figref> is a state transition view illustrating an operation mode of an electronic unit system according to a present modification example. The electronic unit system has three operation modes of the normal mode N and the two gesture modes G<b>1</b> and G<b>2</b>. The switching operation of the operation mode may be carried out such that, for example, the mode is switched to the gesture mode G<b>1</b> when the display screen <b>29</b> is directed to the right side as illustrated in <figref idrefs="DRAWINGS">FIG. 5</figref>, and that the mode is switched to the gesture mode G<b>2</b> when the display screen <b>29</b> is directed to the left side. Alternatively, for example, by using the gyro sensor of the posture acquisition section <b>21</b>, as illustrate in <figref idrefs="DRAWINGS">FIG. 6C</figref>, the mode may be switched to the gesture mode G<b>1</b> with a rotation around the y axis in a positive direction, and the mode may be switched to the gesture mode G<b>2</b> with a rotation in a negative direction. The gesture mode G<b>1</b> and the gesture mode G<b>2</b> can be separately used such that, for example, a frequently-used function is operated in the gesture mode G<b>1</b>, and that a function which is not frequently used is operated in the gesture mode G<b>2</b>. Further, in a case where a plurality of devices are operated as in the modification example 1-2, the operations may be carried out such that the operation of the display device <b>10</b> is carried out in the gesture mode G<b>1</b>, and that the operation of the recording and reproducing device <b>70</b> is carried out in the gesture mode G<b>2</b>, for example.

Other Modification Examples

p-0086In the above-mentioned embodiment, the mobile device <b>20</b> remotely operates the display device <b>10</b>. However, this is not restrictive and any electronic unit having the communication mechanism A may be remotely operated.

2. Second Embodiment

p-0087Next, an electronic unit system <b>2</b> according to a second embodiment of the present disclosure will be described. In the first embodiment described above, the mobile device <b>20</b> sends the remote control signal by using the communication mechanism A equipped in the commonly-used display device. In the present embodiment, alternatively, a remote control signal including a unique control command is sent to a dedicated display device by using a unique communication mechanism. It is to be noted that, the same reference numerals are attached to the same components as those of the above-mentioned electronic unit system <b>1</b> according to the first embodiment, and description thereof is appropriately omitted.

p-0088<figref idrefs="DRAWINGS">FIG. 13</figref> illustrates an exemplary configuration of the electronic unit system <b>2</b> according to a present modification example. The electronic unit system <b>2</b> includes a mobile device <b>40</b> and a display device <b>30</b>.

p-0089The mobile device <b>40</b> includes a transmission section <b>46</b>. The transmission section <b>46</b> generates a unique control command and sends the unique control command as a remote control signal by using a communication mechanism B. The unique control command is a command which sends only information indicating that the mobile device <b>40</b> is moved right when the mobile device <b>40</b> is moved right in the gesture mode G, for example. More specifically, in this example, only the information concerning an operation of the mobile device (gesture motion) is included in the unique control command while information concerning an operation of display device <b>30</b> is not included, and as described later, in the display device <b>30</b>, the information concerning the operation of the mobile device <b>40</b> is converted to the information concerning the operation of the display device <b>30</b>. As the communication mechanism B, wireless communications such as the wireless LAN (Local Area Network), the Bluetooth, and the infrared ray, as well as wire communications such as the LAN and the USB (Universal Serial Bus) can be used.

p-0090The display device <b>30</b> includes a reception section and a command determination section <b>39</b>. The reception section <b>36</b> receives, from the transmission section <b>46</b> of the mobile device <b>40</b>, the remote control signal including the unique control command. The command determination section <b>39</b> has a function of analyzing the received unique control command on the basis of a previously defined correspondence relationship between the operation of (manipulation of) the mobile device <b>40</b> and the operation (contents of the operation) of the display device <b>30</b>, and supplying the result of the analysis to the control section <b>17</b>.

p-0091By this configuration, when the user carries out the gesture motion with the mobile device <b>40</b>, the mobile device <b>40</b> sends the unique control command indicating the information of the gesture motion. In the display device <b>30</b>, the command determination section <b>39</b> analyzes the received control command on the basis of the above-mentioned correspondence relationship, and the display device <b>30</b> carries out the operation corresponding to the control command.

p-0092As described above, in the present embodiment, since the information of the operation of the mobile device is directly sent to the display device, a load of the mobile device can be reduced. Other effects are the same as those of the above-mentioned first embodiment.

3. Third Embodiment

p-0093Next, an electronic unit system <b>3</b> according to a third embodiment of the present disclosure will be described. The electronic unit system <b>3</b> of the present embodiment has a display device which displays on the screen the correspondence relationship between the gesture motion of the mobile device and the operation (contents of the operation) of the display device. It is to be noted that, the same reference numerals are attached to the same components as those of the above-mentioned electronic unit system <b>1</b> according to the first embodiment and the above-mentioned electronic unit system <b>2</b> according to the second embodiment, and description thereof is appropriately omitted.

p-0094<figref idrefs="DRAWINGS">FIG. 14</figref> illustrates an exemplary configuration of the electronic unit system <b>3</b>. The electronic unit system <b>3</b> includes a mobile device <b>60</b> and a display device <b>50</b>.

p-0095The mobile device <b>60</b> includes a transmission section <b>66</b>. The transmission section <b>66</b> sends, at the time of the switching from the normal mode N to the gesture mode G and the like, for example, a gesture motion correspondence table TG (described later). It is to be noted that, the timing of sending the gesture motion correspondence table TG is not limited thereto. For example, the gesture motion correspondence table TG may be sent each time the display device <b>50</b> is operated by using the mobile device <b>60</b>. More specifically, the gesture motion correspondence table TG may be sent at a timing where an operation of up, down, left and right is instructed by using the mobile device <b>60</b> when the display device <b>50</b> displays an electronic program guide, and also may be sent at a timing where the sound volume or channel is changed by using the mobile device <b>60</b> when a television program is displayed, for example.

p-0096<figref idrefs="DRAWINGS">FIG. 15</figref> illustrates an exemplary configuration of the gesture motion correspondence table TG. The gesture motion correspondence table TG describes therein a correspondence relationship among gesture motions in the gesture mode G, control commands actually sent from the mobile device <b>60</b> in each gesture motion, and operations (contents of the operations) of the display device <b>50</b> upon reception of the control command. After sending the gesture motion correspondence table TG to the display device <b>50</b> in advance, the mobile device <b>60</b> sends to the display device <b>50</b> the remote control signal including the unique control command. Thus, the display device <b>50</b> can recognize the specifics of the instruction content of the unique control command.

p-0097The display device <b>50</b> includes a reception section <b>56</b>, a holding section <b>58</b>, a command determination section <b>59</b>, and a control section <b>57</b>. The reception section <b>56</b> receives the remote control signal including the unique control command from the transmission section <b>66</b> of the mobile device <b>60</b>. The holding section <b>58</b> holds the gesture motion correspondence table TG received by the reception section <b>56</b>. The command determination section <b>59</b> has a function of analyzing the received unique control command on the basis of the gesture motion correspondence table TG, and supplying the result of the analysis to the control section <b>57</b>. In addition to the functions of the control section <b>17</b> of the above-mentioned first embodiment, the control section <b>57</b> generates an operation (manipulation) guide screen <b>71</b> (described later) on the basis of the gesture motion correspondence table TG when the mobile device <b>60</b> operates in the gesture mode G, and controls the image processing section <b>12</b> to display the operation guide screen <b>71</b> on the display output section <b>13</b>.

p-0098<figref idrefs="DRAWINGS">FIG. 16</figref> illustrates an exemplary display of the operation guide screen <b>71</b>. The operation guide screen <b>71</b> shows a correspondence relationship between gesture motions of the mobile device <b>60</b> and operations (contents of the operations) of the display device. Thereby, there is no need for the user to memorize all the gesture motions, and the remote operation of the display device can be carried out more easily. In particular, in a case where the user, who uses the electronic unit system <b>3</b> for the first time, learns the gesture motion, the burden of learning the gesture motion can be reduced. It is to be noted that, the operation guide screen <b>71</b> may be displayed at any time in the gesture mode G. Also, the display or non-display of the operation guide screen <b>71</b> may be selected.

p-0099The gesture motion correspondence table TG is an illustrative embodiment of the “control command information” according to the embodiments of the present disclosure.

p-0100According to this configuration, the display device <b>50</b> generates and displays the operation guide screen <b>71</b> on the basis of the previously-received gesture motion correspondence table TG. Then, the user moves up the mobile device <b>60</b> when the user wants to increase the sound volume of the display device <b>50</b>, for example. Then, the mobile device <b>60</b> generates and sends an unique control command indicating the up movement. In the display device <b>50</b>, the command determination section <b>59</b> determines, by comparing the received control command with the gesture motion correspondence table TG, whether the control command is the instructions for increasing the sound volume.

p-0101As described, in the present embodiment, the mobile device sends the gesture motion correspondence table TG to the display device so that the display device can recognize the relationship between the gesture motion and the operation (contents of the operation) of the display device, and with the display of the information indicating the relationship, the user can remotely operate the display device more easily. Other effects are the same as those of the above-mentioned first and second embodiments.

Modification Example 3-1

p-0102In the above-mentioned embodiment, the mobile device remotely operates only the display device <b>50</b>. However, this is not restrictive. For example, the mobile device <b>60</b> may operate the recording and reproducing device <b>70</b> in addition to the display device <b>50</b>. <figref idrefs="DRAWINGS">FIG. 17</figref> illustrates an exemplary display of the operation guide screen <b>71</b> of a present modification example. In this case, for example, a fast-forward and a rewind of the recording and reproducing device <b>70</b> may be carried out by moving the mobile device <b>60</b> left and right; a reproduction and a stop of the recording and reproducing device <b>70</b> may be carried out by moving the mobile device <b>60</b> in a circular motion; and an adjustment of the sound volume of the display device <b>50</b> may be carried out by moving the device up and down.

Modification Example 3-2

p-0103In the above-mentioned embodiment, the display device <b>50</b> generates the operation guide screen <b>71</b> on the basis of the received gesture motion correspondence table TG. However, this is not restrictive. In addition thereto, in accordance with a state of the display device <b>50</b> and a content displayed on the display device <b>50</b>, the gesture motion displayed on the operation guide screen <b>71</b> may be changed, for example. More specifically, it is also practicable that, for example, the mobile device <b>60</b> sends different gesture motion correspondence table TGs according to whether a television program is to be displayed or an electronic program guide is to be displayed, so that the display device <b>50</b> displays the operation guide screen <b>71</b> on the basis of the gesture motion correspondence table TG thus received. In addition, for example, it is also practicable that the mobile device <b>60</b> sends different gesture motion correspondence table TGs according to whether the television program is to be displayed or the Blu-ray Disc (registered trademark) is to be reproduced, so that the display device <b>50</b> displays the operation guide screen <b>71</b> on the basis of the gesture motion correspondence table TG thus received.

p-0104Although the present disclosure has been described based on the embodiments and the modification examples, the present disclosure is not limited to the embodiments and the modification examples and various modifications can be made.

p-0105For example, in the above-mentioned embodiments, the mobile device has the display output section. However, this is not restrictive. Alternatively, a mobile device which does not have the display output section may be adopted. In this case, the mobile device may be a remote control by which the display device is remotely operated by using an infrared ray, for example. Also in this case, the above-mentioned effects can be obtained such that, the orientation of the remote control is changed as illustrated in <figref idrefs="DRAWINGS">FIGS. 6A to 6C</figref>; then the posture acquisition section <b>21</b> detects the posture and the movement of the posture; and then the operation mode is switched from the normal mode to the gesture mode.

p-0106Further, for example, in the above-mentioned embodiments, the operation mode determination section determines the operation mode on the basis of the posture of the mobile device acquired by the posture acquisition section. However, this is not restrictive. Alternatively, for example, the operation mode determination section may determine the operation mode on the basis of only the movement of the posture of the mobile device or on the basis of both the posture of the mobile device and the movement of the posture of the mobile device. In either case, if the posture and the movement of the posture of the mobile device for determining the operation mode are those which are unlikely to occur in the normal use state in the normal mode N, the possibility that the operation mode is accidentally or unintentionally switched when the user is not conscious can be reduced. An example of the case where the operation mode is determined on the basis of only the movement of the posture of the mobile device is such that, for example, if the mobile device is strongly shaken predetermined times or the mobile device is rotated by a predetermined manner, then the mobile device detects the movement to determine the operation mode.

p-0107Further, for example, in the above-mentioned second and third embodiments, as in the above-mentioned first embodiment, the switching operation of the operation mode may be carried out when the posture of the mobile device is kept (kept unchanged) from the previous change of the posture for more than the predetermined time period.

p-0108Further, for example, in the above-mentioned second and third embodiments, as in the above-mentioned first embodiment, the mobile device <b>20</b> may remotely operate the display device <b>10</b> by using the touch panel disposed in an overlapping fashion on the display output section of the mobile device.

p-0109Further, for example, in the above-mentioned second and third embodiments, as in the above-mentioned first embodiment, the operation mode may include the three modes of the normal mode N and the two gesture modes G<b>1</b> and G<b>2</b>.

p-0110The present disclosure contains subject matter related to that disclosed in Japanese Priority Patent Application JP 2010-128741 filed in the Japan Patent Office on Jun. 4, 2010, the entire content of which is hereby incorporated by reference.

p-0111It should be understood by those skilled in the art that various modifications, combinations, sub-combinations and alterations may occur depending on design requirements and other factors insofar as they are within the scope of the appended claims or the equivalents thereof.