Portable electronic device with interface adaptable in relation to environmental conditions

Translation of description of equivalent WO 2004054213 A1

PORTABLE ELECTRONIC DEVICE WITH ADAPTIVE INTERFACE ACCORDING TO HIS

ENVIRONMENT

The present invention relates to a portable object, the type wristwatch, cell phone or PDA, including at least one user interface, for example of the voice interface, for receiving and transmitting signals and a management unit of the user interface 5 comprising means for processing transmitted and received signals.

Such mobile objects are known from the prior art, particularly from JP 01-284 791, which relates to a voice recognition diary watch. There will be a voice interface allowing the user to introduce his schedule oral and means of speech recognition and means of storage

10 in order to process the received information and then store the information once processed.

Document US 6,012,030 shows a portable communication device comprising a multimode user interface including a voice interface and a touch or GUI. The portable device toggles

15 automatically to a standby state of the voice interface to an active state of the latter when the user selects the voice interface, or conversely from the active state to the standby state when the user selects another interface.

Such portable devices however have some drawbacks. Indeed, this type of device being portable, the user is likely to use them

20 any time and especially anywhere, for example in transport or in public places. But it often happens that external or environmental conditions are altered during use. Sometimes such as ambient noise becomes excessive so as to make it unusable voice interface, the speech recognition system can not correctly interpreted the sounds he

25 receives. Similarly, sometimes ambient light becomes insufficient to allow the user to use the touch interface or graphical comfortably. The idea would be in the latter case to use the lighting means is not satisfactory for these lighting means consume too much energy, more and when using a touch screen, a large part of illumination is filtered through this

30th. The use of an interface also depends on the environment in which the portable object. Thus, a user interface using a touch-sensitive glass for the reception of data is not usable in a liquid medium. Similarly, the use of a interface using radio frequency signal receiving means is not used in an environment where too much interference waves are received.

The invention aims to overcome the aforementioned drawbacks, preventing the user from using an interface, for example voice, when the latter is no longer able to function properly, and allowing the extent possible to user can always use an operational interface.

For this purpose, this invention, in one embodiment, relates to a portable electronic object comprising a first user interface including the audio signal receiving means and a control unit comprising audio signal processing means characterized in that it comprises Furthermore, an ambient noise sensor for measuring an ambient noise level, the noise sensor being connected to the management unit and in that this management unit also comprises first comparison means for comparing the ambient noise level with a predetermined level of noise, and control means arranged to disable the sound signal processing means when the ambient noise level exceeds the preset noise level.

According to another embodiment, the portable electronic object comprises a first user interface, at least a second user interface and a user interface management unit comprising first and at least second processing means respectively associated with the first and at least second user interfaces, characterized in that it further comprises means for measuring at least one external parameter related to at least one of the user interfaces, the measuring means being connected to the management unit, and in that this management unit also includes comparison means for comparing a measured level with a predetermined level of the external parameter, and control means arranged to enable or disable the processing means associated with the user linked to the external parameter measured by interface the result of the comparison. According to another advantageous embodiment of the invention, the portable electronic device further includes warning means activated to warn the user in case of deactivation of said processing means of a user interface.

The invention also relates to a method of determining a user interface of a portable electronic object according to the various above described embodiments. The invention will be explained below in detail to embodiments given solely by way of example, these embodiments being illustrated by the accompanying drawings in which:

Figure 1 shows a block diagram of the portable object according to a first embodiment of the invention;

Figure 2 shows a table of the operation of processing means of the portable object according to the external conditions;

Figure 3 shows a block diagram of a portable object according to a second embodiment of the invention; Figure 4 shows a decision tree according to a preferred variant of the second embodiment of the portable object;

Figure 5A shows one possible sequence of tests performed as part of a complete audit Figure 4.

Figure 5B shows an example of a possible sequence of tests performed as part of a partial verification of Figure 4.

The block diagram shown in Figure 1 is applicable to any type of portable electronic object 1 and preferably to a wristwatch or a mobile phone. The portable object 1 includes a first user interface 2 called "voice" including means of receiving sound signals 3, for example a microphone, and can also include means of sound signals 4, for example a speaker speaker.

Preferably, the portable 1 further comprises a second user interface object 5 so-called "touch" comprising control elements 6, for example push buttons or touch keys and a display means 7, for example a crystal display liquid or simply a set of needles moving in opposite directions.

A control unit 8 allows managing different user interfaces, for that it includes processing means associated with each user interfaces. 9a sound signal processing means associated with the first user interface 2 to manage the received sound signals and possibly audio signals to be transmitted and controls the processing means 9b associated with the second user interface 5 are used to manage orders received and possibly the data to display.

As already mentioned above, one objective of the invention is to change the user interface depending on external conditions, particularly according to this embodiment, the ambient noise and ambient light. For this, the portable object 1 is equipped with an ambient noise sensor 10, and preferably a light sensor 11. It is noted that preferably, the microphone 3 is used as an ambient noise sensor and the LCD 7 as a light sensor.

The ambient noise sensor allows measurements of the ambient noise level, these measures are transmitted to the control unit via the VHF signal. The light sensor 11 can perform measurements of the level of light it receives, these measures are transmitted to the control unit 8 with a signal Lm. The management unit which are connected to the ambient noise sensor and light, includes first and second 12a and 12b comparison means for respectively comparing the measured ambient noise level Bm with a predefined noise level Bo and level received light Lm measured with a predefined light level Lo. The first means of comparison 12a receive at an input the signal Bm ambient noise level measured from the ambient noise sensor 10 and to the other input a signal corresponding to a predefined noise level Bo 12b and the second comparison means to receive one input the signal Lm of the measured received light level from the light sensor 11 and at the other input a signal corresponding to a predetermined level of light Lo. Depending on the result of comparing the two signals received at input, the first means 12a compares respectively the second 12b comparing means, send in output a Cb control signal, respectively Cl to control means 13 arranged to deactivated the audio signal processing means 9a and / or the processing means of the control members 9b according to the result of the comparisons made by 12a and 12b comparison means. An activation management example and deactivation of different means of treatment, depending on external conditions, is given in the table in Figure 2.

Advantageously, the control unit also includes warning means 14, eg an electromagnetic vibrator connected to the control means 13. The warning means 14 are particularly used to notify the user by means of mechanical vibrations that a predefined levels (Bo Lo) has been exceeded and that user interfaces is no longer usable or is usable again.

The table in Figure 2 shows the active or inactive state of the means for processing the received sound signals and possibly issue (A), and means for processing the orders received by the control devices and possibly data to be displayed ( B), depending on the ambient noise conditions and received light. As regards the ambient noise is considered a predefined level of noise Bo, preferably corresponding to the noise level above which the sound signal processing means (A) no longer function properly. And, as regards the light received by the light sensor, it is considered a preset light level Lo, corresponding for example to a level sufficient brightness to see clearly the data displayed by the display means of the portable object .

Thus we obtain for an ambient noise level measured lower Bm or equal to the predefined noise level Bo and for a received light level measured Lm greater than or equal to the predefined light level Lo, the processing means A and / or B are activated; to a level of ambient noise measured lower Bm or equal to the predefined noise level Bo and a received light level measured Lm less than the predefined level of light Lo, the processing means A are enabled and the processing means B are deactivated; for an ambient noise level measured Bm exceeds the predefined noise level Bo and for a received light level measured Lm greater than or equal to the predefined light level Lo, the processing means A are deactivated and processing means B are activated; to an ambient noise level measured Bm exceeds the predefined noise level Bo and a received light level Lm measured lower than the predefined level of light Lo, the processing means A and B are disabled. In a variant of this first embodiment of the invention, there is provided only to activate the warning means 13 on exceeding a predefined levels of noise or light, leaving the choice to the user discontinue the use of the current functionality.

Note that the audio signal processing means (A) may typically include a speech recognition system for the management of the received signals and a speech synthesizer for the management of audio signals to be transmitted.

Figure 3 shows a block diagram of a portable object, preferably a clock-calendar, according to a second embodiment of the invention. The portable object 101 comprises a first said user interface IU1

"Voice" similar to that described in the first embodiment. The first user interface comprises sound signal receiving means 103, for example a microphone and may also include means of sound signals 104, such as a speaker.

The portable object 101 further comprises a second user interface IU2 called "touch" tactile means comprising data input, such as a tactile crystal 106, comprising at least two electrodes or touch switches, whose operation is described in in greater detail in the patent applications EP 0791868 and EP 0838737, filed on behalf of the Applicant and incorporated herein by reference, and display means 107 of data, such as a liquid crystal display or LCD according to the English terminology "Liquid Crystal Display." Note that in the preferred case of a wristwatch, the tactile glass is superimposed on the LCD.

The portable object further comprises a third user interface IU3, called "radio frequency or RF" comprising receiving means for radio frequency signals 115, for example an RF antenna for receiving the radio frequency signals transmitted by a transmitter of the RF pen-type 116 with motion recognition means and data display 107. preferably, the display means for the second and third IU2 and IU3 user interfaces are the same. Note that the RF antenna may possibly serve as radiofrequency transmitter. RF transmissions between the pen and the portable object may especially meet the Bluetooth standard's requirements.

These three user interfaces are managed by a management unit 108 with premiers109a, second 109b and third 109c processing means respectively associated with the first IU1, second and third IU2 IU3 user interfaces. The first processing means 109a can process audio signals received through the microphone 103 and possibly the sound signals to be transmitted through the speaker 104. The second processing means 109b can process input data to the means of buttons on the touch screen 106 and possibly to display data on the LCD 107. As to the third means 109c of treatment, they can process radio frequency signals received from the RF pen handle 116 by the user and possibly display data on the LCD 107.

The portable object 101 also includes various means for measuring external parameters related to the user interfaces, these measuring means being connected to the management unit. This shall include an ambient noise sensor, preferably the microphone 103, to measure the level of ambient noise (Bm), a light sensor advantageously using the LCD monitor 107 collecting light in combination with a diode, not shown, for detecting a received light level (Lm), a sensor of the parasitic waves, preferably the RF antenna 115, for measuring the level of spurious waves (Om), and of the activation detection means of each of the electrodes of the touch-sensitive glass 106, advantageously incorporated in the second means 109b treatment which send a signal (de) to the control means 113, in case of simultaneous activation of all keys touch 106.

The management unit 108 includes first comparison means 112 for comparing said ambient noise level (Bm) with a predefined noise level (Bo), second means 112b for comparing said received light level (Lm) with a predetermined level of light (Lo), third means 112c for comparing the level of spurious waves measured (Om) with a level of the predetermined parasitic waves (Oo), and control means 113 arranged to deactivate respectively: - the audio signal processing means 109a when the ambient noise level exceeds the predefined noise level Bm> Bo, the processing means 109b actuators when the received light level passes below the predefined light level, Lm <Lo or when simultaneous activation of said at least two electrodes is detected, and the processing means 109c radio frequency signals when the received light level falls below the preset light level, Lm <Lo, or where the level of measured interference wave exceeds the level of predefined unwanted waves, Om> Oo. A decision tree for example the choice of a user interface will be explained in detail in Figure 4.

It is also intended to provide for the portable object 101 activated warning means to warn the user in case of disabling processing means associated with one or more user interfaces. Advantageously, it is provided a plurality of warning means to ensure that the user is properly notified. selecting means 117 between these various warning means are then added, the selection being then determined by reference to at least one predetermined criterion. such was, first means warning sound alarm type 114a preferentially activated when the light received is less than the predefined level of light, second means of warning the vibrating alarm type 114b preferably activated when detecting that the portable object is immersed in a liquid medium, and third means 114c of the warning flashing light or alarm type activated preferably when the ambient noise level exceeds the predefined noise level. Other selection criteria of the various warning means can obviously be used. It should be noted that advantageously, the portable object also comprises calculation means, not shown in Figure 3, the success rate to check the operation of the processing means associated with the interface used.

Advantageously, this portable object may also include means presets, not shown, allowing the user to disable one or more user interfaces. These presets offer the opportunity to the user to disable, for example, the first user interface called "voice" when he goes to the theater or cinema.

It was mentioned that until now based on an external parameter such as ambient noise, the received light, noise or waves the medium in which is immersed the portable object, some user interfaces have their ways treatment of disabled, the latter can not be used properly. It is also possible that one or more user interfaces are no longer used properly because of an involuntary action by the user, for example, depending on its activity. Indeed, a user playing a sport such as running or cycling will struggle to properly use IU2 second and third IU3 user interfaces. To remedy this, it is planned to equip the portable object movement detection means, such as an accelerometer 118, to determine whether the user's activity allows the reliable and correct use of different user interfaces . In the case of an accelerometer is provided for measuring a level of acceleration (Am) of the object and to compare, via fourth means of comparison 112d, to a level preset acceleration (Ao) of this same object. When the acceleration level measured level exceeds the predefined acceleration Am> Ao, it can be provided to disable the processing means of a same or all user interfaces. In a variant of this second embodiment, it is only intended to alert the user that the processing means associated with one or more user interfaces work properly. means for measuring at least one external parameter related to at least one of said user interfaces to measure a level of the external parameter, the comparing means compares this measured level with a predetermined level of this parameter and depending on the result of the comparison is expected to activate warning means. Figure 4 shows a decision tree, according to a preferred variant of the second embodiment of the portable object, for determining a user interface of a portable electronic object comprising a plurality of user interfaces. According to this variant, it is expected that the user can carry out presettings before use of the portable object. These presets are intended to allow the user to disable one or more originally available interfaces. Indeed, it may be useful to manually deactivate some interfaces depending on where it is located, or by activity that we practice etc .. In the event that the user does not perform presets, alternative NO, the portable object carries out a complete verification of carrying out all planned tests, based on external parameters each relating to at least one of the interfaces to determine which are used in predefined acceptable conditions. Advantageously, there is at least one test for each of the three user interfaces, touch or voice RF. In case the user wants to perform pre-settings, alternative

YES, you can disable it to 1, 2 or 3 processing means associated with 3 initially available user interfaces. Once the pre-settings, the portable object performs a partial verification of performing only the tests based on the external parameters related to the user interfaces of which the processing means have not been deactivated.

Details of tests that can be performed in the context of full and partial audits described respectively in Figures 5A and 5B.

Once complete or partial audit, if no user interface is usable in the predefined acceptable terms, the user is warned by the warning means of the type described in Figure 3, a new audit cycle is initiated or after a specified period or on user request. If a single user interface is used, it is automatically selected and made active. If at least two user interfaces are used, the portable object selects one of these interfaces in accordance with a predetermined criterion. This selection criterion can be, for example, the level of power consumption for each usable user interfaces, which consumes less then being selected. Another selection criterion may be the estimated average speed data entry, one that offers the greatest speed then being selected either to the interfaces described in Figure 3, the first, third and second interfaces. Any other criterion of preset selection, in particular by the user himself, can also be employed. When a user interface has been selected, the processing means associated with this interface are activated, these means allowing the interpretation and storage of data entered by the user. It is advantageously provided to regularly carry out an on the success rate of the interpretation of these processing means. A predefined level allows you to share this success rate in two categories, UP and DOWN. If the success rate is HIGH, the interpretation of the data processing means that seek to introduce the user is satisfactory and interpretation can continue. But if the success rate is LOW, interpretation processing means is poor and the portable object automatically disables these processing means and shall conduct a check on the remaining interfaces, taking into account the pre-settings. During these operations, the warning means can be activated to warn the user of the situation.

Figure 5A shows one possible sequence of tests performed as part of a complete audit Figure 4.

First, it is possible to perform parallel measurement of ambient noise, "MEASUREMENT ENVIRONMENTAL NOISE" and measuring the light received, "RECEIVED LIGHT MEASUREMENT".

The measured level of ambient noise (Bm) is compared with a predefined noise level (Bo). When the ambient noise level measured does not exceed the predefined noise level Bm <Bo, a signal is sent to the management unit to indicate that the first voice interface is usable, "VOICE OK".

The received light level measured (Lm) is compared with a predetermined level of light (Lo). When the measured received light level exceeds or equals the preset light level, Lm> Lo, the second and third tactile and RF interfaces may be used, therefore, it is preferably provided to perform two other then tests in parallel. A detection test of the environment, "WATER DETECTION" to check whether the portable object is not immersed in a liquid medium, eg water, preventing the use of the tactile crystal and another test to check the level of interference waves, "CUSTOM wAVE iNTERFERENCE" in the environment of the portable object.

The detection test environment, "WATER DETECTION" to detect the activation of each of the electrodes of the tactile crystal. If simultaneous activation of all electrodes is not detected, a signal (NO) is sent to the management unit to indicate that the second touch user interface is usable, "TOUCH OK". At the same time, the level of measured interference wave (Om) is compared with a predefined level of waves (Oo). When the level of noise measured wave does not exceed the preset level wave, Om <Oo, a signal is sent to the management unit to indicate that the third RF user interface is usable, "RF OK".

Once all the tests, the management unit knows usable user interfaces.

Figure 5B shows an example of a possible sequence of tests performed as part of a partial verification of Figure 4. The partial check differs from the complete check in that the user has defined presets and / or in that that the processing means of one of the user interfaces have been disabled because of a too low rate interpretation thereof. Accordingly, the measurement detection assays or relating to user interfaces that the processing means are disabled are not performed.

There is therefore a pre-stroke ement that is:

If the processing means of the first voice user interface are deactivated, the test consisting in performing a measurement of the ambient noise is not carried out; - If the processing means of the second touch user interface are disabled, the test consisting in performing a detection of the activation of the electrodes of the tactile crystal is not performed; If the RF of the third user interface processing means are deactivated, the test consisting in performing a measurement of spurious waves of the level is not performed;

If the processing means of the second and third touch user and RF interfaces are deactivated, the test consisting in performing a measurement of the received light is not performed; If the treatment of the three user interfaces means are deactivated, no test is conducted.

Depending on the results of this pre-processing management unit can perform or not each of the available tests.

In the example shown, preferably one begins with the test to control the level of light received, "TEST LIGHT". If it should not be performed (NO), it is not necessary or the screening test of the environment, "TEST WATER" or test to control the level parasitic waves, "TEST WAVE". The management unit then checks if the test directly to control the level of ambient noise, "NOISE TEST" must be made.

If there is to be performed (YES), a measure of the received light level is performed, "RECEIVED LIGHT MEASUREMENT". The received light level measured (Lm) is compared with a predetermined level of light (Lo). When the level of received light falls below the preset light level, Lm <Lo, it is not necessary to perform or the "WATER TEST" nor the "TEST WAVE". The management unit then checks directly whether the "NOISE TEST" must be made. When the measured received light level exceeds or equals the predefined level of light Lm> Lo, the management unit checks, according to the results of the pre-treatment, if the "WATER TEST" and / or "TEST WAVE" must be performed.

If the "WATER TEST" must be performed (YES) and a simultaneous activation of all electrodes is not detected during the detection test, "WATER DETECTION" signal (NO) is sent to the unit management to indicate that the second touch user interface is usable, "tOUCH OK".

If the "WAVE TEST" must be performed (YES), a measure of the level of interference waves is performed, "CUSTOM WAVE INTERFERENCE". The level of spurious waves measured (Om) is compared with a predefined level of waves (Oo). When the level of parasitic waves measured does not exceed the preset level wave, Om <Oo, a signal is sent to the management unit to indicate that the third RF user interface is usable, "RF OK".

Once this information is received, if "NOISE TEST" must be performed (YES), a measure of the level of ambient noise is made, "MEASUREMENT ENVIRONMENTAL NOISE". The measured level of ambient noise (Bm) is compared with a predefined noise level (Bo). When the ambient noise level measured does not exceed the predefined noise level Bm <Bo, a signal is sent to the management unit to indicate that the first voice user interface is usable, "VOICE OK".

Once all the tests, the management unit knows usable user interfaces. As regards the examples of verification shown in Figures 5A and

5B, it is quite possible to change the order of the tests, or even to carry them all in parallel.

As previously mentioned, the invention also relates to a method of determining a user interface from the available interfaces for use according to the conditions external to the portable object.

In the case of a portable object comprising a first user interface including the audio signal receiving means, and a management unit comprising first sound signal processing means, the method comprises at least the following operations: performing a measurement of the ambient noise level (Bm) by means of an ambient noise sensor connected to said management unit; - Comparing the ambient noise level measured with a predefined noise level (Bo); deactivating said first processing means when the measured ambient noise level exceeds the predefined noise level (Bm> Bo). If the portable object further comprises a second user interface comprising a touch-sensitive glass comprising at least two electrodes and a display means, a third user interface including radio frequency signal receiving means and the display means, the unit management further comprising touch the ice second processing means and third radio frequency signal processing means, the method then also comprises the following operations: performing a measurement of the received light level (Lm) by means of a sensor light connected to said management unit; comparing the received light level measured with a predetermined level of light (Lo); - Deactivating said second and third processing means when the measured level of received light falls below the predefined light level (Lm <Lo). Advantageously, when the measured level of received light exceeds or equals the predetermined level of light (Lm> Lo) the method also comprises the steps of: detecting the activation of each of said at least two electrodes by means of a detector connected to said management unit; deactivating said second processing means when simultaneous activation of said at least two electrodes is detected; - Perform a measurement of the level of noise waves (Om) by a parasitic waves of sensor connected to the management unit; comparing the level of spurious waves measured with a predefined level of wave interference (Oo); deactivating said third processing means when the measured noise level exceeds the level waves waves preset parasites

(Om> Oo). Preferably, it is provided that the user can define pre-settings to specify the processing means to turn off automatically, and in this case the measuring or user interfaces relating to detection of which the processing means are deactivated are not performed. The ultimate goal is to select a usable user interface, for it is expected to preferentially select an interface among the interfaces whose processing means are not disabled, according to a predetermined criterion, such as power consumption or speed treatment. When an interface has been selected, the rate of treatment interpretation means associated with the selected user interface is periodically calculated and compared with a predefined minimum interpretation rate, and finally the user interface processing means selected are disabled if the calculated interpretation rate is lower than the predefined minimum interpretation rate. The measuring or user interfaces relating to detection of which the processing means are not disabled, are then carried out again.

In addition, measuring or user interfaces relating to detection of which the processing means are not deactivated automatically, are preferably carried out regularly.

If no user interface is used, the user is notified that no user interface is usable by warning means.

It should be noted that the description is given only by way of example and that other embodiments, in particular user interfaces and sensors incorporated in the portable object, may be of the invention. In particular, it is to note that the audio signal processing means of the voice interface can only be means for storing the received words and transmitting. The portable object then further comprising radio frequency or infrared communications with a computer to transmit and receive the stored words, recognizing and synthesizing words being performed on the computer.

Note also that in a power saving reasons, it is expected that the functionality of the portable object, such as PDA, are not activated during a standard use as shown or telephone the object. These particular features can be activated in different ways, including by specific activation of one of the user interfaces. For the voice interface, it can be expected to recognize a particular sound. For the touch interface may be provided to detect the activation of a specific soft button. Finally for the RF interface, it may be provided to detect a particular RF signal from the RF pen.

When the functionality of the portable object is used, it is expected that the user can manually select the interface that he wishes to use it or leaves the object determine the interface to use based on external parameters.

In the latter case, when the portable object is in a critical environment for all interfaces, it is envisaged that it will determine an interface to use by means of a fuzzy logic method, that is to say not not on the basis of threshold values ​​preset, but based on weighted values ​​of ranges. This method has the advantage of allowing the subject to choose the least critical interface when none is a priori usable.

Finally, note that the light sensor used may be a light source capable of measuring the intensity of ambient light as described in application EP 02075879.3 filed in the name of the Applicant.