Method for operating a device having a speaker so as to prevent unexpected audio output

Description of equivalent WO 2020065405 A1

0001Method for operating a device having a speaker so as to prevent unexpected audio output

FIELD OF THE INVENTION

0003The field of this invention is that of mobile phones having speakers. More particularly, the invention relates to a method for operating a device so as to prevent unexpected audio outputs.

BACKGROUND OF THE INVENTION

0005Recent mobile phones (smartphones) offer numerous features, including GPS, internet, music, video playing, games and countless apps.

0006Several mobile operating systems (OS) such as Android or iOS provide a management of audio outputs which depends on the application running in foreground.

0007More precisely, one or more applications could be launched simultaneously, in particular:

0008- one application running in“foreground” (i.e. the application“active” with which the user interacts in real time); and

0009- the possible other applications running in “background” (i.e. “behind the scenes”, without user intervention and mostly without, if not at all, interaction).

0010If a first application running in foreground has audio output (like video/music player, games, etc.) and is switched by the user (i.e. the user starts a second application and the first application now runs in background) the audio output of the first application is suspended. If the user brings back the first application in foreground, the audio output is resumed.

0011Further, the operating systems are generally able to distinguish different audio output units such as built-in speaker, earphones, a Bluetooth headset, a wireless smart speaker, etc.: for different audio output units, the OS will adjust the volume to different levels. These mechanisms generally allow a comfortable continuity of audio outputs with few interactions.

0012Nevertheless, users could be put in awkward positions by their audio outputs in some situation if they unlock their phone while an application with a loud audio input is still running in foreground (for instance a movie was being watched) or if they accidentally select this application while it was running in background.

0013In all of these cases, the audio output is automatically resumed on the built-in speaker of the phone, causing an embarrassing loud noise drawing attention to the user.

0014There is consequently a need for a simple and user-friendly solution which prevents the occurrence of such situations.

SUMMARY OF THE INVENTION

0016For these purposes, the present invention provides a method for operating an electronic device comprising a processing unit and a speaker, the method being characterized in that it comprises the following steps, performed by the processing unit:

0017when detecting that a process regarding an application installed in the electronic device which implies audio output from the speaker is to be performed, determining that the electronic device is in a quiet environment;

0018when the electronic device is determined to be in a quiet environment, performing said process with a reduced level of audio output from the speaker.

0019As it will be shown, such assessment of the environment allows to foreseeing whether noise from the speaker could be heard and embarrass the user, so as to enable reducing the level of audio output in such a case, and prevent the occurrence of any awkward situation, while still allowing a comfortable continuity of audio outputs with few interactions.

0020Preferred but non limiting features of the present invention are as follow: • the process regarding an application installed in the electronic device corresponds to one of the following :

0021- the unlocking of the electronic device by a user while said application is running in the foreground and provides an audio output;

0022- the switching of said application from running in background to running in foreground while said application provides an audio output; and

0023- the disconnection of an external audio output unit while said application is running in foreground and provides an audio output.

0024• the electronic device comprises a microphone, the determining step comprises recording ambient noise using the microphone;

0025• the determining step further comprises analyzing the recorded ambient noise so as to determine a noise intensity value;

0026• the environment is considered quiet when said noise intensity value is below a predetermined threshold;

0027• said reduced level of audio input is function of the noise intensity value determined;

0028• the speaker is muted in the performing step.

0029• the method comprises a previous step of monitoring requests for audio output, from an application to the speaker, so as to detect when a process implying audio output from the speaker is to be performed;

0030• the method is implemented by a media controller of an operating system of the device;

0031• the determining step is only performed when detecting that a process implying audio output from the speaker is to be resumed;

0032• the performing step comprises, if it has been determined that the electronic device is not in a quiet environment, performing said process with a normal level of audio output from the speaker;

0033• the performing step comprises, if it has been determined that the electronic device is in a quiet environment, inviting the user to confirm whether to perform said process with a reduced level of audio output from the speaker; • the inviting step comprises requesting the user to choose between:

0034- performing said process with a reduced level of audio output from the speaker;

0035- performing said process with a normal level of audio output from the speaker;

0036- cancelling said process.

0037In a second aspect, the invention provides an electronic device comprising at least one processing unit and a speaker, said processing unit being configured to implement:

0038- when detecting that a process implying audio output from the speaker is to be performed, determining that the electronic device is in a quiet environment;

0039- when the electronic device is determined as being in a quiet environment, performing said process with a reduced level of audio output from the speaker.

0040According to a third and a fourth aspects, the invention provides a computer program product, comprising code instructions for executing a method according to the first aspect for operating a device comprising at least one processing unit and a speaker; and a computer-readable medium, on which is stored a computer program product comprising code instructions for executing a method according to the first aspect for operating a device comprising at least one processing unit and a speaker.

BRIEF DESCRIPTION OF THE DRAWINGS

0042The above and other objects, features and advantages of this invention will be apparent in the following detailed description of an illustrative embodiment thereof, which is to be read in connection with the accompanying drawings wherein: - figure 1 illustrates an example of architecture in which is performed the method according to the invention; and

0043- figure 2 is a diagram representing steps of a preferred embodiment of a method according to the invention.

DETAILED DESCRIPTION PREFERRED EMBODIMENTS

0045Architecture The present invention relates to a method for operating an electronic device 1 as represented by figure 1.

0046As explained, the electronic device 1 comprises one or more processing unit(s) 11 and a speaker 13 (for instance a built-in speaker, acting as the default audio output unit of the device 1. It is to be noted that the electronic device could comprise a plurality of speakers). In a preferred embodiment, the electronic device 1 further comprises a microphone 14, and possibly a user interface such as a screen, possibly a touch-sensitive screen, for displaying messages.

0047The electronic device 1 typically further comprises a memory 12 (for example flash memory), in particular for storing applications, which can be of various types. In a known fashion, the processing unit 11 is able to run simultaneously one or more of these applications, in particular as explained:

0048- one application running in“foreground” (i.e. the“top” application); and

0049- the possible other applications running in “background” (i.e.

0050“behind the scenes”, without user intervention).

0051In the present method, the processing unit 11 is able to perform a process implying audio output from the speaker 13, such as the playing of a video, a game, etc.

0052Said“process” is typically the process corresponding to the application running in foreground. In other words, starting a process corresponds to launching a new application, and resuming such process corresponds to unlocking the electronic device 1 while the application runs in foreground or switching the application from background to foreground.

0053The electronic device 1 may further comprise others units such as a battery, a location unit for providing location data representative of the position of the electronic device 1 (using for example GPS, network triangulation, etc.), a communication unit for connecting (in particular wirelessly) the electronic device 1 to a network 20 (for example WiFi, Bluetooth, and preferably a mobile network, in particular a GSM/UMTS/LTE network, see below), etc.

0054The electronic device 1 is typically a smartphone, a tablet computer, a laptop, etc. In the following description, the example of a smartphone will be used.

0055Audio output from speaker

0056The present method is performed by the processing unit 11 of the electronic device 1 , and is advantageously implemented by the operating system of this electronic device 1 , and in particular a“media controller”, i.e. a software module of the operating system dedicated to“push” media data to be played to the right unit, i.e. to the speaker/earphones/a wireless speaker, etc.

0057For example, the media controller sends audio data toward earphones instead of the speaker 13 when being indicated that earphones are plugged.

0058To rephrase again, while the operating system generally indistinctly order performing processes implying audio output, the media controller determines whether such audio output should actually be delivered from the speaker 13 or from another unit, such as earphones, etc.

0059Alternatively, the present method can be implemented by software applications that specifically use audio output (audio/video players, games, etc.).

0060As represented by the figure 2, the present method comprises a determining step (a) of determining if the electronic device 1 is in a quiet environment, or not. This determining step (a) is performed after having detected (step aO) that a process implying audio output from the speaker 13 is to be performed.

0061More precisely, detecting that a process implying audio output from the speaker 13 is to be performed (step aO) triggers the determining step (a).

0062To the contrary, detecting that a process implying no audio output is to be performed does not trigger the determination step (a). To rephrase again, the determining step (a) is performed only when detecting that an process implying some audio output is to be performed.

0063In a more refined embodiment, detecting that a process implying audio output to another sound outputting unit (such as earphones) than the speaker 13 is to be performed does not trigger the determination step (a). To rephrase again, in such an embodiment, the step (a) is performed only when detecting that a process, which regards an application installed in the electronic device 1 and which implies some audio output from the speaker 13, and not from another sound outputting unit such as earphones, is to be performed.

0064To this end, the processing unit 11 preferably monitors requests for audio output, from the application to the speaker 13, and triggers the determining step (a) each time a process implying audio output from the speaker 13 is detected based on such requests.

0065It is to be noted that the media controller inherently performs detecting step (aO) as its very role is to receive and execute various requests for media playing, including requests for audio outputting, in particular from the speaker 13, so that it is very convenient to have the media controller implementing the present method.

0066In a preferred embodiment, what is detected during detecting step (aO) is a process regarding an application installed in the electronic device 1 which implies audio output from the speaker 13, which is to be resumed. Indeed, it may be assumed that the user who starts a new process involving an application which implies audio output from the speaker 13 intends to do so and thus is aware of the risk of loud sound (and thus there is no need to ascertain it). On the other hand, what could be unexpected to the user is the resuming of a process involving an application which implies audio output, leading to embarrassing noises.

0067In particular there are three situations likely to accidentally happen wherein a process regarding an application which implies audio output from the speaker 13 is resumed:

0068- the user unlocks the device 1 while the application running in foreground has audio output;

0069- the user changes the application running in foreground to an application running in background which has audio output;

0070- the user unplugs/disconnects an external audio output unit (such as earphones, wireless headphones, etc.) while the application running in foreground has audio output, so that the process is immediately resumed with audio output switched (by the media controller) to the speaker 13.

0071Ambient noise analysis

0072The present method proposes to consider the environment of the electronic device 1 when resuming a process regarding an application, installed in the electronic device 1 , which implies audio output from the speaker 13.

0073By“process regarding an application installed in the electronic device which implies audio output from the speaker”, it is meant any process, triggered by a user of the electronic device, which causes an application already running on the electronic device (either in foreground or in background) to provide the speaker 13 with some audio output to be outputted.

0074Such a process may be a user interacting with the electronic device, wherein this interaction causes an application, already running on the electronic device without providing the speaker 13 with some audio output, to start providing the speaker 13 with some audio output.

0075Such an interaction is typically an action performed by a user through a user interface of the electronic device 1 (for instance the unlocking of the electronic device while the application is running in the foreground, or the switching of the application from the background to the foreground), but more generically speaking may be any kind of user action performed in relation to the electronic device (for instance when the user unplugs an earphone plugged in the electronic device while listening to the audio output of an application running in foreground).

0076If the electronic device 1 is in a quiet environment (for instance in a meeting room), a sudden loud audio output is likely to be noticed and embarrassing for the user, and should therefore be avoided.

0077As explained, in determining step (a), the processing unit 11 determines if the electronic device 1 is in a quiet environment.

0078It is to be noted that, if it is determined that the electronic device 1 is not in a quiet environment (for instance, in the street), the process regarding an application which implies audio output can be normally performed, or resumed, without any risk to the user.

0079Determining step (a) is typically a step of “testing” the environment. To this end, when the electronic device 1 comprises a microphone 14, the present method comprises recording ambient noise using the microphone 14, the recorded ambient noise being used to determine if the electronic device 1 is in a quiet environment. By ambient noise, it is understood the sound of the environment. It is to be noted that the media controller has by default control of the microphone 14, so that the embodiment is particularly suitable when the method is implemented by the media controller.

0080In such an embodiment, determining step (a) could further comprise analyzing the recorded ambient noise so as to determine a noise intensity value. This value could be a physical quantity such as a Decibel value, or a “level” defining a score. The determination step (a) can then rely on this noise intensity value. In a particular embodiment, the environment of the electronic device 1 may be determined as being quiet when this noise intensity value is below a noise threshold, which can be predetermined threshold, for instance. A pre-trained Al model can be used to define the threshold to discriminate between a noisy environment and a quiet environment. In a first embodiment, the result of determining step (a) is binary: either the noise intensity value is below the threshold and then the environment is considered quiet, or the noise intensity value is above the threshold and then the environment is considered not quiet.

0081In an alternative embodiment, the noise intensity could be classified among a plurality of levels, for example five levels, corresponding to different ranges of noise level intensity values, so that the“quietness” of the environment could be quantified. For example, the five following noise levels could be used:

0082- 0 = silence;

0083- 1 = very quiet;

0084- 2 = fairly quiet

0085- 3 = fairly noisy

0086- 4 = very noisy.

0087As a function of the process to be performed or resumed, different thresholds of levels could be used.

0088For instance, it might be decided that playing or resuming a movie could be embarrassing if the noise level intensity is between 0 and 2.

0089In any case, it is to be noted that the threshold(s) or the intensity range(s) defining the levels can be learnt by the device 1 itself (see below), or alternatively defined from data remotely provided from a server 10 of the operator of the device 1.

0090It will be understood that the determination of whether the user is in a quiet environment is not limited to the recording of ambient noise, and other techniques could be used, as for instance counting the number of nearby connectable electronic devices (for instance through Bluetooth or Wi-Fi).

0091Audio output level reduction

0092When it has been detected that the electronic device 1 is in a quiet environment, in a further step (b), the process regarding the is performed with a reduced level of audio output from the speaker 13. To the contrary, if it has not been determined that the electronic device 1 is in a quiet environment (i.e. it has been determined that the electronic device 1 is in a non-quiet environment), said process is preferably performed without a reduced level of audio output from the speaker 13, i.e. with the normal level of audio output.

0093Figure 2 represents the two alternative cases:

0094- (b1 ) the process is performed with a normal level of audio output from the speaker 13;

0095- (b2) the process is performed with a reduced level of audio output from the speaker 13.

0096Here“reduced” is to be understood with respect to said normal level of audio output, which is the“expected” level of audio output as set by the user and which is to be used by default.

0097The audio output level reduction can be partial (for instance the audio output level is divided by two) or even total (i.e. the speaker 13 is muted: no sound is outputted).

0098In an advantageous embodiment, the reduced level of audio input is function of the noise intensity value which has been determined during step (a).

0099For example, considering the five noise levels cited previously, it might be defined that:

0100- If the noise level intensity value is 0 or 1 , the audio output level is reduced to 0 (i.e. the speaker 13 is muted);

0101- If the noise level is 2, the audio output level is reduced by 50%;

0102- If the noise level is 3 or 4, the environment is not considered quiet and the audio output level is not reduced at all.

0103User confirmation

0104As represented by figure 2, the method may advantageously comprises, if it has been determined in step (a) that the electronic device 1 is in a quiet environment, an optional step (bO) of inviting the user to confirm whether to perform the process with a reduced level of audio output from the speaker 13. Indeed, despite the environment being quiet, performing the process with a loud audio output from the speaker 13 might actually be voluntary (for example if the user is alone at home), so that a confirmation may be requested.

0105Step (bO) typically comprises displaying, on the electronic device 1 , a prompt to the user such as“you are in a quiet place and the application has audio output, do you confirm to resume it on device speaker?”.

0106Preferably, step (bO) thus comprises requesting the user to choose between three options:

0107- (b2) performing said process with a reduced level of audio output from the speaker 13 [Mute speaker and resume];

0108- (b1 ) performing said process with a normal level of audio output from the speaker 13 [Resume anyways];

0109- cancelling said process, i.e. not performing it and just going back to the previous state [Cancel].

0110When it is determined that that the user is not in a quiet environment, there is no need to request confirmation from the user for performing the process with a normal level of audio output from the speaker 13 (it can be done automatically). Indeed, even if the audio output is not wanted by the user, it will not be embarrass the user as the environment is noisy (nobody will notice), so that the number of interactions with the user can be limited.

0111Device, computer product program, and computer-readable medium

0112The present invention concerns an electronic device 1 comprising at least one processing unit 11 and a speaker 13, wherein the processing unit 11 is adapted for carrying out the method for operating as previously described.

0113This electronic device 1 may also comprise a memory 12, a microphone 14. The device 1 is typically a smartphone.

0114The aforementioned processing unit 11 is in particular configured to implement the steps of:

0115- when detecting that a process regarding an application installed in the electronic device which impliesg audio output from the speaker 13 is to be performed, determining that the electronic device is in a quiet environment (in particular through recording ambient noise using the microphone 14, analyzing the recorded ambient noise so as to determine a noise intensity value, and comparing it to one or more thresholds); - when determining that the electronic device is in a quiet environment, performing said process with a reduced level of audio output from the speaker 13 (or if determining that the electronic device is not in a quiet environment, performing said process with a normal level of audio output from the speaker 13), possibly after asking the user for confirmation.

0116As already explained, the present method is preferably implemented by a media controller of an operating system of the electronic device 1.

0117The invention further proposes a computer program product, comprising code instructions for executing (in particular with a processing unit 11 of the device 1 ) the previously described method, as well as a computer-readable medium (in particular a memory 12 of the device 1 ), on which is stored a computer program product comprising code instructions for executing said method. In particular, this computer program product may correspond to the operating system, and especially the media controller.