Ear-worn devices
Abstract
A method for detecting breathing of a user of an ear-worn device. Further, a method for guiding deep breathing may include receiving a request from a user to initiate a deep breathing exercise on a user-controlled device. The method may include monitoring deep breathing using one or more sensors on an ear-worn device in response to initiating the deep breathing exercise. Examples of sensors include at least one of a motion detector, a microphone, a heart rate sensor, and an electrophysiological sensor. The method may further include initiating an end to the deep breathing exercise. The method may be used with various hearing systems including an ear-worn device and optionally a user-controllable device, such as a smartphone.

Term
Projected expiry 5 July 2039.
- Priority
- Filed
- Published
- Today
- Projected expiry
15 claims: 9 independent, 6 dependent
- 1A method of detecting breathing of a user of an ear-worn device, the method comprising:detecting breathing using one or more sensors on the ear-worn device, wherein the one or more sensors include at least one of a motion detector, a microphone, a heart rate sensor, and an electrophysiological sensor.
- 4The method of any preceding claim, further comprising providing a masking noise for tinnitus in response to the detected breathing, and optionally, further comprising providing a masking noise for tinnitus during at least part of a deep breathing mode.
- 6The method of any preceding claim, further comprising calibrating one or more sensors using a pre-determined baseline condition, and/or optionally, the motion detector using a pre-determined baseline condition.
- 7The method of any preceding claim, further comprising:receiving a request from a user to initiate a deep breathing mode on a user-controlled device;and initiating an end to the deep breathing mode, wherein optionally, the end is initiated after a predetermined period of time or in response to wearer input.
- 8The method of any preceding claim, further comprising:logging deep breathing data based on monitored deep breathing over time;and providing progress data based on the logged deep breathing data to the user with the user-controlled device or the ear-worn device.
- 10The method of any preceding claim, further comprising providing deep breathing guidance during the deep breathing exercise to the user with the user-controlled device or the ear-worn device, and optionally, wherein breathing rate guidance provided to the user is based on a breathing rate goal, and/or optionally, wherein content of the deep breathing guidance is based on whether an inhalation, an exhalation, or a holding of the breath is detected.
- 11An ear-worn device comprising:a housing configured to be worn by a user in or proximate to an ear of the user;a motion detector contained in the housing and configured to monitor user motion;a microphone contained in the housing and configured to monitor ambient sound;a communication interface contained in the housing and configured to communicate with a user-controlled device;a controller comprising a processor contained in the housing and operably coupled to the motion detector, the microphone, and the communication interface, the controller being configured to: detect breathing using the motion monitored by the motion detector;and/or detect breathing using the monitored sound.
- 15The device of any of claims 11 to 14, wherein the controller is configured to provide a masking noise for tinnitus, optionally during at least part of a deep breathing exercise, wherein preferably, the controller is further configured to receive a request to initiate a deep breathing exercise from the user-controlled device;monitor user motion and ambient sound in response to receiving the request;and provide monitored breathing data based on at least the monitored user motion.
Independent claims9
129 paragraphs in 5 sections, as filed
TECHNICAL FIELD
The present disclosure relates generally to ear-worn devices, in particular to hearing assistance devices with functionality to assist a wearer with an activity other than hearing.
BACKGROUND
Hearing assistance devices, such as hearing aids, may be used to assist wearers suffering hearing loss by transmitting amplified sounds to one or both ear canals. Such devices typically include hearing assistance components such as a microphone for receiving ambient sound, an amplifier for amplifying the microphone signal in a manner that depends upon the frequency and amplitude of the microphone signal, a speaker or receiver for converting the amplified microphone signal to sound for the wearer, and a battery for powering the components.
In certain types of hearing aids, the hearing assistance components are enclosed by a housing that is designed to be worn in the ear for both aesthetic and functional reasons.
SUMMARY
In one aspect, the present disclosure relates to a method for detecting breathing of a user of an ear-worn device using the ear-worn device. The present disclosure further relates to a method of detecting breathing of a user of an ear-worn device, the method comprising: detecting breathing using one or more sensors on the ear-worn device, wherein the one or more sensors include at least one of a motion detector, a microphone, a heart rate sensor, and an electrophysiological sensor.
Preferably, the method uses an additional one or more sensors including at least one of a motion detector, a microphone, a heart rate sensor, and an electrophysiological sensor for breathing detection.
Optionally, the method further comprises determining a breathing pattern based on the detected breathing. Preferably, the method further comprises determining whether a breathing pattern is detectable in an ambient acoustic environment using a microphone of the ear-worn device. The breathing may be monitored breathing using a motion detector and/or the microphone of the ear-worn device in response to the breathing pattern being detectable.
Preferably, the method further comprises providing a masking noise for tinnitus in response to the detected breathing. Optionally, the method further comprises providing a masking noise for tinnitus during at least part of a deep breathing mode. The method may further comprise modifying the masking noise in response to a detected breathing pattern. Additionally, at least one parameter of the masking noise may be modified in response to the detected breathing pattern comprises at least one of: a sound level, a frequency response, a modulation rate for amplitude, a modulation rate for frequency, and a type of masking noise.
Preferably, the method further comprises calibrating one or more sensors using a pre-determined baseline condition. The motion detector may be calibrated using a pre-determined baseline condition.
Optionally, the method further comprises receiving a request from a user to initiate a deep breathing mode on a user-controlled device; and initiating an end to the deep breathing mode, wherein optionally, the end is initiated after a predetermined period of time or in response to wearer input.
Preferably, the method further comprises: logging deep breathing data based on monitored deep breathing over time; and providing progress data based on the logged deep breathing data to the user with the user-controlled device or the ear-worn device. The progress data may be provided to the user comprises at least one of: results of a comparison of the deep breathing data to a deep breathing goal; merit badges received; and reminders to perform deep breathing exercises.
Optionally, the method further comprises providing deep breathing guidance during the deep breathing exercise to the user with the user-controlled device or the ear-worn device, and optionally, wherein breathing rate guidance provided to the user is based on a breathing rate goal, and/or optionally, wherein content of the deep breathing guidance is based on whether an inhalation, an exhalation, or a holding of the breath is detected.
In a further aspect, the present disclosure provides an ear-worn device comprising: a housing configured to be worn by a user in or proximate to an ear of the user; a motion detector contained in the housing and configured to monitor user motion; a microphone contained in the housing and configured to monitor ambient sound; a communication interface contained in the housing and configured to communicate with a user-controlled device; a controller comprising a processor contained in the housing and operably coupled to the motion detector, the microphone, and the communication interface, the controller being configured to: detect breathing using the motion monitored by the motion detector; and/or detect breathing using the monitored sound.
Preferably, the controller is configured to determine a breathing pattern using the detected breathing. Optionally, the controller is configured to determine whether a breathing pattern is detectable in an ambient acoustic environment using the microphone of the ear-worn device. The controller may be configured to provide monitored breathing data based on the monitored user motion and monitored ambient sound in response to the breathing pattern being detectable.
Optionally, the controller may be configured to provide monitored breathing data without using monitored ambient sound in response to the breathing pattern not being detectable and/or to calibrate the motion detector using a pre-determined baseline condition.
Preferably, the motion detector comprises at least one of an accelerometer and a gyroscope and/or the device further comprising at least one of a heart rate sensor and an electrophysiological sensor.
Preferably, the controller is configured to provide a masking noise for tinnitus. Optionally, the controller is configured to provide a masking noise during at least part of a deep breathing exercise. Preferably, the controller is further configured to receive a request to initiate a deep breathing exercise from the user-controlled device. The controller may be further configured to monitor user motion and ambient sound in response to receiving the request; and provide monitored breathing data based on at least the monitored user motion.
In one aspect, the present disclosure relates to a method for guiding deep breathing. The method includes receiving a request from a user to initiate a deep breathing exercise on a user-controlled device; monitoring deep breathing using one or more sensors on an ear-worn device in response to initiating the deep breathing exercise, wherein the one or more sensors include at least one of a motion detector, a microphone, a heart rate sensor, and an electrophysiological sensor; and initiating an end to the deep breathing exercise.
In one aspect, the present disclosure relates to an ear-worn device. The device includes a housing configured to be worn by a user in or proximate to an ear of the user; a motion detector contained in the housing and configured to monitor user motion; a microphone contained in the housing and configured to monitor ambient sound; a communication interface contained in the housing and configured to communicate with a user-controlled device; a controller including a processor contained in the housing and operably coupled to the motion detector, the microphone, and the communication interface. The controller is configured to: receive a request to initiate a deep breathing exercise from the user-controlled device; monitor user motion and ambient sound in response to receiving the request; and provide monitored breathing data based on at least the monitored user motion.
In one aspect, the present disclosure relates to a user-controllable device. The user-controllable device includes: a user interface having a display and configured to receive user input; a communication interface configured to connect to an ear-worn device; a controller including a processor operably coupled to the user interface and the communication interface. The controller is configured to: receive a request to initiate a deep breathing exercise based on user input at the user interface; connect to the ear-worn device to receive monitored breathing data based on user motion and optionally monitored ambient sound; and initiate an end to the deep breathing exercise.
In one or more aspects, a method or configuration includes: determining whether a breathing pattern is detectable in an ambient acoustic environment using a microphone of the ear-worn device or of the user-controlled device; and monitoring deep breathing using a motion detector and the microphone of the ear-worn device or of the user-controlled device in response to the breathing pattern being detectable.
In one or more aspects, a method or configuration includes initiating an end to the deep breathing exercise after a predetermined period of time, in response to wearer input, or in response to achieving a deep breathing goal.
In one or more aspects, a method or configuration includes calibrating the motion detector using a pre-determined baseline condition.
In one or more aspects, a method or configuration includes logging deep breathing data based on the monitored deep breathing over time; and providing progress data based on the logged deep breathing data to the user with the user-controlled device or the ear-worn device.
In one or more aspects, the progress data provided to the user includes at least one of: results of a comparison of the deep breathing data to a deep breathing goal; merit badges received; and reminders to perform deep breathing exercises.
In one or more aspects, a method or configuration includes providing deep breathing guidance during the deep breathing exercise to the user with the user-controlled device or the ear-worn device.
In one or more aspects, breathing rate guidance provided to the user is based on a breathing rate goal.
In one or more aspects, content of the deep breathing guidance is based on whether an inhalation, an exhalation, or a holding of the breath is detected.
In one or more aspects, a method or configuration includes providing a masking noise for tinnitus during at least part of the deep breathing exercise.
In one or more aspects, a method or configuration includes modifying the masking noise in response to a detected breathing pattern.
In one or more aspects, at least one parameter of the masking noise modified in response to the detected breathing pattern includes at least one of: a sound level, a frequency response, a modulation rate for amplitude, a modulation rate for frequency, and a type of masking noise.
In one or more aspects, a method or configuration includes: determining whether a breathing pattern is detectable in an ambient acoustic environment using the microphone of the ear-worn device or a microphone of the user-controlled device; and providing monitored breathing data based on the monitored user motion and monitored ambient sound in response to the breathing pattern being detectable.
In one or more aspects, a method or configuration includes: providing monitored breathing data without using monitored ambient sound in response to the breathing pattern not being detectable.
In one or more aspects, the motion detector includes at least one of an accelerometer and a gyroscope.
In one or more aspects, at least one of a heart rate sensor and an electrophysiological sensor are included.
In one or more aspects, a method or configuration includes storing progress data based on the monitored breathing data.
In one or more aspects, the communication interface is configured to connect to the internet to share progress data with others.
In one or more aspects, a method or configuration includes commanding the user interface to display at least one of: a measured breathing rate; a breathing rate goal; guidance through the monitored deep breathing; and instructions for calibrating the ear-worn device.
In one or more aspects, a method or configuration includes receiving user input from the user interface including at least one of: a breathing exercise duration; a breathing rate starting goal; and a breathing rate end goal.
In one or more aspects, a method or configuration includes modifying at least one parameter for a masking noise in response to a detected breathing pattern.
BRIEF DESCRIPTION OF THE DRAWINGS
Various embodiments of the present disclosure are described below in the detailed description with reference to the following drawings: <ul id="ul0001" list-style="none"><li><figref idref="f0001"><b>FIG.</b> 1</figref> shows a hearing system including ear-worn devices according to various embodiments of the present disclosure.</li><li><figref idref="f0002"><b>FIG. 2</b></figref> shows one type of ear-worn device that may be used with the hearing system of <figref idref="f0001"><b>FIG. 1</b></figref><b>.</b></li><li><figref idref="f0002"><b>FIG.</b> 3</figref> shows another type of ear-worn device that may be used with the hearing system of <figref idref="f0001"><b>FIG. 1</b></figref><b>.</b></li><li><figref idref="f0003"><b>FIG.</b> 4</figref> shows a layout of one of the ear-worn devices of <figref idref="f0001 f0002"><b>FIGS. 1-3</b></figref>.</li><li><figref idref="f0004"><b>FIG. 5</b></figref> shows the ear-worn device of <figref idref="f0001"><b>FIG. 1</b></figref> used in an ambient acoustic environment with a user-controllable device.</li><li><figref idref="f0005"><b>FIG. 6</b></figref> shows a layout of one user-controllable device that may be used in the ambient acoustic environment of <figref idref="f0004"><b>FIG. 5</b></figref><b>.</b></li><li><figref idref="f0006"><b>FIG. 7</b></figref> shows a plot of acceleration versus time that may be used to detect breathing patterns.</li><li><figref idref="f0007"><b>FIG. 8</b></figref> shows a plot of sound level versus time that may be used to detect breathing patterns.</li><li><figref idref="f0008"><b>FIG. 9</b></figref> shows one method for using a microphone signal to detect breathing patterns.</li><li><figref idref="f0009"><b>FIG. 10</b></figref> shows one method for managing deep breathing sessions.</li><li><figref idref="f0010"><b>FIG. 11</b></figref> shows one specific example of the method of <figref idref="f0009"><b>FIG. 10</b></figref>.</li><li><figref idref="f0011"><b>FIG. 12</b></figref> shows one method for managing deep breathing sessions for tinnitus.</li></ul>
DETAILED DESCRIPTION
The present disclosure relates to an ear-worn device with functionality to assist a wearer with an activity other than hearing. Although reference is made herein to hearing assistance devices, such as a hearing aid, breathing detection functionality, and preferably deep breathing assistance functionality or mode, may be used with any ear-worn device. Non-limiting examples of ear-worn devices with various functionality include: hearing assistance devices, hearable devices (for example, wired or wireless earbuds, Bluetooth® headsets, or back-vented vented tweeter-woofer devices), wearables or health monitors (for example, step counter or heart rate monitor), or other portable or personal electronics (for example, smartwatch or smartphone). Various other applications will become apparent to one of ordinary skill in the art having the benefit of the present disclosure.
A hearing device may include hearing assistance devices, or hearing aids of various types, such as behind-the-ear (BTE), in-the-ear (ITE), in-the-canal (ITC), receiver-in-canal (RIC), completely-in-the-canal (CIC), or invisible-in-the-canal (IIC)-type hearing aids. It is understood that BTE type hearing aids may include devices that reside substantially behind the ear or over the ear. Such devices may include hearing aids with receivers associated with the electronics portion of the device, or hearing aids of the type having receivers in the ear canal of the user, including but not limited to receiver-in-canal (RIC) or receiver-in-the-ear (RITE) designs. The present subject matter can also be used in hearing assistance devices generally, such as cochlear implant type hearing devices and such as deep insertion devices having a transducer, such as a receiver or microphone, whether custom fitted, standard, open fitted, or occlusive fitted. The present subject matter may additionally be used in consumer electronic wearable audio devices having various functionalities. It is understood that other devices not expressly stated herein may also be used in conjunction with the present subject matter.
Hearing assistance devices are typically small to facilitate comfort. It may be beneficial to provide a hearing assistance device with a breathing detection mode or functionality. This functionality may optionally be used to assist the wearer with various activities, particularly for activities that a wearer of a hearing assistance device may regularly engage in, such as deep breathing exercises. It may also be beneficial to provide the wearer with a coordinated user interface using the hearing assistance device and another user-controllable device, such as a smartwatch, smartphone, or tablet. Further, it may be beneficial to track and monitor various health information for the wearer.
Deep breathing exercises involve the regulation of controlled inhaled and exhaled breaths for relaxation, stress reduction, and pain management. In audiology, deep breathing exercises may be helpful for people with tinnitus who have comorbidities of anxiety, depression, sleep disorders, and stress. One Progressive Tinnitus Management (PTM) scheme, for example, promotes various relaxation techniques including deep breathing exercises for persons with tinnitus. It may be beneficial to have monitoring and guidance during deep breathing exercises instead of relying upon wearers to monitor their own abilities. It may also be beneficial to provide real-time feedback to help improve breathing techniques or to better guide the breathing task.
Some devices have been developed to facilitate deep breathing exercises that require the user to carry an additional accessory, such as a chest monitor. It may be beneficial for hearing assistance device wearers to have deep breathing exercise assistance without wearing an additional accessory that must be separately carried and recharged.
This disclosure provides ear-worn devices with a breathing detection functionality or mode, and/or deep breathing assistance. In particular, the ear-worn device has deep breathing detection functionality, which may be used to assist a wearer, or user, with deep breathing exercise sessions. The ear-worn device may leverage the use of motion detection sensors alone, or in combination with other components (e.g., microphones), to detect breaths, optionally, during deep breathing exercise sessions. Breath detection, for example during the session, may be used to provide guidance and feedback to the wearer to modulate their breathing (optionally, during the session and/or task). Such feedback may include, for example, audio queues (e.g., verbal feedback) and/or with modulated audio heard during the session. The ear-worn device may be connected to another user-controllable device, such as a smartphone, to provide breathing detection functionality with a coordinated user interface. The coordinated user interface may provide feedback on breathing techniques during the session.
Advantageously, an ear-worn device with breathing detection functionality or mode may provide a single, integrated system for wearers of hearing assistance devices who may have hearing loss or tinnitus. Particularly advantageous is where the ear-worn device comprises a deep breathing assistance functionality which provides a single, integrated system for wearers of hearing assistance devices who may have hearing loss or tinnitus and may benefit from carrying out deep breathing exercises. Using the aforementioned systems, the hearing device wearer may avoid carrying or wearing additional accessories for breathing detection and/or deep breathing guidance. Further, integration of the deep breathing exercises with an ear-worn device and optionally another user-controllable device may facilitate improvements in the exercises and better results (e.g., reduced heart rate or tinnitus relief) when those exercises are modified or assisted using the ear-worn device.
All scientific and technical terms used herein have meanings commonly used in the art unless otherwise specified. The definitions provided herein are to facilitate understanding of certain terms used frequently herein and are not meant to limit the scope of the present disclosure.
As used herein, the term "ear-worn device" or "ear-level device" refers to an electronic device worn in or around an ear of the wearer. For example, the ear-worn device may be hooked on the pinna (e.g., using a BTE hearing aid) or worn in the ear canal (e.g., using an ITC hearing aid). Ear-worn devices may include devices that are worn proximate, or adjacent, to the ear. Ear-worn devices may exclude, for example, devices worn around the eyes of a user or on a headband or neckband.
As used herein, the term "hearing device" refers to a device that provides sound that is heard by the user. One type of hearing device is a hearing assistance device, which may help a user to hear sounds in the ambient environment. Typically, hearing devices are ear-worn devices.
Reference will now be made to the drawings, which depict one or more aspects described in this disclosure. However, it will be understood that other aspects not depicted in the drawings fall within the scope of this disclosure. Like numbers used in the figures refer to like components, steps, and the like. However, it will be understood that the use of a reference character to refer to an element in a given figure is not intended to limit the element in another figure labeled with the same reference character. In addition, the use of different reference characters to refer to elements in different figures is not intended to indicate that the differently referenced elements cannot be the same or similar.
<figref idref="f0001"><b>FIG. 1</b></figref> shows hearing system <b>10</b> that may include one or more ear-worn devices <b>16</b>. Ear-worn device <b>16</b> may be a hearing device including a hearing aid, an earphone, or a headphone (e.g., earbud). Each ear-worn device <b>16</b> may include one or more sensors, such as an integrated motion detector, a microphone, a heart rate sensor, or an electrophysiological sensor, that may be used individually or in combination to detect breaths and optionally deep breaths. The breath detection functionality may be used to provide feedback to wearer <b>12</b> during, for example, deep breathing exercises.
As illustrated, each ear-worn device <b>16</b> may be worn proximate, or adjacent to, the pinna or worn in one or both ears <b>14</b> of wearer <b>12</b>. As illustrated, each ear-worn device <b>16</b> is positioned, at least partially, in each ear <b>14</b>.
In some embodiments, each ear-worn device <b>16</b> is positioned in a region or zone <b>20</b> around each ear <b>14</b>. In particular, each sensor, such as a motion detector and/or microphone, of ear-worn device <b>16</b> may be positioned within zone <b>20</b>. Various embodiments of ear-worn device <b>16</b> of hearing system <b>10</b> may include sensors, such as a motion detector and/or microphone, outside of zone <b>20</b> or positioned away from the ears <b>14</b> of wearer <b>12</b>, such as sensors positioned on headbands going over the head, on neckbands behind the head, or on cords connected to other devices.
<figref idref="f0002"><b>FIGS. 2</b> and <b>3</b></figref> show two different types of ear-worn hearing devices <b>100, 102</b> that may be used in hearing system <b>10.</b><figref idref="f0002"><b>FIG. 2</b></figref> shows ITE device <b>100,</b> and <figref idref="f0002"><b>FIG. 3</b></figref> shows BTE device <b>102</b> worn in or around the pinna of ear <b>14</b>. Device <b>102</b> may include earpiece <b>108</b> positioned in ear <b>14</b> and ear hook <b>110</b> positioned outside and behind ear <b>14</b>. In addition to hearing assistance, for example, each device <b>100, 102</b> is configured to facilitate breathing detection, and optionally facilitate deep breathing exercises. In particular, each device <b>100, 102</b> includes at least one microphone <b>104</b> and preferably at least one motion detector <b>106</b>. Housing <b>112</b> may be worn in the ear, and part of housing <b>114</b> may be worn proximate to the ear.
Microphone <b>104</b> and motion detector <b>106</b> may each be contained within a housing <b>112, 114</b> of the respective device <b>100, 102.</b> In general, motion detector <b>106</b> is configured to monitor user motion. In general, microphone <b>104</b> configured to monitor ambient sound. Microphone <b>104</b> may be described as an onboard microphone.
Microphone <b>104</b> may be used in conjunction with motion detector <b>106</b> to further improve the detection of breathing, for example during deep breathing exercises. For example, motion detector <b>106</b> may be additionally used to detect movement of the user's ear <b>14</b> in response to deep breathing, and microphone <b>104</b> may be used to detect vocalized and non-vocalized sounds generated during inhalation and exhalation, which described herein in more detail.
One or more components, such as controllers, motion detectors, microphones, speakers, or other sensors, described herein may include a processor, such as a central processing unit (CPU), computer, logic array, or other device capable of directing data coming into or out of an ear-worn hearing device or user-controllable device. The controller may include one or more computing devices having memory, processing, and communication hardware. The controller may include circuitry used to couple various components of the controller together or with other components operably coupled to the controller. The functions of the controller may be performed by hardware and/or as computer instructions on a non-transient computer readable storage medium.
The processor of the controller may include any one or more of a microprocessor, a microcontroller, a digital signal processor (DSP), an application specific integrated circuit (ASIC), a field-programmable gate array (FPGA), and/or equivalent discrete or integrated logic circuitry. In some examples, the processor may include multiple components, such as any combination of one or more microprocessors, one or more controllers, one or more DSPs, one or more ASICs, and/or one or more FPGAs, as well as other discrete or integrated logic circuitry. The functions attributed to the controller or processor herein may be embodied as software, firmware, hardware, or any combination thereof. While described herein as a processor-based system, an alternative controller may utilize other components such as relays and timers to achieve the desired results, either alone or in combination with a microprocessor-based system.
In one or more embodiments, the exemplary systems, methods, and interfaces may be implemented using one or more computer programs using a computing apparatus, which may include one or more processors and/or memory. Program code and/or logic described herein may be applied to input data/information to perform functionality described herein and generate desired output data/information. The output data/information may be applied as an input to one or more other devices and/or methods as described herein or as would be applied in a known fashion. In view of the above, it will be readily apparent that the controller functionality as described herein may be implemented in any manner known to one skilled in the art.
<figref idref="f0003"><b>FIG. 4</b></figref> shows one example layout of ear-worn device <b>16</b>. Ear-worn device <b>16</b> may include electronic components disposed within a housing. The electronic components may be disposed in any suitable location or arrangement within the housing. The electronic components may include any suitable device or devices, e.g., integrated circuits, power sources, microphones, receivers, etc. For example, in one or more embodiments, the components include one or more of a controller, a microphone, a receiver (e.g., speaker), a power source, an antenna (e.g., of a communication interface), or various other sensors (e.g., motion detector, heart rate sensor, or electrophysiological sensor). The microphone, receiver, power source, antenna, and any additional sensors may be electrically connected to the controller using any suitable technique or techniques. In the illustrated embodiment, ear-worn device <b>16</b> includes microphone <b>202</b>, speaker <b>204</b>, controller <b>206</b>, communication interface <b>208</b>, motion detector <b>210</b>, and health sensor <b>212</b>.
Microphone <b>202</b> may be electrically connected to the controller <b>206</b>. Although one microphone <b>202</b> is depicted, the components may include any suitable number of microphones. In one or more embodiments, a port or opening may be formed in the housing, and the microphone may be disposed adjacent the port to receive audio information from the wearer's ambient acoustic environment. In one or more embodiments, microphone <b>202</b> is selected to detect one or more audio signals and convert such signals to an electrical signal that is provided to processor <b>214</b> of controller <b>206</b>. Controller <b>206</b> may include an analog-to-digital convertor (not shown) that converts the electrical signal from microphone <b>202</b> to a digital signal.
Speaker <b>204</b> may be electrically connected to controller <b>206</b>. Speaker <b>204</b> may also be referred to as a receiver. In one or more embodiments, speaker <b>204</b> is adapted to convert an electrical signal from controller <b>206</b> to an acoustic output or sound that may be transmitted from the housing to the wearer. For example, in hearing applications, speaker <b>204</b> may be an amplified version of an audio signal received from microphone <b>202</b>.
A power source (not shown) may be electrically connected to controller <b>206</b> and may be adapted to provide electrical energy to the controller and one or more of the other components. The power source may include any suitable power source or power sources, e.g., a battery. In one or more embodiments, the power source may include a rechargeable battery. In one or more embodiments, the components may include two or more power sources.
Controller <b>206</b> may be contained within a housing of ear-worn device <b>16</b>. Controller <b>206</b> may be operably coupled to motion detector <b>210</b>, microphone <b>202</b>, and communication interface <b>208</b>. In some embodiments, controller <b>206</b> is configured to receive a request to initiate the breathing detection functionality or mode and/or a deep breathing exercise from a user-controlled device. Controller <b>206</b> may be configured to monitor user motion and ambient sound in response to receiving the request. Further, controller <b>206</b> may be configured to provide monitored breathing data based on at least the monitored user motion and/or sound detected by the microphone 202. In embodiments where ear-worn device <b>16</b> is utilized as a hearing aid, controller <b>206</b> may be adapted to employ programmable gains to adjust the hearing device output to the wearer's particular hearing impairment.
In the illustrated embodiment, controller <b>206</b> includes processor <b>214</b> and memory <b>216.</b> In some embodiments, controller <b>206</b> may include a digital signal processor (DSP), microprocessor, microcontroller, other digital logic, or combinations of these. Processing may be done by a single processor or may be distributed over different devices. For example, the processing of signals may be performed using controller <b>206</b> or over different devices. Processing may be done in the digital domain, the analog domain, or combinations thereof. In some embodiments, processing may be done using subband processing techniques. Processing may be done using frequency domain or time domain approaches. Some processing may involve both frequency and time domain aspects. For brevity, in some examples drawings may omit certain blocks that perform frequency synthesis, frequency analysis, analog-to-digital conversion, digital-to-analog conversion, amplification, buffering, and certain types of filtering and processing. In one or more embodiments, processor <b>214</b> or other processing devices execute instructions to perform a number of signal processing tasks. Such embodiments may include analog components in communication with processor <b>214</b> to perform signal processing tasks, such as sound reception by microphone <b>202</b> or playing of sound using speaker <b>204.</b>
Ear-worn device <b>16</b> may be configured to communicate by wire or wirelessly with each other or other devices. Processor <b>214</b> may be configured to control communication to and from ear-worn device <b>16</b> through communication interface <b>208.</b> Communication interface <b>208</b> may be used to communicate information, for example, audio streaming data or control signals, to or from one or more other devices. Communication interface <b>208</b> may be contained in a housing of ear-worn device <b>16.</b> In general, communication interface <b>208</b> is configured to communicate with a user-controlled device.
In some embodiments, communication interface <b>208</b> may include a transceiver. The transceiver may include a receiver portion that receives communication signals from an antenna structure, demodulates the communication signals, and transfers the signals to controller <b>206</b> for further processing. The transceiver may also include a transmitter portion that modulates output signals from controller <b>206</b> for transmission via the antenna structure. Electrical signals from microphone <b>202</b> and wireless communication signals received via communication interface <b>208</b> may be processed by controller <b>206</b> and converted to acoustic signals played to the user via speaker <b>204.</b> In some embodiments, communication interface <b>208</b> may include a wired connection, such as an audio adapter or a wired data connection.
The antenna structure of communication interface <b>208</b> may include one or more antennas having any suitable configuration. For example, antenna configurations may vary and may be included within the housing or be external to the housing. Further, the antenna structure may be compatible with any suitable protocol or combination of protocols.
For example, in one or more embodiments, ear-worn device <b>16</b> may be connected to one or more external devices using, e.g., Bluetooth®, Wi-Fi, magnetic induction, etc. For example, in one or more embodiments, ear-worn device <b>16</b> may be wirelessly connected to the internet using any suitable technique or techniques. Such connection may enable ear-worn device <b>16</b> to access any suitable databases, including medical records databases, cloud computing databases, personal databases, or social networks.
Motion detector <b>210</b> may be electrically connected to controller <b>206.</b> Motion detector <b>210</b> may include any suitable type of motion detector, such as one or more of an accelerometer, a gyroscope, a magnetometer, or other inertial measurement unit (IMU). Motion detector <b>210</b> may be contained within ear-worn device <b>16</b>. In some embodiments, motion detector <b>210</b> may be calibrated. In some embodiments, motion detector <b>210</b> may be calibrated to a pre-determined baseline condition.
In embodiments where ear-worn device <b>16</b> includes a second hearing device disposed on an opposite side of the wearer's head, communication interface <b>208</b> may be utilized to communicate with a communication interface of the second hearing device. In one or more embodiments, a low-power link across the wearer's head may be utilized to transmit electromagnetic signals between the first and second hearing devices. Sensor data from the one or more sensors may be coordinated between the two hearing devices. For example, an accelerometer and/or a microphone disposed in each device may be utilized to determine deep breathing patterns based on signals from both and/or respective devices.
One or more sensors of ear-worn device <b>16</b> may also be utilized to electrically connect to the wearer's body such that the body may be utilized as an antenna for transmitting information to and from the hearing device. Such sensors may be considered part of communication interface <b>208.</b> One or more sensors may electrically connect ear-worn device <b>16</b> to one or more additional body-worn devices by sending electromagnetic signals between the devices through the body. For example, for hearing systems that include two hearing devices, one or more sensors may be utilized for communication between the hearing devices through the skull of the wearer, i.e., ear-to-ear communications. Such communication may be utilized to send electromagnetic signals from one device to the other. For example, the wearer may adjust a volume of an acoustic signal provided by the hearing devices by changing the volume on one device, which sends a control signal to the other device that adjusts its volume.
Ear-worn device <b>16</b> may be used to detect breathing patterns, particularly deep breathing patterns, using microphone <b>202.</b> For example, a breathing rate may be detected. In some embodiments, acoustic detection of breathing patterns may be performed using existing signal-processing algorithms. Algorithms used may operate on pre-defined spectral, temporal features, or both of the microphone signal. For example, an algorithm may operate on low-frequency spectral features that are characteristic of breathing noises, which may be used in combination with temporal-modulation filtering.
Alternatively, or additionally, relevant features of signals from microphone <b>202</b> for the detection and/or the discrimination of breathing patterns in a given individual, or a group of individuals, may be learned by an algorithm using machine-learning techniques, such as Gaussian mixture model or support vector machines. The information provided by acoustic detection may add to, or enhance, the information provided by motion detection sensor <b>210</b>.
In some embodiments, signals from motion detector <b>210</b> or microphone <b>202</b> may be combined with, or compared to, sensor signals conveying information about heart rate. For example, health sensor <b>212</b> may include a heart rate sensor, or heart rate monitor. Heart rate may be influenced, or modulated, by breathing and may provide additional information relating the wearer, for example additional information on the wearer's current state of relaxation. A heart rate sensor may be located on ear-worn device <b>16</b> (e.g., inside the ear canal) or on another part of the body (e.g., on the chest). In the latter case, heart rate information may be sent to and received by communication interface <b>208</b> of ear-worn device <b>16</b>, or to a different user-controllable device (e.g., smartphone) with which device <b>16</b> may communicate using communication interface <b>208</b>.
In some embodiments, electrophysiological information may be used in combination, or compared with signals from motion detector <b>210</b> or microphone <b>202</b>. For example, health sensor <b>212</b> may include an electrophysiological sensor. Health sensor <b>212</b> may be operatively connected to controller <b>206</b>. An electrophysiological sensor may be located in or around the ear, or from other locations on the body, and used to infer information regarding the wearer, for example infer a state of relaxation, in order to provide additional feedback in respect of the breathing detection functionality and/or in order to provide additional feedback to modulate breathing during the session.
Health sensor <b>212</b> may include any suitable sensor or sensors to monitor various health parameters of the wearer. Health sensor <b>212</b> may include any suitable type of sensor to monitor various health parameters, such as one or more of: an electrical sensor, an optical sensor, a bioelectrical sensor including biological sensors, and a bioactive sensor. Non-limiting examples of suitable health sensors <b>212</b> include one or more of: heart rate sensor, blood pressure sensor, magnetometer, electrooculography (EOG) sensor, electroencephalography (EEG) sensor, amperometric sensor, blood sugar sensor, light sensor, body temperature sensor, galvanic skin response (GSR) sensor, and combinations thereof. Health sensor <b>212</b> may be adapted to detect any suitable physiological characteristic of the wearer. For example, the physiological characteristic may include at least one of body position, eye movement, body temperature, heart rate, EEG, skin impedance, and combinations thereof. An electrophysiological sensor may be used to detect one or more of these physiological characteristics.
<figref idref="f0004"><b>FIG. 5</b></figref> shows one example of an integrated system for using ear-worn device <b>16</b> in an ambient environment <b>300</b> with user-controllable device <b>302</b>. Non-limiting examples of user-controllable device <b>302</b> include a mobile phone (e.g., smartphone), tablet, smartwatch, or software application running on a portable user-controllable device (e.g., laptop). As illustrated, ear-worn device <b>16</b> is in operative communication with user-controllable device <b>302</b>. User-controllable device <b>302</b> may be in operative communication with remote computer <b>306</b> (e.g., a server, a personal computer, or a friend's smartphone) over the internet <b>304</b>. As illustrated, ear-worn device <b>16</b> includes microphone <b>202</b> and communication interface <b>208</b>, and user-controllable device <b>302</b> includes microphone <b>402</b>. Each of ear-worn device <b>16</b> and user-controllable device <b>302</b> may include various other sensors not shown in this illustration.
User-controllable device <b>302</b> may be configured to detect breathing and optionally modulate the deep breathing exercise according to the feedback provided by ear-worn device <b>16</b>. For instance, an application running on user-controllable device <b>302</b> may stream, or provide, instructions to the wearer to better modulate breathing, provide visual indicators, and/or custom tailor the instructions based on the ability of the wearer.
Accuracy of breath detection may be improved, for example, by leveraging information provided by a pair of ear-worn devices <b>16</b> in cases where the wearer has one ear-worn device <b>16</b> on each ear. A statistical technique or cross correlation may be applied to the data obtained from a pair of ear-worn devices <b>16</b> to further improve the detection scheme. For instance, the data between the pair may be analyzed for similarities. Similar information across the ears during the breathing cycle may be considered as valid and used for breath detection, whereas all other data may be considered noise and not analyzed.
<figref idref="f0005"><b>FIG. 6</b></figref> shows one example of a layout for user-controllable device <b>302</b>, which may run an application to provide the wearer with various functionality related to breathing detection and/or deep breathing exercise sessions. In the illustrated embodiment, user-controllable device <b>302</b> includes microphone <b>402</b>, speaker <b>404</b>, controller <b>406</b>, communication interface <b>408</b>, and user interface <b>410</b>.
Controller <b>406</b> may include processor <b>414</b> and memory <b>416</b> for running an application and storing data related to breathing detection and/or deep breathing exercise sessions. Controller <b>406</b> may be operably coupled to communication interface <b>408</b> and user interface <b>410</b>. In general, communication interface <b>408</b> is configured to connect to an ear-worn device, such as ear-worn device <b>16</b> (<figref idref="f0001 f0002 f0003 f0004"><b>FIGS. 1-5</b></figref>). In some embodiments, controller <b>406</b> is configured to receive a request to initiate breathing detection and/or a deep breathing exercise based on user input at user interface <b>410.</b> Controller <b>406</b> may be configured to connect to the ear-worn device to receive monitored breathing data based on user motion and optionally monitored ambient sound. Further, controller <b>406</b> may be configured to initiate an end to the breathing detection and/or deep breathing exercise.
User-controllable device <b>302</b> may be used to facilitate calibration of one or more sensors of ear-worn device <b>16</b>, such as motion detector <b>210</b> (<figref idref="f0003"><b>FIG. 4</b></figref>). In some embodiments, a calibration method may be carried out prior to the start of breathing detection and/or a deep breathing exercise session to determine a baseline for the motion detector. The calibration method may involve the wearer or may be carried out automatically in the background. In particular, the wearer may be provided with a series of onscreen, or streamed, instructions on user interface <b>410</b> that describe actions to carry out for calibration. The wearer may be asked to sit in a relaxed, seated position, and preferably at a location with little/no ambient noise while the ear-worn device calibrates a reference position.
In some embodiments, user interface <b>410</b> includes a display and a touchscreen or other user-selectable elements (e.g., buttons). In general, user interface <b>410</b> is configured to receive user input from the wearer and to provide information to the wearer. In general, the goal of the deep breathing exercise session may be to reduce the breathing rate, for example, below a threshold level. In some embodiments, controller <b>406</b> is configured to receive user input from user interface <b>410</b> including at least one of: a breathing exercise duration, a breathing rate starting goal, and a breathing rate end goal. In some embodiments, controller <b>406</b> is configured to command user interface <b>410</b> to display at least one of: a measured breathing rate, a breathing rate goal, guidance through the monitored deep breathing, and instructions for calibrating the ear-worn device.
Further, during the deep breathing exercise session, the wearer may be provided with guidance during deep breathing exercise, for example, with user interface <b>410</b> of user-controllable device <b>302</b> or with ear-worn device <b>16.</b> In some embodiments, breathing rate guidance may be provided to the user based on a breathing rate goal. In some embodiments, deep breathing guidance is based on whether an inhalation, an exhalation, or a holding of the wearer's breath is detected. One or more of these parameters may be selected by the wearer, predetermined, or calculated, for example, by user-controllable device <b>302</b> or ear-worn device <b>16.</b>
In some embodiments, the wearer may define a breathing detection sessions and/or a guided breathing session with user-controllable device <b>302.</b> For example, the wearer may set a duration for the session as 10 minutes long. The breathing rate at the start of the session may be set by the wearer to 20 breaths per minute (BPM), and the breathing rate towards the end of the session may be set to a lower number such as 15 BPM. An application running on user-controllable device <b>302</b> may prompt the wearer for these parameters with user interface <b>410.</b> User-controllable device <b>302</b> may perform a series of calculations to determine the rate of decrease in BPM to achieve the end goal that was set by the wearer. The application may use existing pre-determined calculations to determine the rate of decrease. In some embodiments, the application may use a linear or a log function to calculate the rate at which BPM may be decreased in order to achieve the goal at the end of the session. User-controllable device <b>302</b> may display in a graphical form, or otherwise, on user interface <b>410</b> the rate of BPM, so that the wearer is aware of their progress during the session.
In some embodiments, breathing data and/or deep breathing data based on monitoring breathing and/or deep breathing over time may be logged and stored on memory <b>416</b> of user-controllable device <b>302</b> or memory <b>216</b> of ear-worn device <b>16.</b> For example, the application running on user-controllable device <b>302</b> may also data-log various information, for example, for each session, so that the wearer is able to monitor their vitals and/or progress over time.
Progress data may be based on monitored breathing data, which may be logged, and may be provided to the wearer with user interface <b>410</b> of user-controllable device <b>302</b> or with ear-worn device <b>16.</b> The progress data may include at least one of: results of a comparison of the deep breathing data and a deep breathing goal, merit badges received, and reminders to perform deep breathing exercises. Merit badges may be awarded to the user for achieving a particular deep breathing goal or series of goals. The progress data may also be stored on memory <b>416</b> of user-controllable device <b>302</b> or memory <b>216</b> of ear-worn device <b>16</b>. In some embodiments, communication interface <b>408</b> is configured to connect to the internet to share progress data with others.
The wearer may also have the capability of sharing progress with persons of their choosing (e.g., friends) via various means, for instance through social media. The wearer may also be presented with the average information for persons in their age group for comparison.
The wearer may be presented with a series of merit badges when pre-determined goals, either available as options or set by the user, are achieved. A reminder management system may also be incorporated that sends out notifications to the user if desired. These functionalities may be carried out, for example, by one or both of the user-controllable device <b>302</b> or ear-worn device <b>16</b>.
<figref idref="f0006"><b>FIG. 7</b></figref> shows plot <b>500</b> of one example of data including acceleration versus samples in time from a motion detector, such as motion detector <b>210</b> (<figref idref="f0003"><b>FIG. 4</b></figref>), in particular a 3-axis accelerometer, that may be used to detect breathing patterns. Acceleration may be measured, for example, in milli-g. Plot <b>500</b> shows first signal <b>502</b>, second signal <b>504</b>, and third signal <b>506</b> provided by a 3-axis accelerometer, which correspond to an X-axis, Y-axis, and Z-axis, respectively. Inhalation and exhalation may be detected using one or more signals <b>502</b>, <b>504</b>, <b>506.</b> As illustrated, inhalation <b>508</b> may be detected in response to a decrease in second signal <b>504</b> (Y-axis), and exhalation <b>510</b> may be detected in response to an increase in second signal <b>504</b>.
<figref idref="f0007"><b>FIG. 8</b></figref> shows plot <b>600</b> of one example of sound amplitude versus samples in time from a microphone, such as microphone <b>202</b> (<figref idref="f0003"><b>FIG. 4</b></figref>) or microphone <b>402</b> (<figref idref="f0005"><b>FIG. 6</b></figref>), that may be used to detect breathing patterns. Sound amplitude may be measured, for example in decibels. Plot <b>600</b> shows signal <b>602</b>. As illustrated, inhalation <b>608</b> may be detected as a peak in signal <b>602</b>, or increase and decrease, and exhalation <b>610</b> may be detected as a subsequent peak in signal <b>602</b>. The peak of inhalation <b>608</b> may have a greater amplitude than the peak of exhalation <b>610</b>.
<figref idref="f0008"><b>FIG. 9</b></figref> shows one example of a method for processing a microphone signal from a microphone, such as microphone <b>202</b> (<figref idref="f0003"><b>FIG. 4</b></figref>) or microphone <b>402</b> (<figref idref="f0005"><b>FIG. 6</b></figref>), to facilitate breathing pattern detection. As illustrated, method <b>700</b> includes passing a microphone signal through a filter <b>702</b>. The filter may be a low-pass, high-pass, or bandpass filter. Low-level noise may be removed by the filter.
Method <b>700</b> may continue and extract an envelope from the microphone signal <b>704</b>, for example, after filtering. Envelope extraction may produce a smooth response signal, which may be used to infer a peak, trough, and period of any waveform in the signal. Existing envelope extraction techniques may be applied, such as the Hilbert transform or a low-pass filtering of absolute values. Examples of techniques for extracting envelopes are described, for example, in <nplcit id="ncit0001" npl-type="s"><text>Potamianos, Alexandros, and Petros Maragos. "A comparison of the energy operator and the Hilbert transform approach to signal and speech demodulation." Signal processing 37.1 (1994): 95-120</text></nplcit>, and<nplcit id="ncit0002" npl-type="s"><text> Schloss, W. Andrew. "On the Automatic Transcription of Percussive Music - From Acoustic Signal to High-Level Analysis." Stanford University, Ph.D. Thesis (1985</text></nplcit>), and <nplcit id="ncit0003" npl-type="b"><text>Hartmann, William M. Signals, Sound, and Sensation. Springer-Verlag-AIP Press, 1997</text></nplcit>, which are incorporated by reference herein.
Peak detection may be performed on the envelope, for example, by identifying the maximum amplitude within a specified time frame. In some embodiments where only acoustic data is used, detection of inhalation and exhalation phases may be carried out using extraction of both time- and frequency-domain features that are used in classification techniques, such as voice activity detection, Mel-frequency cepstral coefficients, power level, zero-crossing rate, and so on. Examples of techniques that may be used to detect inhalation and exhalation phases are described, for example, in <nplcit id="ncit0004" npl-type="s"><text>Yahya, Omar, and Miad Faezipour. "Automatic detection and classification of acoustic breathing cycles." American Society for Engineering Education (ASEE Zone 1), 2014 Zone 1 Conference of the IEEE, 2014</text></nplcit>, and<nplcit id="ncit0005" npl-type="s"><text> Abushakra, Ahmad, and Miad Faezipour. "Acoustic signal classification of breathing movements to virtually aid breath regulation." IEEE Journal of Biomedical and Health Informatics 17.2 (2013): 493-500</text></nplcit>, which are incorporated by reference herein.
In some embodiments, classical or more sophisticated classification techniques using Gaussian Mixture Models, Support Vector Machines, and the like can be used to train a classifier to automatically detect various breathing phases in real-time.
In various embodiments, acoustic information could be used in combination with motion detector data to identify inhalation and exhalation phases. As an example, decrease in amplitude measured by a motion detector may correspond to a peak in signal measured by the acoustic data and may be classified as an inhalation event.
Method <b>700</b> may continue and determine a periodicity of the microphone signal <b>706</b>, for example, after extracting the envelope to produce a smooth response signal. Auto-correlation functions may be used to determine the periodicity. For example, a breathing rate may be estimated as the inverse of the lag corresponding to the first, largest peak in the autocorrelation function of the microphone signal.
Method <b>700</b> may continue and cross-correlate the microphone signal from signals of other sensors <b>708</b>, for example, after determining the periodicity. Cross-correlation functions may be used between the microphone signal and, for example different types of sensors (e.g., motion detector and other microphones) to obtain a measure of similarity across different signal domains, which may improve accuracy or precision of breathing-rate estimate.
In one example of cross-correlating information from various sensors, a motion detector, such as an inertial measurement unit (IMU), may be used to detect motion and generate a breath-related signal representing the motion, in which a slow deviation from baseline may indicate a breath cycle (e.g., including inhalation followed by exhalation) (see <figref idref="f0006"><b>FIG. 7</b></figref>). An acoustic sensor of the microphone may be used to generate acoustic signal, in which an inhalation followed by an exhalation may give rise to two consecutive increases and decreases in amplitude (see <figref idref="f0007"><b>FIG. 8</b></figref>). Information from the motion detector may be used to determine a breath cycle, while information from the microphone may provide finer granularity for the inhalation and exhalation cycles. In embodiments where acoustic information is not available, the peak and trough of the data obtained from the motion detector may be used instead to estimate inhalation and exhalation cycles.
<figref idref="f0009"><b>FIG. 10</b></figref> shows a method for managing a deep breathing exercise session using an ear-worn device, such as ear-worn device <b>16</b> (<figref idref="f0001 f0002 f0003 f0004"><b>FIGS. 1-5</b></figref>), and optionally a user-controllable device, such as user-controllable device <b>302</b> (<figref idref="f0004 f0005"><b>FIGS. 5-6</b></figref>). In general, breath detection by ear-worn device <b>16</b> may not always be active. As illustrated, method <b>800</b> includes receiving a request to initiate a deep breathing exercise <b>802</b>. The request may be made by a user or wearer of the ear-worn device or user-controllable device. The request may be made by the wearer to ear-worn device or user-controllable device, for example, using a touchscreen or voice command. Breath detection may be activated when the breathing session is initialized, which may conserve battery usage in both the ear-worn device and the user-controllable device for other types of processing.
Method <b>800</b> may continue and monitor deep breathing using one or more sensors of ear-worn device <b>804</b>, for example, in response to initiating the deep breathing exercise. The one or more sensors may include at least one of a motion detector, a microphone, a heart rate sensor, and an electrophysiological sensor. In some embodiments, once the session initializes, the wearer may be guided through a series of deep breathing exercises that may be voice guided. Voice guidance in this context may be controlled by the application on the user-controllable device that helps the user focus on the breathing task. The voice guidance may be determined based on a series of parameters that the wearer defines. Some of these parameters may include the duration of the breathing session, the breathing rate at the start of the session, the breathing rate at the end of the session, inhalation rate, exhalation rate, and a hold duration.
During the guided session, voice-guidance may be automatically adjusted according to the rate of breaths defined. For example, the phrase "you're doing a good job" may be played through the ear-worn device or through the user-controllable device if the wearer's breathing rate moves closer to achieving a pre-determined breathing-rate goal.
In some embodiments, voice playback may be played in response to a relative to the rate of BPM determined by pre-defined set of logic. For example, the duration of the voice playback may be regulated by a duration for inhalation and exhalation set by the user. If exhalation is set for 5 seconds, a playback phrase such as "good job" may be used. If a longer exhalation time is set, such as 8 seconds, then a longer phrase such as "now exhale slowly," may be used instead. Alternatively, a shorter phrase may be used that is played closer to the end of the exhalation.
Voice guidance may be determined based on the breathing pattern of the user that are defined by a set of parameters. For example, phrases associated with inhalations may be played when inhalation is carried out and not during exhalations. Real-time analyses and feedback from ear-worn devices may be used to let the application on the user-controllable device know when the user is inhaling, exhaling, or holding their breath.
In some embodiments, audio feedback in the form of voice guidance or non-voice sounds may be delivered directly through the ear-worn device (e.g., hearing aid or other device). In some embodiments, the audio feedback may be delivered by another device (e.g., smartphone or Bluetooth device).
Further, method <b>800</b> may continue and initiate an end of the deep breathing exercise <b>806</b>. In some embodiments, the end of the deep breathing exercise is initiated automatically after a predetermined period of time. In some embodiments, the end of the deep breathing exercise may be initiated by wearer input. Further, in some embodiments, the end of the deep breathing exercise may be initiated in response to achieving a deep breathing goal.
<figref idref="f0010"><b>FIG. 11</b></figref> shows one example of method <b>850</b> for managing a deep breathing exercise session using an ear-worn device, such as ear-worn device <b>16</b> (<figref idref="f0001 f0002 f0003 f0004"><b>FIGS. 1-5</b></figref>), and optionally a user-controllable device, such as user-controllable device <b>302</b> (<figref idref="f0004 f0005"><b>FIGS. 5-6</b></figref>). As illustrated, method <b>850</b> includes receiving a request to initiate a deep breathing exercise <b>852</b>.
Method <b>850</b> may also include determining whether a threshold for the ambient acoustic environment is exceeded <b>854</b>, for example, determining whether a breathing pattern is detectable in an ambient acoustic environment such that inhalation and exhalation signatures are detectable. In some embodiments, one or more microphones of the ear-worn device or the user-controllable device may be used to measure sound levels of the ambient environment. If certain conditions are met regarding the sound levels, the breathing pattern may be determined as detectable. For example, there may be a sufficiently low amount of overall noise, or amount of noise in a particular frequency band, below a threshold value.
In some embodiments, checking conditions to determine whether a breathing pattern is detectable may be performed, for example, at the start of a deep breathing session. In other embodiments, the check may occur automatically in the background.
If the breathing pattern is detectable, when the acoustic information in the microphone signal is robust, for example, method <b>850</b> may include monitoring deep breathing using the motion detector and the microphone <b>856</b>. In other words, monitored breathing data may be based on monitored user motion and monitored ambient sound in response to the breathing pattern being detectable.
If the breathing pattern is not detectable, method <b>850</b> may include monitoring deep breathing using the motion detector <b>858</b>, and may not use a microphone signal. In other words, monitored breathing data may be provided without using monitored ambient sound in response to the breathing pattern not being detectable. For example, when ambient sounds are determined to be too loud, the use of the microphones may be nulled, and the detection scheme may use only the onboard motion detectors.
In some embodiments, the wearer may be advised to seek out a quiet place to carry out the session or may be asked to be stationary. Deep breathing exercises are typically carried out when the user is stationary, which may facilitate the accuracy of breath detection when using audio or motion signals.
Method <b>850</b> may continue and provide deep breathing guidance <b>860</b>. Further, method <b>850</b> may continue and initiate an end of the deep breathing exercise <b>862</b>.
<figref idref="f0011"><b>FIG. 12</b></figref> shows a method for managing a deep breathing exercise session for tinnitus. A masking noise may be provided during at least part of a deep breathing exercise. As illustrated, method <b>900</b> may include providing a masking noise for tinnitus <b>902</b>. In some embodiments, the tinnitus masking noise may be presented by the ear-worn device before the start of the sessions. Method <b>900</b> may include receiving a request to initiate the deep breathing exercise <b>904</b>. In some embodiments, the tinnitus masking noise may be initiated before, during, or with (e.g., at the same time as) the deep breathing exercise.
Method <b>900</b> may include modulating the tinnitus masking noise heard <b>906</b>, for example, in response to a detected breathing pattern (e.g., based on breathing rate). Tinnitus masking noise in this context may encompass any sound that may be used to provide relief from tinnitus, such as white noise or a recorded audio file. One or more parameters may be manipulated to modulate the tinnitus noise, such as a sound level (e.g., decibel level or sound amplitude), a frequency response, a modulation rate (e.g., for amplitude or frequency), a type of masking noise, and so on.
In one example, the modulation rate may be synchronized with the breathing rate such that inhalations would result in the tinnitus masking noise level to increase slightly, and then subsequently decrease on exhalation, or vice versa. In another example, the frequency of the tinnitus masking noise may be manipulated such that inhalations would cause a shift in the frequency response for more higher frequency emphasis, and exhalations would result in more lower frequency emphasis, or vice versa.
Thus, various embodiments of the EAR-WORN DEVICES, with breathing detection and/or deep breathing assistance are disclosed. Although reference is made herein to the accompanying set of drawings that form part of this disclosure, one of at least ordinary skill in the art will appreciate that various adaptations and modifications of the embodiments described herein are within, or do not depart from, the scope of this disclosure. For example, aspects of the embodiments described herein may be combined in a variety of ways with each other. Therefore, it is to be understood that, within the scope of the appended claims, the claimed invention may be practiced other than as explicitly described herein.
All references and publications cited herein are expressly incorporated herein by reference in their entirety into this disclosure, except to the extent they may directly contradict this disclosure.
The terms "coupled" or "connected" refer to elements being attached to each other either directly (in direct contact with each other) or indirectly (having one or more elements between and attaching the two elements). Either term may be modified by "operatively" and "operably," which may be used interchangeably, to describe that the coupling or connection is configured to allow the components to interact to carry out at least some functionality (for example, a smartphone may be operatively coupled to the internet to send or receive data).
Terms related to orientation, such as "top," "bottom," "side," and "end," are used to describe relative positions of components and are not meant to limit the orientation of the embodiments contemplated. For example, an embodiment described as having a "top" and "bottom" also encompasses embodiments thereof rotated in various directions unless the content clearly dictates otherwise.
Reference to "one embodiment," "an embodiment," "certain embodiments," or "some embodiments," etc., means that a particular feature, configuration, composition, or characteristic described in connection with the embodiment is included in at least one embodiment of the disclosure. Thus, the appearances of such phrases in various places throughout are not necessarily referring to the same embodiment of the disclosure. Furthermore, the particular features, configurations, compositions, or characteristics may be combined in any suitable manner in one or more embodiments.
The words "preferred" and "preferably" refer to embodiments of the disclosure that may afford certain benefits, under certain circumstances. However, other embodiments may also be preferred, under the same or other circumstances. Furthermore, the recitation of one or more preferred embodiments does not imply that other embodiments are not useful and is not intended to exclude other embodiments from the scope of the disclosure.
As used in this specification and the appended claims, the singular forms "a," "an," and "the" encompass embodiments having plural referents, unless the content clearly dictates otherwise. As used in this specification and the appended claims, the term "or" is generally employed in its sense including "and/or" unless the content clearly dictates otherwise.
As used herein, "have," "having," "include," "including," "comprise," "comprising" or the like are used in their open-ended sense, and generally mean "including, but not limited to." It will be understood that "consisting essentially of," "consisting of," and the like are subsumed in "comprising," and the like.
The term "and/or" means one or all of the listed elements or a combination of at least two of the listed elements.
The phrases "at least one of," "comprises at least one of," and "one or more of' followed by a list refers to any one of the items in the list and any combination of two or more items in the list.
The invention can be described further in respect of the following consistory clauses: <ol id="ol0001"><li>1. A method for guiding deep breathing comprising: <ul id="ul0002" list-style="none"><li>receiving a request from a user to initiate a deep breathing exercise on a user-controlled device;</li><li>monitoring deep breathing using one or more sensors on an ear-worn device in response to initiating the deep breathing exercise, wherein the one or more sensors include at least one of a motion detector, a microphone, a heart rate sensor, and an electrophysiological sensor; and</li><li>initiating an end to the deep breathing exercise.</li></ul></li><li>2. The method of clause 1, further comprising: determining whether a breathing pattern is detectable in an ambient acoustic environment using a microphone of the ear-worn device or of the user-controlled device; and monitoring deep breathing using a motion detector and the microphone of the ear-worn device or of the user-controlled device in response to the breathing pattern being detectable.</li><li>3. The method of clause 1 or clause 2, further comprising initiating an end to the deep breathing exercise after a predetermined period of time, in response to wearer input, or in response to achieving a deep breathing goal.</li><li>4. The method of clauses 1, 2 or 3, further comprising calibrating the motion detector using a pre-determined baseline condition.</li><li>5. The method of any preceding clause, further comprising: <ul id="ul0003" list-style="none"><li>logging deep breathing data based on the monitored deep breathing over time; and</li><li>providing progress data based on the logged deep breathing data to the user with the user-controlled device or the ear-worn device.</li></ul></li><li>6. The method of clause 5, wherein the progress data provided to the user comprises at least one of: <ul id="ul0004" list-style="none"><li>results of a comparison of the deep breathing data to a deep breathing goal;</li><li>merit badges received; and</li><li>reminders to perform deep breathing exercises.</li></ul></li><li>7. The method of any preceding clause, further comprising providing deep breathing guidance during the deep breathing exercise to the user with the user-controlled device or the ear-worn device.</li><li>8. The method of clause 7, wherein breathing rate guidance provided to the user is based on a breathing rate goal.</li><li>9. The method of clause 7 or clause 8, wherein content of the deep breathing guidance is based on whether an inhalation, an exhalation, or a holding of the breath is detected.</li><li>10. The method of any preceding clause, further comprising providing a masking noise for tinnitus during at least part of the deep breathing exercise.</li><li>11. The method of clause 10, further comprising modifying the masking noise in response to a detected breathing pattern.</li><li>12. The method of clause 11, wherein at least one parameter of the masking noise modified in response to the detected breathing pattern comprises at least one of: a sound level, a frequency response, a modulation rate for amplitude, a modulation rate for frequency, and a type of masking noise.</li><li>13. An ear-worn device comprising: <ul id="ul0005" list-style="none"><li>a housing configured to be worn by a user in or proximate to an ear of the user;</li><li>a motion detector contained in the housing and configured to monitor user motion;</li><li>a microphone contained in the housing and configured to monitor ambient sound;</li><li>a communication interface contained in the housing and configured to communicate with a user-controlled device;</li><li>a controller comprising a processor contained in the housing and operably coupled to the motion detector, the microphone, and the communication interface, the controller being configured to: <ul id="ul0006" list-style="none"><li>receive a request to initiate a deep breathing exercise from the user-controlled device;</li><li>monitor user motion and ambient sound in response to receiving the request; and</li><li>provide monitored breathing data based on at least the monitored user motion.</li></ul></li></ul></li><li>14. The device of clause 13, wherein the controller is configured to: <ul id="ul0007" list-style="none" compact="compact"><li>determine whether a breathing pattern is detectable in an ambient acoustic environment using the microphone of the ear-worn device or a microphone of the user-controlled device; and</li><li>provide monitored breathing data based on the monitored user motion and monitored ambient sound in response to the breathing pattern being detectable.</li></ul></li><li>15. The device of clause 14, wherein the controller is configured to provide monitored breathing data without using monitored ambient sound in response to the breathing pattern not being detectable.</li><li>16. The device of any of clauses 13 to 15, wherein the motion detector comprises at least one of an accelerometer and a gyroscope.</li><li>17. The device of any of clauses 13 to 16, wherein the controller is configured to calibrate the motion detector using a pre-determined baseline condition.</li><li>18. The device of any of clauses 13 to 17, further comprising at least one of a heart rate sensor and an electrophysiological sensor.</li><li>19. The device of any of clauses 13 to 18, wherein the controller is configured to provide a masking noise for tinnitus during at least part of the deep breathing exercise.</li><li>20. A user-controllable device comprising: <ul id="ul0008" list-style="none"><li>a user interface comprising a display and configured to receive user input;</li><li>a communication interface configured to connect to an ear-worn device;</li><li>a controller comprising a processor operably coupled to the user interface and the communication interface, the controller being configured to: <ul id="ul0009" list-style="none"><li>receive a request to initiate a deep breathing exercise based on user input at the user interface;</li><li>connect to the ear-worn device to receive monitored breathing data based on user motion and optionally monitored ambient sound; and</li><li>initiate an end to the deep breathing exercise.</li></ul></li></ul></li><li>21. The device of clause 20, wherein the controller is configured to store progress data based on the monitored breathing data.</li><li>22. The device of clause 21, wherein the communication interface is configured to connect to the internet to share progress data with others.</li><li>23. The device of clause 20 or clause 21, wherein the controller is configured to command the user interface to display at least one of: <ul id="ul0010" list-style="none"><li>a measured breathing rate;</li><li>a breathing rate goal;</li><li>guidance through the monitored deep breathing; and</li><li>instructions for calibrating the ear-worn device.</li></ul></li><li>24. The device of any of clauses 20 to 23, wherein the controller is configured to receive user input from the user interface comprising at least one of: <ul id="ul0011" list-style="none"><li>a breathing exercise duration;</li><li>a breathing rate starting goal; and</li><li>a breathing rate end goal.</li></ul></li><li>25. The device of any of clauses 20 to 24, wherein the controller is configured to modify at least one parameter for a masking noise in response to a detected breathing pattern.</li></ol>
Contents5
12 sheets
Sheet 1 Sheet 2 Sheet 3 Sheet 4 Sheet 5 Sheet 6 Sheet 7 Sheet 8 Sheet 9 Sheet 10 Sheet 11 Sheet 12
Every citation, both waysCites: the store holds 2 of 3
| Document | Relation | Office | Cited during |
|---|---|---|---|
| US12149893B2 | Cited by | United States of America | Applicant |
| US11638563B2 | Cited by | United States of America | Applicant |
| WO2020097355A1 | Cited by | World Intellectual Property Organization (WIPO) | International search |
| US12095940B2 | Cited by | United States of America | Applicant |
| US11277697B2 | Cited by | United States of America | Applicant |
| US11559252B2 | Cited by | United States of America | Applicant |
| US12064261B2 | Cited by | United States of America | Applicant |
| EP4280949A4 | Cited by | European Patent Office (EPO) | Search report |
| US2010240945A1 | Cites | United States of America | Examiner |
| US2016296799A1 | Cites | United States of America | Examiner |
| POTAMIANOSALEXANDROSPETROS MARAGOS: "A comparison of the energy operator and the Hilbert transform approach to signal and speech demodulation", SIGNAL PROCESSING, vol. 37.1, 1994, pages 95 - 120 | Non-patent | – | Applicant |
| SCHLOSS, W. ANDREW: "On the Automatic Transcription of Percussive Music - From Acoustic Signal to High-Level Analysis", STANFORD UNIVERSITY, PH.D. THESIS, 1985 | Non-patent | – | Applicant |
| HARTMANNWILLIAM M: "Signals, Sound, and Sensation.", 1997, SPRINGER-VERLAG-AIP PRESS | Non-patent | – | Applicant |
| YAHYA, OMARMIAD FAEZIPOUR: "Automatic detection and classification of acoustic breathing cycles", AMERICAN SOCIETY FOR ENGINEERING EDUCATION (ASEE ZONE 1), 2014 ZONE 1 CONFERENCE OF THE IEEE, 2014 | Non-patent | – | Applicant |
| ABUSHAKRAAHMADMIAD FAEZIPOUR: "IEEE Journal of Biomedical and Health Informatics", vol. 17.2, 2013, article "Acoustic signal classification of breathing movements to virtually aid breath regulation", pages: 493 - 500 | Non-patent | – | Applicant |
8 members in 2 offices
Priority claims4
| Document | Office | Kind | Date |
|---|---|---|---|
| 201816027903 | United States of America | A | |
| 201816027903 | United States of America | A | |
| 201816027903 | United States of America | – | |
| US201816027903 | – | – | – |
Members8
| Document | Office | Kind | |
|---|---|---|---|
| EP3591990A2This record | European Patent Office (EPO) | A2 | |
| US2020008708A1 | United States of America | A1 | |
| EP3591990A3 | European Patent Office (EPO) | A3 | |
| US11540743B2 | United States of America | B2 | |
| US2023093747A1 | United States of America | A1 | |
| US11826138B2 | United States of America | B2 | |
| US2024000339A1 | United States of America | A1 | |
| US12161460B2 | United States of America | B2 |
17 legal events, as the office reported them to INPADOC
Over the term
Point at a mark for the eventEvents
| Event | Code | |
|---|---|---|
| Application refused18R | 18R | |
| Information on the status of an ep patent application or granted ep patentGrantedSTATUS: THE APPLICATION HAS BEEN REFUSEDSTAA | STAA | |
| First examination report despatched17Q | 17Q | |
| Request for examination filed17P | 17P | |
| Designated contracting states (corrected)RBV | RBV | |
| Information on the status of an ep patent application or granted ep patentGrantedSTATUS: EXAMINATION IS IN PROGRESSSTAA | STAA | |
| Information on the status of an ep patent application or granted ep patentGrantedSTATUS: REQUEST FOR EXAMINATION WAS MADESTAA | STAA | |
| Designated contracting statesAK | AK | |
| Request for extension of the european patentAX | AX | |
| Information provided on ipc code assigned before grantRIC1 | RIC1 | |
| Information provided on ipc code assigned before grantRIC1 | RIC1 | |
| Information provided on ipc code assigned before grantRIC1 | RIC1 | |
| Search report despatchedORIGINAL CODE: 0009013PUAL | PUAL | |
| Designated contracting statesAK | AK | |
| Request for extension of the european patentAX | AX | |
| Public reference made under article 153(3) epc to a published international application that has entered the european phaseORIGINAL CODE: 0009012PUAI | PUAI | |
| Information on the status of an ep patent application or granted ep patentGrantedSTATUS: THE APPLICATION HAS BEEN PUBLISHEDSTAA | STAA |
Numbers
- Publication
- 3591990
- Publication, DOCDB
- 3591990
- Publication, EPODOC
- EP3591990
- Application
- 184804
- Application, DOCDB
- 19184804
- Application, EPODOC
- EP20190184804
Titles3
- German
- OHRGETRAGENE VORRICHTUNGEN
- English
- EAR-WORN DEVICES
- French
- DISPOSITIFS PORTÉS DANS L'OREILLE
Classification
- CPC, 17
- H04R25/75
- A61B5/0816
- H04R1/1041
- H04R29/004
- H04R2225/61
- H04R2225/67
- A61B5/0205
- A61B5/113
- A61B5/4815
- A61B5/6803
- A61B5/6815
- A61B5/6898
- A61B5/7214
- A61B5/7267
- A61B2562/0204
- A61B2562/0219
- A61M2230/42
- IPC, 3
- H04R1 10
- H04R25 00
- H04R29 00
Designated states3
- Contracting states, 1
- Türkiye
- Extension states, 1
- Montenegro
- Validation states, 1
- Tunisia