Facilitating calibration of an audio playback device
14 claims: 12 independent, 2 dependent
- 11つ又は複数のマイクロホンを介して、再生デバイスにより再生されるキャリブレーション音を表すデータを取り込むステップ、再生デバイスにより再生されるキャリブレーション音の各サンプルを表すデータ内の複数のセクションを識別するステップ、再生デバイスにより再生されるキャリブレーション音の複数のサンプルを表すデータ内の識別された複数のセクションに基づいて、キャリブレーション周波数範囲にわたる再生デバイスの周波数応答を決定するステップ、ここで、再生デバイスの周波数応答は、再生デバイスによるオーディオ出力と、再生デバイスの周囲の環境の音響特性と、を表す、再生デバイスの周波数応答および目標周波数応答に基づいて、再生デバイスの周囲の環境の音響特性を少なくとも部分的にオフセットするオーディオ処理アルゴリズムの1つ又は複数のパラメータを決定するステップ、再生デバイスに、オーディオ処理アルゴリズムの1つ又は複数のパラメータを適用するステップ、 閾値SNRより大きい信号対雑音比(SNR)を有する識別された複数のセクションにおけるサンプルの少なくとも1つの閾値数を決定するステップ、 を含 み、 サンプルのSNRは、キャリブレーション音の所与のサンプルの信号レベルと、再生デバイスの環境内でマイクロホンにより検出されるバックグランドノイズと、の比率である、 方法。
- 2再生デバイスは、マイクロホンを有し、1つ又は複数のマイクロホンは、再生デバイスのマイクロホンを含む、請求項1に記載の方法。
- 3再生デバイスのマイクロホンは、逆曲線によって表される既知の音響特性を有し、キャリブレーション周波数範囲にわたる再生デバイスの周波数応答を決定するステップは、逆曲線に基づいて、再生デバイスにより再生されるキャリブレーション音の各サンプルを表すデータ内の識別された複数のセクションから1つ又は複数のマイクロホンの既知の音響特性をオフセットすること、を有する、請求項1又は2に記載の方法。
- 4複数のセクションを識別するステップは、キャリブレーション周波数範囲全体にわたるオーディオを含むデータ内の特定のセクションを識別すること、を有する、請求項1~3のいずれか一項に記載の方法。
- 5キャリブレーション音は、(i)キャリブレーション周波数範囲の最小値と第1の閾値周波数との間の周波数においてキャリブレーションノイズを含む第1の成分、(ii)第2の閾値周波数とキャリブレーション周波数範囲の最大値との間の周波数を介して掃引する信号を含む第2の成分、を含む、請求項1~4のいずれか一項に記載の方法。
- 6再生デバイスは、キャリブレーション音を複数回反復して再生し、キャリブレーション音の複数回の反復は、第1の成分を含む各保護帯域により時間的に分割されており、第1の成分は、キャリブレーション周波数範囲の最小値と第1の閾値周波数との間の周波数においてキャリブレーションノイズを含み、各保護帯域は、第2の成分を除外し、第2の成分は、第2の閾値周波数と前記キャリブレーション周波数範囲の最大値との間の周波数を介して掃引する信号を含む、請求項1~ 5 のいずれか一項に記載の方法。
- 7再生デバイスにより再生されるキャリブレーション音の複数回の反復を表すデータ内の複数のセクションを識別するステップは、第2の成分を除外する各保護帯域に対応するデータの1つ又は複数の第1セクションを識別すること、識別された1つ又は複数の第1セクションと予め決定されたキャリブレーション音の周期性とに基づいて、再生デバイスにより再生されるキャリブレーション音の各反復に対応するデータの1つ又は複数の第2セクションを識別すること、を有する、請求項1~ 6 のいずれか一項に記載の方法。
- 8再生デバイスにより再生されるキャリブレーション音の複数回の反復を表すデータ内の複数のセクションを識別するステップは、キャリブレーション音の複数回の反復を表すデータ内の第1保護帯域を表す第1セクションを識別すること、キャリブレーション音の複数回の反復を表すデータ内の第2保護帯域を表す第2セクションを識別すること、第1セクションと第2セクションとの間のキャリブレーション音の複数回の反復を表すデータ内の、キャリブレーション音の所与の反復を表す第3セクションを識別すること、を有する、請求項1~ 7 のいずれか一項に記載の方法。
- 9再生デバイスにより再生されるキャリブレーション音の複数回の反復を表すデータ内の複数のセクションを識別するステップは、キャリブレーション音の複数回の反復を示すデータの部分を識別すること、ここで、識別された部分は、閾値SNRより大きい信号対雑音比(SNR)を有し、識別された部分のSNRは、(i)(a)キャリブレーション音の所与の反復及び/又は(b)保護帯域、の信号レベルと、(ii)再生デバイスの環境内でマイクロホンにより検出されたバックグランドノイズと、の比率である、保護帯域に対応する識別された部分のサブセクションを識別すること、ここでサブセクションは、閾値音強度より小さい音強度を有する、(i)識別された部分の識別された第2セクションと、(ii)キャリブレーション音の予め決定された周期性と、に基づいて、複数のセクションのうち1つ又は複数のセクションを識別すること、を有する、請求項1~ 8 のいずれか一項に記載の方法。
- 10更に、再生デバイスにより再生されるキャリブレーション音の複数回の反復を表すデータ内で複数のセクションの各信号対雑音比(SNR)を決定するステップ、ここで、各SNRは、(i)(a)キャリブレーション音の各反復及び/又は(b)保護帯域の各反復、の信号レベルと、(ii)再生デバイスの環境内でマイクロホンにより検出されたバックグランドノイズと、の比率を表す、複数のセクションとして、閾値SNRを除外するSNRを有する特定のセクションを識別するステップ、を含む、請求項1~ 9 のいずれか一項に記載の方法。
- 11保護帯域は、ある特定の時間において第1のオーディオ周波数および第2のオーディオ周波数を含み、前記方法は、更に特定の時間において第1のオーディオ周波数と、第2のオーディオ周波数と、を検出するステップを含み、再生デバイスにより再生されるキャリブレーション音の複数回の反復を表すデータ内の複数のセクションを識別するステップは、(i)特定の時間において第1のオーディオ周波数と第2のオーディオ周波数とを検出することと、(ii)キャリブレーション音の予め決められた周期性と、に基づいて複数のセクションを識別すること、を有する、請求項1~ 10 のいずれか一項に記載の方法。
- 12オーディオ処理アルゴリズムの1つ又は複数のパラメータを決定するステップは、オーディオ処理アルゴリズムが再生デバイスによって実装されている場合に、再生デバイスによって再生されたオーディオの一部が閾値増幅率を超えて増幅されるのを防ぐため、オーディオ処理アルゴリズムの1つ又は複数のパラメータのうち少なくとも1つのパラメータを制限すること、を有する、請求項1~ 11 のいずれか一項に記載の方法。
- 13更に、オーディオ処理アルゴリズムを実装している場合に、マイクロホンを介して、再生デバイスにより再生される1つ又は複数の追加のキャリブレーション音を取り込むステップ、取り込まれた1つ又は複数の追加のキャリブレーション音に基づいて、再生デバイスが周囲の環境に合わせて構成されていることを決定するステップ、を含む、請求項1~ 12 のいずれか一項に記載の方法。
- 14再生デバイスを備え、請求項1~ 13 のいずれか一項に記載の方法を実行するように構成される、システム。
Independent claims14
218 paragraphs, as filed
Cross-reference of related applications
This application gives priority to US Patent Application No. 14 / 864,393 filed on September 24, 2015 and US Provisional Application No. 62 / 220,225 filed on September 17, 2015. It is claimed and incorporated herein by reference in its entirety.
The application also incorporates the entire contents of US Patent Application No. 14 / 481,511, filed September 9, 2014, herein by reference. The application also incorporates the entire contents of US Patent Application No. 14 / 696,014, filed April 24, 2015, herein by reference. The application also incorporates the entire contents of US Patent Application No. 14 / 805,140, filed July 21, 2015, herein by reference. The application also incorporates the entire contents of US Patent Application No. 14 / 805,340, filed July 21, 2015, herein by reference. The application also incorporates the entire contents of US Patent Application No. 14 / 826,873, filed August 14, 2015, herein by reference.
This application relates to consumer products, in particular to methods, systems, products, features, services, and other elements directed at media reproduction, and some aspects thereof.
In 2003, Sonoz Incorporated filed a patent application entitled "How to Synchronize Audio Playback Between Multiple Network Devices," one of the first patent applications, and in 2005 sold the media playback system. Until the start, the options for accessing and auditioning digital audio in the outloud settings were severely restricted. The Sonos Wireless HiFi system allows people to experience virtually unlimited music from many sources via one or more network playback devices. Through software control applications installed on smartphones, tablets, or computers, people can play the music they want in any room equipped with a network playback device. You can also use a controller, for example, to stream different songs to each room with a playback device, group multiple rooms for synchronous playback, or synchronize in all rooms. You can also listen to the same song.
<p>Given the growing interest in digital media to date, there is a need to further develop consumer-accessible technologies that can further enhance the listening experience.</p><p>The features, embodiments, and advantages of the techniques disclosed herein are more easily understood with reference to the following description, the appended claims, and the accompanying drawings.</p>
<figref num="1">An example of a media reproduction system configuration in which a certain embodiment can be implemented is shown.</figref><figref num="2">A functional block diagram of an example of a playback device is shown.</figref><figref num="3">A functional block diagram of an example of a control device is shown.</figref><figref num="4">An example of the controller interface is shown.</figref><figref num="5">It is a flow chart of an example of a method.</figref><figref num="6">It is a flow chart of an example of a method.</figref><figref num="7A">It is a flow chart of an example of a method.</figref><figref num="7B">It is a flow chart of an example of a method.</figref><figref num="8">It is a flow chart of an example of a method.</figref><figref num="9">It is a flow chart of an example of a method.</figref><figref num="10A">It is a flow chart of an example of a method.</figref><figref num="10B">It is a flow chart of an example of a method.</figref><figref num="11">It is a flow chart of an example of a method.</figref><figref num="12">It is a flow chart of an example of a method.</figref><figref num="13">An example of the path of a moving microphone is shown.</figref><figref num="14A">An example of the calibration sound is shown.</figref><figref num="14B">An example of the calibration sound is shown.</figref><figref num="15">An example of the sweep component of the calibration sound is shown.</figref><figref num="16">An example of the noise component of the calibration sound is shown.</figref><figref num="17">An example of the calibration sound and the protection band is shown.</figref><figref num="18">An example of the calibration sound and the protection band is shown.</figref><figref num="19">An example of the frequency-domain format data section is shown.</figref><figref num="20">An example of the calibration sound and the protection band is shown.</figref>
The drawings are intended to illustrate some exemplary embodiments, but it is understood that the invention is not limited to the arrangements and means shown in the drawings.
I. Overview An example of a procedure for calibrating a playback device is one or more in which the playback device is captured and / or analyzed by a computer (eg, a control device configured to control the playback device). It may include playing a calibration sound. In some embodiments, the computer may analyze the captured calibration sound over the calibration frequency range of the playback device. Therefore, one or more calibration sounds reproduced by the reproduction device may include frequencies that span the calibration frequency range. The calibration frequency range may include a range of frequencies that the playback device can emit (eg, 15-30,000 Hz) and also includes frequencies that are considered to be within the range of human hearing (eg, 20-20,000 Hz). But it may be. By reproducing and subsequently capturing a calibration sound that spans the calibration frequency range, the frequency response of the reproduction device, including the calibration frequency range, may be determined. Such a frequency response may represent an environment in which the reproduction device reproduces the calibration sound.
An example of such an environment may include a room with walls, ceilings and / or furniture and the like. Such objects in the environment affect the viewer's perception of playback by the playback device in various ways, based on where the viewer is in the environment and / or where the playback device is located in the environment. obtain. Therefore, for calibration, the playback device may be placed in an environment where the playback device will later perform playback of audio content that is not necessarily calibrated. At that location, the effect of the environment on the calibration sound played by the playback device can be similar to the effect the environment can have on playback during normal playback.
Some examples of calibration procedures may include the computer capturing the calibration sound reproduced by the reproduction device at multiple physical locations, which may assist in determining the acoustic characteristics of the environment. To facilitate the capture of calibration sound at multiple points in the environment, some calibration procedures include moving microphones. For example, a microphone that captures the calibration sound (eg, a computer) may be continuously moved through the environment while the calibration sound is being played. Such continuous movement can facilitate the capture of calibration sound at multiple physical locations within the environment, thereby better understanding how the environment affects audio playback by the playback device.
In some embodiments, the reproduction device may repeatedly reproduce the calibration sound such that each calibration sound spans the calibration frequency range during each iteration. Each calibration sound may be captured by a computer microphone at different physical locations in the environment, providing an audio sample for each location. Therefore, reproduction and capture of such calibration sounds can facilitate the determination of the spatially averaged frequency response of a reproduction device operating in the environment.
Examples of calibration sounds may span the calibration frequency range with various waveforms. Some examples of calibration sounds may include calibration noise (eg, pseudo-random periodic noise) that spans at least a portion of the calibration frequency range. However, the phase distortion caused by the movement of the microphone can complicate the association between the captured sound and the emitted calibration noise. Other examples of calibration sounds may include sweep sounds (eg, sweep sine waves or chirps) whose frequency rises or falls through at least a portion of the calibration frequency range. Since such a sweep sound can take the form of a Doppler shift in which the phase shift is predictable, it is possible to facilitate the association between the captured sound and the emitted sweep sound. However, at lower frequencies, the sweep sound reproduced at the volume required to overcome the background noise typically present in a given environment can overload the speaker driver of the reproduction device.
Accordingly, some examples of calibration sounds described herein may include calibration sounds that include both a first component and a second component that may help alleviate some of these problems. For example, the calibration sound may include a first component that includes calibration noise between the minimum calibration frequency range (eg, 15-20 Hz) and the first threshold frequency (eg, 50-100 Hz). .. The first component is enough energy for the playback device to overcome typical background noise (eg, quiet room noise), which overloads the playback device's speaker driver compared to the sweep sound emission. Can be released with reduced risk. Also, the calibration sound is swept through a frequency between a second threshold frequency (eg, a frequency in the range of 50-100Hz) and a maximum frequency in the calibration frequency range (eg, 20-30,000Hz). It may also contain a second component (eg, rising or falling through said frequency). The use of predictable sounds, such as the sweeping sound of the second component, makes it easier for the computer to reveal the phase distortion resulting from the movement of the microphone.
Since part of the calibration frequency range can be audible to humans, some aspects of the calibration sound may be designed to make the calibration sound more pleasing to the viewer. For example, some calibration sounds may include a transition frequency range in which the first (noise) component and the second (sweep) component overlap. The first component, whose frequency overlaps with the second component, may avoid the potentially unpleasant sounds associated with the jarring frequency transition between the first and second components. In another example, the second portion of the calibration sound may descend (rather than ascend) through at least a portion of the calibration frequency range. Any second component that rises or falls can be useful for calibration, but sounds with frequencies that fall in frequency can be heard more comfortably due to the particular shape of the human ear canal.
In some situations, multiple playback devices may be calibrated during the calibration procedure. For example, an example of a calibration procedure may include calibration of a grouping of playback devices. Such groupings may be zones of a media playback system containing multiple playback devices, or may be formed from multiple zones of a media playback system grouped into zone groups containing each playback device from each zone. It may be done. Such groupings may also be physically positioned within the same environment (eg, a room in a house or other building).
In some embodiments, multiple playback devices may reproduce the calibration sound simultaneously. However, if multiple playback devices play the same calibration sound at the same time, the simultaneous calibration sounds may interfere with each other, and thus audio of sufficient quality for calibration of multiple playback devices by a computer microphone. May be hindered. Moreover, because the common frequencies of the various calibration sounds are generally indistinguishable, the computer may not be able to associate a particular calibration sound with the playback device that reproduced this particular calibration sound.
In an implementation example, the calibration sound may be tuned in an attempt to avoid such interference. For example, the first (noise) component of the calibration sound reproduced by each reproduction device may have a longer duration. The second (sweep) component of the calibration sound reproduced by each reproduction device may be staggered so that the common frequency of the sweep components is not reproduced simultaneously by the plurality of reproduction devices. Such an extension of each first component and a shift of each second component may provide sufficient time for each of the reproducing devices to reproduce each calibration sound detectable by the computer in each cycle. In such an example, the first (noise) component of the calibration sound may be excluded because the calibration noise reproduced by each reproduction device is generally indistinguishable. Therefore, calibration of multiple playback devices is limited to a frequency range that is bounded by the second threshold frequency and the maximum calibration frequency range (eg, the range of frequencies contained within each second sweep component). May be done.
Therefore, some of the examples described herein, among other things, detect and analyze the calibration sound played by the playback device to determine the frequency response of the playback device that is affected by its ambient environment. It also involves determining an audio processing algorithm that is tuned to tune the frequency response of the playback device to the target frequency response. Other aspects of the example will be apparent in the rest of the text of this specification.
In one example, a non-temporary computer-readable medium stores instructions that cause the computer to perform a function when performed by the computer. Functions include capturing one or more calibration sounds played by the playback device via the computer's microphone as the computer moves within the environment of the playback device. Each calibration sound contains one or more calibrations over frequencies in the calibration frequency range. The function also produces data representing one or more calibration sounds, one or more data sections, each of one or more calibration sounds, each of one or more data sections. Includes identifying to correspond to the calibration sound. Functions further include determining the frequency response of the playback device over the calibration frequency range using one or more data sections. The frequency response of the playback device characterizes audio playback by the playback device, which is influenced by the acoustic characteristics of the playback device's environment. The function further determines one or more parameters of the audio processing algorithm based on the frequency response of the reproduction device and the target frequency response, and sends the one or more parameters of the audio processing algorithm to the reproduction device. including.
In another example, the method performed by the computer involves capturing one or more calibration sounds played by the playback device through the computer's microphone as the computer moves through the environment of the playback device. .. Each calibration sound contains one or more calibrations over frequencies in the calibration frequency range. The method further comprises a step of generating data representing one or more calibration sounds, one or more data sections, each of one or more calibration sounds in each of the one or more data sections. Includes steps to identify to correspond to the calibration sound. The method further comprises using one or more data sections to determine the frequency response of the reproduction device over the calibration frequency range. The frequency response of the playback device characterizes audio playback by the playback device, which is influenced by the acoustic characteristics of the playback device's environment. The method further determines one or more parameters of the audio processing algorithm based on the frequency response of the reproduction device and the target frequency response, and sends the one or more parameters of the audio processing algorithm to the reproduction device. including.
In another example, a computer includes one or more processors, a non-temporary computer-readable medium that stores instructions that cause the computer to perform a function when executed by one or more processors. Functions include capturing one or more calibration sounds played by the playback device via the computer's microphone as the computer moves within the environment of the playback device. Each calibration sound contains one or more calibrations over frequencies in the calibration frequency range. The function also produces data representing one or more calibration sounds, one or more data sections, each of one or more data sections each one or more calibration sounds. Includes identifying to correspond to the calibration sound. Functions further include determining the frequency response of the playback device over the calibration frequency range using one or more data sections. The frequency response of the playback device characterizes audio playback by the playback device, which is influenced by the acoustic characteristics of the playback device's environment. The function further determines one or more parameters of the audio processing algorithm based on the frequency response of the reproduction device and the target frequency response, and sends the one or more parameters of the audio processing algorithm to the reproduction device. including.
In one example, a non-temporary computer-readable medium stores instructions that cause the computer to perform a function when performed by the computer. Functions include capturing one or more calibration sounds played by a playback device via a computer microphone and generating data representing one or more calibration sounds. The function further comprises identifying one or more data sections so that each of the one or more data sections corresponds to each calibration sound of one or more calibration sounds. The function further determines that more than one threshold amount of one or more data sections corresponds to each signal-to-noise ratio (SNR) less than the signal-to-noise ratio of the threshold, the computer user interface. Includes providing information that the playback device has not been properly calibrated through.
In another example, the method performed by the computer comprises capturing one or more calibration sounds played by the playback device via the computer's microphone. The method further comprises a step of generating data representing one or more calibration sounds, one or more data sections, each of one or more calibration sounds in each of the one or more data sections. Includes steps to identify to correspond to the calibration sound. The method further comprises determining that more than one threshold amount of one or more data sections corresponds to each signal-to-noise ratio (SNR) less than the signal-to-noise ratio of the threshold. The method further comprises providing information via the user interface of the computer that the playback device has not been properly calibrated.
In another example, a computer includes one or more processors, a non-temporary computer-readable medium that stores instructions that cause the computer to perform a function when executed by one or more processors. Functions include capturing one or more calibration sounds played by a playback device via a computer microphone and generating data representing one or more calibration sounds. The function further comprises identifying one or more data sections so that each of the one or more data sections corresponds to each calibration sound of one or more calibration sounds. The function further determines that more than one threshold amount of one or more data sections corresponds to each signal-to-noise ratio (SNR) less than the signal-to-noise ratio of the threshold, the computer user interface. Includes providing information that the playback device has not been properly calibrated through.
In one example, a non-temporary computer-readable medium stores instructions that cause the computer to perform a function when performed by the computer. The feature is one or more first calibration sounds played by the first playback device via the computer's microphone as the computer moves through the environment of the first playback device and the second playback device. , And capturing one or more second calibration sounds played by the second playback device. Each of the one or more first calibration sounds, and each of the one or more second calibration sounds, comprises sweeping through frequencies in the calibration frequency range. The function further comprises generating data representing one or more first calibration sounds and one or more second calibration sounds. The function corresponds to (i) one or more first data sections, each of the one or more first data sections each calibration sound of one or more first calibration sounds. And (ii) each calibration sound of one or more second data sections, each of one or more second data sections, one or more second calibration sounds. Includes identifying to correspond to. The function further comprises using one or more first data sections to determine the first frequency response of the first reproduction device over the calibration frequency range. The first frequency response characterizes audio reproduction by the first reproduction device, which is influenced by the acoustic characteristics of the environment of the first reproduction device and the second reproduction device. The function further comprises using one or more second data sections to determine the second frequency response of the second reproduction device over the calibration frequency range. The second frequency response characterizes audio reproduction by the second reproduction device, which is influenced by the acoustic characteristics of the environment of the first reproduction device and the second reproduction device. The function is Further, one or more first parameters of the first audio processing algorithm are determined based on the first frequency response and the first target frequency response, and the second frequency response and the second target frequency response. Includes determining one or more second parameters of the second audio processing algorithm based on. The function sends one or more first parameters of the first audio processing algorithm to the first playback device and one or more second of the second audio processing algorithms to the second playback device. Includes sending parameters for.
In another example, the method performed by the computer is played by the first playback device via the computer's microphone as the computer moves within the environment of the first and second playback devices1 It comprises the step of capturing one or more first calibration sounds and one or more second calibration sounds played by the second playback device. Each of the one or more first calibration sounds, and each of the one or more second calibration sounds, comprises sweeping through frequencies in the calibration frequency range. The method further comprises generating data representing one or more first calibration sounds and one or more second calibration sounds. The method further comprises (i) one or more first data sections, each of one or more first data sections into each calibration sound of one or more first calibration sounds. Identify correspondingly and (ii) each of one or more second data sections, each of one or more second sections of data one or more second calibration sounds. Includes steps to identify to correspond to the calibration sound. The method further comprises the step of using one or more first sections of data to determine the first frequency response of the first reproduction device over the calibration frequency range. The first frequency response characterizes audio reproduction by the first reproduction device, which is influenced by the acoustic characteristics of the environment of the first reproduction device and the second reproduction device. The method further comprises the step of using one or more second sections of data to determine the second frequency response of the second reproduction device over the calibration frequency range. The second frequency response characterizes audio reproduction by the second reproduction device, which is influenced by the acoustic characteristics of the environment of the first reproduction device and the second reproduction device. The method is further based on a first frequency response and a first target frequency response. One or more second of the second audio processing algorithm that determines one or more first parameters of one audio processing algorithm and is based on the second frequency response and the second target frequency response. Includes steps to determine parameters. The method further transmits one or more of the first parameters of the first audio processing algorithm to the first playback device and one or more of the second audio processing algorithms to the second playback device. Includes a step to send the second parameter.
In another example, a computer includes one or more processors, a non-temporary computer-readable medium that stores instructions that cause the computer to perform a function when executed by one or more processors. The feature is one or more first calibration sounds played by the first playback device via the computer's microphone as the computer moves through the environment of the first playback device and the second playback device. , And capturing one or more second calibration sounds played by the second playback device. Each of the one or more first calibration sounds, and each of the one or more second calibration sounds, comprises sweeping through frequencies in the calibration frequency range. The function further comprises generating data representing one or more first calibration sounds and one or more second calibration sounds. The function further comprises (i) one or more first data sections to each calibration sound of one or more first calibration sounds, each of which one or more first data sections. Identify correspondingly and (ii) each calibration of one or more second data sections, each of one or more second data sections, one or more second calibration sounds. Includes identifying to correspond to the sound. The function further comprises using one or more first data sections to determine the first frequency response of the first reproduction device over the calibration frequency range. The first frequency response characterizes audio reproduction by the first reproduction device, which is influenced by the acoustic characteristics of the environment of the first reproduction device and the second reproduction device. The function further comprises using one or more second data sections to determine the second frequency response of the second reproduction device over the calibration frequency range. The second frequency response is influenced by the acoustic characteristics of the environment of the first playback device and the second playback device. Characterizes audio playback by a second playback device. The function further determines one or more first parameters of the first audio processing algorithm based on the first frequency response and the first target frequency response, and the second frequency response and the second. It involves determining one or more of the second parameters of the second audio processing algorithm based on the target frequency response. The function further transmits one or more first parameters of the first audio processing algorithm to the first playback device and one or more of the second audio processing algorithms to the second playback device. Includes sending a second parameter.
In one example, a non-temporary computer-readable medium stores instructions that cause a first computer to perform a function when executed by the first computer. The function includes receiving data representing one or more calibration sounds played by the playback device and captured by the second computer from the second computer. Each calibration sound contains one or more calibrations over frequencies in the calibration frequency range. The function further comprises identifying one or more data sections so that each of the one or more data sections corresponds to each calibration sound of one or more calibration sounds. Functions further include determining the frequency response of the playback device over the calibration frequency range using one or more data sections. The frequency response of the playback device characterizes audio playback by the playback device, which is influenced by the acoustic characteristics of the playback device's environment. The function further determines one or more parameters of the audio processing algorithm based on the frequency response of the reproduction device and the target frequency response, and sends the one or more parameters of the audio processing algorithm to the reproduction device. including.
In another example, the method performed by the first computer receives data from the second computer representing one or more calibration sounds played by the playback device and captured by the second computer. Including steps. Each calibration sound contains one or more calibrations over frequencies in the calibration frequency range. The method further comprises identifying one or more data sections so that each of the one or more data sections corresponds to each calibration sound of one or more calibration sounds. The method further comprises using one or more data sections to determine the frequency response of the reproduction device over the calibration frequency range. The frequency response of the playback device characterizes audio playback by the playback device, which is influenced by the acoustic characteristics of the playback device's environment. The method further determines one or more parameters of the audio processing algorithm based on the frequency response of the reproduction device and the target frequency response, and sends the one or more parameters of the audio processing algorithm to the reproduction device. including.
In another example, the first computer is a non-temporary computer readable that stores instructions that cause the first computer to perform a function when executed by one or more processors, one or more processors. Including the medium. The function includes receiving data representing one or more calibration sounds played by the playback device and captured by the second computer from the second computer. Each calibration sound contains one or more calibrations over frequencies in the calibration frequency range. The function further comprises identifying one or more data sections so that each of the one or more data sections corresponds to each calibration sound of one or more calibration sounds. Functions further include determining the frequency response of the playback device over the calibration frequency range using one or more data sections. The frequency response of the playback device characterizes audio playback by the playback device, which is influenced by the acoustic characteristics of the playback device's environment. The function further determines one or more parameters of the audio processing algorithm based on the frequency response of the reproduction device and the target frequency response, and sends the one or more parameters of the audio processing algorithm to the reproduction device. including.
In one example, a non-temporary computer-readable medium stores instructions that cause a first computer to perform a function when executed by the first computer. The function includes receiving data representing one or more calibration sounds played by the playback device and captured by the second computer from the second computer. The function comprises identifying one or more data sections so that each of the one or more data sections corresponds to each calibration sound of one or more calibration sounds. The function determines that more than the threshold amount of one or more data sections corresponds to each signal-to-noise ratio (SNR) less than the signal-to-noise ratio of the threshold, and to a second computer. Includes sending information that the playback device was not properly calibrated.
In another example, the method performed by the first computer receives data from the second computer representing one or more calibration sounds played by the playback device and captured by the second computer. Including steps. The method further comprises identifying one or more data sections so that each of the one or more data sections corresponds to each calibration sound of one or more calibration sounds. The method further determines that more than one threshold amount of one or more data sections corresponds to each signal-to-noise ratio (SNR) less than the threshold signal-to-noise ratio, and a second computer. Includes a step to send information that the playback device was not properly calibrated.
In another example, the first computer is a non-temporary computer readable that stores instructions that cause the first computer to perform a function when executed by one or more processors, one or more processors. Including the medium. The function includes receiving data representing one or more calibration sounds played by the playback device and captured by the second computer from the second computer. The function further comprises identifying one or more data sections so that each of the one or more data sections corresponds to each calibration sound of one or more calibration sounds. The function further determines that more than one threshold amount of one or more data sections corresponds to each signal-to-noise ratio (SNR) less than the threshold signal-to-noise ratio, and a second computer. Includes sending information to, that the playback device was not properly calibrated.
In one example, a non-temporary computer-readable medium stores instructions that cause a first computer to perform a function when executed by the first computer. The functions are from the second computer, (i) one or more first calibration sounds played by the first playback device and captured by the second computer, and (ii) the second playback device. Includes receiving data representing one or more second calibration sounds, reproduced by and captured by a second computer. The function further comprises (i) one or more first data sections to each calibration sound of one or more first calibration sounds, each of which one or more first data sections. Identify correspondingly and (ii) each calibration of one or more second data sections, each of one or more second data sections, one or more second calibration sounds. Includes identifying to correspond to the sound. The function further comprises using one or more first data sections to determine the first frequency response of the first reproduction device over the calibration frequency range. The first frequency response characterizes audio reproduction by the first reproduction device, which is influenced by the acoustic characteristics of the environment of the first reproduction device and the second reproduction device. The function further comprises using one or more second data sections to determine the second frequency response of the second reproduction device over the calibration frequency range. The second frequency response characterizes audio reproduction by the second reproduction device, which is influenced by the acoustic characteristics of the environment of the first reproduction device and the second reproduction device. The function further determines one or more first parameters of the first audio processing algorithm based on the first frequency response and the first target frequency response, and the second frequency response and the second. Determining one or more of the second parameters of the second audio processing algorithm based on the target frequency response. And include. The function sends one or more first parameters of the first audio processing algorithm to the first playback device and one or more second of the second audio processing algorithms to the second playback device. Includes sending parameters for.
In another example, the method performed by the first computer is from the second computer, (i) one or more firsts played by the first playing device and captured by the second computer. It comprises receiving data representing a calibration sound and (ii) one or more second calibration sounds played by a second playback device and captured by a second computer. The method further comprises (i) one or more first data sections, each of one or more first data sections into each calibration sound of one or more first calibration sounds. Identify correspondingly and (ii) each of one or more second data sections, each of one or more second sections of data one or more second calibration sounds. Includes steps to identify to correspond to the calibration sound. The method further comprises the step of using one or more first sections of data to determine the first frequency response of the first reproduction device over the calibration frequency range. The first frequency response characterizes audio reproduction by the first reproduction device, which is influenced by the acoustic characteristics of the environment of the first reproduction device and the second reproduction device. The method further comprises the step of using one or more second sections of data to determine the second frequency response of the second reproduction device over the calibration frequency range. The second frequency response characterizes audio reproduction by the second reproduction device, which is influenced by the acoustic characteristics of the environment of the first reproduction device and the second reproduction device. The method further determines one or more first parameters of the first audio processing algorithm based on the first frequency response and the first target frequency response, and the second frequency response and the second. It comprises the step of determining one or more second parameters of the second audio processing algorithm based on the target frequency response. The method is further to the first playback device, the first audio processing algorithm
In another example, the first computer is a non-temporary computer readable that stores instructions that cause the first computer to perform a function when executed by one or more processors, one or more processors. Including the medium. The functions are from the second computer, (i) one or more first calibration sounds played by the first playback device and captured by the second computer, and (ii) the second playback device. Includes receiving data representing one or more second calibration sounds, reproduced by and captured by a second computer. The function further comprises (i) one or more first data sections to each calibration sound of one or more first calibration sounds, each of which one or more first data sections. Identify correspondingly and (ii) each calibration of one or more second data sections, each of one or more second data sections, one or more second calibration sounds. Includes identifying to correspond to the sound. The function further comprises using one or more first data sections to determine the first frequency response of the first reproduction device over the calibration frequency range. The first frequency response is influenced by the acoustic characteristics of the environment of the first reproduction device and the second reproduction device.Characterizes audio playback with a vise. The function further comprises using one or more second data sections to determine the second frequency response of the second reproduction device over the calibration frequency range. The second frequency response characterizes audio reproduction by the second reproduction device, which is influenced by the acoustic characteristics of the environment of the first reproduction device and the second reproduction device. The function further determines one or more first parameters of the first audio processing algorithm based on the first frequency response and the first target frequency response, and the second frequency response and the second. It involves determining one or more of the second parameters of the second audio processing algorithm based on the target frequency response. The function further transmits one or more first parameters of the first audio processing algorithm to the first playback device and one or more of the second audio processing algorithms to the second playback device. Includes sending a second parameter.
In one example, a non-temporary computer-readable medium stores instructions that cause the playback device to perform a function when performed by the playback device. The function includes receiving data representing one or more calibration sounds played by and captured by the playing device from the computer. Each calibration sound contains one or more calibrations over frequencies in the calibration frequency range. The function further comprises identifying one or more data sections so that each of the one or more data sections corresponds to each calibration sound of one or more calibration sounds. Functions further include determining the frequency response of the playback device over the calibration frequency range using one or more data sections. The frequency response of the playback device characterizes audio playback by the playback device, which is influenced by the acoustic characteristics of the playback device's environment. Functions further include determining one or more parameters of the audio processing algorithm based on the frequency response and target frequency response of the playback device. Functions further include playing audio that is processed using an audio processing algorithm.
In another example, the method performed by the playback device comprises receiving data from the computer representing one or more calibration sounds played by the playback device and captured by the computer. Each calibration sound contains one or more calibrations over frequencies in the calibration frequency range. The method further comprises identifying one or more data sections so that each of the one or more data sections corresponds to each calibration sound of one or more calibration sounds. The method further comprises using one or more data sections to determine the frequency response of the reproduction device over the calibration frequency range. The frequency response of the playback device characterizes audio playback by the playback device, which is influenced by the acoustic characteristics of the playback device's environment. The method further comprises determining one or more parameters of the audio processing algorithm based on the frequency response and target frequency response of the playback device. The method further comprises playing back the audio processed using the audio processing algorithm.
In another example, the playback device includes one or more processors, a non-temporary computer-readable medium that stores instructions that cause the playback device to perform a function when executed by one or more processors. .. The function includes receiving data representing one or more calibration sounds played by and captured by the playing device from the computer. Each calibration sound contains one or more calibrations over frequencies in the calibration frequency range. The function further comprises identifying one or more data sections so that each of the one or more data sections corresponds to each calibration sound of one or more calibration sounds. Functions further include determining the frequency response of the playback device over the calibration frequency range using one or more data sections. The frequency response of the playback device characterizes audio playback by the playback device, which is influenced by the acoustic characteristics of the playback device's environment. Functions further include determining one or more parameters of the audio processing algorithm based on the frequency response and target frequency response of the playback device. Functions further include playing back audio that is processed using an audio processing algorithm.
In one example, a non-temporary computer-readable medium stores instructions that cause the playback device to perform a function when performed by the playback device. The function includes receiving data representing one or more calibration sounds played by and captured by the playing device from the computer. The function further comprises identifying one or more data sections so that each of the one or more data sections corresponds to each calibration sound of one or more calibration sounds. The function further comprises determining that the section greater than the threshold amount of one or more data sections corresponds to each signal-to-noise ratio (SNR) less than the signal-to-noise ratio of the threshold. The function further includes providing information that the playback device has not been properly calibrated.
In another example, the method performed by the playback device comprises receiving data from the computer representing one or more calibration sounds played by the playback device and captured by the computer. The method further comprises identifying one or more data sections so that each of the one or more data sections corresponds to each calibration sound of one or more calibration sounds. The method further comprises determining that more than one threshold amount of one or more data sections corresponds to each signal-to-noise ratio (SNR) less than the signal-to-noise ratio of the threshold. The method further comprises the step of providing information that the playback device was not properly calibrated.
In another example, the playback device includes one or more processors, a non-temporary computer-readable medium that stores instructions that cause the playback device to perform a function when executed by one or more processors. .. The function includes receiving data representing one or more calibration sounds played by and captured by the playing device from the computer. The function further comprises identifying one or more data sections so that each of the one or more data sections corresponds to each calibration sound of one or more calibration sounds. The function further comprises determining that the section greater than the threshold amount of one or more data sections corresponds to each signal-to-noise ratio (SNR) less than the signal-to-noise ratio of the threshold. The function further includes providing information that the playback device has not been properly calibrated.
Those skilled in the art will appreciate that this disclosure includes many other embodiments. Some examples described herein may refer to functions performed by a given actor, such as a "user" and / or other entity, but this is for illustration purposes only. It should be understood that it is a thing. A claim should not be construed as requiring any action by such an exemplary actor, unless expressly required by the wording of the claim itself.
When the terms "substantially" or "about" are used herein, this means that the properties, parameters or values cited do not need to be achieved exactly, but for example tolerances, measurements. Deviations or variability may occur, including errors, measurement accuracy limits and other factors known to those of skill in the art, which ultimately means that the characteristics do not preclude the intended effect.
II. Examples of Operating Environments Figure 1 shows an exemplary configuration of a media playback system 100 that can or can be implemented in one or more embodiments disclosed herein. As illustrated, the media playback system 100 is associated with an exemplary home environment having multiple rooms and spaces, such as a master bedroom, an office, a dining room, and a living room. As shown in the example of FIG. 1, the media playback system 100 includes playback devices 102, 104, 106, 108, 110, 112, 114, 116, 118, 120, 122 and 124, control devices 126 and 128, wired or Includes wireless network router 130.
Further, a description of the different components of the exemplary media playback system 100 and how the different components work to provide the user with a media experience is provided in the sections below. Although the description herein generally refers to the media playback system 100, the techniques described herein are not limited to the home environment applications shown in FIG. For example, the techniques described herein include environments where multi-zone audio is desired, such as commercial environments such as restaurants, malls, or airports, sport utility vehicles (SUVs), buses or cars. It is useful in environments such as vehicles, ships, or boards and airplanes.
Exemplary playback devices FIG. 2 shows a functional block diagram of an exemplary playback device 200 that comprises one or more of the playback devices 102-124 of the media playback system 100 of FIG. The playback device 200 may include a processor 202, a software component 204, a memory 206, an audio processing component 208, an audio amplifier 210, a speaker 212, and a network interface 214. Network interface 214 includes wireless interface 216 and wired interface 218. In some cases, the playback device 200 does not include the speaker 212, but may include a speaker interface for connecting the playback device 200 to an external speaker. In other cases, the playback device 200 does not include the speaker 212 or the audio amplifier 210, but may include an audio interface for connecting the playback device 200 to an external audio amplifier or audiovisual receiver.
In one example, processor 202 may be a clock-driven computer component configured to process input data based on instructions stored in memory 206. The memory 206 may be a non-temporary computer-readable recording medium configured to store instructions that can be executed by the processor 202. For example, the memory 206 may be data storage capable of loading one or more of the software components 204 that can be executed by the processor 202 to perform a function. In one example, the function may include the step of the playback device 200 reading audio data from an audio source or another playback device. In another example, the function may include the step of the playback device 200 transmitting audio data to another device or playback device on the network. In yet another example, the function may include pairing the playback device 200 with one or more playback devices to create a multi-channel audio environment.
One feature comprises the step of the playback device 200 synchronizing the playback of audio content with one or more other playback devices. While synchronizing the playback, it is preferable that the listener is unaware of the delay between the playback of the audio content by the playback device 200 and the playback by one or more other playback devices. US Pat. No. 8,234,395, entitled "Systems and Methods for Synchronizing Operations Between Multiple Independent Clock Digital Data Processing Devices," is incorporated herein by reference, which may synchronize audio playback between playback devices. It provides a more detailed example as described.
Further, the memory 206 may be configured to store data. The data may be stored in, for example, a playback device 200 such as a playback device 200, an audio source accessible by the playback device 200, or a playback device 200 (or other playback) included as part of one or more zones and / or zone groups. It is associated with a play queue, which can be associated with the device). The data may be updated periodically and stored as one or more state variables indicating the state of the playback device 200. The memory 206 may also contain data associated with the state of other devices in the media system, and by sharing between the devices at any time, one or more devices may have near-most recent data related to the system. Can have. Other embodiments are also possible.
The audio processing component 208 may include one or more digital-to-analog converters (DACs), audio processing components, audio enhancement components, digital signal processors (DSPs), and the like. In certain embodiments, the audio processing component 208 may be a subcomponent of the processor 202. In certain embodiments, the audio content may be processed and / or deliberately modified by the audio processing component 208 to generate an audio signal. The generated audio signal is transmitted to the audio amplifier 210, amplified, and reproduced through the speaker 212. In particular, the audio amplifier 210 may include a device configured to amplify the audio signal to a level capable of driving one or more speakers 212. The speaker 212 may include a complete speaker system including an independent transducer (eg, a "driver") or a housing containing one or more drivers. Certain drivers included in the speaker 212 may include, for example, a subwoofer (eg, for low frequencies), a middle range driver (eg, for intermediate frequencies), and / or a tweeter (for high frequencies). In some cases, each converter of one or more speakers 212 may be driven by the corresponding individual audio amplifiers of the audio amplifier 210. In addition to generating an analog signal to be played on the playback device 200, the audio processing component 208 processes the audio content and sends the audio content for playback by one or more other playback devices.
Audio content processed and / or played by the playback device 200 is received via an external source, such as an audio line-in input connection (eg, an auto-detecting 3.5 mm audio line-in connection) or network interface 214. May be good.
The microphone 220 may include an audio sensor configured to convert the detected sound into an electrical signal. The electrical signal may be processed by audio processing components 208 and / or processor 202. The microphone 220 may be aligned in one or more directions at one or more locations on the reproduction device 200. The microphone 220 may be configured to detect sound within one or more frequency ranges. In some cases, one or more microphones 220 may be configured to detect sounds within the frequency range of the audio that the playback device 200 can render. In other cases, the microphone 220 may be configured to detect sounds within a human audible frequency range. As an example, other than these are also possible.
The network interface 214 may be configured to allow data flow between the playback device 200 and one or more other devices on the data network. Thus, the playback device 200 is a data network from one or more other playback devices communicating with the playback device, a network device within a local area network, or an audio content source on a wide area network such as, for example, the Internet. It may be configured to receive audio content via. In one example, audio content and other signals transmitted and received by the playback device 200 may be transmitted in the form of digital packets containing source addresses based on Internet Protocol (IP) and destination addresses based on IP. In such a case, the network interface 214 can appropriately receive and process the data addressed to the reproduction device 200 by the reproduction device 200 by analyzing the digital packet data.
As shown, the network interface 214 may include a wireless interface 216 and a wired interface 218. The wireless interface 216 provides network interface functionality for the playback device 200 and is wireless, including communication protocols such as the wireless standards IEEE802.11a, 802.11b, 802.11g, 802.11n, 802.11ac, 802.11ac, 4G mobile communication standards, etc. Wireless communication with other devices (eg, other playback devices, speakers, receivers, network devices, control devices in the data network associated with the playback device 200) based on any of the standards) good. The wired interface 218 provides a network interface function for the playback device 200, and may communicate via a wired connection with another device based on a communication protocol (eg, IEEE802.3). Although the network interface 214 shown in FIG. 2 includes both the wireless interface 216 and the wired interface 218, the network interface 214 may include only the wireless interface or only the wired interface in certain embodiments.
In one example, the playback device 200 and other playback devices may be paired to play two separate audio components of audio content. For example, the playback device 200 may be configured to play the left channel audio component, while the other playback device may be configured to play the right channel audio component. This can generate or enhance the stereo effect of the audio content. The paired playback device (also referred to as a "combined playback device") may further play audio content in synchronization with another playback device.
In another example, the reproduction device 200 may be acoustically integrated with one or more other reproduction devices to form a single integrated reproduction device (integrated reproduction device). The integrated playback device can be configured to process and reproduce sound differently than a non-integrated playback device or a paired playback device. This is because the integrated playback device can add speakers to play audio content. For example, if the playback device 200 is designed to play low frequency range audio content (eg, a subwoofer), the playback device 200 is designed to play full frequency range audio content. It may be integrated with the device. In this case, the full frequency range playback device may be configured to play only the mid-high frequency components of the audio content when integrated with the low frequency playback device 200. On the other hand, the low frequency range playback device 200 plays low frequency components of audio content. Further, the integrated playback device may be paired with a single playback device or even another integrated playback device.
As an example, Sonos Incorporated currently plays including "PLAY: 1", "PLAY: 3", "PLAY: 5", "PLAYBAR", "CONNECT: AMP", "CONNECT", and "SUB". We sell and offer devices. Any other past, present, and / or future reproduction device may be additionally or optionally implemented and used in the reproduction device of the embodiments disclosed herein. Further, it is understood that the reproduction device is not limited to the particular example shown in FIG. 2 or the Sonos product provided. For example, the playback device may include wired or wireless headphones. In another example, the playback device may include or interact with a docking station for a personal mobile media playback device. In yet another example, the reproduction device may be integrated with another device or component, such as a television, luminaire, or some other device for indoor or outdoor use.
b. Illustrative Playback Zone Configuration Returning to the media playback system of Figure 1, the environment has one or more playback zones, each playback zone containing one or more playback devices. .. The media reproduction system 100 may be formed of one or more reproduction zones, and one or more zones may be added or deleted later to form an exemplary configuration shown in FIG. Each zone may be given a name based on a different room or space, such as an office, bathroom, master bedroom, bedroom, kitchen, dining room, living room, and / or balcony. In some cases, a single regeneration zone may include multiple rooms or spaces. In other cases, a single room or space may include multiple regeneration zones.
As shown in Figure 1, each of the balcony, dining room, kitchen, bathroom, office, and bedroom zones has one playback device, while each of the living room and master bedroom zones has multiple playback devices. Has. The living room zone has playback devices 104, 106, 108, and 110 as separate playback devices, one or more combined playback devices, one or more integrated playback devices, or any of these. In any combination of these, the audio content may be configured to be played back in synchronization. Similarly, in the case of the master bedroom, the playback devices 122 and 124 may be configured to play audio content synchronously as separate playback devices, combined playback devices, or integrated playback devices. ..
In one example, one or more playback zones in the environment of FIG. 1 are playing different audio content. For example, the user can listen to hip-hop music played by the playback device 102 while grilling in the balcony zone. Meanwhile, another user can listen to classical music played by the playback device 114 while preparing a meal in the kitchen zone. In another example, the playback zone may play the same audio content in sync with another playback zone. For example, if the user is in the office zone, the office zone playback device 118 may play the same music that is being played on the balcony playback device 102. In such cases, the playback devices 102 and 118 are playing rock music synchronously so that the user can seamlessly (or at least at least) play the audio content out-loud as they move between different playback zones. You can enjoy it almost seamlessly). Synchronization between reproduction zones may be performed in the same manner as synchronization between reproduction devices as described in US Pat. No. 8,234,395 above.
As described above, the zone configuration of the media playback system 100 may be dynamically changed, and in certain embodiments, the media playback system 100 supports a plurality of configurations. For example, if the user physically moves one or more playback devices to or out of the zone, the media playback system 100 may be reconfigured to accommodate the changes. For example, if the user physically moves the playback device 102 from the balcony zone to the office zone, the office zone may include both the playback device 118 and the playback device 102. If desired, the playback devices 102 may be paired, grouped into office zones, and / or renamed via control devices, such as control devices 126 and 128. On the other hand, when one or more playback devices are moved to a certain area in a home environment in which a playback zone has not yet been set, a new playback zone may be formed in that area.
Further, the different playback zones of the media playback system 100 may be dynamically combined into zone groups or divided into separate playback zones. For example, by combining the dining room zone and the kitchen zone 114 into a zone group for a dinner party, the playback devices 112 and 114 can play audio content in synchronization. On the other hand, if one user wants to watch TV while another user wants to listen to music in the living room space, the living room zone is the TV zone containing the playback device 104 and the listening zone containing the playback devices 106, 108 and 110. And may be divided into.
c. Illustrative Control Device Figure 3 shows a functional block diagram of an exemplary control device 300 that constitutes one or both of the control devices 126 and 128 of the media playback system 100. As shown, the control device 300 may include a processor 302, a memory 304, a network interface 306, and a user interface 308. In one example, the control device 300 may be a control device dedicated to the media playback system 100. In another example, the control device 300 is a network device on which the media playback system controller application software is installed, such as an iPhone®, iPad®, or any other smartphone, tablet or network device (eg). , PC or network computer such as Mac®).
Processor 302 may be configured to perform functions related to enabling user access, control, and configuration of the media playback system 100. The memory 304 may be configured to store instructions that can be executed by the processor 302 and perform those functions. The memory 304 may also be configured to store media playback system controller application software and other data associated with the media playback system 100 and the user.
The microphone 310 may include an audio sensor configured to convert the detected sound into an electrical signal. The electrical signal may be processed by processor 302. In some cases, the microphone 310 may be a microphone for facilitating these functions, provided that the control device 300 is also a device that can also be used as a means of voice communication or voice recording. .. For example, one or more microphones 310 may be configured to detect sounds within a frequency range that can be produced by a person and / or within a frequency range that can be heard by a person. As an example, other than these are also possible.
In one example, network interface 306 is an industrial standard (eg, infrared, wireless, wired standards such as IEEE802.3, wireless standards such as IEEE802.11a, 802.11b, 802.11g, 802.11n, 802.11ac, 802.11ac, 802.11ac, 4G communication. It may be based on standards, etc.). In the network interface 306, the control device 300 may provide a means for communicating with other devices in the media playback system 100. In one example, data and information (eg, state variables) may be communicated between the control device 300 and other devices via network interface 306. For example, the configuration of playback zones and zone groups in the media playback system 100 may be received by the control device 300 from the playback device or another network device, or by the control device 300 via the network interface 306. It may be transmitted to a playback device or a network device. In some cases, the other network device may be another control device.
Playback device control commands such as volume control and audio playback control may be communicated from the control device 300 to the playback device via network interface 306. As described above, the configuration of the media playback system 100 can be changed by the user using the control device 300. Configuration changes include adding one or more playback devices to a zone, removing one or more playback devices from a zone, adding one or more zones to a zone group, one or more. Zones may include removing a zone from a zone group, forming a combined player or integrated player, dividing the combined player or integrated player into one or more playback devices, and the like. As described above, the control device 300 may be referred to as a controller, and the control device 300 may be a dedicated controller in which the media playback system controller application software is installed, or a network device.
The user interface 308 of the control device 300 may be configured to allow user access and control of the media playback system 100 by providing a controller interface such as the controller interface 400 shown in FIG. The controller interface 400 includes a reproduction control area 410, a reproduction zone area 420, a reproduction status area 430, a reproduction queue area 440, and an audio content source area 450. The illustrated user interface 400 is merely an example of a user interface provided with a network device (and / or control devices 126 and 128 of FIG. 1) such as the control device 300 of FIG. 3, and is played back by the user. It is accessed to control a media playback system such as System 100. Alternatively, various formats, styles, and interactive sequences may be implemented in the interface of another user on one or more network devices to provide similar control access to the media playback system.
Playback control area 410 may include selectable icons (eg, by touch or cursor). This icon allows playback devices in the selected playback zone or zone group to play or stop, fast forward, rewind, then skip, skip before, shuffle mode on / off, repeat mode on / off, cross. Turns fade mode on / off. The reproduction control area 410 may include another selectable icon. Other selectable icons may change other settings such as equalization settings, playback volume, etc.
The playback zone region 420 may include a display of playback zones within the media playback system 100. In certain embodiments, the graphic display of the reproduction zone may be selectable. Playback zones within the media playback system can be managed or configured by moving additional selectable icons. Other management or configuration can be performed, for example, creating joined zones, creating zone groups, splitting zone groups, and renaming zone groups.
For example, as illustrated, a "group" icon may be provided for each of the graphic displays of the playback zone. The "Group" icon in the graphic display of a zone may be selectable so that one or more zones in the media playback system can be selected to give an option to group with the zone. Once grouped, the playback devices in one zone and the grouped zone are configured to play audio content in sync with the playback devices in the zone. Similarly, the "group" icon may be provided within the graphic display of the zone group. In this case, the Group icon can be selected to give the option to deselect one or more zones in the zone group in order to remove one or more zones in the zone group from the zone group. There may be. Other interactions for grouping and ungrouping zones are possible and can be performed via a user interface such as the user interface 400. The display of the reproduction zone in the reproduction zone area 420 may be dynamically updated when the reproduction zone or zone group configuration is changed.
The playback status area 430 provides a graphic display of the currently played audio content, the previously played audio content, or the next audio content scheduled to be played within the selected playback zone or zone group. It may be included. Selectable play zones or groups may be visually distinguished on the user interface, eg, within play zone areas 420 and / or play status areas 430. The graphic display may include other relevant information useful to the user when controlling the track title, artist name, album name, album year, track length, and media playback system through the user interface 400. ..
The play queue area 440 may include a graphic display of audio content in the play queue associated with the selected play zone or zone group. In certain embodiments, each play zone or zone group may be associated with a play queue containing information corresponding to zero or more audio items played by the play zone or play group. For example, each audio item in the play queue may contain a URI (URI), a URL (URL), or another identifier that can be used by a play zone or zone group play device. good. These allow audio items to be found and / or retrieved from a local audio content source or a network audio content source and played back by a playback device.
In some examples, playlists may be added to the play queue. In this case, the information corresponding to each audio item in the playlist may be added to the play queue. In another example, the audio items in the play queue may be saved as playlists. In yet another example, when the playback device continues to play streaming audio content, eg, an internet radio that plays continuously unless stopped, rather than an audio item that does not play continuously due to having a play time. The replay queue may be empty or "unused" but filled. In another embodiment, the play queue may contain internet radio and / or other streaming audio content items and shall be "unused" when the play zone or zone group is playing those items. Can be done. Other examples are possible.
When a replay zone or zone group is "grouped" or "ungrouped", the replay queue associated with the affected replay zone or zone group may be cleared or reassociated. You may. For example, if the first replay zone containing the first replay queue is grouped with the second replay zone containing the second replay queue, the formed zone group may have an associated replay queue. The associated play queue is initially empty, contains audio items from the first play queue (for example, if a second play zone is added to the first play zone), or (for example, the first play). If a zone is added to the second play zone), it can contain audio items in the second play queue, or it can combine both audio items in the first play queue and the second play queue. If the formed zone group is then ungrouped, the ungrouped first play zone may be associated again with the previous first play queue or with an empty new play queue. Alternatively, it may be associated with a new play queue containing audio items from the play queue that were associated with the zone group before the zone group was ungrouped. Similarly, the ungrouped second replay zone may be reassociated with the previous second replay queue, may be associated with an empty new replay queue, or before the zone group is ungrouped. May be associated with a new play queue that contains audio items from the play queue that were associated with the zone group.
Returning to the user interface 400 in Figure 4, the graphic display of the audio content in the play queue area 440 shows the track title, artist name, track length, and other relevant information associated with the audio content in the play queue. It may be included. In one example, the graphic display of audio content can be moved by selecting additional selectable icons. This makes it possible to manage and / or edit the audio content displayed in the play queue and / or the play queue. For example, the displayed audio content may be removed from the play queue, moved to a different position in the play queue, played immediately, or played after the currently playing audio content. It may be selected for, or it may perform other actions. The replay queue associated with a replay zone or zone group is the memory of one or more replay devices within the replay zone or zone group, the memory of replay devices not within the replay zone or zone group, and / or other designations. It may be stored in the memory of the device.
The audio content source area 450 may include a graphic display of selectable audio content sources. In this audio content source, audio content may be retrieved and played by the selected playback zone or zone group. A description of audio content sources can be found in the following sections.
d. Illustrative Audio Content Sources As previously illustrated, one or more playback devices within a zone or zone group will play the audio content (eg, based on the corresponding URI or URL of the audio content). ) May be configured to retrieve from multiple available audio content sources. In one example, the audio content may be retrieved directly from the corresponding audio content source (eg, line-in connection) by the playback device. In another example, the audio content may be provided to a playback device on the network via one or more other playback devices or network devices.
An exemplary audio content source may include the memory of one or more playback devices in the media playback system. Examples of the media playback system include the media playback system 100 of FIG. 1, a local music library on one or more network devices (eg, a control device, a network-enabled personal computer, or a network-attached storage (NAS)). A streaming audio service that provides audio content over the Internet (eg, the cloud), or an audio source that is connected to a media playback system via a line-in input connection of a playback device or network device, or any other possible system. You may.
In certain embodiments, the audio content source may be periodically added to or removed periodically from a media playback system such as the media playback system 100 of FIG. In one example, audio items may be indexed each time one or more audio content sources are added, removed, or updated. Indexing audio items may include scanning identifiable audio items in all folders / directories shared on the network. Here, the network is accessible by the playback device in the media playback system. Indexing of audio items also includes creating or updating an audio content database that contains metadata (eg, title, artist, album, track length, etc.) and other relevant information. good. Other relevant information may include, for example, a URI or URL for finding each identifiable audio item. Other examples for managing and maintaining audio content sources are possible.
The above description of playback devices, control devices, playback zone configurations, and media content sources provides only a few exemplary operating environments in which the functions and methods described below can be implemented. The present invention is also applicable to other operating environments and configurations of media playback systems, playback devices, and network devices not expressly described herein, and to implement its functions and methods. Are suitable.
III. Examples of Methods and Systems to Facilitate Calibration of Audio Playback Devices As discussed earlier, some of the examples described herein are, among other things, calibrations played back by the playback device. To detect and analyze sound to determine the frequency response of the playback device in its surroundings and to determine an audio processing algorithm that is tuned to tune the frequency response of the playback device to the target frequency response. include. Other aspects of the example will be apparent in the rest of the text of this specification.
Methods 500, 600, 700, 800, 900, 1000, 1100 and shown in Figure 5, Figure 6, Figure 7A, Figure 7B, Figure 8, Figure 9, Figure 10A, Figure 10B, Figure 11 and Figure 12, respectively. The 1200 can be implemented in an operating environment comprising, for example, one or more media playback systems 100 in FIG. 1, one or more playback devices 200 in FIG. 2, and one or more control devices 300 in FIG. An example of is presented. Methods 500-1200 may also include other devices. Methods 500-1200 block 502, 504, 506, 508, 510, 512, 602, 604, 606, 608, 610, 702, 704, 706, 708, 710, 712, 714, 716, 718, 802, 804 , 806, 808, 810, 902, 904, 906, 908, 1002, 1004, 1006, 1008, 1010, 1012, 1014, 1102, 1104, 1106, 1108, 1110, 1202, 1204, 1206 and 1208 It may include one or more actions, functions or actions exemplified by one or more blocks. Although the blocks are shown in order, these blocks may be executed in parallel and / or in a different order than described herein. Also, the various blocks may be combined into fewer blocks, split into additional blocks, and / or removed based on the desired implementation.
In addition, the flow charts show the functionality and operation of one possible implementation of this embodiment for methods 500-1200 and other processes and methods disclosed herein. In this context, each block may represent a module, segment or portion of program code that contains one or more instructions that can be executed by a processor to perform a particular logical function or step in a process. The program code may be stored on any type of computer-readable medium, such as a storage device, including a disk or hard drive. In some embodiments, the program code is a server system (eg, an application store or other type) that makes the program code available for download to a desktop / laptop computer, smartphone, tablet computer or other type of computer. It may be stored in a memory (eg, disk or disk array) associated with and / or concatenated with (the server system of). Computer-readable media include non-transient computer-readable media, such as computer-readable media that store data for short periods of time, such as register memory, processor cache, and random access memory (RAM). May be included. Computer-readable media include non-temporary devices such as read-only memory (ROM), optical or magnetic discs, and secondary or persistent long-term storage devices such as compact disc read-only memory (CD-ROM). A medium may also be included. The computer-readable medium may be any other volatile or non-volatile storage system. The computer-readable medium may be considered, for example, a computer-readable storage medium or a tangible storage device. Further, with respect to the methods 500-1200 and other processes and methods disclosed herein, each block in FIGS. 5-12 has a specific logical function in the process.
In some examples, method 500 is performed by a computer in the form of a control device, such as control device 300, but other examples are possible. Therefore, in the present specification, a computer may be referred to as a control device in the light of Method 500. Method 500 may generally include using the computer to calibrate the playback device.
At block 502, method 500 may include capturing one or more calibration sounds played by the playback device through the microphone of the computer as the computer moves within the environment of the playback device.
To illustrate the movement of the computer during calibration, FIG. 13 shows the media playback system 100 of FIG. FIG. 13 shows path 1300, where a computer (eg, control device 126) may travel along during calibration. The control device 126 shows how to perform such movements (eg, via the user interface) in various ways, among other examples, by video, animation and / or audible instructions, etc. May be good.
The control device 126 may capture the calibration sound played by the playback device (eg, playback device 108) via a microphone at various points along path 1300 (eg, points 1302 and / or point 1304). good. Alternatively, the control device 126 may capture the calibration sound along the path 1300. In some embodiments, the reproduction device 108 may reproduce a periodic calibration sound such that the control device 126 captures each instance of the calibration sound at different points along the path. Comparison of such captured calibration sounds can show how the acoustic characteristics of an environment vary from physical location to physical location, which is a parameter of the audio processing algorithm chosen for the playback device in that environment. Can have an impact.
In this regard, one or more calibration sounds reproduced by the reproduction device may each include a sweep over frequencies in the calibration frequency range. For example, the calibration sound may include a sweeping sine wave or another sound containing a sequence of all frequencies in the calibration frequency range, respectively. There are innumerable frequencies between any two frequencies, but in practice the calibration sound may only contain a set of discrete frequencies at a given frequency resolution. Such a set of discrete frequencies may resemble a continuous sweep over all frequencies in the calibration frequency range.
In a more specific example, the calibration sound reproduced by the playback device is (i) with a first component containing calibration noise at a frequency between the minimum value of the calibration frequency range and the first threshold frequency. , (Ii) may include a second component that is swept over a frequency between the second threshold frequency and the maximum value in the calibration frequency range.
14A and 14B show the components of an example of calibration sounds 1400 and 1450 spanning each calibration frequency range. In FIG. 14A, the calibration frequency range is defined by the minimum frequency at 1406A and the maximum frequency at 1412A. FIG. 14A shows the first component 1402A (ie, the noise component) and the second component 1404A (ie, the "sweep" component) of the calibration sound 1400. Component 1402A contains pseudo-random noise similar to Brownian noise (discussed below) and spans frequencies from a minimum frequency of 1406A (eg, 15-20Hz) to a first threshold frequency of 1408A (eg, 50-100Hz). .. Component 1404A includes a sweep sine wave spanning frequencies from a second threshold frequency 1410A (eg 50-100Hz) to a maximum frequency 1412A (eg 20-30kHz). As shown in the figure, the threshold frequency 1408A and the threshold frequency 1410A may have the same frequency.
In FIG. 14B, the calibration frequency range is defined by the minimum frequency at 1406B and the maximum frequency at 1412B. FIG. 14B shows the first component 1402B (ie, the noise component) and the second component 1404B (ie, the "sweep" component) of the example calibration sound 1450. Component 1402B contains pseudo-random noise similar to Brownian noise (discussed below) and spans frequencies from the minimum frequency 1406B to the first threshold frequency 1408B. Component 1404B includes a sweep sine wave spanning frequencies from a second threshold frequency 1410B to a maximum frequency 1412B. As shown, the threshold frequency 1410B is lower than the threshold frequency 1408B, so that the components 1402B and 1404B overlap in a transition frequency range extending from the threshold frequency 1410B to the threshold frequency 1408B.
A sweep component (eg, a chirp or a sweep sine wave) is a waveform whose frequency increases or decreases over time. Inclusion of such a waveform as a component of the calibration sound facilitates coverage of the calibration frequency range because a sweep component that increases or decreases across the calibration frequency range (or a portion thereof) can be selected. obtain. For example, the sweep component emits each frequency of the sweep component over a relatively short time period so that the sweep component covers the calibration frequency range more efficiently than any other waveform. FIG. 15 shows Graph 1500 showing an example of the sweep component. As shown in FIG. 15, the frequency of the waveform increases over time (plotted on the X-axis) and the tone is emitted over a relatively short period of time at each frequency. Other examples of sweep components may have frequencies that decrease over time.
However, since each frequency of the sweep component is emitted for a relatively short duration, the amplitude (or sound intensity) of the sweep component is relatively high at low frequencies in order to overcome typical background noise. Must be a thing. Some speakers do not seem to be able to produce such high intensity tones without the risk of damage. Moreover, such high intensity tones can be unpleasant to humans within the audible range of the playback device, as can be expected during calibration procedures involving movement of the microphone. Therefore, some embodiments of the calibration sound may not include a sweep component that spans relatively low frequencies (eg, less than 50 Hz). Alternatively, the sweep component may span a frequency between the second threshold frequency in the calibration frequency range (eg, a frequency of about 50-100 Hz) and the maximum frequency. The maximum value of the calibration range may correspond to the physical ability of the playback device to emit the calibration sound, and may be 20,000 Hz or higher.
The use of sweep components may also facilitate the nullification of phase distortions caused by moving microphones. Moving microphones can cause phase distortion, which can complicate the exact determination of frequency response from captured calibration sound. However, the sweep component can be used to predict the phase of each frequency (as a Doppler shift). This predictability makes it easy to reverse the phase distortion so that the captured calibration sound can be associated with the (known) calibration sound emitted during the analysis. Such associations can be used to determine the effect of the environment on the calibration sound.
As mentioned earlier, the frequency of the sweep component can increase or decrease over time. The diminishing chirp can be heard more comfortably by some viewers than the increasing chirp due to the physical shape of the human ear canal. Some implementations may use a diminishing sweep signal, but an increasing sweep signal may also be effective for calibration.
As mentioned earlier, the calibration sound example may include a noise component in addition to the sweep component. Noise refers to random sounds, which in some cases are filtered to equalize the energy per octave. In an embodiment in which the noise component is periodic, the noise component of the calibration sound may be considered to be pseudo-random. The noise component of the calibration sound may be emitted over substantially the entire duration of the calibration sound or during repetitions. This causes each frequency covered by the noise component to be emitted over a longer duration, reducing the signal strength typically required to overcome background noise.
In addition, the noise component may cover a frequency range smaller than the sweep component, which may allow increased sound energy to be used at each frequency within that range. As mentioned earlier, the noise component may cover a frequency between the minimum value in the frequency range and a threshold frequency that may also be a threshold frequency of, for example, about 50-100 Hz. As with the maximum calibration frequency range, the minimum calibration frequency range may correspond to the physical capacity of the playback device to emit the calibration sound, which may be below 20 Hz. be.
FIG. 16 shows Graph 1600, which shows an example of Brownian noise. Brownian noise is a type of noise based on Brownian motion. In some cases, the reproduction device may emit a calibration sound containing Brownian noise within its noise component. Brownian noise has a "soft" sound quality that can be pleasing to some viewers, similar to a waterfall or heavy rain. Some embodiments may implement a noise component that uses brown noise, while other embodiments may implement a noise component that uses other types of noise, such as pink noise or white noise. As shown in FIG. 16, the intensity of the exemplary Brownian noise is reduced by 6 dB (20 dB / decade) per octave.
Some implementations of the calibration sound may include a transition frequency range in which the noise and sweep components overlap. The noise component may contain noise at frequencies between the minimum and maximum values of the calibration frequency range, and the second component may include the second threshold frequency and maximum value of the calibration frequency range. It may be swept through frequencies between.
In order to superimpose these signals, the second threshold frequency may be lower than the first threshold frequency. In such a configuration, the transition frequency range includes a frequency between the second threshold frequency and the first threshold frequency, which may be, for example, 50-100 Hz. By superimposing these components, the reproduction device can avoid the emission of possibly unpleasant sounds associated with the jarring transition between the two types of sounds.
In this regard, the calibration sound may be temporally separated from subsequent calibration sounds reproduced by the playback device by a protection band containing a first (noise) component. In addition, the protection band may not contain a second (sweep) component.
FIG. 17 shows an example of the calibration sound 1708. The calibration sound 1708 includes a sweep signal component 1702 and a noise component 1704. Sweep signal component 1702 is shown as a downward ramp to indicate a sweep signal that diminishes over frequencies in the calibration range. The noise component 1704 is shown to indicate low frequency noise. As shown, the sweep signal component 1702 and the noise component 1704 overlap in the transition frequency range.
The calibration sound 1708 is temporally preceded by the protection band 1706 and followed in time by the protection band 1710. As shown, both protection bands 1706 and 1710 may contain the noise component 1704 but may not contain the sweep component 1702. The protection bands 1706 and 1710 may act as "markers" to distinguish the calibration sound 1708 from other captured calibration sounds.
At block 504, method 500 may include generating data representing one or more captured calibration sounds. For example, a computer microphone may generate an analog signal that represents the captured calibration sound, and the computer may process the analog signal through an analog-to-digital converter (ADC) to produce one or more. Digital data representing the calibration sound of is may be stored. At least initially, the data may be stored in time domain format as amplitude (eg, sound intensity) and each time the amplitude is detected.
In block 506, method 500 comprises identifying one or more data sections such that each of the one or more data sections corresponds to each calibration sound of one or more calibration sounds. But it may be.
In some examples, identifying one or more data sections identifies the first data section corresponding to the protected band and the second data section corresponding to a given calibration sound. , (I) identification based on a first data section identified, and (ii) a predetermined periodicity of one or more calibration sounds.
FIG. 18 shows examples of periodic calibration sounds 1808, 1818, 1828, 1838 and 1848, and protection bands 1810, 1820, 1830, 1840 and 1850. In some examples, the protection band is about 0.1875 seconds long, which can dissipate the reverberation of one calibration sound before the start of another calibration sound. In some situations, it may be useful to think of Figure 18 as depicting a data section representing the calibration sound and protection band. In one example, the computer predetermines the data section corresponding to the calibration sound 1828: (i) the identification of the data corresponding to the protection band 1830, and (ii) the calibration sounds 1808, 1818, 1828, 1838 and 1848. Identification may be based on the given (known) periodicity.
For example, the reproduction device may identify the data corresponding to the protection band 1830 by identifying frequencies below frequencies that are part of the (known) sweep component of calibration sound 1828. The computer may then "cut" the data based on a predetermined periodicity. That is, the computer may make a first data cut at time t = 0 within the protection band 1830 and then make subsequent cuts at t = n * T, where "n" is arbitrary. Is an integer of. For example, the computer may cut the data at t = -2T, t = -T and t = T corresponding to the protection bands 1810, 1820 and 1840, respectively. This may result in data sections 1852, 1854 and 1856 corresponding to calibration sounds 1818, 1828 and 1838, respectively. Note that data sections 1852, 1854 and 1856 may represent parts of the protection bands 1810, 1820, 1830 and 1840. Since the data sections 1852, 1854 and 1856 each contain information about the entire calibration frequency range, the computer may use these sections to calibrate the playback device. In some examples, the data sections 1852, 1854 and 1856 may be further cut to include only information about the calibration sound and not information about the protected band.
The computer also identifies the data corresponding to the protection band 1830 in the absence of the sweep component (eg, the absence of higher frequencies) and in the protection band 1830, perhaps less than that of the sweep component but greater than the ambient background noise. This may be done by detecting the sound intensity of the noise component. The data may then be cut based on the periodicity of the calibration sounds 1808, 1818, 1828, 1838 and 1848 in a manner similar to that described above.
In another example, the computer may identify the section of data corresponding to the calibration sound in the erasing process by identifying the data corresponding to the protected band. For example, the computer identifies the first data section corresponding to protection band 1830, identifies the second data section corresponding to protection band 1820, and identifies the first data section identified and the second identified. A third data section corresponding to the calibration sound 1828 may be identified based on the data section of. The computer may identify the first and second data sections corresponding to the protection bands 1820 and 1830 by any of the methods described so far, and the third data corresponding to the calibration sound 1828. Sections may be identified by their temporal position between the identified protection bands 1820 and 1830.
In some examples, identifying one or more data sections may include identifying data sections that represent a signal-to-noise ratio (SNR) greater than the threshold signal-to-noise ratio (SNR). In this regard, the signal-to-noise ratio represented by the identified data section is (i) (a) calibration sound and / or (b) protected band, signal level vs. (ii) within the environment of the playback device. The ratio of background noise detected by the microphone.
For example, the computer can capture data corresponding to the captured calibration sounds 1808, 1818, 1828, 1838 and 1848, and the protected bands 1810, 1820, 1830 and 1840, as well as the captured back that can be present in the environment of the playback device. The data corresponding to the ground noise may be analyzed. For example, a computer may have calibrated sounds 1808, 1818, 1828, 1838 and 1848 and / or sound intensities in the protected bands 1810, 1820, 1830 and 1840 averaged over the calibration frequency range to capture background noise. The playback device may be calibrated with data corresponding to the calibration sound and / or the protected band if it is determined that it was at least 8 times stronger. On the other hand, data corresponding to sounds whose average intensity is less than 8 times the background noise in the calibration range may not be used for calibration of the playback device and may be discarded. Although the above example describes a signal-to-noise ratio threshold of 8, other SNRs may be used as the threshold for deciding whether to use the data section in the calibration process.
When such data "passes" these SNR checks, the computer further identifies the subsection of such data that represents the protected band by identifying data that represents a sound intensity less than the threshold acoustic intensity. You may. For example, the computer analyzes the data corresponding to the protection bands 1820 and 1830, respectively, and the data corresponding to the calibration sound 1828, and the sound intensity of the calibration sound 1828 is the protection band 1820 and the average of the calibration frequency range. It may be determined that it is 20 times stronger than the sound intensity of 1830, which recognizes that the data corresponding to the calibration sound 1828 actually corresponds to a certain calibration sound. The above example describes a threshold sound intensity ratio of 20: 1, but other thresholds are used as thresholds for distinguishing (i) calibration sound and (ii) data corresponding to the protected band, respectively. Sound intensity ratios may be used.
As mentioned earlier, the computer identifies other sections of the generated data that correspond to other calibration sounds, (i) already identified subsections of the data, and (ii) one or more. It may be performed based on a predetermined periodicity of a plurality of calibration sounds. For example, after identifying the data corresponding to the protection band 1830, the computer may "cut" the data at t = -2T, t = -T, t = 0, t = T, thereby calibrating each. Data sections 1852, 1854 and 1856 corresponding to the sound 1818, 1828 and 1838 are identified.
The data section corresponding to the calibration sound may be otherwise identified by the computer. For example, the protection band may include both a momentary first audio frequency (eg, 5 kHz) and a momentary second audio frequency (10 kHz) at a particular time (not shown). The computer may detect the first audio frequency and the second audio frequency at a specific time in the data representing the captured audio. In this regard, the computer, as mentioned above, identifies one or more data sections, (i) detects the first and second audio frequencies at a particular time, and ( ii) It may be performed based on a predetermined periodicity of one or more calibration sounds. For example, after identifying the data corresponding to the protection band 1830, the computer may "cut" the data at t = -2T, t = -T, t = 0, t = T, thereby calibrating each. Data sections 1852, 1854 and 1856 corresponding to the sound 1818, 1828 and 1838 are identified.
At block 508, method 500 may include determining the frequency response of the reproduction device over the calibration frequency range using one or more identified data sections. In this regard, the frequency response of the playback device characterizes audio playback by the playback device, which is influenced by the acoustic characteristics of the playback device's environment. By identifying the sections of the captured data that correspond to the calibration sounds captured as the microphone moves within the environment, these data sections can be viewed by the viewer with the physical characteristics and / or environment of the playback device. It may be used to characterize how the various audio frequencies that can be heard are distorted (eg, enhanced or attenuated).
More specifically, the frequency response of the playback device is (b) reproduction of the average intensity of the sound waves captured by the microphone at various locations within the environment of the reproduction device at various frequencies in the calibration range. It may be a ratio (eg, transfer function) to a reference intensity that represents the amplitude of the sound wave actually generated by the device. According to a further example, a playback device that reproduces audio in an ideal environment that does not alter playback by the playback device will have a transfer function of 1 (or 0 dB) for all audio frequencies. At frequencies where the intensity captured by the microphone is greater than the reference intensity, the transfer function can have a value greater than 1 (or greater than 0 dB). At frequencies where the intensity captured by the microphone is below the reference intensity, the transfer function can have a value lower than 1 (or lower than 0 dB). The frequency response of the playback device may take other forms.
Using one or more data sections to determine the frequency response may include the computer converting one or more identified data sections from time domain format to frequency domain format. In a time domain format, one or more data sections may represent the amplitude of the captured audio over a given time period. The computer may use the Fast Fourier Transform (FFT) or another transformation algorithm to transform one or more data sections from the time domain format to the frequency domain format. In the frequency domain format, the data may represent the intensity of the captured audio at various frequencies within the calibration frequency range. The converted frequency domain data may indicate at what frequency the captured audio was amplified or attenuated by the environment of the playback device. This information may be used to match the actual frequency response of the playback device in the environment to the target frequency response (eg, a "flat" frequency response).
More specifically, the computer may calculate the total amount of audio captured over the calibration frequency range of one or more converted data sections. In one example, one or more calibration sounds represent audio captured by a microphone at various locations around the room, so by calculating the sum at each frequency spanning the calibration frequency range, the environment. Frequency responses can be provided that contribute to various ways in which the environment affects reproduction at various listening locations within.
Referring to FIG. 19 as an example, the converted data section 1902 may correspond to the calibration sound 1828 captured by the microphone at point 1302 in FIG. The converted data section 1904 may correspond to the calibration sound 1838 captured by the microphone at point 1304 in FIG. (Since calibration sounds 1828 and 1838 are continuous calibration sounds, the distance between point 1302 and point 1304 may be exaggerated for illustration purposes.)
The converted data section 1902 is at any frequency f<sub>1</sub>, F<sub>2</sub>, F<sub>3</sub>, F<sub>4</sub>, F<sub>5</sub>, F<sub>6</sub>And f<sub>7</sub>May include information about the capture intensity of the calibration sound 1828 in. (Actually, frequency f<sub>1</sub>~ f<sub>7</sub>May represent a frequency range, and the intensity depicted may be in the form of spectral power density (W / Hz). ) The converted data section 1904 has the same frequency f<sub>1</sub>, F<sub>2</sub>, F<sub>3</sub>, F<sub>4</sub>, F<sub>5</sub>, F<sub>6</sub>And f<sub>7</sub>May include information about the capture intensity of the calibration sound 1838 in. The converted data section 1906 has a frequency f<sub>1</sub>, F<sub>2</sub>, F<sub>3</sub>, F<sub>4</sub>, F<sub>5</sub>, F<sub>6</sub>And f<sub>7</sub>May represent the sum of the converted data section 1902 and the converted data section 1904 in. The sum may be calculated as follows. f<sub>1</sub>In, the intensity "9" of the captured calibration sound 1828 represented by the converted data section 1902 is added to the intensity "8" of the captured calibration sound 1830 represented by the converted data section 1904. And f<sub>1</sub>With respect to the converted data section 1906 in<sub>1</sub>The total intensity "17" in is brought. Similarly, f<sub>2</sub>In, the intensity "8" of the captured calibration sound 1828 represented by the converted data section 1902 is added to the intensity "10" of the captured calibration sound 1830 represented by the converted data section 1904. And f<sub>1</sub>With respect to the converted data section 1906 in<sub>2</sub>The total intensity in is "18". The rest of the converted data section 1906 can be calculated in the same way. Therefore, many converted data sections representing many calibration sounds can be summed up and, as a result, the frequency response of the playback device can be determined.
In some examples, to reduce overall processing time, the computer may calculate the "cumulative sum" of the converted data sections as the microphone moves around the environment to capture the calibration sound. .. Therefore, calculating the sum of one or more converted data sections is (i) the first conversion section of one or more converted data sections and (ii) one or more conversions. After calculating the first sum of the second transform section of the data section, and after calculating the first sum, (i) the first sum and (ii) the first and second transforms, respectively. To calculate the modified sum of the third conversion section of one or more converted data sections, which corresponds to the calibration sound captured after the calibration sound corresponding to the data section. May include.
In some examples, the computer is one or more such that each of the one or more normalized data sections represents a common amount of energy over the normalized frequency range (eg, 300 Hz to 3 kHz). The converted data section may be normalized. The normalization procedure may include increasing or decreasing the size of the converted data section by a common factor for all frequencies in the frequency calibration range. This may explain the difference in captured intensity between the calibration sounds due to the different calibration sounds being captured at different distances from the playback device. That is, even if all calibration sounds can be reproduced at substantially the same intensity, calibration sounds captured near the playback device are captured far away from the playback device (at some or all frequencies). It can be louder than the calibration sound. This normalization can vary the size of the data section being converted at different frequencies, but generally the intensity ratios that exist between the different frequencies (eg, the "shape" of the frequency response represented by the corresponding data section. ) Does not change. Without this normalization process, it may not be possible to discern the true (frequency-dependent) effect that the environment has on the frequency response of the playback device.
In fact, one way to normalize the converted data section is to use the converted data section, (i) the reference intensity, and (ii) the average intensity of the converted data section over the normalized frequency range. In some cases, it is multiplied by the scaled coefficient divided. For example, if (i) the ratio of the average intensity of the converted data section over the normalized frequency range to (ii) the reference intensity is 1.5, then the converted data section is scaled (eg, multiplied) with a factor of 0.666667. May be done.
In some examples, in calibrating a playback device, the calibration sound captured near the playback device plays a more important role than the calibration sound captured far from the playback device (or vice versa). Can be beneficial. For example, the environment may include a seating area near the playback device, where the viewer often sits while listening to audio content. Therefore, the computer performs normalization of one or more converted data sections by weighting the data sections in proportion to the total energy represented by each converted data section over the calibration frequency range. You may. Calibration sounds captured near the playback device are generally greater than those captured far from the playback device. The reference intensity corresponding to the central area of the environment is probably determined by capturing the calibration sound while the microphone is in such a location and calculating the average intensity of this captured data over the normalized frequency range. May be done.
Therefore, each transformed data section representing the calibration sound may be weighted exponentially, and the weighted index is from (i) the average intensity of the transformed data sections over the normalized frequency range, (ii). It is obtained by subtracting the reference strength. Therefore, the converted data section representing the calibration sound captured near the playback device may be weighted with a positive exponent, while the converted data section representing the calibration sound captured far from the playback device. The data section may be weighted with a negative exponent.
Calibration of the playback device can be improved by revealing the frequency response of the microphone that captures the calibration sound. Such a microphone may have physical properties that make the microphone more sensitive to a given frequency than other microphones. Therefore, the computer uses the known frequency response of the microphone to represent the captured calibration sound so that the processed data section more accurately represents the actual frequency response of the playback device. One or more data sections may be processed.
For example, a computer may store data in the form of an inverted FFT curve (or another similar dataset) that represents a known calibration sound captured by a microphone (perhaps in an anechoic chamber). Thus, one or more data sections may each be transformed from a time domain format to a frequency domain format and multiplied by an inverse FFT curve representing the frequency response of the microphone over the calibration frequency range. These processed data sections may be normalized and / or used to determine the frequency response of the playback device, as described above. If multiple microphones are used for calibration, multiple inverted FFT curves corresponding to each microphone may be stored by the computer and / or used for calibration of the playback device. Therefore, the processed one or more data sections generally reveal the non-ideality of the microphone while at the same time accurately representing the corresponding calibration sound captured by the microphone.
At block 510, method 500 may include determining one or more parameters of the audio processing algorithm based on the frequency response and target frequency response of the playback device.
As mentioned earlier, the frequency response of a playback device is determined based on one or more data sections that correspond to one or more calibration sounds played by the playback device, converted to a frequency domain format. May be done. For example, one or more data sections are (i) converted from a time domain format to a frequency domain format, (ii) the distance from the playback device from which each calibration sound was captured, and / or various calibration sounds. It may be normalized according to each average tone intensity of, (iii) processed to reveal the non-ideal frequency response of the microphone, and / or (iv) summed over the calibration frequency range. Any or all of the above processes may provide the frequency response of the reproduction device in the form of frequency domain data.
The data that make up the frequency response of the playback device can represent sound intensity as a function of frequency, but other examples are possible. The frequency response of the reproduction device may be multiplied by an inverse FFT curve representing the target frequency response (discussed below) to yield an offset curve. The offset curve represents the "adjustment" that may be required to calibrate the playback device to match the target frequency response. One or more parameters of the audio processing algorithm may be determined based on the offset curve. That is, if the reproduction device implements an audio processing algorithm characterized by one or more parameters, the reproduction device may reproduce the audio according to a target frequency response in the environment. One or more parameters may include a biquad filter coefficient representing the offset curve. The audio processing algorithm may be an infinite impulse response filter consisting of quadratic sections, but other examples such as a finite impulse response filter are possible.
In some examples, the target frequency response simply represents an ideal situation in which any audio content played by the playback device sounds substantially as represented by the audio signal representing that audio content. It may be a "flat" response curve. Other target frequency responses are possible. The computer sets various target frequency responses, the type of playback device, the orientation of the playback device, the zone configuration of the playback device, the proximity and / or orientation of the playback device to another playback device, and the audio content to be played by the playback device. It may be selected based on any of the characteristics of.
In some examples, if the audio processing algorithm is implemented according to one or more determined parameters by the playback device, the audio portion played by the playback device is amplified by the audio processing algorithm beyond the threshold amplification factor. Not done. That is, the offset curve may be "clip" or "restricted" to avoid overloading the speaker driver of the playback device.
At block 512, method 500 may include transmitting one or more parameters of the audio processing algorithm to the playback device. For example, the computer may send one or more parameters directly to the playback device or indirectly via a wireless or wired network interface, but other examples are possible.
In some examples, the calibration procedure may include a verification procedure. For example, the computer was moved using one or more motion sensors in a manner sufficient to adequately determine the frequency response of the playback device while capturing the calibration sound within the environment of the playback device. You may decide that. In this case, the computer may provide notification via the user interface that the calibration procedure has been successfully performed.
In another verification procedure, the computer may capture additional calibration sounds played by the playback device while implementing the audio processing algorithm. Based on one or more additional calibration sounds captured, the computer determines or verifies that the playback device is properly calibrated and provides such notifications using the user interface. You may.
In some examples, method 600 is performed by a computer in the form of a control device, such as control device 300, but other examples are possible. Therefore, in the present specification, a computer may be referred to as a control device in the light of the method 600.
At block 602, method 600 may include capturing one or more calibration sounds played by a playback device via a computer microphone. This may be performed in the same manner as block 502 described above.
At block 604, method 600 may include generating data representing one or more calibration sounds. This may be done in the same way as block 504 described above.
In block 606, method 600 comprises identifying one or more data sections such that each of the one or more data sections corresponds to each calibration sound of one or more calibration sounds. But it may be. This may be done in the same way as block 506 described above.
In block 608, method 600 comprises determining that more than a threshold amount of one or more data sections corresponds to each signal-to-noise ratio (SNR) less than the signal-to-noise ratio of the threshold. But it may be. The SNR of the data section representing the calibration sound is (i) (a) a given calibration sound and / or (b) a signal level in the protected band vs. (ii) a back detected by the microphone within the environment of the playback device. It may be defined as the ratio of ground noise. In some examples, the threshold amount of the section may be 90% of the data section representing one or more calibration sounds captured, and the threshold SNR may be 8: 1. , Other threshold quantities or threshold SNR examples are also possible.
For example, the computer may capture 100 calibration sounds played by the playback device. The computer may then identify and analyze the data sections corresponding to each of the 100 calibration sounds. Therefore, the computer may determine that 15 of the data sections each have an SNR of less than 8: 1. Therefore, the computer may determine, based on one or more calibration sounds captured, that the calibration procedure may have failed, i.e., the playback device may not be properly calibrated.
At block 610, method 600 may include providing information via the user interface of the computer that the playback device has not been properly calibrated. For example, the computer may display the message "Calibration failed. Reduce background noise or move closer to the playback device." In another example, the computer may emit a tone or "voice" alarm that the user can recognize as an indication of the failure of the calibration procedure.
In some examples, method 700 is performed by a computer in the form of a control device, such as control device 300, but other examples are possible. Therefore, in the light of Method 700, a computer may be referred to herein as a control device.
At block 702, method 700 is one or more first played by the first playing device via the microphone of the computer as the computer moves within the environment of the first playing device and the second playing device. It may include capturing one calibration sound and one or more second calibration sounds reproduced by the second reproduction device. In this regard, each of the one or more first calibration sounds and each of the one or more second calibration sounds may include sweeping over frequencies in the calibration frequency range.
Block 702 can be performed in the same way as block 502 described above, but the computer can capture the calibration sound played by both the first and second playback devices (and perhaps additional playback devices). Features have been added. As an example, referring to FIG. 20, the computer uses the calibration sounds 23A, 23B, 23C, 23D and 23E played by the playback device 2002 and the calibration sounds 25A, 25B, 25C, 25D and 25E played by the playback device 2004. , The calibration sounds 27A, 27B, 27C, 27D and 27E reproduced by the reproduction device 2006, and the calibration sounds 29A, 29B, 29C, 29D and 29E reproduced by the reproduction device 2008 may be captured.
At block 704, method 700 may include generating data representing one or more first calibration sounds and one or more second calibration sounds. Block 704 can be performed in the same manner as block 504 described above, but with data corresponding to the calibration sound that the computer plays on both the first and second playback devices (and perhaps additional playback devices). A function that can be generated has been added. For example, the computer may generate data representing calibration sounds 23A-23E, 25A-25E, 27A-27E and 29A-29E.
In block 706, method 700 (i) calibrates one or more first data sections, each of one or more first data sections each calibrating one or more first calibration sounds. Identify corresponding to the sound, and (ii) one or more second data sections, each of one or more second data sections one or more second calibration sounds. It may include identifying to correspond to each calibration sound of. Block 706 can be performed in the same way as block 506 described above, but with a data section corresponding to the calibration sound that the computer plays on both the first and second playback devices (and possibly additional playback devices). The ability to identify is added. For example, the computer may identify sections of generated data corresponding to calibration sounds 23A-23E, 25A-25E, 27A-27E and 29A-29E, respectively.
As shown in FIG. 20, the media playback system may include four playback devices 2002, 2004, 2006 and 2008. As an example, the playback device 2002 may be the "front" playback device, the playback device 2004 may be the "left" playback device, and the playback device 2006 may be the "right" playback device. In some cases, and the playback device 2008 may be a "rear" playback device, other examples are possible.
The calibration sound may be reproduced in a "frame" by the reproduction device 2002-2008. For example, the calibration sounds 23A, 25A, 27A and 29A may be reproduced in frame 2010 by the reproduction devices 2002, 2004, 2006 and 2008, respectively. The calibration sounds 23B, 25B, 27B and 29B may be reproduced in frame 2012 by the reproduction devices 2002, 2004, 2006 and 2008, respectively. The calibration sounds 23C, 25C, 27C and 29C may be reproduced in frame 2014 by the reproduction devices 2002, 2004, 2006 and 2008, respectively. The calibration sounds 23D, 25D, 27D and 29D may be reproduced in frame 2016 by the reproduction devices 2002, 2004, 2006 and 2008, respectively. The calibration sounds 23E, 25E, 27E and 29E may be reproduced in frame 2018 by the reproduction devices 2002, 2004, 2006 and 2008, respectively.
Frames 2010-2018 may be temporally separated via common protection bands 2020, 2022, 2024 and 2026. For example, the playback devices 2002 to 2008 play each calibration sound 23A to 29A in an alternate order so that none of the sweep components of the calibration sounds 23A to 29A are played during the common protection band 2020. May be good. After the common protection band 2020, the playback devices 2002-2008 each calibration sound 23B-29B so that none of the sweep components of the calibration sounds 23B-29B are played during the common protection band 2020 or 2022. May be played back in a staggered order. After the common protection band 2022, the playback devices 2002-2008 will play each calibration sound 23C-29C so that none of the sweep components of the calibration sounds 23C-29C are played during the common protection band 2022 or 2024. May be played back in a staggered order. After the common protection band 2024, the playback devices 2002-2008 each calibration sound 23D-29D so that none of the sweep components of the calibration sounds 23D-29D are played during the common protection band 2024 or 2026. May be played back in a staggered order. Similarly, after the common protection band 2026, the playback devices 2002-2008 each calibration sound 23E ~ so that none of the sweep components of the calibration sounds 23E ~ 29E are played back during the common protection band 2026. 29E may be played in a staggered order.
Therefore, the computer may have one or more data sections corresponding to the playback device 2002, one or more data sections corresponding to the playback device 2004, one or more data sections corresponding to the playback device 2006 and the playback device 2008. One or more data sections corresponding to may be identified.
For example, the computer may identify data sections that represent calibration sounds based on a predetermined order of calibration sounds. For example, within frame 2010, the computer may identify data corresponding to the maximum frequency in the calibration frequency range. Each of the calibration sounds 23A to 29A starts at the maximum frequency in the calibration frequency range. In the alternating order of the calibration sounds 23A to 29A, the computer first captures the maximum frequency of the calibration sound 23A, then the maximum frequency of the calibration sound 25A, and then the maximum frequency of the calibration sound 27A. It may be captured, and then the maximum frequency of the calibration sound 29A may be captured. Based on the staggered order, the computer has the first maximum frequency detected corresponding to the playback device 2002, the second maximum frequency detected corresponding to the playback device 2004, and the third maximum frequency detected. May correspond to the reproduction device 2006 and the fourth maximum frequency detected corresponds to the reproduction device 2008. Other frequencies contained within the calibration sounds 23A-29A may also be staggered according to this order, so that the computer reproduces the captured frequencies according to this staggered order. It may be associated with a device. After detecting the threshold frequency representing the bottom edge of the sweep component range for each of the playback devices 2002-2008, the computer may determine that any additional calibration sounds captured are related to subsequent frames 2012-2018. .. The data sections corresponding to the calibration sounds 23B-23E, 25B-25E, 27B-25E and 29B-29E may be identified in the same manner.
In block 708, method 700 may include determining the first frequency response of the first reproduction device over the calibration frequency range using one or more first data sections. The frequency response characterizes audio reproduction by the first reproduction device, which is affected by the acoustic characteristics of the environment of the first reproduction device and the second reproduction device.
At block 710, method 700 may include determining the second frequency response of the second reproduction device over the calibration frequency range using one or more second data sections. The frequency response characterizes audio reproduction by the second reproduction device, which is affected by the acoustic characteristics of the environment of the first reproduction device and the second reproduction device.
Blocks 708 and 710 can be performed similar to block 508 described above, but with the ability of the computer to determine the frequency response of both the first and second playback devices (and perhaps additional playback devices). Has been added. For example, the computer may use the data section representing the calibration sounds 23A-23E to determine the frequency response of the playback device 2002, or the data representing the calibration sounds 25A-25E to determine the frequency response of the playback device 2004. It may be determined, the frequency response of the reproduction device 2006 may be determined using the data representing the calibration sounds 27A to 27E, and the frequency response of the reproduction device 2008 may be determined using the data representing the calibration sounds 29A to 29E. May be determined.
At block 712, method 700 may include determining one or more first parameters of the first audio processing algorithm based on the first frequency response and the first target frequency response.
At block 714, method 700 may include determining one or more second parameters of the second audio processing algorithm based on the second frequency response and the second target frequency response.
Blocks 712 and 714 can be performed in the same manner as block 510 described above, but the computer can determine the parameters of the audio processing algorithm of both the first and second playback devices (and possibly additional playback devices). The function is added. For example, the computer may use the determined frequency response of each of the reproduction devices 2002-2008 to determine one or more parameters that define each audio processing algorithm for each of the reproduction devices 2002-2008.
At block 716, method 700 may include transmitting one or more first parameters of the first audio processing algorithm to the first playback device.
At block 718, method 700 may include transmitting one or more second parameters of the second audio processing algorithm to the second playback device.
Blocks 716 and 718 may be executed in the same manner as block 512 described above.
In some examples, Method 800 is performed by a first computer in the form of a server connected to the media playback system, perhaps via a wide area network, but other examples are possible. In light of Method 800, the second computer may take the form of a control device for a media playback system, but other examples are possible. Also, the playback device referred to in the light of Method 800 may be part of a media playback system.
At block 802, method 800 may include receiving from a second computer data representing one or more calibration sounds reproduced by the reproduction device and captured by the second computer. In this regard, each of the one or more calibration sounds comprises sweeping through frequencies in the calibration frequency range.
In block 804, method 800 comprises identifying one or more data sections such that each of the one or more data sections corresponds to each calibration sound of one or more calibration sounds. But it may be. Block 804 may be executed in the same manner as block 506 described above.
At block 806, method 800 may include determining the frequency response of the reproduction device over the calibration frequency range using one or more data sections. In this regard, the frequency response of the playback device characterizes audio playback by the playback device, which is influenced by the acoustic characteristics of the playback device's environment. Block 806 may be executed in the same manner as block 508 described above.
At block 808, method 800 may include determining one or more parameters of the audio processing algorithm based on the frequency response and target frequency response of the playback device. Block 808 may be executed in the same manner as block 510 described above.
At block 810, method 800 may include transmitting one or more parameters of the audio processing algorithm to the playback device. Block 810 may be executed in the same manner as block 512 described above.
In some examples, Method 900 is performed by a first computer in the form of a server connected to a media playback system, perhaps via a wide area network, but other examples are possible. In light of Method 900, the second computer may take the form of a control device for a media playback system, but other examples are possible. Also, the playback device referred to in the light of Method 900 may be part of a media playback system.
At block 902, method 900 may include receiving from a second computer data representing one or more calibration sounds reproduced by the reproduction device and captured by the second computer. Block 902 may be executed in the same manner as block 802 described above.
In block 904, method 900 comprises identifying one or more data sections such that each of the one or more data sections corresponds to each calibration sound of one or more calibration sounds. But it may be. Block 904 may be executed in the same manner as block 506 described above.
In block 906, method 900 comprises determining that more than a threshold amount of one or more data sections corresponds to each signal-to-noise ratio (SNR) less than the signal-to-noise ratio of the threshold. But it may be. Block 906 may be executed in the same manner as block 608 described above.
At block 908, method 900 may include sending information to the second computer that the playback device has not been properly calibrated.
In some examples, Method 1000 is performed by a first computer in the form of a server connected to a media playback system, perhaps via a wide area network, but other examples are possible. In light of Method 1000, the second computer may take the form of a control device for a media playback system, but other examples are possible. Also, the first and second playback devices referred to in light of Method 1000 may be included within the media playback system.
In block 1002, method 1000 is from a second computer, (i) one or more first calibration sounds played by and captured by the first playback device, and (ii). It may include receiving data representing one or more second calibration sounds, reproduced by the second reproduction device and captured by the second computer. Block 1002 may be executed in the same manner as block 902 described above.
In block 1004, method 1000 (i) calibrates one or more first data sections, each of one or more first data sections each calibrating one or more first calibration sounds. Identify corresponding to the sound, and (ii) one or more second data sections, each of one or more second data sections one or more second calibration sounds. It may include identifying to correspond to each calibration sound of. Block 1004 may be executed in the same manner as block 706 described above.
In block 1006, method 1000 may include determining the first frequency response of the first reproduction device over the calibration frequency range using one or more first data sections. In this regard, the first frequency response may characterize audio reproduction by the first reproduction device, which is influenced by the acoustic characteristics of the environment of the first reproduction device and the second reproduction device. Block 1006 may be executed in the same manner as block 708 described above.
In block 1008, method 1000 may include determining the second frequency response of the second reproduction device over the calibration frequency range using one or more second data sections. In this regard, the second frequency response characterizes audio reproduction by the second reproduction device, which is influenced by the acoustic characteristics of the environment of the first reproduction device and the second reproduction device. Block 1008 may be executed in the same manner as block 710 described above.
In block 1010, method 1000 determines one or more first parameters of the first audio processing algorithm based on the first frequency response and the first target frequency response, and the second frequency response and It may include determining one or more second parameters of the second audio processing algorithm based on the second target frequency response. Block 1010 may be executed in the same manner as blocks 712 and 714 described above.
At block 1012, method 1000 may include transmitting one or more first parameters of the first audio processing algorithm to the first playback device. Block 1012 may be executed in the same manner as block 716 described above.
At block 1014, method 1000 may include transmitting one or more second parameters of the second audio processing algorithm to the second playback device. Block 1014 may be executed in the same manner as block 718 described above.
In some examples, method 1100 is performed by playback device 200. The computer referred to in light of Method 1100 may be a control device for a media playback system, including playback device 200.
At block 1102, method 1100 may include receiving data from the computer representing one or more calibration sounds played by and captured by the playing device. In this regard, one or more calibration sounds each include a sweep over frequencies in the calibration frequency range. Block 1102 may be executed in the same manner as block 802 described above.
In block 1104, method 1100 comprises identifying one or more data sections such that each of the one or more data sections corresponds to each calibration sound of one or more calibration sounds. But it may be. Block 1104 may be executed in the same manner as block 804 described above.
At block 1106, method 1100 may include determining the frequency response of the reproduction device over the calibration frequency range using one or more data sections. In this regard, the frequency response of the playback device characterizes audio playback by the playback device, which is influenced by the acoustic characteristics of the playback device's environment. Block 1106 may be executed in the same manner as block 806 described above.
At block 1108, method 1100 may include determining one or more parameters of the audio processing algorithm based on the frequency response and target frequency response of the playback device. Block 1108 may be executed in the same manner as block 808 described above.
At block 1110, method 1100 may include playing audio processed using an audio processing algorithm.
In some examples, method 1200 is performed by playback device 200. The computer referred to in light of method 1200 may be a control device for a media playback system, including a playback device 200.
At block 1202, method 1200 may include receiving from the computer data representing one or more calibration sounds played by and captured by . Block 1202 may be executed in the same manner as block 802 described above.
In block 1204, method 1200 comprises identifying one or more data sections such that each of the one or more data sections corresponds to each calibration sound of one or more calibration sounds. But it may be. Block 1204 may be executed in the same manner as block 804 described above.
In block 1206, method 1200 includes determining that more than a threshold amount of one or more data sections corresponds to each signal-to-noise ratio (SNR) less than the signal-to-noise ratio of the threshold. But it may be. Block 1206 may be executed in the same manner as block 608 described above.
At block 1208, method 1200 may include providing information that the playback device was not properly calibrated. Block 1208 may be executed in the same manner as block 610 described above.
IV. Conclusion The above description discloses various examples of systems, methods, devices, and products including firmware and / or software running on hardware, among other things. It is understood that such examples are merely exemplary and should not be considered limiting. For example, any or all of the aspects or components of the hardware, hardware and / or software may be embodied exclusively in hardware, exclusively in software, exclusively in firmware, or in any combination of hardware, software and / or firmware. It is intended to get. Therefore, the examples provided are not the only way to implement such systems, methods, devices and / or products.
This specification is broadly described with respect to exemplary environments, systems, procedures, steps, logical blocks, processes, and other symbolic representations, which are the behavior of data processing devices that are directly or indirectly connected to a network. Is similar to. These processing descriptions and expressions are commonly used by those skilled in the art and can most efficiently convey the content of their work to those skilled in the art. Much specific content is provided to understand this disclosure. However, it will be appreciated by those skilled in the art that certain embodiments of the present disclosure may be implemented without specific, specific details. In other examples, well-known methods, procedures, components, and circuits are not described in detail to avoid unnecessarily obscuring embodiments. Therefore, the scope of the present disclosure is defined by the appended claims rather than the embodiments described above.
When any of the appended claims is simply read to cover implementation in software and / or firmware, one or more of the elements in at least one example are referred to herein as software and / or firmware. It is clearly defined to include tangible non-temporary storage media for storing firmware, such as memory, DVD, CD, Blu-ray® and the like.
(Feature 1) A non-temporary computer-readable medium that stores instructions that cause the computer to perform a function when executed by the computer, said function: (i) the computer is in the environment of the playback device. As it moves, it captures one or more calibration sounds played by the playback device via the computer's microphone, each of which includes a sweep over frequencies in the calibration frequency range. That, (ii) generate data representing one or more calibration sounds, (iii) calibrate one or more data sections, each of one or more data sections. Identifying each calibration sound of a sound, (iv) using one or more data sections to determine the frequency response of the playback device over the calibration frequency range, and the frequency response of the playback device. Characterize audio playback by the playback device, which is influenced by the acoustic characteristics of the playback device's environment, (v) determine one or more parameters of the audio processing algorithm based on the playback device's frequency response and target frequency response. This includes (vi) sending one or more parameters of the audio processing algorithm to the playback device.
(Feature 2) In the non-temporary computer-readable medium described in Feature 1, a given calibration sound of one or more calibration sounds is (i) the minimum of the calibration frequency range and the first. A first component containing calibration noise at a frequency between the threshold frequency of (ii) a second component swept through the frequency between the second threshold frequency and the maximum value of the calibration frequency range. The given calibration sound is temporally separated from the subsequent calibration sound of one or more calibration sounds by the protection band containing the first component, and the protection band is the second. Contains no ingredients.
(Feature 3) Identifying one or more data sections in the non-temporary computer-readable medium described in Feature 2 is (i) identifying the first data section corresponding to the protected band. A second corresponding to a given calibration sound, based on (a) the identified first data section and (b) the predetermined periodicity of one or more calibration sounds. Includes identifying data sections.
(Feature 4) In the non-temporary computer-readable medium according to Feature 2, the protection band is the first protection band, and a given calibration sound is the second protection band containing the first component. Separated in time from the preceding calibration sound of one or more calibration sounds, the second protection band does not contain a second component and identifies one or more data sections. (I) identify the first data section corresponding to the first protected band, (ii) identify the second data section corresponding to the second protected band, (iii) identified Includes identifying a third data section that corresponds to a given calibration sound, based on the first data section and the identified second data section.
(Feature 5) In the non-temporary computer-readable medium described in Feature 2, identifying one or more data sections represents (i) a signal-to-noise ratio (SNR) greater than the threshold signal-to-noise ratio (SNR). Identifying a given data section, where the SNR represented by a given data section is (a) (b) a given calibration sound, and / or (c) a signal level in the protected band. Represents a protected band by identifying a subsection of a given data section that represents a sound intensity less than (ii) the threshold sound intensity, which is the ratio to the background noise detected by the microphone in the environment of the playback device. Identifying a subsection of a given data section and (iii) (a) the identified subsection of a given data section, and (b) a predetermined period of one or more calibration sounds. Includes identifying one or more data sections based on gender.
(Feature 6) In the non-temporary computer-readable medium described in Feature 2, the function further (i) sets the signal-to-noise ratio (SNR) of a given section of one or more data sections. To determine, where the SNR of a given data section is (b) a given calibration sound and / or (c) a protected band, (a) a signal level, (ii) the environment of the playback device. The ratio to the background noise detected by the microphone within, (iii) determining that the SNR of a given section exceeds the threshold SNR, (iv) the SNR of a given section sets the threshold SNR. It involves determining the frequency response of the playback device using a given section based on the determination that it is exceeded.
(Characteristic 7) In the non-temporary computer-readable medium according to feature 2, the protection band includes both the first audio frequency and the second audio frequency at a specific time, and the above-mentioned function includes. (i) further comprising detecting a first audio frequency and a second audio frequency at the particular time, (ii) identifying one or more data sections is (a) said. One or more based on the detection of a first audio frequency and a second audio frequency at a particular time, and (b) a predetermined periodicity of one or more calibration sounds. Includes identifying the data section.
(Feature 8) In the non-temporary computer-readable medium described in Feature 1, determining the frequency response of a playback device using one or more data sections is (i) one or more data. Includes converting a section from a time domain format to a frequency domain format, (ii) using one or more converted data sections to determine the frequency response of the playback device.
(Feature 9) In the non-temporary computer-readable medium described in Feature 8, determining the frequency response of a playback device using one or more converted data sections is one or more converted. Includes calculating the total size of captured audio over the calibration frequency range of multiple data sections.
(Feature 10) In the non-temporary computer-readable medium described in Feature 9, calculating the sum of one or more converted data sections is (i) to capture a given calibration sound. Prior to, the first sum of (a) the first conversion section of one or more converted data sections and (b) the second conversion section of one or more converted data sections. (Ii) After calculating the first sum, (a) the first sum and (b) the first of one or more converted data sections corresponding to a given calibration sound. Includes 3 conversion sections and calculating the modified sum of.
(Feature 11) In the non-temporary computer-readable medium described in Feature 8, determining the frequency response of a playback device using one or more converted data sections is one or more normalizations. Includes normalizing one or more converted data sections so that each of the normalized data sections represents a common amount of energy over the normalized frequency range.
(Feature 12) In the non-temporary computer-readable medium described in Feature 8, determining the frequency response of a playback device using one or more converted data sections is 1 over the normalized frequency range. Includes weighting one or more converted data sections based on the amount of energy individually represented by one or more converted data sections.
(Feature 13) In the non-temporary computer-readable medium described in Feature 1, determining the frequency response of a playback device using one or more data sections is (i) the frequency response of the computer's microphone. Includes processing one or more data sections based on, (ii) determining the frequency response of the playback device using one or more processed data sections.
(Feature 14) In the non-temporary computer-readable medium of feature 13, the function further comprises (i) converting one or more data sections from time domain format to frequency domain format. , (Ii) Processing one or more data sections involves processing one or more converted data sections.
(Feature 15) In the non-temporary computer-readable medium described in Feature 1, determining one or more parameters of an audio processing algorithm can be played if the audio processing algorithm is implemented by a playback device. It involves determining one or more parameters of the audio processing algorithm so that no part of the audio played by the device is amplified beyond the threshold amplification factor.
(Feature 16) In the non-temporary computer-readable medium described in Feature 1, the function further performs the playback device within the environment of the playback device by the computer via one or more motion sensors of the computer. Includes determining that the frequency response of the computer has been adequately determined.
(Feature 17) In the non-temporary computer-readable medium described in Feature 1, the function is further reproduced by a playback device via a microphone by implementing (i) an audio processing algorithm 1 Includes capturing one or more additional calibration sounds, (ii) determining that the playback device is properly calibrated based on the captured additional calibration sounds. ..
(Feature 18) A non-temporary computer-readable medium that stores instructions that cause the computer to perform a function when executed by the computer, the function being (i) played back through the computer's microphone. Capturing one or more calibration sounds played by the device, (ii) generating data representing one or more calibration sounds, (iii) one or more data sections. Or identify each of the multiple data sections to correspond to each calibration sound of one or more calibration sounds, (iv) sections greater than the threshold amount of one or more data sections of the threshold. Determining that each signal-to-sound ratio (SNR) is less than the signal-to-noise ratio, and (v) providing information via the computer's user interface that the playback device was not properly calibrated. That includes.
(Feature 19) A non-temporary computer-readable medium that stores instructions that cause the computer to perform a function when executed by the computer, wherein the function is (i) the computer is the first playback device and As you move through the environment of the second playback device, one or more of the first calibration sounds played by the first playback device and the second playback device through the microphone of your computer. Capturing one or more second calibration sounds, where each of the one or more first calibration sounds, and each of the one or more second calibration sounds. Including sweeping over frequencies in the calibration frequency range, (ii) generating data representing one or more first calibration sounds and one or more second calibration sounds, (iii). (a) One or more first data sections, and one or more first data sections, each of which corresponds to each calibration sound of one or more first calibration sounds. (b) One or more second data sections, such that each of one or more second data sections corresponds to each calibration sound of one or more second calibration sounds. Identifying, (iv) using one or more first data sections to determine the first frequency response of the first reproduction device over the calibration frequency range, where the first frequency response. Characterizes audio playback by the first playback device, which is affected by the acoustic characteristics of the environment of the first playback device and the second playback device, (v) one or more second data sections. It is used to determine the second frequency response of the second reproduction device over the calibration frequency range, where the second frequency response is the acoustic characteristic of the environment of the first reproduction device and the second reproduction device. Characterizes audio playback by a second playback device, affected by (vi) firstDetermining one or more of the first parameters of the first audio processing algorithm based on the frequency response and the first target frequency response, (vii) to the second frequency response and the second target frequency response. Based on the determination of one or more second parameters of the second audio processing algorithm, (viii) one or more first parameters of the first audio processing algorithm to the first playback device. Includes transmitting, (ix) transmitting one or more second parameters of the second audio processing algorithm to the second playback device.
(Feature 20) In the non-temporary computer-readable medium of feature 19, a given calibration sound of one or more first calibration sounds has a first audio frequency at a particular time. And including both the second audio frequency and the second audio frequency, the function further comprises (i) detecting the first audio frequency and the second audio frequency at the particular time, (ii) one. Or identifying a plurality of first data sections is (a) detecting a first audio frequency and a second audio frequency at the particular time, (b) one or more firsts. Includes identifying one or more first data sections based on the predetermined periodicity of the calibration sound of.
23 sheets
Sheet 1 Sheet 2 Sheet 3 Sheet 4 Sheet 5 Sheet 6 Sheet 7 Sheet 8 Sheet 9 Sheet 10 Sheet 11 Sheet 12 Sheet 13 Sheet 14 Sheet 15 Sheet 16 Sheet 17 Sheet 18 Sheet 19 Sheet 20 Sheet 21 Sheet 22 Sheet 23
Every citation, both ways
| Document | Relation | Office |
|---|---|---|
| JP2011215378A | Cites | Japan |
| JP2002101500A | Cites | Japan |
| JP2014523165A | Cites | Japan |
| JP2006191562A | Cites | Japan |
| JP2006064393A | Cites | Japan |
| JP2008191005A | Cites | Japan |
| JP2012058701A | Cites | Japan |
| JP02309800A | Cites | Japan |
| WO2014032709A1 | Cites | World Intellectual Property Organization (WIPO) |
| US20160239255A1 | Cites | United States of America |
176 members in 5 offices
Priority claims10
| Document | Office | Kind | Date |
|---|---|---|---|
| 201562220225 | United States of America | P | |
| 201562220225 | United States of America | P | |
| 62220225 | United States of America | – | |
| 14864393 | United States of America | – | |
| 201514864393 | United States of America | A | |
| 201514864393 | United States of America | A | |
| 14864393 | – | – | – |
| 62220225 | – | – | – |
| US201514864393 | – | – | – |
| US201562220225P | – | – | – |
Members176
| Document | Office | Kind | |
|---|---|---|---|
| US2014003625A1 | United States of America | A1 | |
| US2015212789A1 | United States of America | A1 | |
| US2015214914A1 | United States of America | A1 | |
| US9106192B2 | United States of America | B2 | |
| US2015263692A1 | United States of America | A1 | |
| US2015263693A1 | United States of America | A1 | |
| WO2015142873A1 | World Intellectual Property Organization (WIPO) | A1 | |
| US9219460B2 | United States of America | B2 | |
| US2016011848A1 | United States of America | A1 | |
| US2016011850A1 | United States of America | A1 | |
| US2016014510A1 | United States of America | A1 | |
| US2016014511A1 | United States of America | A1 | |
| US2016014512A1 | United States of America | A1 | |
| US2016014534A1 | United States of America | A1 | |
| US2016014535A1 | United States of America | A1 | |
| US2016014536A1 | United States of America | A1 | |
| US2016044413A1 | United States of America | A1 | |
| WO2016040329A1 | World Intellectual Property Organization (WIPO) | A1 | |
| US9419575B2 | United States of America | B2 | |
| EP3085112A1 | European Patent Office (EPO) | A1 | |
| US2016316305A1 | United States of America | A1 | |
| WO2016172590A1 | World Intellectual Property Organization (WIPO) | A1 | |
| WO2016172593A1 | World Intellectual Property Organization (WIPO) | A1 | |
| US2016323686A1 | United States of America | A1 | |
| CN106105272A | China | A | |
| EP3100262A1 | European Patent Office (EPO) | A1 | |
| WO2017007843A1 | World Intellectual Property Organization (WIPO) | A1 | |
| WO2017015350A1 | World Intellectual Property Organization (WIPO) | A1 | |
| WO2017015356A1 | World Intellectual Property Organization (WIPO) | A1 | |
| US2017075645A1 | United States of America | A1 | |
| US2017083279A1 | United States of America | A1 | |
| WO2017049169A1 | World Intellectual Property Organization (WIPO) | A1 | |
| EP3146731A1 | European Patent Office (EPO) | A1 | |
| US9648422B2 | United States of America | B2 | |
| CN106688249A | China | A | |
| EP3100262A4 | European Patent Office (EPO) | A4 | |
| US9668049B2 | United States of America | B2 | |
| JP2017514182A | Japan | A | |
| US9690271B2 | United States of America | B2 | |
| US9690539B2 | United States of America | B2 | |
| US9699555B2 | United States of America | B2 | |
| US9706323B2 | United States of America | B2 | |
| US2017208406A1 | United States of America | A1 | |
| US9736584B2 | United States of America | B2 | |
| US2017245074A1 | United States of America | A1 | |
| US9749744B2 | United States of America | B2 | |
| JP6196010B1 | Japan | B1 | |
| US9781532B2 | United States of America | B2 | |
| US9788113B2 | United States of America | B2 | |
| JP6216471B2 | Japan | B2 | |
| JP2017531377A | Japan | A | |
| US9820045B2 | United States of America | B2 | |
| US2017339489A1 | United States of America | A1 | |
| EP3146731B1 | European Patent Office (EPO) | B1 | |
| US9872119B2 | United States of America | B2 | |
| US2018020306A1 | United States of America | A1 | |
| US2018035227A1 | United States of America | A1 | |
| JP2018023116A | Japan | A | |
| EP3286932A1 | European Patent Office (EPO) | A1 | |
| US2018063660A1 | United States of America | A1 | |
| US9913057B2 | United States of America | B2 | |
| CN107852562A | China | A | |
| CN107852564A | China | A | |
| US9961463B2 | United States of America | B2 | |
| CN108028985A | China | A | |
| EP3320698A1 | European Patent Office (EPO) | A1 | |
| US2018146313A1 | United States of America | A1 | |
| US2018192216A1 | United States of America | A1 | |
| EP3351015A1 | European Patent Office (EPO) | A1 | |
| US10045138B2 | United States of America | B2 | |
| US10045139B2 | United States of America | B2 | |
| JP6383896B1 | Japan | B1 | |
| JP2018527608A | Japan | A | |
| JP2018530179A | Japan | A | |
| EP3085112B1 | European Patent Office (EPO) | B1 | |
| JP2018533277A | Japan | A | |
| US2018324537A1 | United States of America | A1 | |
| US10127006B2 | United States of America | B2 | |
| US10129674B2 | United States of America | B2 | |
| US10129675B2 | United States of America | B2 | |
| US2018352355A1 | United States of America | A1 | |
| US10154359B2 | United States of America | B2 | |
| JP6437695B2 | Japan | B2 | |
| JP6449393B2 | Japan | B2 | |
| EP3286932B1 | European Patent Office (EPO) | B1 | |
| US2019073192A1 | United States of America | A1 | |
| US2019075413A1 | United States of America | A1 | |
| US2019075414A1 | United States of America | A1 | |
| EP3351015B1 | European Patent Office (EPO) | B1 | |
| JP2019061250A | Japan | A | |
| US2019116439A1 | United States of America | A1 | |
| JP2019068446A | Japan | A | |
| US10284983B2 | United States of America | B2 | |
| US10284984B2 | United States of America | B2 | |
| US10296282B2 | United States of America | B2 | |
| CN106688249B | China | B | |
| JP6523543B2 | Japan | B2 | |
| CN107852564B | China | B | |
| EP3509326A1 | European Patent Office (EPO) | A1 | |
| US10390159B2 | United States of America | B2 |
10 legal events, as the office reported them to INPADOC
Over the term
Point at a mark for the eventEvents
| Event | Code | |
|---|---|---|
| Cancellation because of no payment of annual feesLAPS | LAPS | |
| First payment of annual fees (during grant procedure)JAPANESE INTERMEDIATE CODE: A61A61 | A61 | |
| Certificate of patent or registration of utility modelJAPANESE INTERMEDIATE CODE: R150R150 | R150 | |
| Written decision to grant a patent or to grant a registration (utility model)JAPANESE INTERMEDIATE CODE: A01A01 | A01 | |
| Decision of grant or rejection writtenTRDD | TRDD | |
| Request for written amendment filedJAPANESE INTERMEDIATE CODE: A523A521 | A521 | |
| Notification of reasons for refusalJAPANESE INTERMEDIATE CODE: A131A131 | A131 | |
| Report on retrievalJAPANESE INTERMEDIATE CODE: A971007A977 | A977 | |
| Request for written amendment filedJAPANESE INTERMEDIATE CODE: A523A521 | A521 | |
| Written request for application examinationJAPANESE INTERMEDIATE CODE: A621A621 | A621 |
Numbers
- Publication
- 7092829
- Publication, DOCDB
- 7092829
- Publication, EPODOC
- JP7092829B
- Application
- 134012
- Application, DOCDB
- 2020134012
- Application, EPODOC
- JP20200134012
Titles2
- Japanese
- オーディオ再生デバイスのキャリブレーションを容易にする方法
- English
- How to facilitate calibration of audio playback devices
Classification
- CPC, 16
- H04R3/04
- H03G5/005
- G06F3/165
- H04R29/00
- H04S7/00
- H03G5/00
- H03G5/16
- H03G5/165
- H04R29/001
- H04S7/301
- H04R2227/005
- H04R29/007
- H04R2227/001
- H04S7/303
- H04S7/307
- H04S2420/07
- IPC, 4
- H04R3 04
- H04R3 00
- G10K15 00
- H04S7 00
