Generating a control signal based on propagated data

Generate control signals based on disseminated data

The present invention relates to generating a control signal. The invention further relates to providing feedback information for use in a control system.

In electromechanical integrated systems, component vibration detection can be used to improve positioning or early fault detection. It is often impossible or undesirable to attach the sensor to the vibrating component. In addition, the control system is used in the production line to influence the operation of the devices used in the production line.

Near-field Acoustic Holography (NAH) is a sound source identification technology based on measurement and a microphone array is arranged on a plane (holographic plane) close to a surface of a sound source. The array data is transformed to obtain information about the sound pressure and the vibration velocity distribution on the surface of the sound source. For example, NAH can be used to locate the source of noise generated by a product.

An acoustic sensor in an array setup is used to record the acoustic signal. R. Scholte's 2008 PhD thesis "Fourier based High-resolution Near-field Sound Imaging" at Eindhoven University of Technology describes the method of performing near-field sound imaging based on such recorded sound signals. This method includes the following steps. Create a set of sound data representing a set of near-field sound holographic measurements at the first set of positions. Apply a spatial frequency transform to acoustic data to obtain data in the spatial frequency domain. Spread the frequency-transformed sound data to obtain the transmitted frequency-transformed sound data (for example, in a source plane). Apply a regularization in a wave number domain. Perform an inverse spatial frequency transformation to obtain acoustic data describing the acoustic vibration at the source plane.

It would be advantageous to have an improved system for generating a control signal. In order to better solve this problem, a first aspect of the present invention provides a system including the following: a data spreader for spreading toward a group of propagating positions and a group of sensors at a group of sensor positions The acoustic sensor array related to the acoustic measurement obtains the propagated data related to the set of propagated positions; and a control signal generator for generating a control signal based on the propagated data.

Since the sensor array data propagates from the set of sensor positions to the set of propagated positions, the propagated data is related to sound or vibration at a set of propagated positions. Therefore, there is no need to have a sensor in the group of propagated positions, while still having accurate information of the vibration and/or sound at the group of propagated positions. This information is used to generate a control signal. Therefore, the transmitted data can be used as input or feedback within a control system. This allows the control signal to more accurately reflect the conditions at the propagated locations. The control signal can be supplied to a device to at least partially control the operation of the device. The control signal can therefore be distinguished from a purely visual representation of the disseminated material.

The control signal generator may include a data analyzer for analyzing propagated data in a spatial frequency domain. The spatial frequency domain can provide enough information to serve as the basis of a control signal without first converting the data in the frequency domain. In addition, data in the frequency domain can be calculated more efficiently. By deriving control signals when analyzing the sensor array data in the spatial frequency domain, calculation time can be saved because the data does not need to be transformed back to the spatial domain. For example, when holography is applied by propagating data in the spatial frequency domain, the data in the spatial frequency domain becomes available as part of the processing chain. Therefore, the calculation of transforming the data from the spatial frequency domain back into the spatial domain can be omitted.

The data analyzer may include a spatial frequency selector for separating at least one spatial frequency component in the sensor array data. This spatial frequency component can provide appropriate information that can be used as a basis for the control signal. A specific spatial frequency component can be associated with a specific control event or a condition of a measured object.

The data analyzer may include a pattern recognition module for recognizing a pattern in the sensor array data in the spatial frequency domain or in another domain. A specific pattern can be associated with a specific control event or a condition of a measured object.

The data disseminator can be configured to disseminate the sensor array data in real time. In addition, the control signal generator can be configured to generate the control signal in real time. Provide immediate control in this way.

The control signal generator can be configured to detect a warning condition based on the propagated data and include a corresponding warning signal in the control signal. This allows appropriate measures to be taken in response to the warning situation. For example, the system may include an alert generator configured to generate an alert in response to the alert signal. The warning generator can be configured to generate, for example, an audible warning and/or a visual warning.

The system may include a sensor array for collecting acoustic sensor array data about a device or a product manufactured using the device. In addition, the control signal generator can be configured to at least partially control the device by the control signal. This allows the operation of the equipment to be controlled by the control signal based on the relevant sound measurement information. For example, the system and the device can form at least part of a closed control loop. The acoustic sensor data can be used as feedback in the control loop. For example, when the acoustic sensor array data relates to a product manufactured using the equipment, the system can be used for quality control.

The transmitted data may indicate a vibration or deflection of at least part of the device or at least part of the product. Such vibration or deflection can cause an acoustic signal that can be detected by the acoustic sensor. In this way, vibration or deflection can be detected from a distance without using a touch sensor.

The sensor array data can be about a monitored patient. This allows the system to be used in a medical monitoring device.

The system may include: an input for receiving the acoustic sensor array data representing a set of holographic measurements at the position of the set of sensors; and a spatial frequency converter for converting a spatial Frequency transformation is applied to the sensor array data to obtain transformed sensor array data in a spatial frequency domain; wherein the data propagator is configured to propagate the transformed sensor in the spatial frequency domain toward the set of propagation positions The device array data is used to obtain the propagated data related to the set of propagated positions in the spatial frequency domain.

This is an exemplary implementation of acoustic holography. This provides a high accuracy input for the control signal generator. The acoustic holography may include near-field acoustic holography. The control signal generator can be configured to analyze the propagated data in the spatial frequency domain.

The system may include a further spatial frequency converter for performing an inverse spatial frequency transformation to the propagated data to obtain reconstructed sound data in a spatial domain, which represents a sound at the set of propagated positions Signal. This allows the control signal generator to base the control signal on the propagated data in a spatial domain. This allows the use of spatial information to generate the control signal. The control signal generator can be configured to analyze the propagated data in the spatial domain. The control signal generator can also be configured to analyze the propagated data in both the spatial domain and the spatial frequency domain.

The further spatial frequency converter may be configured to perform the inverse spatial frequency conversion in response to an alarm condition indicated by the control signal. This allows viewing the spatial distribution of the propagated data when needed due to a warning condition without having to perform the inverse spatial frequency transformation when it is not needed. It also allows the source of the warning to be identified.

The system may include a pattern recognition module for detecting a position of the cause of the warning condition based on a result of the inverse spatial frequency transformation. This allows automating the location of the cause of the warning condition. This can be used to generate an effective control signal.

Another aspect of the present invention provides an integrated circuit including the stated system.

Another aspect of the present invention provides a method for generating a control signal, which includes: propagating acoustic sensor array data related to a set of acoustic measurements at a set of sensor positions toward a set of propagation positions to obtain and The group of propagated data related to the propagated position; and generating a control signal based on the propagated data.

Another aspect of the present invention provides a computer program product for causing a processor system to execute the stated method.

Those skilled in the art will understand that two or more of the above-mentioned embodiments, implementations and/or aspects of the present invention can be combined in any manner deemed effective.

The modification and change of the integrated circuit, the method and/or the computer program product corresponding to the described modification and change of the system can be realized by a person familiar with the technology based on the current description.

These and other aspects of the present invention will be understood and clarified with reference to the embodiments described below.

Acoustic sensors in an array configuration can be used to monitor acoustic vibrations (generally in the near field) produced by a vibration source. The sound hologram can be recorded in a real-time manner. A near-field acoustic holography (NAH) can be performed based on these holographic images, which includes an inverse calculation of a sound field in a wavenumber (or spatial frequency) domain. The recorded sound field of the hologram can be transformed into vibrations that appear on the surface of the sound source. The sound pressure, particle velocity and sound intensity in front of and on the source surface can be calculated. For this reason, it can be assumed that the particle velocity of air particles directly in front of the surface of an object is a good approximation of the surface vibration of the object. The information obtained about structural vibrations or sound fields can be used in a decision-making system, such as a control system or a real-time monitoring system.

Figure 1 shows a block diagram of a control system (especially a system for generating a control signal). The system can be implemented on an integrated circuit or as a computer program stored on a computer-readable storage medium and configured to run on a computer system. The system may have electronic input and/or output ports, for example, for connecting an acoustic sensor array to the input 7 or providing control signals to a controlled warning signal generator 14 or device 5.

The system may include a data propagator 9 configured to propagate acoustic sensor array data about a set of acoustic measurements at a set of sensor locations toward a set of propagated locations. The set of sensor positions can cover an aperture. The data spreader 9 can be configured to process data in the spatial frequency domain, but this is not a limitation. The sensor position group can be configured in a plane. Other configurations of the sensor position (such as a three-dimensional configuration) are also possible. For example, the sensor position group can be arranged in a plurality of layers to form a multi-layer configuration.

The system may include a control signal generator 2 for generating a control signal based on the propagated data. The control signal generator 2 may include a data analyzer 1 configured to analyze time-dependent sensor array data in a spatial frequency domain. The near-field acoustic holographic processing technology can generate time-dependent sensor array data in the spatial frequency domain. For example, the sensor array data can be transformed into the spatial frequency domain and spread to another plane of interest before analysis. The data analyzer 1 can analyze the time-dependent sensor array data in the spatial frequency domain by using a signal processing technique known in the art itself. The data analyzer 1 can be alternatively or additionally configured to analyze time-dependent sensor array data in one spatial domain or another domain.

The control signal generator 2 can be configured to generate control signals based on sensor array data analysis. The control signal therefore depends on the time-dependent sensor array data, such as the time-dependent sensor array data in the spatial frequency domain. The control signal can be configured to control a device or equipment 5 or an alarm generator 14. The data analyzer 1 and the control signal generator 2 can be configured to perform analysis and generate real-time control signals (that is, during data acquisition). In this way, a closed loop control system or a warning system can be implemented. The data analyzer 1 can be a sub-component of the control signal generator 2.

The data analyzer 1 may include a spatial frequency selector 3 configured to separate at least one spatial frequency component in the sensor array data. For example, detecting the existence of a specific spatial frequency in the sensor array data. When the specific spatial frequency amplitude exceeds a threshold value or increases, the control signal generator 2 can be configured to trigger a warning. The spatial frequency selector 3 can also be configured to separate a specific combination or range of spatial frequencies.

The data analyzer 1 may also include a pattern recognition module 4 for recognizing a pattern in the sensor array data in the spatial frequency domain or the spatial domain. The pattern recognition technology is known per se. The pattern recognition technology enables complex analysis of a data.

The data analyzer 1 can be configured to detect an alarm condition based on sensor array data. The control signal generator 2 can be configured to generate a corresponding warning signal in response to the detection of the warning condition.

The system may include a sensor array and/or have an input 7 for receiving sensor array data measured by an external sensor array.

The sensor array data may be related to at least part of a device 5 or time-dependent and/or space-dependent vibrations occurring in a device 5. For example, the data is measured by a sensor array 12 disposed close to a surface of the device 5, and then transformed into a spatial frequency domain and propagated toward the surface of the device 5 using holographic processing technology. The control signal generator 2 is operatively coupled to the device 5. In this way, the control signal generator 2 can be configured to facilitate the control of the device. Therefore, a closed control loop can be established.

The sensor array data can be related to at least a part of a product 6 or the time-dependent and spatially dependent vibration, deflection, or noise that occur in the product 6 manufactured by the device 5. In this way, the quality of the equipment can be checked. The sensor array data can be measured by a sensor array 13 arranged close to the surface of the product, and then transformed into a spatial frequency domain and propagated toward the surface of the product 6 using holographic processing technology. The control signal generator 2 is operatively coupled to the device 5. Once again, a closed control loop can be established.

Alternatively, the sensor array data may pertain to, for example, a monitored patient (not shown). The sensor array can be arranged on the surface of the patient's body or close to the surface of the patient's body, and measure the vibration or sound of the body. The control signal can be configured to control a warning system and/or a medical device (such as a medication supply or breathing device).

The data analyzer 1 can be configured to analyze a product 6 as a main body of the sensor array data, and the control signal is coupled to a manufacturing device 5 to control a process of the same or similar product 6.

The system may include an input 7 which is configured to receive sensor array data from a sensor array 12,13. The sensor array data can represent a set of near-field holographic measurements (such as acoustic measurements) at the first set of positions of the sensors of the sensor arrays 12 and 13, and the first set of positions covers an aperture .

The received sensor array data can be forwarded to a spatial frequency converter 8, which is configured to apply a spatial frequency transformation to the sensor array data. In this way, the sensor array data is transformed into a spatial frequency domain, such as a spatial Fourier domain. The sensor array data in the spatial frequency domain can be provided to a data spreader 9, which is configured to spread the sensor array data to a second set of positions in the spatial frequency domain to obtain data corresponding to the second The propagated data of the group of locations, the second group of locations may be different from the first group of locations. The propagated data is processed sensor array data or propagated sensor array data in the spatial frequency domain. The data analyzer 1 can be configured to analyze the propagated sensor array data in the spatial frequency domain.

The system may include a further spatial frequency converter 10. This can be the same operation unit as the spatial frequency converter 8 that operates in a different mode. Furthermore, the spatial frequency converter 10 can also be implemented as an operating unit different from the spatial frequency converter 8. Further, the spatial frequency converter 10 can be configured to perform an inverse spatial frequency transformation on the propagated data to obtain reconstructed acoustic data in a spatial domain, which represents the respective acoustic signals at the second set of positions. Further, the spatial frequency converter 10 can be configured to perform inverse spatial frequency conversion (only) when an alarm condition is detected. To this end, the control signal generator 2 can provide a control signal to the further spatial frequency converter 10.

The spatial frequency transform may include a Fourier transform. Note that the spatial frequency transform may include a time-varying spatial frequency transform (such as a wavelet transform or a short-time Fourier transform).

The system may include a pattern recognition module 11, which is configured to detect a location of a cause of an alarm condition based on a result of the inverse spatial frequency transformation. For example, the pattern recognition module 11 can be configured to find a sound source in the reconstructed sound data in the spatial domain.

A warning generator 14 may be provided to generate a warning (for example, an audible or visual warning signal) based on the control signal from the control signal generator 2.

The equipment 5 may include at least part of a production line. The product 6 manufactured by the production line may include an electronic device, such as a computer, a mobile phone, a television, or an integrated circuit. Product 6 may further include a car or any other product.

The sensor arrays 12 and 13 may include a plurality of acoustic sensors arranged at a set of sensor positions. This group of sensor positions can be arranged in a regular grid. However, this is not a limitation. The sensor position group can be arranged in a plane. Other non-planar configurations of the sensor position are also possible. For example, the sensor position group can be arranged in a plurality of layers to form a multi-layer configuration. This configuration allows the use of improved noise suppression techniques. The sensor position configuration of other sensor arrays is also possible. The sensor arrays 12, 13 may include a supporting material for holding the sensors in place. The signal generated by the sensor array can be coupled to input 7.

The system can be implemented in an integrated circuit. This integrated circuit may include a sensor array 12 or 13. In this case, the sensors of the sensor arrays 12, 13 are mounted on or integrated with the integrated circuit. Alternatively, the sensor array and integrated circuit including a system for generating a control signal can be implemented as separate devices.

Note that propagated acoustic data (such as those produced by holographic acoustics technology) is different from, for example, beamforming technology in that beamforming is more specific to sound from a specific direction and the propagated data used in this description is about Sound or vibration patterns that appear in a set of transmitted positions.

Figure 2 shows a flow chart of a method of generating a control signal. The method may include step 201: propagating acoustic sensor array data about a set of acoustic measurements at a set of sensor positions covering an aperture toward a set of propagation positions to obtain a set of propagation positions about the set of propagation positions. material. The method may further include step 202: generating a control signal based on the propagated data. The method can be modified or extended based on the processing steps that can be performed by the system described in this description. The method can be implemented, for example, as a dedicated integrated circuit or as a computer program product.

For control applications (such as real-time or near-real-time control applications), the results of the holographic reconstruction can be made available within a relatively short time after the measurement is performed. This can be done by using time interval wavelet transform or short-time Fourier transform (STFT).

The systems and methods described herein can be implemented on a chip (such as an FPGA or an ASIC). The linear prediction boundary filling and clipping and hypotenuse repetition of a modified exponential filter can be implemented in hardware or implemented as an embedded software in an FPGA.

Approximate measurement of a (microphone) sensor array integrated in a silicon wafer can be used for holographic measurement close to a vibration source; the spatial mapping interference and/or sound field of the array can be considered interference.

A near-field acoustic holography (NAH) system may include one or more or all of the following:

1- A digital microphone grid that can be installed on a PCB array as a holographic sound measurement system.

2- A holographic program that can be executed by standard multiplication and addition operations on an FPGA. By using (short-term) FFT to obtain acoustic information in spatial frequency, k-space or wavenumber domain (holographic data in k-space), cyclotron integration can be avoided to calculate the source's backward or forward propagation sound and vibration fields. Reverse procedures, filtering, and data processing can be performed by linear operations, and they can be performed by standard (multiplication and summation) operations in the CPU or FPGA.

3- An automated holographic procedure, which reconstructs the source data without the intervention of a human operator.

4-A decision system (such as a control system or image detection system), which can be implemented on an FPGA and can be configured to operate without the intervention of a human operator.

The techniques described in this article can be used in many different application areas. In medical applications, it can be used, for example, in heartbeat monitoring. Other applications include mechanical/chemical installation monitoring, production monitoring/testing/quality control (vibration and/or sound), music and sound monitoring, robotic vision systems, active voice masking in public areas (such as restaurants), or for teleconferencing applications Sensor input, automatic voice, vibration and crack detection in a production line, real-time sensing of safety applications in the middle and (electromechanical integration) control systems.

The data analyzer can be configured to analyze the crowd, and the control signal can be coupled to a selection device to selectively activate the audiovisual media in response to the analysis.

The system may include a set of sensor arrays that can be applied to an autonomous (robot) system to detect the sound environment as an aid in the decision-making process.

It will be understood that the present invention also applies to computer programs, especially computer programs on or in a carrier, which are adapted to practice the present invention. The program can be a source code, an object code, a code intermediate source, and an object code such as a partially compiled form or any other form suitable for implementing the method according to the present invention. It will also be understood that this program can have many different structural designs. For example, a code that implements the functionality of the method or system according to the present invention can be subdivided into one or more subroutines. Those familiar with this technology will understand the many different ways of distributing functionality in these subroutines. The subroutines can be stored together in an executable file to form a self-contained program. This executable file may include computer executable instructions, such as processor instructions and/or interpreter instructions (such as Java interpreter instructions). Alternatively, one or more or all of the subroutines may be stored in at least one external library file and linked to a main program statically or dynamically (for example, at runtime). The main program contains at least one call to at least one of the subroutines. Subroutines can also include function calls to each other. An embodiment of a computer program product includes computer-executable instructions corresponding to each processing step of at least one of the methods described herein. These commands can be subdivided into subroutines and/or stored in one or more files that can be statically or dynamically linked. Another embodiment of a computer program product includes computer-executable instructions corresponding to various components of at least one of the system and/or product described herein. These commands can be subdivided into subroutines and/or stored in one or more files that can be statically or dynamically linked.

A computer program carrier can be any entity or device capable of carrying programs. For example, the carrier may include a storage medium, such as a ROM (such as a CD ROM or a semiconductor ROM) or a magnetic recording medium (such as a floppy disk or a hard disk). In addition, the carrier can be a transmissible carrier (such as an electrical signal or an optical signal), which can be communicated via a cable or an optical cable, or by radio or other means. When the program is embodied in the signal, the carrier can be formed by a cable or other devices or components. Alternatively, the carrier may be an integrated circuit in which the program is embedded, and the integrated circuit is adapted to perform the related method or be used in the execution of the related method.

It should be noted that the above-mentioned embodiments illustrate rather than limit the present invention, and those skilled in the art will be able to design many alternative embodiments without departing from the scope of the attached patent application. Within the scope of the patent application, any reference signs placed between parentheses shall not be construed as limiting claims. The use of the term "comprising" and its combination does not exclude the presence of other elements or steps than those stated in a claim. The article "one" or "one" before an element does not exclude the existence of plural such elements. The invention can be implemented by hardware including several independent components and by a suitably programmed computer. In the device technical solution enumerating several components, several of these components can be embodied by one and the same hardware object. The mere fact that certain measures are stated in mutually different subsidiary technical solutions does not indicate that a combination of these measures cannot be used to advantage.

<p>1. . . Data analyzer</p><p>2. . . Signal generator</p><p>3. . . Frequency selector</p><p>4. . . Pattern recognition module</p><p>5. . . equipment</p><p>6. . . product</p><p>7. . . enter</p><p>8. . . Converter</p><p>9. . . Information disseminator</p><p>10. . . Spatial frequency converter</p><p>11. . . Pattern recognition module</p><p>12. . . Sensor array</p><p>13. . . Sensor array</p><p>14. . . Warning generator / warning signal generator</p>

Figure 1 is a block diagram of a system for generating a control signal; and

Fig. 2 is a flowchart of a method of generating a control signal.