System and method supporting infrared remote control over a network

FEDERALLY SPONSORED RESEARCH OR DEVELOPMENT

[0001] [Not Applicable]

SEQUENCE LISTING

[0002] [Not Applicable]

BACKGROUND OF THE INVENTION

[0003] The development of home networks to distribute video content digitally presents new problems to system designers seeking to integrate the control of multiple devices in the home. An early example is the use of coaxial cable to distribute analog video content throughout a home. Although it was relatively easy to connect multiple televisions to a common video source such as a VCR located in a different room, the standard remote controls for the VCR would not allow a homeowner to directly control a remotely located VCR from the room where the TV was located, which is where the operator typically would desire to view the video. In prior analog systems, remote control of a source not located in the room where the content was played was accomplished with either UHF radio remote controls (an uncommon solution for home equipment and susceptible to interference from neighbors) or more typically with the use of infrared repeaters that would collect IR control signals in a given room and then either retransmit them by bouncing them down a hallway, send them by a dedicated wired connection to the program source, or retransmit the signals using radio waves, again suffering interference from other radio sources. All of these techniques require additional dedicated components and wiring making their installation relatively expensive.

[0004] There are also significant differences from control schemes using dedicated “home run” wiring. Usually, dedicated wiring control schemes must be wired from box-to-box separately from the wires used to carry the analog video/audio signal. The control wires can be used ONLY to carry command information. Dedicated wiring control schemes are proprietary and do not work with all IR remote controls (e.g., SONY S-link). They are usually based on decoding the IR signal, and only sending the control word. The invention described here does not require decoding the IR signal, but rather works by reconstructing the IR signal at the central box.

[0005] There are control schemes based on 1394 networks, however, they rely upon one box controlling another through known control word protocols, and do not seem capable of sending and reconstructing the original IR signal. As such, they do not work with existing IR remote controls, or existing A/V equipment. The invention disclosed here operates with existing A/V equipment, and it makes use of the home network and remote/central boxes to receive, communicate on home network, and finally reconstruct the original IR remote control signal, allowing for highly flexible control with a minimum of additional wiring while preserving the homeowner's investment in pre-existing A/V sources and displays.

[0006] Further limitations and disadvantages of conventional home A/V control approaches will become apparent to one of skill in the art, through comparison of such systems with the present invention as set forth in the remainder of the present application with reference to the drawings.

BRIEF SUMMARY OF THE INVENTION

[0007] Aspects of the present invention may be found in a home network system that is based on digital transmission. The system allows the user to send remote control commands across the home network, rendering unnecessary a physically separate control path for commands to the remotely located A/V source.

[0008] In one embodiment, the remote settop box (located with the TV, stereo speakers, PC, or other unit capable of playing or displaying an A/V program) is networked to a central settop box (located where the A/V source such as a VCR, DVD player, or file server is located). The network is any of Ethernet, HPNA, HCNA, wireless 802-11 or other digital network. The remote settop box can receive the infrared remote control signals, process them, construct packets of control information, and send the packets over the network to the central settop box. The central settop box can receive and decode the packets, and use an IR blaster to re-transmit the remote control signals into the room with the other AV equipment.

[0009] Such a system allows a user in the bedroom, for example, to use a normal IR remote control to turn on a VCR that is remote in the family room. The video signal would leave the VCR as an analog signal and be digitized and compressed by the central settop box, typically using an MPEG encoder. The VCR signal is then sent over the home network to the remote settop box in the bedroom. Control signals from the VCR IR remote are relayed from the remote settop box, over the digital network, and to the VCR, thus giving the user all the normal operations expected.

[0010] Alternatively, a small remote-only box can be placed on the network anywhere in the home where IR remote capability is needed. This would allow a remote to work totally independently of the location of the AV equipment. All that is required in this embodiment is an IR digitizer connected to the home network.

[0011] By taking advantage of the digital back channel available on the home network, a number of schemes that allow for the remote control using existing IR controls of A/V equipment are possible, without the disadvantages of prior schemes. Other aspects, advantages and novel features of the present invention, as well as details of an illustrated embodiment thereof, will be more fully understood from the following description and drawings, wherein like numerals refer to like parts.

BRIEF DESCRIPTION OF THE DRAWINGS

P-0012[0012]FIG. 1 shows an overview of a typical implementation of one embodiment the invention.

P-0013[0013]FIG. 2 is a more detailed overview showing the basic system and an alternate scheme for use with A/V sources that are not connected to the digital home network.

P-0014[0014]FIG. 3 is an alternate embodiment that includes a central decode and command distributor that allows multiple display media to share multiple program sources.

P-0015[0015]FIG. 4<i>a </i>is a block diagram of a remote settop box in accordance with one embodiment of the present invention.

P-0016[0016]FIG. 4<i>b </i>is a logical diagram of the packet structure of packetized IR control data in accordance with one embodiment of the invention.

P-0017[0017]FIG. 4<i>c </i>illustrates one embodiment of a simple buffering scheme for use in sending and re-assembling IR control data packets.

P-0018[0018]FIG. 5 is a block diagram of a central settop box in accordance with one embodiment of the present invention.

P-0019[0019]FIG. 6 is a block diagram of one embodiment of a central decode and command distributor for use with the system of FIG. 3, for example.

P-0020[0020]FIG. 7 is a diagram of a logical translation function wherein the system of FIG. 3 can be adapted to control devices other than A/V sources.

DETAILED DESCRIPTION OF THE INVENTION

P-0021[0021] Referring to FIG. 1, in one embodiment of the invention, the home network system comprises 2 boxes: a remote settop box <b>101</b> and a central settop box <b>102</b>. The central settop box <b>102</b> includes a home network interface <b>103</b> and an IR packet decoder <b>104</b>, although these functions could be separated into two physically distinct units. An IR cable <b>105</b> connects the IR packet decoder to an IR Blaster <b>106</b>, whose construction may be conventional. A program source such as a VCR <b>107</b> is connected to network interface <b>103</b> by either an analog or digital link <b>108</b>. An IR remote control <b>109</b> can now send IR commands <b>110</b> to remote settop box <b>101</b>. Remote settop box <b>101</b> packetizes the IR commands <b>110</b> and forwards them across digital network <b>111</b> to network interface <b>103</b>. IR packet decoder <b>104</b> translates packetized IR commands received from the network <b>111</b> and forwards them to IR blaster <b>106</b>. IR blaster <b>106</b> broadcasts an IR blaster command <b>115</b> to conventional program source <b>107</b>. The program source <b>107</b> responds to the commands and sends its program content to the digital network <b>111</b> via link <b>108</b> and the network interface <b>103</b>. Finally, the remote display or speakers <b>112</b> receives the program from source <b>107</b>, even though source <b>107</b> may be separated from IR remote <b>109</b> and display <b>112</b> by one or more walls <b>113</b>.

P-0022[0022] Remote Box.

P-0023[0023]FIG. 4<i>a </i>is a detailed view of the remote settop box <b>101</b>. The IR receiver <b>401</b> within the remote box is typically a photodiode, with a simple RC filter <b>402</b> at the output. The RC filter <b>402</b> is sufficiently broadband to receive all varieties of IR remote control signals. Most IR remote controls <b>109</b> generate signals <b>110</b> that are either baseband signals with pulse widths in the range of 3-7 μs on/20 μs off or AM modulated carriers around 30-40 KHz. Buffer/amplifier <b>403</b> forwards the received signal to the remote signal processor <b>405</b> over interrupt line <b>404</b>.

P-0024[0024] The signal <b>110</b> is received, digitized, and packetized efficiently for distribution over the home network. The remote signal processor <b>405</b> in the remote settop box may perform this function in a number of ways:

P-0025[0025] 1. Programmed Remote: In this scheme, the user can program the remote settop box via a user interface <b>406</b> to identify the type of remote control in use. Different remote controllers use different protocols, and different transmission pulse widths/frequencies. The remote settop box control logic <b>407</b> can then use a signal processing scheme specifically designed for that remote by matching the received pattern with a known patterns stored in ROM <b>408</b>, or trying alternate schemes until a scheme that works is selected. Usually, this consists of timing specific pulse widths, and demodulating a signal to decode digital bits. The sequence of digital bits contain remote control commands. In this scheme, only the decoded bits for the commands are sent over the network, resulting in very few bits transmitted, a few kilobits/second. This scheme has the advantages of being very immune to noise (some lights put off IR noise that can interfere), and has the advantage of consuming very few bits of network bandwidth.

P-0026[0026] 2. Learned Remote: This scheme is very similar to the programmed remote scheme, however, rather than the user programming the type of remote from a user interface, the signal processor implements a learning algorithm by taking a sample remote control signal <b>110</b> from the user. For example, the user could place the system in ‘learn mode’, point the remote control at the receiver, and press the remote control buttons. The signal processor then only needs to match a received signal with a previously learned remote. It shares similar advantages as the programmed remote above.

P-0027[0027] 3. Brute-force: In this scheme, the remote settop box simply samples the IR receiver at a very high frequency, and sends the information from every sample time across the network. Most IR receivers operate off a very high gain receiver, so as to receive weak signals, or signals of variable strength in a room. Because of this, the resulting IR signal is usually limited to either a 0 or 1 level, or may be digitized with very low quantization (4 bit quantization may be sufficient) with an A/D converter. It is also not necessary to sample at a very high frequency, as most IR remote controls operate with low frequency signals. However, some remote controls save battery life by making pulse widths shorter. A typical system may sample the IR signal at 1 Mhz (1 μs period) with 4 bit quantization. This signal is then packetized, and sent across the network. The advantage of this system is that it will work with any remote control, regardless of the use of AM modulated carrier or baseband signal, as long as the bandwidth of the signal is less than 500 KHz. There are simple improvements on this scheme to save bandwidth, such as applying simple run-length compression or other lossless compression algorithms on the signal prior to transmission. Given that most IR pulses are much longer than 1 us, the signal should compress very well, on the order of 6-10× compression, reducing the network bandwidth to well below 1 Mbit/s.

P-0028[0028] 4. PWM: This scheme takes advantage of the nature of remote control IR signals. All of these signals can be amplified to a very high level, resulting in essentially a stream of pulses of IR signal which are converted to 0-1 pulses of various width by sampling circuitry <b>409</b>. At this point the signal has been converted to a pulse-width modulated signal: <chemistry id="CHEM-US-00001" num="1"><img file="US20030195969A1-20031016-C00001.TIF" id="EMI-C00001" he="111.38715" wi="211.23585" img-format="tif" img-content="ui" /><attachments><attachment idref="CHEMCDX-00001" attachment-type="cdx" file="US20030195969A1-20031016-C00001.CDX" /><attachment idref="CHEMMOL-00001" attachment-type="mol" file="US20030195969A1-20031016-C00001.MOL" /></attachments></chemistry>

P-0029[0029] The pulse width modulated signal can be filtered by pulse width coding circuit <b>410</b> to remove any pulses less than 1 μs in width (this is the lower limit of pulse widths used in remote control signals). The filter removes the narrow pulse, and adds this time to the previous pulse width. The pulse width is measured with a high frequency clock, for example, 10 Mhz or 100 ns precision. The pulse width value is then coded as an 8 bit number, with some mechanism to encode very long periods of time with no change in level. This could be done by reserving the value 0 (0×00) to mean extend the pulse width count by 256. This very simple run-length coding could be improved with other simple data compression schemes. In this method, the bit rate on the network is usually very low, but could peak if there is a lot of IR noise in the system, or if the receiver is triggered by a high speed IR signal. The lower limit occurs if there is a slow IR signal, and is generally a single 8-bit number every 25.6 μs using a 10 Mhz sample clock, resulting in 312 Kbits/second. If there is no IR signal, the bandwidth is generally 0, as no information is sent. The upper limit occurs if there is a noisy signal received. Pulses just over 1 μs in length generally require an 8 bit number every 1 μs, or about 8 Mbits/second. This can be adjusted by making the sample clock longer, changing the filter characteristics of the pulse-eating filter, or by using entropy-coding of Huffman coding the pulse width signals. A peak data rate of 1 Mbit/second provides a reliable system that works with most commercially available remote controls. The advantages of this system is that it is independent of the protocol on the remote control, does not require a user to program the system, has some noise filtering and noise immunity, and requires no bandwidth when there is no IR signal received.

P-0030[0030] The Remote Network Interface.

P-0031[0031] The remote network interface <b>412</b> in the remote settop box <b>101</b> is controlled by a software application running on control logic <b>407</b> to manage this process over the network. It implements a number of functions, for example:

P-0032[0032] 1. Establish connection with the application in the central settop box

P-0033[0033] In one embodiment, on power-up, the remote settop box <b>101</b> sends a message to the central settop box <b>102</b> to establish an IR connection. This could also be done when the user selects such a feature on the remote settop box. This essentially allows the remote settop box IR application software to pass information to the central box, which is also running an IR application software. Additionally, after the connection is made, the remote settop box or the central settop box sends brief messages every few minutes to ensure that the other box is still connected. Upon discovering a disconnect, the remote and central boxes attempt to re-establish a connection, with time-out and retry if the other box is still disconnected.

P-0034[0034] 2. Remove locally relevant IR signals for remote box and route to local processor.

P-0035[0035] The remote settop box may have it's own IR remote controller, and may process the commands from this controller. The control logic <b>407</b> examines the signal from the signal processor <b>405</b>, determines if it matches the IR signal for the remote settop box control, and if so, does not transmit this on the network I/F <b>412</b>. Instead it sends the resulting command to any local processor that may need to process commands for the remote box operation. This has at least two benefits: it allows the settop remote box to operate off the same IR receiver <b>401</b> as the network application, and also prevents re-transmission of the local IR signal, thus allowing multiple remote settop boxes on a network, while preventing other similar boxes from receiving these signals inadvertently through the network <b>111</b>. In one embodiment, any remote settop box needs to respond only to its IR control.

P-0036[0036] If a homeowner wants to have multiple identical remote settop boxes in a single network, and wants the ability to control any of them through the network <b>111</b>, then the remote settop box <b>101</b> and the IR controller for that box are programmed so that each remote control will only work with a single box, for example. All other signals are routed on the network for use by other boxes.

P-0037[0037] 3. Packetize IR signal from the signal processor (possibly with compression)

P-0038[0038] The IR application software constructs a packet of information <b>430</b> to be used by the central settop box. One embodiment of a packet structure is shown in FIG. 4<i>b. </i>This information starts with some header information, followed by a number of PWM samples <b>434</b>. The header information <b>431</b> contains control bits to indicate the start of transmission (if the IR receiver was previously quiet) and end of transmission <b>432</b>. The header indicates a packet length to allow the central box to know how much information is to be received. The header indicates a packet count or sequence number <b>433</b>, which is simply an increment of +1 from the previous packet. Each packet in sequence has an increasing count. The count can be used by the central settop box to order the data, and allows simple buffering models (see below). Finally, the packets are a fixed, finite length of time. 50 ms covers most IR transmitter times for a single control code word. Using the PWM approach above, a 50 ms packet contains about 4000 bytes for typical IR codes with pulse periods of 25 μs or less if compression is used.

P-0039[0039] Buffer and time stamp data for transmission.

P-0040[0040] In one embodiment, the data that is transmitted is buffered prior to transmission, and buffered on receipt. FIG. 4<i>c </i>shows one embodiment of how packets are “bundled” for network transmission. This ensures that the data is transmitted without gaps on the network. The network is typically packet based, and may have other information traffic. The resulting effect is that packets of IR information are not sent continuously. By using a buffer <b>411</b> on the transmitter side, and on the receiver side <b>506</b>, the network delivery time does not affect the system operation. The buffer model can be very simple. For example, the system could buffer 4 packets on the transmit side, not start transmitting until 4 packets are available to send, and use 4 packets on the receiver side, while holding IR data at the central settop box until 4 packets are received. After the startup condition, packets are generated every 50 ms in the remote settop box <b>101</b> and consumed in the central settop box <b>102</b> every 50 ms, so the system works as long as the data is sent within 4×50 ms or about 200 ms. As most IR remote controls <b>109</b> repeat the IR signal multiple times, the system is not sensitive to occasional network drop-outs.

P-0041[0041] 5. Ensure low delay operation (numbered packets to assemble sequence).

P-0042[0042] In one embodiment, low delay operation ensures that the user does not perceive annoying delays from when they push a button on an IR remote until the operation starts to take effect. This may be achieved by two means. For example, first the data is sent to the network while the button is still being pressed. A typical key press may last a few seconds, and the signal processing and application software must not wait until the button press is complete to send data packets <b>430</b>. Second, the buffer model for buffer <b>411</b> keeps a small number of packets of information in the buffer to ensure low delay from input (IR received at remote box) to output (IR blasted at central box). The buffer model above uses 8 packets of 50 ms each for a 400 ms total delay. This may be modified for different system performance goals.

P-0043[0043]FIG. 2 shows a variation on the basic system embodiment shown in FIG. 1. In this embodiment, multiple remote settop boxes <b>101</b>, <b>201</b> and program sources <b>107</b>, <b>207</b> are connected to network <b>111</b>. A stand-alone remote capture device <b>215</b> can be positioned at any convenient point on network <b>111</b> so that IR remotes <b>109</b>, <b>209</b> can be used in any room, even rooms that contain no program sources <b>107</b>, <b>207</b> or display or speaker devices <b>112</b>, <b>212</b>. Home digital network interface <b>202</b> is conventional and has digitizing ports for digitizing and forwarding digital audio <b>216</b> and video <b>217</b> across network <b>111</b>.

P-0044[0044] Furthermore, from FIG. 2 it can be seen that the remote IR control across the digital home network can be accomplished even for program sources that are not connected to the network, since source <b>107</b> in FIG. 2 can receive IR commands through its IR receiver <b>114</b> and send analog output to the display device via a “homerun” connection <b>218</b> (such as ordinary coaxial cable or S-video) to display device <b>112</b>.

P-0045[0045]FIG. 3 shows another embodiment of a system arrangement in accordance with the present invention. In this scheme, the functions of remote settop box <b>301</b> are built into display device <b>312</b>, or may be as in FIG. 1. Multiple display devices <b>312</b>, <b>313</b> are connected to network <b>111</b>. Furthermore, multiple clusters of program sources <b>340</b>, <b>341</b> are also connected to the network. Central decode and distribute device <b>350</b> manages connections between the remote settop boxes and different media clusters, so that multiple remotes and sources can be accessed simultaneously.

P-0046[0046] Central Settop Box:

P-0047[0047] One embodiment of the central settop box is shown in FIG. 5. The IR blaster <b>106</b> is typically an LED. In FIG. 5 it is shown as part of the settop box, although it could be located remotely in a convenient transmitting location, high on a wall for example. Most IR remote controls are either baseband signals with pulse widths in the range of 3-7 μs on/20 μs off or AM modulated carriers around 30-40 KHz. The packets are received from the network <b>111</b>, depacketized, processed and driven to the IR blaster <b>106</b>. The IR blaster <b>106</b> will transmit the signal into the room, where it will bounce off objects and reflect back into the AN equipment <b>107</b> in the room.

P-0048[0048] The central signal processor <b>501</b> in the central settop box is generally more complex than the remote settop box. Signal processor <b>501</b> is implemented on a microprocessor with the functions described below. It takes the packets of data <b>430</b> from the network <b>111</b>, decodes the data according to the algorithm chosen, and using a time base similar to the remote settop box, reconstructs the original signal. An example would be using the PWM method described above, decompressing the values if entropy coding or Huffman coding was used to compress the signal in the remote settop box <b>101</b>. After decompression, a 10 Mhz clock <b>503</b> counts out the relevant clock cycles to recreate the pulse width of the signal, and the output of the pulse counter drives the LED either on or off via a driver <b>504</b> (full power) into the room.

P-0049[0049] The central settop box also runs a software application that manages the system over the home network. The operations are, for example:

P-0050[0050] 1. Establish connection with remote boxes. This is different than above, as the central settop box “pings” the network <b>111</b> to find if any remote boxes have been powered up. It does this on a regular period, on the order of one second to one minute. It also establishes separate connections with each remote settop box, and maintains separate connection information. This supports multiple remote settop boxes in a home, since each may use different A/V equipment in the central location.

P-0051[0051] 2. De-code and parse information received on the network. Decode and parse routine <b>505</b> examines the header information <b>431</b>, and if a new IR signal is being started, creates buffer space for the receipt of the signal. The routine <b>505</b> examines the packet count <b>433</b>, and if packets are lost or received out of order, they are reordered properly in the buffer, or re-requested from the remote settop box. Routine <b>505</b> starts the signal processing and IR blaster after a minimum number of packets have been received. The central settop box waits for a few packets to arrive to ensure that the buffer <b>506</b> does not underflow during an IR event. In one embodiment, 4 packets is the minimum number of packets that are received and present in buffer <b>506</b> before processing begins. Buffering ends when the header <b>432</b> indicates the end of IR signal reception.

P-0052[0052] 3. Maintain separate buffers for each remote settop box. Semaphore control is maintained over the IR blaster <b>106</b> and signal processing. The IR blaster is a shared resource, so it is generally controlled carefully. When a network packet <b>430</b> is received from a remote settop box <b>101</b>, it requests a path through multiplexer <b>507</b> by setting a “semaphore” for its buffer. If a later network packet is received from a remote box <b>201</b>, the buffer <b>509</b> or <b>510</b> should fail to receive the semaphore and control over the IR blaster. Remote box <b>101</b> maintains control over the IR blaster through buffer <b>508</b> until the entire IR signal is received on the network, buffered, depacketized, and sent out the IR blaster output. Signals from other settop boxes can be held in buffers <b>509</b> and <b>510</b>. Further, there is generally a dead time on the order of 100 ms or more after remote box <b>101</b> finishes, before remote box <b>201</b> is allowed to gain the semaphore and buffer <b>509</b> or <b>510</b> is released to the IR blaster. This dead time allows the A/V equipment <b>107</b> to clearly delineate the end of the IR command, and not confuse the following signal with the previous signal. After this dead time, the buffered packets received from remote box <b>201</b> are processed and sent to the IR blaster. While any remote settop box has control of the semaphore and IR blaster, all other packets from other remote boxes are buffered up in the receive buffer <b>506</b>, but are not be processed. This ensures that a single IR signal is sent completely before another signal is sent in the event that multiple remote controls are used in different rooms at the same time.

P-0053[0053]FIG. 6 shows a “central decode and universal translate” device that can be used with the system shown in FIG. 3, for example. This device may have all of the functions of the central signal processor <b>501</b>, except instead of converting packets into IR signals, the converted packets are examined for header information that identifies the appropriate program source and remote for each packet. This device can be connected to network <b>111</b> at any convenient point through network interface <b>602</b>. The packets are then routed to the appropriate media source cluster <b>340</b>. This is possible since the central decoder <b>350</b> is made “aware” of which remotes are associated with each source via user input from interface <b>606</b>. A look-up table <b>650</b> correlates each remote <b>109</b> with each source <b>107</b> or media cluster <b>340</b>. Each packet is then appropriately addressed by re-packetizer <b>660</b> and sent back across the network <b>111</b>. By using this central universal translate, the “any to any” IR control shown in FIG. 7 can be accomplished.

P-0054[0054] While there may be other choices for sample rates, packet size, buffer models, these are easily changed in the implementation, and can be optimized for the best quality operation while utilizing the lowest bandwidth. Different systems may prefer higher noise immunity and trade off bandwidth if the system network <b>111</b> uses 100 Mbit Ethernet, while another system may sacrifice noise sensitivity for bandwidth if using 20 Mbit HPNA or 10 Mbit Ethernet.

P-0055[0055] Embodiments of the present invention are quite different than known systems that utilize convention radio retransmission of IR signals. Notably, the system described here has at least the following advantages:

P-0056[0056] Single network connection to systems already exists with the home network used to transmit digital video.

P-0057[0057] Minimal additional cost when integrated into a settop box.

P-0058[0058] Compatible with multiple remote controls operating simultaneously in a single home.

P-0059[0059] Not susceptible to radio interference from within the home, or from neighbors.

P-0060[0060] Compatible with multiple sources (multiple remote boxes) within a single home.

P-0061[0061] The foregoing description is representative, however variations will be apparent to those of skill in the art and the invention is in no way limited to the specific example described.