Camera for communication of streaming media to a remote client

<img file="ES2741016T3_D0001.tif" />

SPANISH OFFICE OF THE PATENTS AND BRAND

SPAIN lllllllllllllllllllllllllllllllllllllllllll © Publication number: 2 741 016 © Int. Cl .:

H04N 7/15

H04N 5/00 (2006.01) (2011.01)

TRANSLATION OF EUROPEAN PATENT

T3 © Date of submission and number of the international application: 07.10.2004 PCT / CA2004 / 001785 © Date and number of international publication: 14.04.2005 W005034505 © Date of submission and number of the European application: 07.10.2004 E 04789695 (6 ) © Date and publication number of the European concession: 08.05.2019 EP 1671480 © Title: Camera to communicate a continuous multimedia transmission to a Remote Client © Priority:

07.10.2003 US 508861 P

30.07.2004 US 592137 P © Date of publication and mention in BOPI of the © Owner / s:

LIBRESTREAM TECHNOLOGIES INC. (100.0%) Suite 110, 895 Waverley St.

Winnipeg, Manitoba R3T 5P4, CA © Inventor / es:

Patent translation:

07.02.2020

KAVANAGH, CHRISTOPHER T .; WIELER, CONWAY A .; MC CONNELL, ROBERT R .;

BRAUN, TIMOTHY N .;

FREILING, DONALD A .;

WOTHERSPOON, KENT D .; GILLANDERS, WILLIAM J. and THACHER, KERRY E.

© Agent / Representative:

ELZABURU, SLP

ES 2 741 016 T3

Notice: Within nine months from the date of publication in the European Patent Bulletin, of the mention of granting the European patent, any person may object to the European Patent Office to the granted patent. The opposition must be in writing and be motivated; It will only be considered as formulated once payment of the opposition fee has been made (art. 99.1 of the Convention on the Grant of European Patents).

ES 2 741 016 T3

DESCRIPTION

Camera to communicate a continuous multimedia transmission to a Remote Client

This invention relates to a device for use in multimedia streaming and is used in conjunction with compatible remote client devices to create a mobile conference system.

Background of the invention

Internet and several new technologies combine to allow communications anywhere, anytime. High-speed wireless data technologies, such as IEEE 802.11, allow people to stay in touch electronically, virtually anywhere in the world. With the current state of the art, it is possible for an individual to communicate with another individual or group, exchanging emails, using instant messaging services or having a conversation with Internet-enabled phones. With enough bandwidth, it is possible to send videos online.

Existing videoconferencing systems are beginning to exploit ubiquitous Internet connectivity instead of relying solely on ISDN or other forms of dedicated communication links. Conventional videoconferencing systems have been designed so that the material in question should be taken to the conference, for example, to a meeting room that has been equipped with a system or to a PC that has been equipped to function as a videoconferencing system. . In most cases, the material in question is an individual or group that wishes to communicate in real time with another individual or group. Some videoconferencing systems also include the ability to send images of small devices that can be placed near the videoconferencing equipment. These systems cannot be used in many scenarios, such as a production plant, a test laboratory or an inspection station where a reduced size and total mobility is required. However, it is valuable to be able to participate in a videoconference from these places.

Another alternative for these types of locations is a body or wearable computer system where an operator uses a head-mounted camera and microphone, which are connected to a body computer that can establish a communications session with a remote person. Currently, these systems have restricted functionality and their use is cumbersome in most circumstances. Most workers will find that the inconvenience of having to wear computer equipment decreases the value offered by these systems. As such, they are more suitable for specialized and somewhat exceptional circumstances.

What is needed is a multimedia streaming device that is truly portable, without cables of any kind, that can be used as easily and quickly as the phone, making the key difference the addition of a high quality video communication in real time. On the other hand, the portable device needs to incorporate the main functions of a traditional videoconferencing system in a small package, not very different from a traditional camera, which can be used practically from anywhere, whether outside or in an industrial environment As a production plant. This will allow the conference to be taken to the material in question, which will dramatically improve the usefulness of video-based communications.

Companies engaged in the development, manufacture and maintenance of expensive and complex products can take advantage of this system to reduce time to market and reduce the costs of developing new products. Numerous problems arise during the product development process that slow down or completely stop the process. What typically results in expired delivery dates and cost overruns. These results are serious, given the demand for rapid market implementation and the multi-million dollar costs associated with the development and introduction of many new products. A mobile collaboration system that can go where the problem is and provide video, audio and other real-time collaboration tools to remote experts from their PCs regardless of where they are, has the potential to significantly reduce the time and cost required to solve problems.

As an example, if you consider the scenario in which a multi-million dollar milling machine has broken. There could be a loss of revenue of hundreds of dollars per hour as a result of the breakdown of the machine. The internal technical support is not able to solve the problem and the owner of the grinding machine should call a technical expert of the machine manufacturer to make the repair. Technician availability, travel time and travel costs only amplify the problem. With a mobile video collaboration system, the house technician could take the digital camera to the grinding machine, get in touch with the manufacturer's technical expert in his central office via the Internet and have the expert guide him to Do the repair.

This scenario illustrates only one way in which this product can be used. Many other uses are possible.

Compendium of the invention

The invention is set forth in the claims.

According to a first aspect of the invention, an apparatus is provided comprising:

ES 2 741 016 T3 a Mobile Continuous Transmission Camera, operable by an Operator to communicate with a Remote Client that has:

a mobile camera housing;

a power supply battery mounted in the housing;

a camera module and lens for it mounted on the camera housing;

a video screen to show the operator video signals;

a manual control input for manual control by the operator of the camera module and the lens to generate video signals;

an audio output to provide audio and voice communications to the operator;

at least one audio input to receive audio and voice communications from the operator and the surroundings;

network connections for a wireless connection to a network;

a processing subsystem in the housing;

the processing subsystem being arranged to receive videos from the camera module and audio and voice communications from the audio input to compress the video, audio and voice;

the processing subsystem being arranged to provide communication protocols for the communication of video, audio and voice signals for real-time transmission to the network;

the processing subsystem being arranged to receive compressed video, audio and voice signals from the network and decompress the signals to display, in real time, the video signals on the screen and output the audio and voice to the operator;

the camera being arranged for communication with the remote client when the remote client has:

a video screen;

an audio output for audio and voice;

an audio input at least for voice;

a network connection for a network connection;

and a processing subsystem;

the processing subsystem of the remote client being arranged to receive compressed video, audio and voice signals from the camera unit over the network for decompression and real-time broadcast on the screen and audio output;

the processing subsystem being arranged to provide communications protocols of at least voice signals for real-time transmission to the network.

Preferably, the Mobile Continuous Transmission Camera is arranged to initiate, receive and participate in mobile voice and video calls, in real time, full duplex with the Remote Client.

Preferably, the Mobile Continuous Transmission Camera is arranged to initiate, receive and participate in a real-time, full-duplex mobile teleconference and video call with multiple Remote Clients through a connection to a Conference Server.

The Mobile Continuous Streaming Camera is arranged to distribute video streams to multiple Remote Clients through a connection with a Video Distribution Server.

The Mobile Continuous Transmission Camera is arranged to interact with a registration server and a Directory Server to establish the presence on the network and obtain information about the Remote Clients necessary to establish connections with them.

The Mobile Continuous Transmission Camera includes a touch panel superimposed on the video screen.

Preferably, the Mobile Continuous Transmission Camera includes interfaces for connecting to external audio, video and control sources through which the Mobile Continuous Transmission Camera can receive audios and videos supplied by external audios and videos.

ES 2 741 016 T3

The Mobile Continuous Transmission Camera includes a directional microphone to capture the audio of a subject and an omnidirectional microphone to capture the voice of the Operators.

Preferably, the Mobile Continuous Transmission Camera includes a speaker. Preferably, the Mobile Continuous Transmission Camera includes a connector for connecting a headset.

Preferably, the Mobile Continuous Transmission Camera includes a radio transceiver and an antenna to connect to a wireless headset.

Preferably, the Mobile Continuous Transmission Camera includes a radio transceiver and an antenna to connect to a wireless headset.

Preferably, the Mobile Continuous Transmission Camera includes a lighting system and wherein the device can control the brightness levels of the lighting by varying the power transferred to the elements of the lighting system, manually controlled by the operator and / or remotely by the Remote Client and / or automatically controlled by the device software.

Preferably, the automatic brightness control of the lighting system allows an on / off control with a preset control of the brightness level, as well as a continuous and variable brightness control, where the brightness level is calculated using the exposure parameters of the camera indicated by the camera's internal module.

Preferably, the Mobile Continuous Transmission Camera includes a Backlight for the video screen, where the brightness level of the Backlight can be controlled by adjusting the energy transferred to the backlight, so that the Operator can control the brightness levels manually to select the desired brightness level setting from a menu presented on the video screen and / or the device can automatically control the brightness levels by calculating the optimum brightness level using the camera exposure parameters indicated by the camera's internal module.

Preferably, the Mobile Continuous Transmission Camera is arranged to automatically select the appropriate bank or banks of lighting elements to turn them on based on the distance to the subject from the device, where the distance is calculated from the focus parameters indicated by The camera module.

Preferably, the video screen includes an overlay touch panel that is arranged to provide the operator with context-sensitive controls, status indicators and information about the device and its operations.

Preferably, the processing subsystem of the Mobile Continuous Transmission Camera is arranged to digitize the video signal and then compress it using a video compression algorithm.

Preferably, the processing subsystem of the Mobile Continuous Transmission Camera is arranged to capture individual video frames from the integrated video source in the camera or from a connected external source, and process them in image format.

Preferably, the processing subsystem of the Mobile Continuous Transmission Camera is arranged to digitize the audio and then compress it using an audio compression algorithm.

Preferably, the processing subsystem of the Mobile Continuous Transmission Camera is arranged to digitize the Operator's voice and compress it using a voice audio compression algorithm.

Preferably, the Mobile Continuous Transmission Camera includes a wired network interface.

Preferably, the Mobile Continuous Transmission Camera is arranged to transmit captured images to the Remote Client.

Preferably, the Mobile Continuous Transmission Camera is arranged to provide a full duplex telephone speaker phone feature, which uses echo cancellation, as well as an integrated speaker and voice microphone during VoIP communications.

Preferably, the Mobile Continuous Transmission Camera is arranged to allow the operator to monitor the raw video signal obtained from the camcorder on the video screen.

Preferably, the Mobile Continuous Transmission Camera is arranged to allow the operator to monitor the compressed video signal on the video screen.

Preferably, the Mobile Continuous Transmission Camera is arranged to allow the operator to simultaneously monitor the raw video from the camera module, the compressed video signal that is being sent to the Remote Client, the compressed video received from the Remote Client or its combinations in windows separated from the video screen.

Preferably, the Mobile Continuous Transmission Camera is arranged to allow the operator to monitor the

EN 2 741 016 T3 audio captured from a Directional Microphone using a connected headset.

Preferably, the processing subsystem of the Mobile Continuous Transmission Camera is arranged to store the transmission content and images in a memory device.

Preferably, the Mobile Continuous Transmission Camera is arranged to provide a feature that allows the Operator to leave a voice note of the content stored in a memory device of the Mobile Continuous Transmission Camera.

Preferably, the Mobile Continuous Transmission Camera is arranged to simultaneously do any combination of the following:

stream content continuously to the Remote Client;

receive and display the streaming content from the Remote Client, store the streaming content on a memory device;

allow the Operator to participate in a full-duplex video and voice call with the Remote Client;

and monitor the content of the continuous transmission of video and Audio that is being sent to the Remote Client.

Preferably, the Mobile Continuous Transmission Camera is arranged to recover the content stored in a memory device of the Mobile Continuous Transmission Camera and at the same time do any combination of the following:

transmit content stored continuously to the Remote Client;

receive and play streaming content from the Remote Client, allow an Operator to participate in a full-duplex video and voice call with the Remote Client;

and monitor the content of the streaming video and audio that is being sent to the Remote Client.

Preferably, the Mobile Continuous Transmission Camera is arranged to allow the operator to designate an area in the video image shown on the video screen that the device will use to calculate the camera's exposure control parameters.

Preferably, the Mobile Continuous Transmission Camera is arranged to provide a feature that allows the Operator to use an Optical Pen, the video screen and a Touch Panel associated with the video screen to remotely control a cursor on the video screen. of the Remote Client.

Preferably, the Mobile Continuous Transmission Camera is arranged to provide a feature that allows the operator to use an Optical Pen, the video screen and a Touch Panel associated with the video screen to draw images on top of the video being displayed on the Remote Client video screen.

Preferably, the Mobile Continuous Transmission Camera is arranged to allow the Remote Client, using pointing devices connected to the Remote Client, to control a cursor that is displayed on the video screen of the Mobile Continuous Transmission Camera and the Client video screen Remote.

Preferably, the Mobile Continuous Transmission Camera is arranged to allow the Remote Client, using a pointing device connected to the Remote Client, to draw images on top of the video that is being displayed on the video screen of the Mobile Continuous Transmission Camera and the screen Video of the Remote Client.

Preferably, the Mobile Continuous Transmission Camera is arranged to calculate the optimum ink color with the highest contrast that will be used to draw on the video screen of the Mobile Continuous Transmission Camera and the video screen of the Remote Client.

Preferably, the Mobile Continuous Transmission Camera is arranged to adapt to the available network bandwidth upon receiving the performance metrics of the Remote Client network and adjusting the multimedia continuous transmission parameters to optimize the use of the network.

Preferably, the Mobile Continuous Transmission Camera is arranged to encrypt all or part of the content transferred to the Remote Client using an encryption algorithm.

Preferably, the Mobile Continuous Transmission Camera is arranged to decrypt the encrypted content received from the Remote Client using an encryption algorithm.

Preferably, the Mobile Continuous Transmission Camera is arranged to provide a Control feature.

ES 2 741 016 T3

Remote that allows the Remote Client to control the functions of the Continuous Transmission Mobile Camera.

Preferably, the Mobile Continuous Transmission Camera is arranged to provide an interface to a docking station to acquire power to operate the device and charge the internal battery and where the device provides a Remote Locator function indicating a unique station ID. coupling to the Remote Client that it acquires from the docking station to which the device is attached.

Preferably, the Mobile Continuous Transmission Camera is arranged to overcome network access equipment / firewalls.

Preferably, the Mobile Continuous Transmission Camera is arranged to provide a telephony-like connection environment for the Operator and the Client in which the connection requests (calls) from one party to the other behave like telephone calls, so what:

The recipient of the call can answer the incoming call in several ways, but not limited to them, such as: automatically ignore, answer automatically, ask the Remote Client / Operator to answer / ignore manually.

In the event that the Remote Client / Operator has already established a connection with another Mobile Transmission Camera, the Remote Client will respond to this new connection request as busy.

The Remote Client and the Mobile Continuous Transmission Camera send audible and visual notifications to the Operator that the Mobile Continuous Transmission Camera is trying to connect.

In the event that a connection has not been established, the initiator (Operator or Remote Client) may leave a message consisting of a VoIP voice recording and / or an audio and video clip of the video in question for the recipient in the Mobile Transmission Camera / Remote Client.

Preferably, the Mobile Continuous Transmission Camera is arranged to calculate the distance in a straight line to the subject using optical parameters obtained from the camera module.

Therefore, the Mobile Continuous Transmission Camera is a generally camera-shaped device comprising a housing, a camcorder, a color screen, a Processing Subsystem and components, including a battery, an audio subsystem with a codec that interacts with speakers and microphones and / or a headphone interface, telephone software, audio compression / decompression software and hardware, video compression / decompression software and hardware, Echo cancellation software, an Ethernet interface, a radio and a power source that can accept power from an AC adapter or battery, which combine to convert the sounds and images of a subject into audio and video signals suitable for its distribution through a network using an Internet Protocol. This device has the following features and advantages:

it has a network connectivity that uses an Internet protocol that allows sounds and video information to be captured and shared immediately with other people who have a network connection, including those with Internet access;

provides telephony functionality so that device operators can be in voice contact with others who have a network connection, including those with Internet access;

The integration of the provision of wireless networks allows mobile device operators to be in constant communication with other people who have a network / Internet connection.

Brief description of the drawings

Figure 1 is a Basic System Diagram illustrating the general basic system and how this invention relates to said system.

Figure 2 is a CMT Block Diagram detailing the various functional blocks of the Mobile Continuous Transmission Camera (CMT).

Figure 3 is a rear view of the CMT, and of the Controls showing a representative rear view of the CMT device and associated controls.

Figure 4 is a Front / Top View, and of the Controls showing front and top views representative of the CMT and its associated controls.

Figure 5 is a Complete System Block Diagram illustrating a complete system that incorporates all system components.

Detailed description

The mobile videoconferencing system (SVCM) comprises a Mobile Continuous Transmission Camera (CMT) 100/500,

ES 2 741 016 T3 a Remote Client (CR) 110/510, a Registration Server 104/504, a Directory Server 108/508, a Video Distribution Server 502 and a Voice Conference Server 506 as illustrated in Figure 1 and Figure 5. The following paragraphs describe the purpose / functionality of each.

Remote Client

Remote Client 110 consists of a computer platform with a display and a microphone / speaker system, such as a Personal Computer (PC) or a Personal Digital Assistant (PDA) or a smartphone or a CMT, an operating system such as Windows XP ® , Linux, Windows CE or PocketPC or other specialized application software. The CR allows a CR (Client) user to collaborate with a CMT (Operator) user.

Registry Server

The Registration Server 104 consists of a computer platform, such as a Personal Computer (PC), an operating system such as Windows XP® or Linux or another and a registration software such as one provided with a SIP Registrar. The Registry Server provides optional control and system access functions for the SVCM.

Directory Server

The Directory Server consists of a computer platform such as a PC, an operating system such as Windows XP® or Linux or other directory services of Lightweight Directory Access Protocol (LDAP) or equivalent.

Video Distribution Server

The Video Distribution Server consists of a computer platform such as a PC, an operating system such as Windows XP® or Linux or another and works to reformat and distribute continuous streaming of videos and audios in a matter of a CMT to multiple CRs.

Voice Conferencing Server

The Voice Conference Server consists of a computer platform, such as a PC, an operating system such as Windows XP® or Linux or another and works to combine and distribute voice data to each participant of a conference call by an SVCM.

Mobile Continuous Transmission Camera (CMT)

The basic CMT consists of a camera-shaped housing that contains a Camera Module 200, two Integrated Microphones 230/269, an Integrated Speaker 233, a Liquid Crystal Display (LCD) 254; a Touch Panel 253, Buttons and Indicators 255 with Light Emitting Diodes (LEDs) and other components, as illustrated in Figure 2, which are combined to; convert the video images in question captured by the Camera Module 200 and the audio in question captured by the Integrated Microphones 231/269 so that they are suitable for transmission to a CR 110 and; Provide real-time Voice over IP (VoIP), full duplex and video communications between the Operator and the Client.

The CMT Processing Subsystem 213 consists of a microprocessor 235, a Synchronous Dynamic Random Access Memory (SDRAM) and a flash memory 265, I / O Circuits, a coprocessor of the Digital Signal Processor (DSP) 266, embedded Linux or other operating systems such as Microsoft Windows CE.Net, Microsoft Pocket PC, Symbian, Palm OS and, custom SVCM software. The Processing Subsystem 213 of the CMT provides computationally intensive compression and decompression functions for video, audio and voice, the communication functions with the network necessary for the CMT 100 to transmit continuous content efficiently through IP networks and , a User Interface (UI) and local I / O processing functions for the CMT.

The CMT has a Camera Module 200 to capture the video in question. The Camera Module 200 allows the CMT to be used for detailed inspection work approaching a distance of up to 1 cm, as well as longer focal lengths for a clear view of distant objects. The Video Output of the camera is formatted as an analog S-Video 201 of 768 pixels horizontally by 494 pixels vertically. The Camera Module 200 allows control of its operating parameters through a VISCA Interface 262 or an equivalent interface. Through the VISCA 262 Interface, the CMT can control and obtain the status of the camera parameters, such as Zoom, zoom speed, Digital Zoom, Manual / Auto Focus, Focus speed, Auto Exposure modes, location of Exposure screen, White Balance modes, Aperture / Diaphragm settings, Shutter speed, Gain, Backlight, Mirror Image, Memory Presets, Screen Display Content, Key Lock, camera ID and On / Off.

The CMT has a 254 LCD screen with integral Backlight. LCD 254 is used to display videos and images to the Operator and to present control and status information to the Operator. The integral Backlight is provided to improve the display capacity of the 254 LCD screen in dim light conditions.

ES 2 741 016 T3

The CMT has a Display Controller 212 that converts the digital pixel data received from the CMT Processing Subsystem through a mini-PCI or equivalent interface 263 and / or the Video A / D converter 202 through a CCIR -601 or an equivalent interface 203 on the signals necessary to activate the LCD screen 254.

The CMT has a Touch Panel. The Touch Panel 253 is superimposed on top of the LCD screen 254 and provides a touch sensitive surface on which the operator can interact with the information presented on the LCD screen 254.

The CMT 100 has an integrated 218 Ethernet interface. The CMT 100 can be connected to the Network by connecting a standard Ethernet cable to its RJ45 219 Ethernet connector.

The CMT 100 has an integrated Broadband Radio Data Transmission 221 and a corresponding Antenna 222. The CMT 100 can connect wirelessly to the Network through this radio. Broadband radio transmissions used by the CMT conform to the mini-PCI standard and connect to the CMT Processing Subsystem 213 via an internal PCI 220 bus. The types of broadband radio transmission supported by the CMT include, but are not limited to, 802.11, 802.16, 3G and / or 4G mobile systems.

The CMT 100 has an integrated directional microphone 230 to capture the audio in question associated with the video in question.

The CMT 100 has an integrated omnidirectional microphone 269 that is used to capture the Operator's voice during VoIP telephony calls in speakerphone mode with the Client.

The CMT 100 has a built-in speaker 233 to play the audio associated with the prerecorded video being played and to play the Customer's voice audio during VoIP communications in speaker mode.

An external Headset 228 can be connected to the CMT 100 via the Audio Jack 227 that replaces the Integrated Speaker and the integrated omnidirectional Microphone 269 for VoIP communications and the Integrated Speaker for audio playback.

The CMT 100 has a USB Host interface 130/259 to connect the CMT 100 to selected client devices. The USB connection to the CMT 100 is made by connecting a standard USB AB cable to connector 260 of the CMT receptacle A.

The CMT 100 has an External Optical Lighting System 261 to improve lighting conditions in situations that justify it. The lighting is provided by one or more white LED banks or equivalent lighting system, controlled by the CMT Processing Subsystem 213. An LED bench is positioned to provide uniform illumination for distant objects. A second LED bench is positioned to provide lighting for nearby objects.

The power is supplied by an internal rechargeable battery pack 252, through an external power that is supplied to the CMT 100 by connecting an AC / DC converter 132/247 to the power connector 249 or by external power supplied to the CMT 100 a through a Power over Ethernet (POE) interface via the 219 Ethernet interface. The power supply of the CMT 251 automatically switches to external power when the adapter is connected and recharges the internal battery 252.

The CMT 100 has a 239 tripod mount to connect a 136/240 camera tripod. Tripod mount 239 can also be used to connect other mounting devices to the CMT, such as a magnetic mount, to facilitate secure attachment to non-planar surfaces.

In the CMT 100, physical buttons with touch feedback and soft buttons implemented with the 253/322 Touch Panel are superimposed on the 254/322 LCD screen, to allow the operator to control the camera's functions. 300 Power On / Off buttons, On / Off Menu 302, On / Off Screen Display 304, Start / Stop Recording 306, Start / Stop Play / Start Transmission 308, On / Off Screen Light are provided LCD 310, On / Off Manual Focus 312, Input / Output Manual Focus-Zoom Camera 320, Start / Stop Transmission 400 and, Freeze Frame 402. The physical buttons are interconnected with the CMT Processing Subsystem 213 through discrete I / O circuits 255. Resistive Touch Panel 253/322 is superimposed on the 254/322 LCD screen. The Operator can use a 324 stylus and / or finger to interact with the buttons and menus drawn on the 254/322 LCD screen below the 253/322 Touch Panel.

The CMT 100 provides audible alerts to the Operator. Audible alerts are provided, but not limited to, for functions such as Start / Stop Transmission, Start / Stop Recording, Still Image Capture, VoIP Call Ringing, Busy VoIP Call, Connection Status Changes Network, indication of low file system memory, low battery indication.

The CMT 100 has dedicated Operator Indicators for Transmission Status 314, Charge / Energy Status 316 and Network Connection Status 318. These are interconnected with the Processing Subsystem 213 of the CMT

EN 2 741 016 T3 via discrete I / O circuits 255. The LCD 254/322, together with the Display Controller 212 and the CMT Processing Subsystem 213 are used to show additional visual indicators to an operator.

The CMT 100 has a Secure Digital 257 interface, or another interface such as Compact Flash, to install 258 portable memory cards in the CMT: The installed memory cards are used to load / download CMT 100 configuration data, to update the software on the CMT 100 and for recording and / or playing videos, audios and images.

Functioning

The SVCM provides a means for the user of a CMT (Operator) and the user of the CR (Client) to communicate and collaborate remotely. The video and audio in question captured by the CMT are digitally processed and transmitted in real time (transmission) to a CR 110, where the CR 110 processes it for the Customer to see and hear (respectively). Voice communications between the Operator and the Client are provided by a full-duplex Voice over Internet Protocol (VoIP) communications channel between the CMT and the CR. A Registry Server 104 function and a Directory Server 108 function are used to authenticate and manage access to the system from the Operator / CMT and the Client / CR. Video, audio and voice are transmitted and control information is transferred, between CMT, CR and servers, using the Internet Protocol (IP) through an interconnection:

• Local Area Network (LAN);

• Wireless Local Area Network (WLAN);

• Wireless Wide Area Network (WWAN);

• Internet: or;

• any combination thereof.

For the purposes of this document, this interconnection network is called Network.

The SVCM uses a variety of standard network communication protocols to implement the control and continuous transmission functionality. The following list details the main protocols used in an SVCM implementation:

• Session initiation, control and termination are performed using the Session Initiation Protocol (SIP) and Session Description Protocol (SDP);

• VoIP streams can be either unicast or multicast and are encapsulated in Real Time Transport Protocol (RTP) packets;

• Audio / video streams can be either unicast or multicast and are encapsulated in RTP packets;

• The Real-time Transport Control Protocol (RTCP) is used to monitor the supply of real-time flows in order to allow adjustments to maintain optimum quality;

• Application and data sharing (remote control, image sharing, etc.) uses standard T.120 protocols.

These protocols will be used throughout the remainder of this patent in order to clearly describe the operation of the SVCM. However, other protocols can be used.

The Operator / CMT 100 and the Client / CR 110 log into the system using a secure connection to the Registration Server 104 through the Network 102/112/114/116. The CMT 100 and / or the CR 110 pass the information on the username and password to the Registration Server 104 to verify their identity. The SIP Registration Server 104 in turn uses an LDAP or an equivalent Directory Server 108 to validate the information about the username and password passed to it. If valid, access is granted and information about the IP address / Port and the presence information of the Operator / CMT and / or Client / CR are updated in the Directory Server databases 108.

To initiate a connection (call) with a CR / Client, the Operator, using the display and control features provided by the CMT, enters the information about the IP address / Port of the CR / Client in the CMT. The CMT uses a SIP (RFC3261) to establish a connection with that IP address / Port and to negotiate the communication characteristics using the Session Description Protocol (RFC2327) or similar. Alternatively, the Operator can select the name of a CR / Client from a list stored in the CMT that associates the names with the IP address / Port. Alternatively, the Operator can access a list of CR / Client names and associated IP / Port address information from Directory Server 108 through the Network.

ES 2 741 016 T3

CR can respond to the incoming connection request in several ways, but not limited to them, such as: automatically ignore, respond automatically, ask Customer to answer / ignore manually. In the event that the CR / Client has already established a connection with another CMT, the CR will respond to this new connection request indicating that it is busy. The CR sends audible and visual notifications to the Client and the CMT to the Operator that the CMT is trying to connect. In the event that the CMT cannot establish a connection with the CR, a feature is provided that allows the Operator to leave a message consisting of a VoIP voice recording and / or a recording of the audio and video in question in the CR .

To initiate a connection with a CMT / Operator the Client, using the visualization and control features provided by the CR, enters the information about the IP address / Port of the CMT / Operator in the CR. The CR uses SIP (RFC3261) to establish a connection with that IP address / port and negotiate the communication characteristics through the Session Description Protocol (RFC2327) or similar. Alternatively, the Client can select a CMT / Operator name from a list stored in the CR that associates the names with the IP address / port. Alternatively, the Client can access a list of CMT / Operator names and associated information about the IP address / port from Directory Server 108 through the Network. The CMT can respond to the incoming connection request in several ways, but not limited to them, such as: automatically ignore, automatically respond, ask the Operator to answer / ignore manually. In the event that the CMT / Operator has already established a connection with another CR, the CMT will respond to this new connection request indicating that it is busy. The CR sends audible and visual notifications to the Client and the CMT to the Operator that the CR tries to connect. In the event that the CR cannot establish a connection with the CMT, the provision is provided to allow the Operator to leave a message consisting of a VoIP voice recording and / or a recording of the audio and video in question in the CMT .

The CMT's video capability allows an Operator to transmit the video captured by the CMT 100 to CR 110 over the Network while watching the video locally on the LCD 254.

With the CMT on, the Video captured by the Camera Module 200 is continuously supplied to the A / D Video converter 202 in analog S-Video format 201. The A / D Video converter 202 converts the analog video into data of pixels of digital video. This digital video pixel data is then sent to Display Controller 212 and Video Compression Engine 205 via a CCIR0601 or equivalent interfaces 203 and 204 (respectively).

The Video Compression Engine compresses the digital video pixel data, received from the A / D Video Converter 202, to a highly compressed format using CODECS such as MPEG-4, Windows Media, Real or H.264. Compressed digital video pixel data is collected in packages, marked over time and then supplied to the Processing Subsystem 213 of the cMt through a USB interface 217.

The Multimedia Continuous Transmission Server, implemented in a software within the Processing Sub-System 213 of the CMT receives the compressed digital video pixel data packets from the Video Compression Engine 205 and gives them a format according to the requirements of the protocols of real-time transport, such as RFC3016 (MPEG-4 A / V transmission over RTP). When the Operator presses and releases the Start / Stop Button 400 of Continuous Transmission, the CMT Multimedia Continuous Transmission Server opens a real-time transport session with CR 110, negotiates mutually compatible CODECS for video and audio in question and sends the formatted video packets to CR 110 through that session via the Network.

The Display Controller 212, under the control of the Processing Subsystem 213 of the CMT, uses the digital video pixel data received directly from the A / D Converter 202 to provide the Operator with a Video Viewer feature. To achieve this, the Display Controller 212 formats the received digital video pixel data, through its temporary storage, decimation, fragmentation, clipping and color conversion and then displays the video on the LCD screen 254 generating the signals to activate it . Using the control functions provided by the CMT, the Operator can control the decimation, fragmentation and trimming operations to adjust the viewfinder image size and to digitally enlarge a part of the video.

The video rendering of the CMT is improved by providing a connector 206 and interface circuits for routing the SVideo 201 from the Internal Module of the Camera 200 to an external monitor 207. This feature allows an external monitor to be used, when connected via a standard S-video cable, to see the video signal of the CMT. This feature is used, for example, in situations where the LCD screen is not visible to the Operator or in situations where a physically larger image is desired.

The CMT's video performance is improved by providing a connector and interface circuits to accept an S-Video from an external camcorder when connected with a standard S-Video cable. When this feature is enabled, the A / D Video Converter 202 and the Video Compression Engine 205 process the video from the External Video Input Interface 208 instead of the internal Camera Module 200.

The CMT's video performance is enhanced by a Video Monitor Mode that allows you to view digitally compressed digital video pixel data packets on LCD 254 in parallel to its transmission to CR 110. This allows the Operator to view the video as seen by the Client. The Video Monitor mode is obtained

ES 2 741 016 T3 via the CMT Processing Subsystem 213 that unpacks and decompresses the data packets received from the Video Compression Engine 205 back into digital video pixel data and routes the pixels to the Display Controller 212 to its display on the 254 LCD screen.

The CMT's video performance is improved by allowing the operator to use Touch Panel 253 and Optical Pen 264 to designate the location within the video image in question that Camera Module 200 will use for exposure control. This feature uses the camera's spot exposure mode along with the 254 LCD screen, the 253 Touch Panel and the 264 Optical Pen. When the LCD screen shows the video of the Viewfinder, or that of the Video Monitor, or both, the operator touches the surface of the Touch Panel 253 with the Optical Pen 264 on the point inside the video image to be used. for exposure control processing. The CMT Processing Subsystem 213 calculates the touch location of the screen and forwards this data to Camera Block 200 through the VISCA 262 interface. The Camera Block 200 then uses the designated area to optimize the exposure parameters.

The video rendering of the CMT is improved by allowing the CMT 100 to receive the video in question from the CR 110 or compatible device and display it on the LCD 254. This video session is initiated by the client / CR 110 and is established using the same real-time protocols as those used to allow CMT 100 to stream videos to CR 110 and use the same compression CODECS, MPEG4, Real, Windows Media, H.264. The CR 110 compressed video packets received by the Processing Subsystem 213 of the CMT of the CR 110 over the Network are decompressed into compressed digital video pixel data packets. The CMT Processing Subsystem 213 then decompresses the compressed digital video pixel data packets into digital video pixel data using the negotiated Codec and sends the data to Display Controller 212 for formatting and display on LCD screen 254 .

The CMT video feature allows the LCD 254 to display the Viewer video, the Video of the Video Monitor, the video of the CR 110 or combinations thereof simultaneously in separate windows.

The subject's lighting can be improved using the CMT Lighting System 261. The brightness level of the Lighting System 261 can be controlled by the Operator, by the Client through the remote control functions of the CR 110 and, automatically by the CMT control software. Using the control software, the CMT calculates the ambient lighting conditions using the exposure parameters indicated by the Camera Module 200, which include, but is not limited to, the diaphragm, shutter speed and gain, and adjusts the light output of the 261 External Optical Lighting system to maintain the minimum acceptable ambient light conditions. This algorithm allows the on / off control together with a preset brightness level control, as well as a continuous and variable light output control. Similarly, using the focal length information provided by the Camera Module 200, the CMT software will turn on the LED banks that best fit the distance at which the object is away from the camera.

The CMT allows the client, using a mouse or other pointing device connected to the CR 110, to control a cursor shown on the LCD 254. This feature allows the Client to point to elements within the video that is being displayed on the LCD 254. This feature is further improved by allowing the Customer to draw images on the video that is being displayed on the LCD 254. Conversely, this feature allows the Operator to use the Touch Panel 253 and the Optical Pen 264 to remotely control a cursor on the CR screen and allows the Operator to draw images on the CMT video that is being displayed on CR 110 .

The CMT's audio capability allows the CMT 100 to transmit digital audio associated with the captured video to a CR 110 over the Network. The CMT 100 maintains temporary synchronization between the audio and video streams.

The audio captured by the Integrated Directional Microphone 230 is sent in analog format to the Audio Codec Subsystem 214, where it is converted in real time to digital audio data of Coded Pulse Modulation (MIC). This MIC digital audio data is transferred to the Video Compression Engine 205 through an I2S 216 serial interface. The Video Compression Engine 205 collects the MIC digital audio data received in packets and synchronizes them temporarily with the compressed digital video using a time stamp and then sends the synchronized MIC digital audio data packets to the Processing Subsystem 213 of the CMT through a USB 217 interface.

The CMT Processing Subsystem 213 compresses the MIC digital audio data received from the Video Compression Engine 205 in MPEG-1 Layer 3 audio (MP3) or AAC or other video-compatible audio compression format. The Multimedia Continuous Transmission Server, implemented in the software within the Processing Subsystem 213 of the CMT, then formats it as required by real-time transport session protocols, such as RFC3016 (MPEG4 A / V transmissions over rTp) . When an Operator presses and releases the Start / Stop Button 400 of Continuous Transmission, the CMT Multimedia Continuous Transmission Server opens a real-time transport session with the CR 110 over the Network and sends the audio packets with Customer format through that session.

The CMT's audio performance is improved by providing a connector and interface circuits to accept External Audio 263 from an external camcorder or other external microphone source, when connected with a power cable.

EN 2 741 016 T3 standard RCA Jack audio to External Audio Input interface 264. When enabled, External Audio 263 is processed as the audio in question instead of the Audio of the Integrated Directional Microphone 230.

The CMT allows the Operator to listen to the audio in question that the CMT is capturing and transmitting to the Client / CR. By listening to the audio in question, the Operator can control the quality of the audio that is being transmitted to the Client / CR. This is called Audio Monitor. The Audio Monitor Mode is implemented by the Processing Subsystem 213 of the CMT and causes the audio from the source of the Integrated Directional Microphone 230 or the External Audio 263 to be directed to a connected Headset 228/229. The Audio Monitor Mode is controlled by the Operator using the display and control functions provided by the CMT. Through these controls, the Operator can choose between listening; only Customer VoIP Audio; only to the Audio in Question or; Both mixed together.

The CMT's audio performance is improved by allowing the CMT 100 to receive the audio in question from the CR 110 or a compatible device and send it to speaker 253. This audio session is initiated by the Client / CR 110 and is established using the same real-time protocols as those used to allow CMT 100 to transmit audios to CR 110, and use the same compression CODECS, (MP3, AAC). Compressed audio packets received by the CMT Processing Subsystem 213 from the CR 110 over the network are unpacked and decompressed using the negotiated CODEC. The CMT Processing Subsystem 213 then transmits them to the Audio Codec Subsystem 214 through the I2S 215 interface. The Audio Codec Subsystem 214 converts the received MIC digital audio data into an analog signal, filters them, amplifies them and directs them to the Integrated Speaker 233 and / or the speaker of a connected Headset 228.

The voice provision of the CMT allows an Operator to initiate or receive a VoIP phone call with a Client, while the CMT 100 is transmitting a video, audio and images to the CR 110 over the Network. The call is established using the Session Initiation Protocol (SIP). The Operator uses a Headset 228 connected through the Jack 227 audio jack or the CMT telephone speaker feature for VoIP phone calls. The speakerphone feature of the phone uses the Integrated Omnidirectional Microphone 269 and the Integrated Speaker 233 together with the echo cancellation software running on the CMT Processing Subsystem 213 to provide a hands-free, full-duplex operation.

The audio microphone of an external Headset 228, connected through the Audio Jack 227, is supplied in analog format to the Audio Codec Subsystem 214, where it is converted in real time to digital audio data of Coded Pulse Modulation (MIC ). The MIC digital audio data is then transferred to the Processing Subsystem 213 of the CMT through the I2S 215 interface.

Audio from the Integrated Omnidirectional Microphone 269 is sent in analog format to the Audio Codec Subsystem 214, where it is converted to digital audio data in real time in (MIC) Coded Pulse Modulation. The MIC digital audio data is then transferred to the Processing Subsystem 213 of the CMT through the I2S 215 interface.

The CMT Processing Subsystem 213 receives MIC digital audio data from the Omnidirectional Microphone 230 and the Headset Microphone 228 directly from the Audio Codec Subsystem 214 through an I2S 215 interface. The Processing Subsystem 213 of the CMT performs Echo cancellation operations on this data and then compress them using a CODEC such as G.711, G.723, G.729, GSM or other appropriate CODECS for VoIP. This compressed voice data is then formatted in packets and transmitted to a CR 110 over the Network.

The CMT Processing Subsystem 213 unpacks and decompresses the VoIP data packets received from the CR 110 over the Network into MIC digital audio data using the appropriate CODEC, such as G.711, G.723, G.729, GSM or other. The CMT Processing Subsystem 213 then transmits them to the Audio Codec Subsystem 214 through the I2S 215 interface. The Audio Codec Subsystem 214 converts the received MIC digital audio data into an analog signal, filters them, amplifies them and directs them to the Integrated Speaker 233 and / or the speaker of a connected Headset 228.

The audio capabilities of the CMT are improved by separately processing the audio in question and the voice audio of the Operator with the Processing Subsystem 213 of the CMT. By processing and transmitting these sources separately, the Client can control the CR 110 to reproduce only the audio in question, only the Operator VoIP audio or the two mixed audio sources.

The audio and voice capabilities of the CMT 100 are improved by allowing the use of a Wireless Headset 229 instead of a set of wired headphones 228. The CMT 100 provides a digital radio in the 900 MHz ISM band 224, or other equivalent radio system and an Antenna 225 to send / receive MIC digital audio data to / from a compatible Wireless Headset 229. When the wireless headset function is enabled, the MIC digital audio data is routed from the Audio Codec Subsystem 214 to the digital radio link 224/225 of the 900 MHz ISM band through a bi-directional I2S serial interface 223 where modulates and transmits to an associated wireless headset 229. Similarly, the MIC digital audio data demodulated by the digital radio link 224/225 of the 900 MHz ISM band from the wireless headset 229 is directed to the Audio Codec Subsystem

ES 2 741 016 T3

214 through the I2S 223 interface.

The provision of wireless headphones is improved by providing multiple independent two-way radio channels to eliminate interference between the placed SVCM systems and their associated wireless headphones.

Two embodiments of the Wireless Headset 229 are provided. The first version incorporates the digital radio and the power supply battery in the headset. The second version uses a small, wearable module (Adapter) to house the digital radio and the power supply battery. An external connector is provided on the Adapter to allow connection of compatible wired headphones, allowing a wider selection of headphones to be used while maintaining a wireless connection between the Operator and the CMT 100.

The video, audio and voice performance of the CMT 100 is improved due to its provision to adapt to the available network bandwidth and the reliability between it and the CR 110. This is achieved by the CR 110 that collects and indicates the metrics of session performance, on the end-to-end network connection between it and CMT 100 and back to CMT 100 using the Real-time Transport Control Protocol (RTCP (RFC1889)) or a similar protocol. The indicated metrics include, but are not limited to, the lost packet rate, packet latency and packet fluctuation. Using this indicated data, the CMT 100 adjusts the parameters of the video, audio and voice data streams according to a predefined algorithm to optimize the quality supplied to the CR 110 for the available connection.

The video, audio and voice capabilities of the CMT 100 are enhanced by allowing compressed audio and voice video streams to be stored in the CMT local file storage system 265 and / or in the portable memory cards installed 258 and / or in the USB memory modules connected through the USB Host interface 259/260 and / or in a storage center 150 of the Network File System (NFS). This feature works independently of the transmission from CMT 100 to CR 110. Files are automatically named and can be renamed manually if desired. The files are automatically labeled with information such as the date, time, coding information and the identities of the Operator, the Client and the CMT that were involved in the session. The Operator can add description text of the file and a voice recording note to each item stored.

The CMT's video capability is enhanced by allowing an operator to capture still images (photos) of the video stream and store them on local file system 265 or on an installed portable memory card 258 and / or transmit them to CR 110 The files are named automatically and can be renamed manually if desired. The files are automatically labeled with information such as the date, time, coding information and the identities of the Operator, the Client and the CMT that were involved in the session. The Operator can add description text of the file and a voice recording note to each item stored. The images are captured by the Operator by pressing and releasing the Freeze Image 402 button. In association with this action, the CMT 100 will capture the next video frame provided by the camera, produce an audible alert, such as the sound of a camera's shutter to indicate that an image has been captured, will give the image a JPEG format, TIFF, BMP or other image format and will show the captured image to the Operator on LCD 254. The CMT 100 will then provide the operator with options to save the images, transmit the image to a Remote Client 110 or discard the image.

The video, audio and voice capabilities of the CMT 100 are enhanced by allowing video, audio, voice and images stored on the local CMT file storage system 265 or on a portable 258 memory card installed or in modules USB memory connected via the USB Host interface 259/260 or in a storage center of the Network File System (NFS) 150 can be retrieved and replayed on CMT 100 and / or continuously transmitted to CR 110 . This content can be played, paused, rewound, searched, stopped and advanced quickly with Buttons 255 and 300 through 312 and Touch Panel 253/322 provided on the device. The CMT Processing Subsystem 213 acquires the data from the storage medium, decompresses the formats and sends them to the Display Controller 212, which in turn displays them on the LCD 254. At the same time, the Processing Subsystem 213 of the CMT can transfer the data from the storage medium to a CR 110. The recovery of stored transmissions is facilitated through a file viewer application running in the Processing Subsystem 213 of the CMT and presents a display on the LCD 254. The file viewer function shows the file name, file properties and thumbnail images for each item stored on the LCD 254. The file viewer function provides the ability to play any associated voice memo through the Speaker. 233 Integrated or Headphones 228 and 229.

The video, audio and voice features of the CMT 100 are enhanced by allowing video, audio, voice and images to be encrypted before transmitting them to a CR 110. This feature is used in situations where secure video streaming is required. , audio and voice. In this mode, the Processing Subsystem 213 of the CMT encrypts the transport packets before providing them to the function of the multimedia streaming server. The CMT 213 processing subsystem uses the Data Encryption Standard (DES), Triple DESC Cryptographic Algorithms (3DES) or the Advanced Encryption Standard (AES) for this purpose.

ES 2 741 016 T3

A backlight is provided to improve the display capacity of the LCD screen in low light conditions. The Backlight of the LCD screen can be adjusted using the CMT software and electronics. The CMT software allows the operator to manually control the brightness level by selecting the desired level in a menu displayed on the LCD 254 or automatically using the exposure settings indicated by the camera module, such as, but not limited to the diaphragm, shutter speed and gain. Using these settings, the CMT calculates ambient light levels and adjusts the brightness of the backlight to match those conditions.

The remote control can be applied to the CMT 100 from a CR 110 by communicating commands to the CMT 100 through the Network or from a central computer through the USB Host interface. A CR can use this feature to configure key CMT 100 compression parameters, which include: - audio and video codec selection, audio format, video size, frame rate, video bit rate, key interval frames, buffer size, video smoothness, decoder complexity, clipping method, deinterlacing processing, reverse telecine processing, pixel format, timecode generation and packet size. The CR can also use this feature to control the functions of continuous transmission of live and stored content, including: - Start / Stop / Pause Transmission, Start / Stop Recording, Rewind, Move Backward, Move Forward, Fast Forward, Tele Zoom, Wide Zoom, Manual Focus On / Off, Input / Output Focus, Still Image Capture.

Connecting the CMT 100 to a keyboard through the USB Host 259/260 interface allows the camera operator to locally control all aspects of the operation and configuration of the CMT. The connection of the CMT 100 to a USB memory module client via USB Host 259/260 allows configuration data to be loaded into the device, to transmit content continuously to the memory module for storage and to reproduce previously stored content. The USB Host 259/260 interface of the device also provides the ability to connect to remote control devices, such as a motorized tripod 240, which gives CMT 100 and CR 110 the ability to control the physical orientation of the device.

The CMT 100 provides an interface 244 to an external Docking Station 241 that allows the CMT 100 to obtain DC power 242 and information on a unique serial number 243 from the Docking Station 241. The DC power 245 is sent to the CMT power supply and is used to run the CMT 100 and charge the internal battery. The unique serial number information from a Docking Station 241 is used to help locate the device. This is achieved using a docking station of a fixed, known location. A CMT 100 indicating a serial number of a docking station to a CR 110 implies that the CMT 100 is in the same location as the docking station. The unique serial number information of the Docking Station 243 is read by the Processing Subsystem 213 of the CMT. The CMT Processing Subsystem 213 transmits this information to a CR 110 over the network.

The CMT 100 provides a feature for measuring the straight line distance between the CMT 100 and the subject using the focus information provided by the Camera Module 200. Using the focal length and aperture data received from the Camera Module 200, the Processing Subsystem (213) of the CMT calculates an estimate of the average distance to the subject and makes this data available on the LCD 254 and for the CR 210.

The CMT 500 improves by allowing multiple CR 510s to interact at the same time with a single CMT 500. CR 510 can watch the video and listen to the audio transmitted continuously by the CMT 500, can remotely control the CMT 500 and can participate in a VoIP teleconference session with the cMt 500.

Video and audio support for multiple CR 510s is achieved by adding the 502 Video Distribution Server feature. The 502 Video Distribution Server works in conjunction with a 504 Registration Server to establish Audio and Video sessions SIP between the CMT 500 and the CR 510 participants. Once the sessions are established, the CMT 500 transmits the best quality video and audio streams to the 502 Video Distribution Server, which in turn distributes the transmissions to each CR 510. Each CR 510 can control the selection of the audio and video codec, audio format, video size, frame rate, video bit rate, keyframe interval, buffer size, video smoothness, decoder complexity, method of clipping, deinterlacing processing, reverse telecine processing, pixel format, time code generation and packet size of the streams presented by the 502 Video Distribution Server. This is achieved through the software running on the Video Distribution Server that decodes the best quality streams received from the CMT 100 and re-encodes them according to the characteristics established by each CR 510. The Video Distribution Server then it transmits the video streams recoded to the CR 510 through the Network.

A VoIP Teleconference feature is provided in multiple CR situations using a 506 Voice Conferencing Server feature. Conference Server 506 works together with a Registration Server 504 to establish a SIP voice session between CMT 100 and CR 510. Once a session is established, each participant (CMT 100 and CR 510) compresses the audio from their microphone, using a previously negotiated VoIP CODEC and transmits it to the 506 Voice Conference Server over the Network. The Conference Conferencing Server Voice receives these VoIP input streams through its network interface, decodes and normalizes each one creating MIC digital voice audio streams. Create unique VoIP output data streams to be transmitted back to each

EN 2 741 016 T3 participant by adding the MIC digital voice audio input streams of each participant other than the one to which the transmission is being sent. A flow of this type is created for each participant. Each stream is then compressed using a previously negotiated VoIP CODEC and transmitted to the target participant as VoIP data streams through the Network.

The Video Distribution and VoIP Teleconferencing capabilities are enhanced by their ability to adapt to the bandwidth available between them and the CR 510 and between them and the CMT 500. Each CR 510 collects and reports to Servers performance statistics about of the end-to-end network connection between him and the Servers. Similarly, the Servers in turn indicate to the CMT 500 the performance metrics of the end-to-end network connection between them and the CMT 500. The indicated metrics include, but are not limited to, the 10 packet rate lost, packet latency and packet fluctuation. Using these indicated data, the Servers and the CMT 500 then adjust their data flow parameters for video, audio and voice according to a predefined algorithm to optimize the quality supplied to the CR and the servers (respectively), for the available connection.

ES 2 741 016 T3