Wireless display with multiscreen service

Wireless display with multi-screen services {WIRELESS DISPLAY WITH MULTISCREEN SERVICE}

This application, in January 2012 six-pending US Provisional Application No. 61/583 987 calls to date, and in February 2012 the claims of U.S. Provisional Application of Article 61/599 564 call to a priority application in a 16-day, are the entire contents of these provisional application It is included by reference.

The present invention is, for the transmission of the techniques, and more specifically, from a wireless source device, the wireless sink (sink) the media data to the device, and the wireless client device to transmit data between a wireless source device and the other wireless device will.

The wireless display (WD), or WI-FI display (WFD) systems include a wireless source device and a sink device or greater. Each of the source device and the sink device may be mobile devices or wired devices with wireless communication capabilities. A source device and a sink device, one or more than one of, for example, mobile telephones, portable computers having wireless communication cards, personal digital assistant (PDA) s, portable media players, or so-called "smart" phones and "smart" pads, or other such devices having wireless communication capabilities, including the tablet, or may include other types of wireless communication device. A source device and a sink device, one or more than one of also including television communication capabilities, desktop computers, monitors, and may include wired devices such as projectors.

The source device sends the media data such as audio-video (AV) data in one or more than one of the sink devices participating in a specific media sharing session. Media data may be played back on each display two or all of the display of the local display of the source device and the sink device. More specifically, each of the sink device are joined, the received media data to be rendered on the screen and their audio equipment.

Server computing device also may provide the media item to the client device using various media sharing protocol. Client devices, the server computing device may be the play command issue (issue). In response to receiving the play command, the server, for example, may be transmitted using streaming media items in the client device.

The present invention generally describes a system, where the first wireless computing device is configured as a wireless source device may communicate with the second wireless computing device configured as a wireless sink device, and a wireless client computing device. As part of the communication session, the wireless source device may transmit the audio and video data to a wireless sink device, the wireless sink device may send back to the wireless source device, the user input received from a wireless sink device. Wireless source device also may execute the first wireless computing device with a wireless client computing device, media sharing applications, which makes it possible to share a playlist of media items between. A wireless client computing device, a wireless client computing device may determine whether to output the one media item. The first wireless computing device, may receive media playback commands from a wireless client computing device, or may be in response to the reproduction command transmission of media items on a wireless client computing device.

In one example, the invention describes a method for transmitting contents of the first wireless computing device to the second wireless computing device, the method, on the first wireless computing device, WI-FI display (WFD) initiating a connection a step, on the first wireless computing device, the method comprising: first through WFD connection from the mobile computing device transmits data to the second wireless computing device, on the first wireless computing device, the first wireless computing device, a wireless client computing executing the media sharing applications to share the media items on the device with a play list, the method comprising: on the first wireless computing device, sending the information describing the media items of the playlist to a wireless client computing device, a media item the step of transmitting information describing causing a wireless client computing device, a wireless client computing device is also to determine whether to output the media item -, and on the first wireless computing device, a media item wireless client computing and a step of sending to the device.

In another example, the present invention describes the first wireless computing device, the device comprises a second start a WI-FI display (WFD) connection to the wireless computing device and, through the WFD connection from the first wireless computing device of claim 2, the wireless computing device to adapted to transmit the data WI-FI display (WFD) module, a first wireless computing device running the media sharing applications to share the media items of a wireless client computing device, and the play list and the play list transmission of the information describing the media items on a wireless client computing device, and - the transmission of the information describing the media item, causing a wireless client computing device, referred to determine whether a wireless client computing device to output the media item - , and include a media item media sharing module configured to transmit a wireless client computing device.

In another example, the present invention describes the first wireless computing device, the device, WI-FI display of the second wireless computing device (WFD) means for initiating a connection, the second wireless computing device via the WFD connection means for transmitting data to the wireless first means for executing a wireless computing device, the media sharing applications to share the media items of a wireless client computing device, and the play list, the information describing the media items of the playlist means for transmitting to the client computing device, means for sending the information describing the media item, causing a wireless client computing device, a wireless client computing device is also to determine whether to output the media item -, and media items a means for sending to the wireless client computing devices.

In another embodiment, the present invention is a computer-readable storage medium will be described. Computer-in-readable medium are instructions are stored, and that the instructions, when executed, one or cause the processors of the excess, and the second to initiate a WI-FI display (WFD) connection to the wireless computing device, first through WFD connection from the mobile computing device and to transmit data to the second wireless computing device, the first wireless computing device to run the media sharing applications to share the media items of a wireless client computing device, and the play list and to send information that describes the format of the media item in the playlist to a wireless client computing device, and - the transmission of the information describing the media item causing a wireless client computing device, a wireless client computing device to output the media item must determine if it can -, and transmits the media items on a wireless client computing device.

Figure 1a is a block diagram illustrating a system including the capital source / sink device and the server device to implement the techniques of this invention. Figure 1b is a block diagram showing an example of a system including a source device and a client device. Figure 1c is a block diagram showing an example of a system including a source device and a sink device, and the client device. Figure 2a is a schematic diagram illustrating a play list of media items. Figure 2b is a schematic diagram showing a play list containing the media items. Figure 2c and 2d are the conceptual diagrams showing two examples of media items associated with the characteristics and values ​​of. 3 is a conceptual diagram showing an example of a communication based on the model. Figure 4 is a block diagram showing an example of a video and / or source devices that may implement the techniques to be transmitted to the application data sink device. 5 is a block diagram showing an example of a sink device for implementing the technology for receiving video and / or other information from a source device. Figure 6 is a block diagram showing the transmitter and receiver systems, that may implement the techniques of the present invention. Figure 7a and 7b illustrate exemplary message delivery sequence for performing the display, WI-FI (WFD) ability consultation. 8 is a flow chart illustrating a method for performing the WFD according to the teachings of the invention and transmission of media items.

WI-FI display (WFD) may be used in a variety of applications to support the transmission of content over the air. As an example, in (the "source", referred to as) from the mobile device is a mobile computing device, such as telephones, tablets, smart phones, or as a portable personal information terminal (PDA), ("sink (s)" and "clients" It is referred to) the other device to enable the WFD video content, or other application may be used to transmit data over the air. Video content, or other application data may be transmitted from the source, received by the sink ones can be output by the output device the one or more of the sync.

In the present invention, the term source devices generally, either the client device or the sink device refers to a device for transmitting the media data. As will be described in more detail below, the term sink device in general, receives the media data from a source device, and at the same time refers to the device for rendering the same content as the media source device. The term client device is typically referred to a device for receiving media data from the source device but, unlike the sink device, the client device is not at the same time to render the same content as the media source device. For example, even if the source device itself does not render the movie data or audio data, the source device may stream video data or audio data to the client device. The terms source device, sink device and a client device in general, referred to the operating status of a particular device. Thus, a device may be a source device and a sink device, or any device of the client device, in some examples may serve at the same time as the device type of even more than one. For example, a particular device may be a client device for a single device, and may be the source device to the other device.

In one example, if the user enters a proximity to support WI-FI communication, the user of the mobile source device may execute the media sharing application on the source device. Media sharing applications, WI-FI allow the user to the one or more of the client devices that are equipped, WI-FI reporting the shared media items on the source device through streaming, to listen to, and / or viewing (View) You may choose the content. Media sharing applications, the source device also includes contacts (contact) to share access with WFD- compatible sink device, or any other application data in the source device may be connected to the WFD WFD- compatible sink device have.

Media sharing applications for streaming to the users of client device that may run the client application to communicate with the media sharing applications, audio, video, image (picture) presented the play list the one or more of the media items, such as the You may. Users can choose to play media items from the play list of the client device. In some instances, and the client device and the media sharing applications are also consult each other, the devices can only media items in the playlist that can be output to indicate. Users of a client device may select one or more than that for the reproduction of the media item.

Source computing devices may share a Universal Plug and Play play list using the one or more protocols such as the protocol (UPnP),. Client devices, by using the RTSP (Real Time Streaming Protocol) protocol and the like may request a stream of one or more than that of the selected media item playlist. One or in response to receiving a request for a media item that exceeds the source device uses the real-time transport protocol (RTP) with the same protocol, may be streamed to the client device requests the requested item.

If the source device is entering close enough to support wireless communication through a WI-FI, the user of the source device may launch a media sharing applications (launch). The application may initiate the WFD session that may be configured as a mobile device WFD source. Source device by communication with the sink device and a wireless WFD- compatible, ("sink" or "sink device" as referred to) may be connected with WFD- compatible devices. WFD sink device by the user of the sink device, the pre-authentication mechanism can be used a few to ensure that authorized to access the sink device, such as a shared key, or authorization system.

Source devices, client devices, and a sink device, DVD players, comprise a TV, MP3 players, laptops, tablet s, netbooks, and / or a WI-FI-enabled devices, such as other devices may. In some instances, a client device and / or a sink device may be integrated in a car. In other instances, the client device and / or the sink device may belong to the user, or may be portable.

In an exemplary user environment, smart phones, and can also operate as a wireless source device, the media data may be transmitted to the passengers in the vehicle. Vehicles, for example, the driver may comprise a wireless sink device in the dashboard (dashboard) or control panel to secure the viewing a map application, or other such content while driving. Motors may also include the one or more client devices in addition. For example, they are on the inside of the back seat passenger in the back seat, may be viewing the movie stored on a smart phone may be able to listen to the music stored on a smart phone. For purposes of description and illustration, but certain aspects of the invention may be described in the user environment of the car, the technique of the present invention are not limited to any particular user environment.

WFD connection between the source device and the sink device may also allow sharing of application data. In various instances, the application data may comprise the contact, the calendar event, the music stored on the source device, any other application data which may be user wishes to have access to navigation data, or the source device. In addition to providing application data to enable the device of WFD- of the vehicle, the source device also may perform screen mirror (mirroring) of the sink device in accordance with the WFD draft standard is currently under development. When performing the mirror, the display of a source device in a sink device to be transmitted in real time, and the sink device and the source device to be synchronized.

WFD mirroring refers to the device that transmits the image data from the source to the sink device, the sink device displays the transmitted image data in real time. Between the source and the sink, in addition to transmitting the image data, WFD also using UIBC (user input back channel), as described below, the source device has passed the input command to the sink device, the sink device, the sink sending the input command from the source. In one example, the sink device may also be received through the play list of media items WFD. Sink device may receive user input command for selecting a media item for playback, the user input command can be transmitted to the source device. In response to receiving the media command, the source device may transmit the requested media item to the sink device.

In the context of the present invention, WFD sink device may include one or processors of the excess, memory, one or a storage device of the excess, and the input and / or output devices, WI-FI communication are wireless modules . As described above, when the source device is connected to the sink device, the sink device may display an interface of the source device. And a sink device is a device of the vehicle, in the example, the source device is a device which the driver of the vehicle, the sink device may comprise a larger screen than the source device. This, in turn, can be beneficial from the safety point of view for the driver. By using the integrated (built-in) the output device of the vehicle as a wireless sink device, the driver can be avoided to turn the eye from the road to view the display of the source device.

In various instances, the user of the sink device may issue a user input command to the source device. In some instances, the commands are input to a mouse click, scrolling actions, keystrokes, or may comprise any other type of user input. An input device in the sink, for example, in some instances may also include a touch screen and / or voice command system via Bluetooth.

In response to receiving the user input, the sink device may transmit the user input back to the source device via the data connection UIBC between the source and the sink. In response to receiving user input from a sink device, the source device as a response to the scrolling operation, mouse and / or receiving a keyboard input, or a voice command, accepting user input, and may take an action.

In the user interface of the automobile, a driver may use a sink device in a variety of ways to interact with the content of the source device. In various examples, and the user may interact with the sink device, the interaction of the source device to make a call, access contact information, change the music selection, and accesses the calendar and / or scheduling of data, access to the Internet, and , access to the navigation data and / or service, or may perform other operations. Additionally, in some instances, various input and output of the source device may be redirected to the various devices connected to the sink device. For example, the operator places a call, the driver can call to the one or more microphones that may be connected to the sink device in order to facilitate ease of dialing. Additionally, audio from the telephone, in order to provide a better audio call quality and convenience to the driver taking, from a source device, or may be redirected through the speakers of the vehicle is connected to the sink device.

As described above, the user of the client device may also access the content from the source device via the media sharing applications. In one example, the user of the client device (for example, a passenger in the back seat) before it can access the content on the source device, the user of the source device (e.g., a driver) is the play list of the user of the client device It may be set up for. Playlists may also include a variety of media which may be selected to report that the user of the client device and / or listening. Playlist for example, for various compressed, which may be displayed by the output device of the client device, video files, audio files, images, or may comprise any other content. A plurality of output devices, for example, a number of WI-FI- with client devices, may be connected at the same time to share the application of media source device, the source device to each client device a number of concurrent media streams It may be transmitted. In this manner, each user of the client device may be able to simultaneously access to different media items in accordance with each user's preference.

Using the touch screen display, mouse, keyboard input and output devices, the one or more client devices, such as, a user of the wireless client device can be connected via a WI-FI media sharing application running on the source device. In some instances, WI-FI connection may be set up using the WI-FI direct (direct). In another example, the car may be provided a wireless network that may be the source device and the client devices may have access, the source and the client device and the data from the transmission device. In some instances, the client devices are WI-FI module, a processor, memory, storage, and may also include additional input device, the one or more, the user may choose the media from the play list of the source device, .

Once the user of the client device, selecting one or more than those of the media items from the play list, the source device may initiate a streaming to the client device via a WI-FI connection to the selected media item. After closing the media items to be played back until the playlist is completed, the next media item from the playlist could be streamed to output device. In some instances, the user of the client device may use a user input on the client device to select a different media item from the media server from the source device. User to control the media of the play list on the client device, a "start", "stop", it is also possible to perform the additional reproduction command, such as "Fast-forwarding".

Figure 1a is a diagram illustrating an exemplary system 100 that may implement the present invention has been described block. As shown in Figure 1a, system 100 includes a sink device 160 is in communication with the source device 120 via the communication channel 150. Source device 120 may comprise a netbook, a tablet, a smart phone, PDA, or any similar mobile device, such as devices that can support the WFD. The source device 120 is referred to as audio / video (A / V) memory for storing data 121, display 122, speaker 123, an audio / video encoder 124 (also, the encoder 124, Has), it may include a audio / video control module 125, and a transmitter / receiver (TX / RX) (126). Sink device 160 has a display 162, a speaker 163, an audio / video decoder 164 (and the decoder 164 to refer to search), a transmitter / receiver unit 166, a user input (UI) device ( 167), and it may also include a user input processing module (UIPM) (168) a. Illustrated components constitutes only one exemplary configuration for the system 100. Other configurations are, or may include fewer components than those shown, and may include additional components other than the illustrated ones.

In the example of Figure 1a, the audio portion of the source device 120, a display 122 on the can display the video of the audio / video data 121, the speaker 123 on the audio / video data (121) and can output. Audio / video data 121, a file server, a Blu-ray disc, or on the source device 120 is accessed from an external storage medium such as a DVD may be stored locally. In some examples, the audio / video data (121), telephone, audio, or video may be captured in real-time through the camera and microphone in the source device 120 to be captured or played through the audio system of the vehicle. Audio / video data 121 of a movie, but also include multimedia content such as television shows, or music, real-time content is generated by the source device 120 may also include. Such real-time content, for example, may be generated by applications running on the source device (120). As will be described in further detail below, in some examples, in such real-time content is some instances, it may also include a video frame of the user input options are available for user selection. In some examples, the audio / video data 121 may include an overlay (overlay) the same user input options and the video frames of a movie or TV show having, coupling the video frame of the content of different types to the frame of the video may.

Display 122 and through the speaker 123, in addition to locally rendering the audio / video data 121, audio / video encoder 124 of source device 120 is an audio / video data (121) can be encoded, the transmitter / receiver unit 126 may transmit the encoded data to the sink device 160 via the communication channel 150. Sink device 160 may include a device that includes a touch screen display that may be mounted in a convenient location on the vehicle to the operator interaction. Receives a transmitter / receiver unit 166 is the encrypted data of the driver sink device 160, audio / video decoder 164 decodes the encoded data, displays the decoded data 162 and the speaker 163 and it outputs through. In this way, the audio and video data is rendered by a display 122 and a speaker 123 may be rendered at the same time by the display 162 and speaker 163. Audio data and video data may be arranged in frames, audio frames and video frames if the rendering time - can also be synchronized.

Audio / video encoder 124 and the audio / video decoder 164 to MPEG-4, Part 10, AVC (Advanced Video Coding) as referred to in the alternative, the ITU-T H.264 standard, or the H.265 standard, often appeared newly referred HEVC (high efficiency video coding) may implement the audio and video compression standards, such as standards of any number. Generally speaking, the audio / video decoder 164 is configured to perform the inverse operation of encoding an audio / video encoder 124,. Although not shown in FIG. 1A, in some aspects, A / V encoder 124, and A / V decoder 164, each of which may be integrated with an audio encoder and decoder, the common data stream or in a separate data stream to handle encoding of both audio and video of the two may also include appropriate MUX-DEMUX units, or other hardware and software.

As will be described in more detail below, A / V encoder 124 also has, in addition to implementing the video compression standard, such as described above it may perform different encoding. For example, A / V encoder 124 may also add various types of metadata to the A / V data 121 before being sent to the A / V data 121, the sink device 160. In some examples, A / V data 121 may be stored in the source device 120 in encoded form, or received from the source device 120, and thus, an additional compression of the A / V encoder 124 It may not require a.

Figure 1a is shown a communication channel 150 for transporting the audio payload data and the video payload data separately, but appreciated that in some examples, the video payload data and audio payload data that may be part of a common data stream, will. If applicable, MUX-DEMUX units, ITU H.223 multiplexer protocol may conform to, or User Datagram Protocol (UDP), different protocol, such as. Audio / video encoder 124 and the audio / video decoder 164 each includes one or microprocessors of the excess, a digital signal processor (DSP) s, application specific integrated circuit (ASIC), field programmable gate array (FPGA) to, discrete logic, software, hardware, may be implemented as firmware or any combination thereof. Audio / video encoder 124 and the audio / video decoder 164, each of which may be included in the encoder or decoder, the one or more, and any one of them to be integrated as part of a combined encoder / decoder (CODEC) may.

Display 122 and display 162 is a cathode ray tube (CRT), liquid crystal display (LCD), a plasma display, an organic light emitting diode (OLED) display, or any of the devices of a variety of video output devices, such as other type of display device It may include. Speaker 123 is a headphone, Single-speaker system, the multi-device may comprise any of a variety of audio output device such as a speaker system or surround sound system. Additionally, a display 122 and a speaker 123 are shown as part of the source device 120, the display 162 and speaker 163 are shown as part of the sink device 160, source device 120 and a sink device 160 may be of virtually system device. By way of example, display 162 may be a television, a speaker 163 may be a surround sound system, the decoder 164 is an external box connected to a display 162 and a speaker 163 in a wired or wireless It may be a part. In other examples, sink device 160 may be a single device, such as a tablet computer or a smart phone. In still other cases, the operator device 160 and the sink device 120 is also deulil similar device, for example, is both a smart phones, tablet computers, and the like. In this case, a device may operate as source and the other is can act as a sink. These roles may be reversed even in the subsequent communication session.

Transmitter / receiver unit 126 and the transmitter receiver unit 166. Each of the various mixers, filters, as well as other components designed for amplifiers and signal modulation, one or transmit antennas and the data of the out and It may comprise other components designed to receive. Communication channel 150, generally, from the source device 120 to sink device 160, the set of any suitable communication medium, or a different communication medium for transmitting the video data. Communication channel 150 typically, WI-FI, a relatively short-range communication channel such as Bluetooth similar. However, the communication channel 150 is not necessarily limited to this aspect, a radio frequency (RF) spectrum or one or a physical transmission line in the excess, or wireless, and any wired or wireless, such as any combination of wired media It may include communication media. In other instances, the communication channel 150 is even, a wired or wireless local area network, wide area network, or global network such as the Internet, such as a packet-based network may form part. Additionally, the communication channel 150 is a peer-to-may be used by the source device 120 and sink device 160 to generate a peer link. The source device 120 and sink device 160 using a communication protocol such as the IEEE 802.11 standard from the family of standards, and may communicate over the communication channel 150. While the techniques of this invention are often described to be WI-FI, aspects of the techniques are also contemplated that may be compatible with other communications protocol.

In addition to decoding and rendering of the data received from the source device 120, the sync device 160 also may receive user input from a user input device (167). User input device 167 is, for example, a keyboard, a mouse, trackball, or trackpad, a touch screen, voice command recognition module may be, or any other such user input devices. UIPM (168) is, the user input command received by the user input device 167, the source device 120 is formatted as a data packet structure that may be interpreted. Such data packets are transmitted by the transmitter / receiver 166 to the source device 120 through the communication channel 150. Transmitter / receiver unit 126 receives the data packet, A / V control module 125, and parsing (parse) the data packets to interpret the user input command was received by the user input device 167.

Additionally, the user of the sink device 160, for example, the passenger or the driver may be able to launch and control applications on the source device (120). For example, the user, the source device 120, launch a photo editing or navigation application stored on the source device 120 can use the application to edit the stored images locally on the sink device 160 There may be. Sink device 160, but is in fact on the source picture editing device 120, the user experience photo feel reported and edited locally on the sink device 160 may be presented to the user. Using such a configuration, the device user may be able to leverage (leverage) the ability of a device for use with a number of devices. For example, source device 120 may be a smart sulfonyl having a large amount of memory and the high end (high end) processing capability, the user of the source device 120, all the settings of the smart phone are normally used, and a smart phone can be used in situations. When you want to view the movie, the user may want to view a movie on a device having a larger display screen, in this case, the sink device 160 may be a tablet computer. When sending an email, or wants to respond to the e-mail, the user may want to use the device with the keyboard, in this case, the sink device 160 may be a laptop. In the context of the both, even when a user is interacting with a tablet computer or laptop, and most processing may be still carried out by the source device 120 (in this example, a smart phone). Since the bulk of processing is performed by the source device 120 and sink device 160 has fewer resources than those who received the sink device 160 to effect performed processed by the request source device (120), It may be a device having a lower cost.

In some configurations, A / V control module 125 may be an operating system process to be executed by the operating system of the source device 120,. However, in other configurations, A / V control module 125 may be a software process of an application running on the source device (120). In one example, A / V control module 125 may include a media server and a media streaming WFD as WIFI. In such a configuration, the user input command in may be interpreted by a software process, the operating system and is executing on the source device 120. In contrast, user applications and directly running on the source device 120 of the sink device 160 to interact. The operating system, as opposed to the direct application by the interaction, the user of the sink device 160 may have access to a library of non-unique command to the operating system of the source device 120,. Additionally, it is to interact directly with the application may be able to more easily commands are to be sent and processed by the device to run on the different platform.

The source device 120 can respond to user input applied to a wireless sink device 160. In such an interactive (interactive) application settings, user input is applied to a wireless sink device 160 may be sent back to the wireless display source over a communication channel 150. In one example, a reverse (reverse) channel architecture, referred to also as UIBC (user interface fack channel) so as to be able to sink device 160 is transmitted to the source device 120, a user input applied to the sink device 160, It may be implemented. It may comprise a reverse channel architecture lower layer frames to consult the user interface capabilities from the higher layer messages, and the sink device 160 and source device 120 for transferring a user input. UIBC may reside on the Internet Protocol (IP) transport layer between the sink device 160 and source device 120,. In this manner, UIBC may be on the transport layer in the OSI (Open System Interconnection) communication model. In one embodiment, the communication includes seven layers of OSI (1-physical, data link 2, 3 Network, 4-transport, session 5, 6 present, and the 7-application). In this example, the transport layer is present on the layers 5, 6, and 7 refer to. In order to facilitate the reliable transmission, and in the sequential transmission of the data packet containing the user-entered data, UIBC, the Transmission Control Protocol / Internet Protocol (TCP / IP) or User Datagram Protocol (UDP), such as different packet- It may be configured to run on top of the underlying communication protocol.

In some cases, source device 120, and a mismatch between a user input interface located in the sink device 160 may be present. In order to facilitate a good user experience, and under such circumstances to address the potential problems created by such a mismatch, before setting up the communication session, a user input interface capability consult the source device 120 and sink device (160 ) it can occur between.

UIBC is, cross-platform (cross-platform) may be designed to deliver various types of user input data including the user-entered data. For example, the source device 120 is iOS<img id="i0001" he="5" wi="5" file="pct00001.tif" img-format="tif" /> But also to drive the operating system, sink device 160 Android<img id="i0002" he="5" wi="5" file="pct00002.jpg" img-format="jpg" /> Or Windows<img id="i0003" he="5" wi="5" file="pct00003.jpg" img-format="jpg" />Other operating systems, such as drives. Without platform related, UIPM (168) is, may be in a form understandable to the user input received A / V control module 125 encapsulating (encapsulate). Source and sink devices of many different types of cars in order to take advantage of the protocol, a number of user input, different types of formats may also be supported by the UIBC. Generic (generic) may be input formats are defined, the platform, and a specific input formats may be both support and, therefore, the user input is a source device 120 and sink device 160 such a way that it can be communicated by the UIBC between to provide a diplexer scalability (flexibility).

In one example, the sink device 160 may set the source device 120 and the WFD connection, the source device 120, information describing the media item the one or more of the playlist sync device 160 It may be sent to. Playlist and media items in more detail below, for example, is described in Figure 2a-2d. Sink device 160, the sink device 160 may determine whether to output the one media item. Sink device 160 may output the play list, or may receive a user input selection of media items of that excess. Sink device 160 may transmit a selection of media items in the source device 120, the source device 120 (e. G., Streaming) transmitted to the sink device 120, the selected media item can be .

In the example of Figure 1a, source device 120 may include any other device capable of transmitting a smart phone, a tablet computer, a laptop computer, a desktop computer, WI-FI-enabled television, or audio and video data have. Similarly, the sink device 160 is a smart phone, a tablet computer, a laptop computer, a desktop computer, WI-FI-enabled television, or audio, and receive video data and to receive user input data, any other device It may comprise. In some examples, sink device 160, a display 162, a speaker (163), UI device 167, and the A / V encoder 164 may comprise a system of devices, such as, all of which are a separate part, but are interoperable devices. Similarly, the source device 120 may be the system of devices rather than a single device.

For the present invention, the term source device is typically used to refer to a device that transmits the audio / video data, the term sink device is typically used to refer to a device that receives the audio / video data from the source device, . In many cases, a source device 120 and sink device 160 may deulil similar or identical devices, one device operates as the source, and the other is acting as a sink. In addition, these roles may be reversed in a different communication session. Therefore, a sink device in a communication session may be a source device in a subsequent communication session, it may be vice versa.

Figure 1b is a block diagram illustrating a system that may implement comprising, a source device and a client device, the techniques of the invention. In the system of Figure 1b, the source device 120 may communicate with the client device 180 over the communication channel 152. The client device 180 and the sink device 160 may be the same or may be different device device. Communication channel 152 may comprise a wireless communication channel is similar as WI-FI. The source device 120, a set of UPnP protocols, UDP, using protocols such as the one or more RTSP and / or RTP may communicate with client device 180 through the communication channel 152. In some instances, UPnP, UDP, RTSP, and / or not using the RTP streaming data to the source device 120 from client device 180, source device 120 and client device 180 is a reduced power and also to transmit the content item to the consumer, it is also possible to use different protocols, such as WFD requires less computational complexity as compared to transmitting the media item.

Source device 120 may share a playlist available in the devices of the one or more than one or greater, and as the client device 180. Source device 120 may be transmitted further to the client device 180, information describing the at least one media item in the playlist. Transmission of information allows the client device 180, may determine whether the wireless client device 180 can not output the at least one media item. The user may request one or the media item of the one or more than one of the play list from the driver source device 180 of the client device 180. In response to receiving a request for one or the media item of the excess, source device 120 may be streamed or sent to the requested media item client device 180, client device 180 is requested of media items it can be output on an output device such as a display 182 and / or speaker (183).

The source device 120 of Figure 1b may be the same as the source driver 120 in FIG. 1A. Source device 120 includes a display 122, an audio-visual data 121, a speaker 123, an audio / video controller 125, an audio / video encoder 124, and to a transmitting / receiving unit 126 may. Client device 180 may be similar or identical to the sink device 160 of Figure 1a. Client device 180 is an audio / video decoder 184, a display 182, speakers 183, user input device 187, and may include a transmission / reception unit 186.

Audio / video control unit 125, using one or more than processors of the source device 120 and may be configured to run the media sharing application 128. In some instances, the media application 128 may be part of an operating system or a stand-alone application on the source device (120). Media sharing application 128 may determine the one or more play lists to share with the client computing device, such as a client computing device 180. The media items of the playlist are, hard drives, flash memory, and / or may be stored in a local storage including a peripheral device connected to the source device (120). Additionally, the media items of the playlist may be accessed remotely by the source device 120. Example of what such a remotely accessible may comprise media items stored on the media items, streaming video, or file stored on a server cloud.

The user of the driver source device in response to launching the media sharing application 128, a media sharing application 128 may also broadcast the play list to client device 180, such as one or a client device of the excess . In some instances, media sharing applications 128 may also use one or more than one of the protocols of the UPnP protocol, a set of broadcasting the play list. Although described with respect to UPnP, the media sharing application 128 may be any mechanism that is compatible with a wireless communication protocol to broadcast the play list to client devices such as client device 180,. The source device 120 using protocols Simple Service Discovery Protocol (SSDP) of UPnP to provide for the service discovery of devices on the network, the own service (that is, the driver source device stream by using the RTSP and RTP the disclosure may provide) services. As used in the SSDP Discovery Protocol is merely just one example, a non-to be considered as limiting. Set of Universal Datagram Protocol (UDP), Bonjour (BONJOUR), the Service Location Protocol (SLP), Web Services Dynamic Navigation (WS-Search), and the zero-configuration networking (zeroconf) such as other protocols and protocol also, client devices may be able to browse the streaming service provided by the source device 120. In the example of the source device 120 uses UDP for transmitting the play list, the client device 180, client device the one or more, such as are to also listen to the play list is sent by the source device 120 , source device 120 may transmit the play list using a particular port, a broadcast address or a well-known multicast address.

Client device 180 may be similar to the sink device 160 of Figure 1a, may include a mobile computing device such as a tablet, PDA, a laptop, a netbook, DVD player, or other computing device. The user of the client device 180 may be able to launch a client application (185). The client application 185 may receive disclose the one or more from the media sharing applications (1280 across a communication channel 152, in response to receiving the disclosure, the media sharing application 128 is the announcement message may be parsed, and media sharing applications may determine the services provided. In some instances, a client device 180, media sharing application 128 is, for example, RTSP and / or by using the RTP media stream and the play list may be determined that provides the ability to share.

Service Disclosure received by the client application 185 may also, the play list the one or more of the media items, or a URL, such as the network path, the one or the resource location that includes a play list of the excess of media items for it may also include a link. If the link to the play list included in the service disclosure, client application 185 may also retrieve the shared playlist by the media sharing application 128 from the position.

One or more than that of each of the play list may include a list of one or more than that of the media items that can be streamed to client device 180 from the operating unit 120, a. Each playlist also includes one or access to the users of the excess may include a user identifier that may be used to be limited to the specific play list. Each play list can also include the one or more attributes for each of the one or more media items. Properties in general, as a few examples, the name of each media item, the length, resolution, frame rate, profile, level, bit rate, and / or may include information such as the file format. Attribute of the play list and the media items are described in more detail with respect to Figure 2a-2d.

One or upon receiving the play list of the excess, the client application 185 may output the play list to the user of the client device 180 having a display 182. Display 182, a cathode ray tube (CRT), liquid crystal display (LCD), a plasma display, an organic light emitting diode (OLED) display, or other type of display device, such as a wide range of video output devices of any device for containing to be have. Client device 180 may receive user inputs to select one of the playlists of the user input devices (187). The user input device 187 is, for example, a keyboard, a mouse, trackball, or trackpad, a touch screen, voice command recognition module may be, or any other such user input devices.

In response to receiving the play list, the client application 185, which media items of the playlist that may determine if the number to be output by the client device 180, a display 182 by using a client device (180 ) it may present the media item that may be output by the client device 180 to the user's. To determine if the client device 180 is any media items to play any of the, the client application 185 is in the installed codecs, digital rights management (DRM) capability, and / or client device 180 Contact the operating system to the hardware capabilities (query) and also, the play list may be compared to the ability of the characteristic information of the client device 180 included in the media item of the playlist and.

The client application 185, a media item from the selected play list in the client device 180 can not reproduce, it is also possible to use the display 182 is displayed to the user of the client device 180. You may select the one or more media items from the play list for playback the user using the user input device 187, the client device 180. In response to receiving the selection of the media items in the one or more client application 185 may generate a playback request for one of the transmission / reception unit 186, the selected media item. In some instances, the playback request, the source device 120 to play the selected media item may be a request to perform pause, stop, record and so on. Transmission / reception unit 186 may transmit the request to the selected media item to a transmission / reception unit 126 over a communication channel 152.

When the user of the client device 180, select a plurality of media items from the play list, the client application 185 may also issue a playback request for a first media item of the selected media item, and the other of the selected media item In also requests for enqueue (enqueue), once the reproduction of the first media item is completed, the requesting client application 185 for one of the enqueue media item for playback and streaming the requested media item, and , all media items are requested, and incubated until the stream, and repeats the enqueue request and streaming media items to process.

In one example, client device 180 may be connected to the source using the WFD connection device 120. If the client device 180 is rendered by the client device 180, (e.g., graphics surfaces), display information showing the play list, and may receive one or play list of the excess are one or further it includes the media items of the excess. Client device 180 may use the display 182 outputs display information to the user of the client device 180, the user of one or for playback by using the UI (187) of the client device 180 You may select a media item in excess. In one example, client device 180 may receive the play list containing information describing the one or more media items using the WFD connection. The UI (187) receives a user input command for selecting one of the media items, or more than, and transmits to the source device 120 through a UIBC.

In response to receiving one or from the client device 180 for the media items of the excess RTSP PLAY request or UIBC user input command such as a request or a media playback command, the media sharing application 128, the transmission / reception may allow unit 126 may be configured to stream the requested media item. In some instances, the transmission / reception unit 126 may also configure the RTP session to the stream of media items. Transmission / reception unit 126, the client device 180 and may establish a RTP session, may transmit a stream of the media item in the transmission / reception unit 186 over a communication channel 152. In the example described above, the client device 180 receives the information about the play list from the WFD connection, using UIBC when transmitting the selected media item, the source device 120 and client device 180, media In response to the items and / or receive UIBC input command for selecting the play list, WFD may close the connection. Once UIBC connection is terminated, the source device 120 and client device 180 may continue to communicate using the RTSP, and / or RTP.

In some instances, media sharing applications 128, prior to transmitting the media item to the client device 180, the selected media item in a different format may need to be transcoded (transcode). In such case, the media application 128, from one format to another, for example, MPEG layer 3 audio (MP3), Window Media Audio (WMA) audio to re-encode the selected media format to the format from the format It may be used / video encoder 124.

You may receive the RTP stream of the transmission / reception unit 186 requests the media item from the transmitting / receiving unit (126). If some of the wrong order of the packets in the streams of the requested media item, the transmission / reception unit 186 may be re-assembled and / or re-order the stream in the correct order. Transmission / reception unit 186 also, with respect to the received RTP stream, may determine whether there are any issues, such as dropped packets, dropped packets may request the material from a source device (120).

The client application 185 may also analyze the stream, it is also possible to use the display 182 and the speaker 183 outputs the audio and / or video portion of the stream. In this way, the display 182 and speaker 183 for rendering audio and video data by the display 182 and speaker 183 to be rendered by the same time can be. Audio data and video data may be arranged in the frame and, when the audio frames are rendered, the video frame of the time-synchronization can be. If there is to be a stream, the decoding of the media item client application 185 is determined, the client application 185, before outputting the stream, it is also possible to use the audio / video decoder 184 for decoding an encoded stream, .

Figure 1c is a block diagram illustrating an exemplary system 101 that may implement the techniques of the present invention. System 101 includes a source device 120 and sink device 160, each of which may function and operate in the manner described above with respect to Figure 1a. System 101 further includes a client device 180. As described above, the client device 180 is connected to the source device 120 and the wireless, and may be any device that can stream media from a media sharing application 128 of the source device 120. Sink device 160, for example, by using a streaming protocol such as the RTSP and / or RTP may receive audio and video data from the source device 120 via the WIFI. In some configurations, the sink device 160 and client device 180 is in, and can operate independently of each other, the source device 120, the audio and video data output from the sink device 160 and client device 180 It may be output at the same time. Although the sink device 160 and client device 180 are shown as separate devices, they may be the same device. Although system 101 is shown as having only a single client device 180, this is merely one example and should not limit. Additional device similar to the client device 180 may also be present in the system 101.

Figure 2a is a schematic diagram illustrating a play list of media items in accordance with the techniques of this invention. 2a is a three exemplary play list, namely, shows a play list (200, 202, and 204). Each of the playlist may comprise a playlist of media items as described above in the examples of Fig. 1a-1c. Play lists (200, 202, and 204) it may also include the one or more associated attributes describing the properties of the associated play list. Play lists (200, 202, and 204), each of which may comprise one or more than that of the media items, such as audio, video and image media item. The media items are also, the characteristics that describe the attributes of the media items or meta-data may include.

Play lists (200, 202, and 204) or the characteristics of more than one of each may have a general identifier. The identifier may be associated with a list of values ​​of one or greater. As an example, the playlist 200, 202, 204 may include a "number" properties. The number attribute may be a client device to display the number of media items associated with each play list that may be streamed to the client device 180 from the source device 120,. As another example, the play list 200, 202, 204 also may include a "Users" characteristics. Users characteristic is associated with a particular play list of media items of one or a list of users allowed to stream in excess of that, the user of the group, and / or may be associated with the devices.

In some instances, the value associated with the access attribute may include are, the user name of a specific user is allowed to stream media items of the playlist. As an example, in Fig. 2A, the play list 200 may also include the "present" and "Bob" user name, which is, the play list 200, the user and the "present", and made accessible to "Bob" It indicates that it should. In some other examples, the value associated with the access attribute may include an identifier of the device. For example, a device identifier may comprise an IP address, machine access control (MAC) address, or other hardware to identify a particular device. In some other examples, the Access attribute may include a group identifier corresponding to one or a group of users of the excess.

Media sharing application 128, the hardware identifier provided by a client device (for example, MAC address) to the client device identified by the identifier, by comparing the hardware media sharing application 128 may be authenticated. In the example of Figure 2a, the user characteristics of the play list 202 is the MAC address ("BF: 54: 51: 7E: 30: B6") and are associated. Media sharing application 128, the MAC address associated with the play list 202 (s) with the client device, for example, may compare the MAC address of the client device 180. The provided identifier (e.g., MAC addresses) associated with the user identifier in the characteristics when matched with one of the media sharing application 128 may grant (grant) to access to the client device 180.

Media sharing application 128, various client devices using different authentication mechanisms, for example, it is also possible to authenticate the user of the client device 180. In some instances, the client application 128, the authentication information from the client device 180, for example, to request a user name and a password may be. In response to receiving the user name and password from the client device 180, media sharing applications 128 may also compare the user name and the password received with a user name associated with the user characteristics. In one example, the user characteristics of the play list 200 includes a user-associated "present" and "Bob". Media sharing application 128 may request a user name and password from the client application 185, the user name "Bob", and may receive a response that includes the password for the user Bob. Media sharing application 128, the user name included in the rice may determine that the user characteristics. Then, the media sharing application 128, to determine if the supplied password matches the stored password, the password and the password may be compared to stored locally supplied by the client device 180. If the supplied password is stored in the password matches, the media-sharing application 128 may authenticate the client device 180, media items (that is the play list 200 to client device 180, of media items It may grant access to the streaming allowed). Media sharing application 128 may store the password of the user in the local storage unit of the database, or the source device 120. In some instances, media sharing application 128 may use an authentication technology, such as applied to the system to authenticate users or devices.

In the example of Figure 2a, playing the user the characteristics of the users 204 in the list, one or which may be a group of users that exceed indicate that allow access to the media items of the playlist 204, the identifier " It includes adults ". In this example, the group "adults" may be displayed that corresponds to a group of adult and allows the user to exclude children to stream media items of the playlist 204. Prevent people stream inappropriate content for the excluded group of users, or sensitive or privilege (privileged) to restrict access only of users who have access to the play list of media items, excluding the users, For example, it may be useful for children.

Play lists (200, 202, 204) the user the characteristics of the play list of the access to the media items (200, 202, 204) are shown as a list of user or device that is allowed, but a specific playlist Users characteristics Alternatively, the user is excluded from having access to the media item of the playlist and / or may comprise a list of the devices. In some instances, the playlist may comprise a list of users to be denied access to the list, and the play list of a specific user is allowed to access to the media item playlist.

Figure 2b is a schematic diagram showing a play list that includes, in accordance with the media item to the techniques of this invention. Figure 2b shows the media items associated with the playlist 200. Figure 2b includes a three media items (220, 222, 224). Media items, such as media items of the playlist 200 may comprise any type of media that may be transmitted over the air. In the example of Figure 2b, the media item 220 may be an H.264 video, MPEG (Motion Picture Experts Group) video, or video and other media, such as video format. Media item 222, MP3, WMA, OGG Vorbis, FLAC (Free Lossless Audio Codec), or other media such as audio may be compressed or uncompressed media and formats. The media items 224, raw, JPEG (Joint Picture Experts Group), BMP (Bitmap), or TIFF (Tagged Image File Format) image format or other image formats and media, such as an image file may be. Although not shown in Figure 2b, documents, web pages, and other media formats, such as the drawing media formats it can also be included as a media item in the playlist.

Figure 2b illustrates a play list 200 that may be presented to the user of the client device 180, for example, it may represent an example interface of the client application (185). In response to receiving a user input from one of the user input device 187 (Fig. 1a, Fig. 1b), the client device, the source device 120, the media items of the playlist 200 (220, 222, and / or 224) may request to perform a reproduction command associated with the one or more than one. In one example, the playback commands are, play, stop, pause, one or RTSP commands, such as burning of the excess and / or may include other RTSP command or request. Although described with respect to RTSP, the client device 185 may use other protocols for controlling playback of media from the source device 120,.

In response to receiving one or more than that of the reproduction command, the media sharing application 128 may perform the operations in accordance with the requested reproduction command. As an example, if the media sharing application 128, a media item RTSP play command to the client application requesting the playing 200, 185 are sent to the media sharing application 128, a media sharing application 128, It may respond by sending to the client application 185, a stream corresponding to the requested media item (202). As another example, the media sharing application 128 is stopped upon receiving the RTSP command, media sharing application 128 may stop the current playback and which is streaming the media item 222, such as media items. In addition to the use of RTSP to control the playback of media items, the stream of the source device 120 from the client device a media item is transmitted to the unit 180 generally, when using an RTSP to control the RTP stream, the actual It may be used for different protocols, such as RTP to stream media items.

Figure 2c and 2d are the conceptual diagrams showing two examples of properties and values ​​associated with the media item on the technology of the present invention. Figure 2c and 2d illustrate a few of the characteristics associated with the media items (220 and 222) and values. The media items (220, 222, 224), each of which may have associated with the one or more properties. Each of which may have associated attribute values ​​associated with the one or more. Format of the characteristics of the media items (220, 222, and 224) is, in general, play lists 200, 202, 204 may be similar to the format of the properties of, wherein the characteristics of one or the value of the excess an identifier associated with the list of.

In general, the media item may have a file name, file type, resolution, bit rate, length, and / or profile characteristics. The file name may indicate the attribute file name or title (title) of the media items. The file type characteristics, media items may be displayed has the video, audio, or other file formats. In some instances, and the file type characteristics, such as audio or video of a specific type of media item can be displayed as a more specific information (e.g., H.264 or MP3) and.

The resolution properties can be displayed the horizontal and vertical resolution of the media item. Source device 120 and client device 180 may negotiate a set of resolution of the one or more that can be output on the basis of the client device 180 that the resolution characteristics of the media items in the one or greater, . As part of the agreement process, the source device 120 and client device 180 may accept the negotiated screen resolution. If the client device 180 for streaming data associated with a media item, such as streaming video, the source device 120 to the video data of the media item ring or transcoding scale to match the negotiated screen resolution. In this way, the client device 180 may receive video data with the motion resolution. By providing the video of the motion resolution of the client device 180, client device 180 may not need to be transcoded (additional power and / or which may be consumed by the processing cycle), the video data of the media item .

In Fig. 2C, are the resolution of the media item 220 is 1920x1080 pixels. In one example, the client device 180 has a resolution of 1280x720 source device 120 has a resolution of 1600x900 Having a, the device may include, for example, may be used as their negotiated 1280x720 resolution. Although negotiated resolution may be selected based on the resolution of the client device 180, or some other resolution, the resolution of the source device 120 may also be used. In the example of 1280 x 720 is used, the sink device, the client device 180, before sending the x- coordinate obtained in the source device 120, the acquisition of the acquisition of the x- coordinate 1600/1280 (factor) by a scale ringhal can, similarly, client device 180 before sending the y- coordinates obtained in the source device 120, the scaling can be obtained by 900/720 of the y- coordinate. In other configurations, the source device 120 can be obtained by scaling the coordinate negotiated resolution. Scaling is, the client device 180 may increase or decrease the range based on the coordinate that the display of a higher resolution than the source device or the display of a smaller resolution. In Figure 2d, the media item 222, since the MP3 audio file does not have the resolution, the resolution characteristics of the media items (222) does not have a value (N / A). Media items may also, includes a bit rate characteristics which may indicate a bit rate of the streaming media items. In Figure 2c, a media item 220 has a mega bits / second bit rate (12 Mbit / s). Media item 222 has a 320 kilo bits / second bit rate (320kbit / s). When a media item that does not have a bit rate, such as still images or documents, and the value associated with the bit rate characteristics may not be present.

The media items (220, 222) is also a length indicating the playback time of a media item may have attributes. Media item 220 has a length of 1 hour and 40 minutes (1 H 40M). Media item 222 has a length of 2 minutes 22 seconds (2M 22SEC). In addition to the characteristic length, the media item may have attributes associated with the profile can be displayed, or the ability to encode characteristics of the media item. As an example, the value of the profile attribute value of the media item 220 is also in the "main" correspond to the particular profile of the MPEG4 video. Because MP3 media that does not have a profile, the media item 222 does not have a value associated with the profile attributes. It described with respect to the profiles of the H.264 video in Figure 2c, but other values ​​may also be profile.

The client application 185 may use the media items (220, 222, 224) associated with the values ​​of the characteristics of the client device 180, the play list in order to determine a subset of the media items that are played (200), . Once the client device 180 is determined to which the media items of a client application 185 is playing, the client application 185, client device 180 to only those media items in the subset of media items that are playback client It may be output to a user of device 180. The user, client device 180 may be selected for playback only those media items from a sub-set that is played back.

To determine if the client device 180 can play any media item, the client application 185 may also contact the client device 180 to determine the hardware capabilities of the client device 180. The client application 185, the amount of RAM, storage area, output device resolution, the sound output capabilities, processor speed, installed libraries, codecs (coders-decoders) or media item on the client device 180 You may contact the operating system with respect to any other information related to the reproduction of. Client application 185 is the play list, for example, if the request to access the play list 200, the client application 185, to determine if the client device 180 can play any media item, the media items of the playlist 200, the characteristics and the playlist 200 may be a characteristic of (220, 222, 224) compared to the ability of the client device (185).

In one example, the client device 180 may have an output device that can display only the video resolution of 1280x720 pixels. The client application 185, a media item 220 may be determined as having a resolution of 1920x1080, a media item from a media item in the playlist 200 are available for reproduction by the client device 180 (220) It may be excluded. Alternatively, the client application 185, source device 120 may determine that to the scaling down the video to 1280x720 the media item 220, the media in the playlist 200 is available for playback It may also include a media item 220 is the item.

In another example, a client application 185 is for connection speed, such as the client device 180 and source device 120, the communication link between 152 and may determine the 10 Mbit / s of bandwidth. Based on the connection rate, the client application 185 may determine whether there is a sufficient excess to stream a particular media item bandwidth without buffering. Because the media item 220 has a large 12 Mbit / s bit rate than the available 10 Mbit / s bandwidth, the client application 185 is a media item from the list of media items of the playlist 220 is available for play, ( 220) can be excluded. The client application 185 may be irradiated with a bit rate characteristic of the media item 222, since the value of 320kbit / s is less than 10 Mbit / s of bandwidth, media item play available for the play list 220 It may also include a media item 222 in the list of.

Ability to the client device 180 determines whether playback of any media item, and presenting them to the user only the media item, the client device 180 may be useful in situations with a limited function. As an example, in the automotive setting, the client device 180, may be a hardware built in the car, such as a media player or the back seat of the newer codecs that may or may not receive the update including a media profile. Thus, the client device 180 may be itjineun to display a wide variety of media items, the client device 180 are media items that can not be played back, to be excluded from the play list of media items that is ultimately presented to the user.

Properties of the play list (200, 202) and media items (220, 222, and 224) may be stored in various formats. In some instances, properties and their associated values ​​are XML (eXtensible Markup Language), a binary, CSV (comma separate value), HTML (HyperText Markup Language), or any other format of the stored records to be stored may be. In some instances, the characteristics of the media item and the playlist may be stored in the play list itself. In some examples, the properties and their associated values, media sharing applications 125 may be stored in a separate database which may be indexed on the basis of each play list and / or a unique identifier associated with a media item.

3 is a block diagram showing an example of the data communication model or protocol stack for the WD system. Data communication model 300, to transmit data between a source device and a sink device in the system is implemented WD shows the interaction between control and data protocol used. In one example, WD system 100 may be a data communication model 300. Data communication model 300 is a physical (PHY) layer 302, a media access control (MAC) layer 304, Internet Protocol (IP) (306), User Datagram Protocol (UDP), (308), Real-Time Protocol ( RTP) (310), MPEG2 transport stream (MPEG2-TS) (312), the content protection (314), a packetized elementary stream (PES) packets screen 316, the video codec 318, audio codec 320, Transmission Control Protocol (TCP) (322), Real Time Streaming Protocol (RTSP) (324), feedback packetized 328, the human interface device constant 330, a generic (generic) the user input 332, a performance analysis ( 334), and an operating system (OS) (336).

The physical layer 302 and MAC layer 304 may also define the physical signaling, addressing and channel access control that is used for communications on the WD system. The physical layer 302 and MAC layer 304, the band structure is used for communication, for example, 700MHz, 2.4GHz, 3.6GHz, 5GHz, 60GHz defined in the Federal or ultra wideband (UWB) frequency band structure It may also define the communication Association (Federal Communications Commission) band. The physical layer 302 and MAC (304) also includes data modulation techniques, such as, analog and digital amplitude modulation, frequency modulation, phase modulation techniques, and may also define a combination of the two. The physical layer 302 and MAC (304) also multiplexing techniques, for example, time division multiple access (TDMA), frequency division multiple access (FDMA), code division multiple access (CDMA), or OFDM, FDMA, TDMA and / or it may define any combination of CDMA. In one example, the physical layer 302 and a media access control layer 304 (e.g., IEEE 802.11-3007, and 802.11n-3009x) Wi-Fi, such as those provided by the WFD may be defined by a standard. In other instances, the physical layer 302 and a media access control layer 304 is WirelessHD, WHDI (Wireless Home Digital Interface), WiGig, and may be defined by any of the Wireless USB.

Internet Protocol (IP) (306), User Datagram Protocol (UDP) (308), real-time protocol (RTP) (310), Transmission Control Protocol (TCP) (322), and Real Time Streaming Protocol (RTSP) (324) is , define a packet structure and the encapsulation used in the WD system, it may be defined according to standards to be maintained by the IETF (Internet Engineering Task Force).

RTSP (324), the discussion of capabilities, session, and session maintenance, and not only be used by the source device 120 and sink device 160 to set the control, media according to the techniques of this invention It may be used by the source device 120 and sink device 160 to transmit the item. For example, source device 120 includes a power request message that specifies a list of capabilities of interest to the source device 120 may send (e.g., RTSP GET_PARAMETER request message) to the sink device 160. A sink device 160 is a response message to the ability to declare their capabilities, source device 120 supports the ability to, and may not respond to (for example, RTSP GET_PARAMETER response message). In one example, the capability response message, if the sink device 160 supports the ability to, and may display the "Yes". Thereafter, the source device 120 is an acknowledgment request message indicating that the ability to support, may be transmitted (for example, RTSP SET_PARAMETER request message) to the sink device 160. A sink device 160 is an acknowledgment response message to the media session for sharing the power for the acknowledgment that will be used, the source device 120, may respond to (for example, RTSP SET_PARAMETER response message).

Video codec 318 may define video data coding techniques that may be used by the WD system. Video codec 318, ITU-T H.261, ISO / IEC MPEG-1 Visual, ITU-T H.262 or ISO / IEC MPEG-2 Visual, ITU-T H.263, ISO / IEC MPEG-4 Visual, ITU-T H.264 (also, ISO / IEC MPEG-4 AVC as known), and a high efficiency VP8 video coding (HEVC) may implement any number of video compression standards, such as. In some examples, the system is to be noted that the WD may be compressed or uncompressed video data.

Audio codec 320 may define an audio data coding techniques that may be used by the WD system. Audio data, and Dolby Digital Theater multi such as those developed by Systems - may be coded using channel format. Audio data may be coded using a compressed or uncompressed format. Examples of compressed audio formats are MPEG-1, 2 audio layers II and III, AC-3, AAC and a. Examples of uncompressed audio format is pulse-comprises code modulation (PCM) audio format.

The packetized elementary stream (PES) packets screen 316 and an MPEG2 transport stream (MPEG2-TS) (312) may define that the coded audio and video is how packetized and transmitted. The packetized elementary stream (PES) packets screen 316 and the MPEG-TS (312) may be defined according to the MPEG-2 Part 1. In other examples, the audio and video data, and according to other packetized transport stream protocol may be packetized and transmitted. The content protection 314 may also provide for the copy protection of audio or video data is not allowed. In one example, the content protection 314 may be defined in accordance with the High-bandwidth Digital Content Protection 2.0 standard.

4 is a block diagram illustrating an example of a source device that may implement techniques for transmitting video and / or application data to the sink device. Source device 400 may be part of a system including a data communication WD model provided in Figure 3. The source device 400, transmit, store, and / or the media data may be of encoding and / or to decode for display. The source device 400, memory 402, display processor 404, the local display 406, an audio processor 408, the speaker 410, the video encoder 412, a video packetizer 414 and the audio encoder 416, the audio packetizer (418), A / V MUX (420), a transfer module 422, a modem 424, a control module 426, the feedback inverse-packetizer (de-packetizer) (428) and a feedback module (430). Component of the source device 400 are one or microprocessors of the excess, a digital signal processor (DSP) s, application specific integrated circuit (ASIC), field programmable gate array (FPGA) s, discrete logic, software, hardware , it may be implemented as firmware, or any of a variety of suitable circuit, such as circuit any combination thereof.

Memory 402 may store the A / V data in the form of visual media data into a compressed or uncompressed format. Memory 402 may store an entire media or data file, for example, may comprise a smaller part of the buffer that stores the streaming media data file simply from another device or source. Memory 402, random access memory such as Synchronous Dynamic Random Access Memory (SDRAM) and (RAM), read-only memory (ROM), non-volatile random access memory (NVRAM), electrically erasable programmable read-only memory (EEPROM), FLASH memory and the like, but not limited to a wide variety of volatile or non-memory may include any of volatile memory. Memory 402 is a computer for storing the data of the media data, as well as other types, - it may include a readable storage medium. Memory 402 additionally may store instructions and program code that is executed as part of what to do a variety of techniques described in the present invention by a processor.

Display processor 404 may also obtain the captured video frame, it may process the video data for display on the local display 406. Display 406 includes a liquid crystal display (LCD), a plasma display, an organic light emitting diode (OLED) display, or the source device 400 of the user to the video data presentation can be in other types of display devices such as various display devices It includes any of the

Audio processor 408 may acquire the audio capture, audio samples, and may process the audio data for output to the speaker 410. Speakers 410, headphone, Single-speaker system, the multi-device may comprise any of a variety of audio output device such as a speaker system or surround sound system.

The video encoder 412 obtains the video data from the memory 402, it is also possible to encode the video data in the desired video format. Video encoder 412 may be a combination of hardware and software used to implement aspects of the video codec 318, described above with respect to Figure 3. A video encoder 412, ITU-T H.261, ISO / IEC MPEG-1 Visual, ITU-T H.262 or ISO / IEC MPEG-2 Visual, ITU-T H.263, ISO / IEC MPEG-4 Visual, ITU-T H.264 (also, ISO / IEC MPEG-4 AVC as is known), and high efficiency can be VP8 video coding in accordance with any number of video compression standards such as (HEVC) encoding video. In some cases, that the video data is compressed using lossless or lossy compression techniques that video encoder 412 is to be noted that there may be encoded video.

Video packetizer 414 may hwahal packet encoded video data. In one embodiment, as the video packetizer 414 as defined according to the MPEG-2 Part 1, may hwahal packet encoded video data. In other instances, the video data may be packetized according to the different packetization protocol. Video packetizer 414 may be a combination of hardware and software used to implement aspects of the packetized elementary stream of Figure 3 described above with respect to (PES), the packetized (216).

The audio encoder 416 and the audio data acquired from the memory 402, it is also possible to encode the audio data in a desired audio format. The audio encoder 416 may be a combination of hardware and software used to implement the aspects of the audio codec 320, described above with respect to Figure 3. Audio data, and Dolby Digital Theater multi such as those developed by Systems - may be coded using channel format. Audio data may be coded using a compressed or uncompressed format. Examples of compressed audio formats are MPEG-1, 2 audio layers II and III, AC-3, AAC and a. Examples of uncompressed audio format is pulse-comprises code modulation (PCM) audio format.

Audio packetizer 418 may hwahal packet encoded audio data. In one example, the audio packetizer 418, as defined by the MPEG-2 Part 1, may hwahal packet encoded audio data. In other examples, the audio data may be packetized according to the different packetization protocol. Audio packetizer 418 may be a combination of hardware and software used to implement aspects of the packetized elementary stream of Figure 3 described above with respect to (PES), the packetized (316).

A / V MUX (420) may be applied to the multiplexing technique to combine the video payload data and audio payload data as part of the common data stream. In one example, A / V MUX (420) is a MPEG2 transport stream defined by the MPEG-2 Part 1, may be in the encapsulating element, a packetized video and audio stream. A / V MUX (420) may also provide error correction techniques as well as the synchronization of the audio and video packets.

Sending module 422 may process the media data for transmission to a sink device. In addition, the transmission module 422 is also in processing the received packet from the sink device, allowing the packets to be further processed. For example, the transmission module 422 may be configured to communicate using the IP, TCP, UDP, RTP, and RTSP. For example, the transmission module 422 may be further encapsulating the MPEG2-TS for transmission over the network or to the sink device.

Modem 424 may be configured to perform a processing according to the physical and MAC layers that are used in the physical and MAC layers WD system. As described with respect to Figure 3, the physical and MAC layers, the physical signaling used for communications on the WD system may define addressing and channel access control. In one example, the modem 424, as provided by the WFD, Wi-Fi (e.g., IEEE 802.11x) to perform the physical layer and MAC layer processing on the physical and MAC layers as defined by the standard It may be configured. In other instances, the modem 424, WirelessHD, WiMedia, WHDI (Wireless Home Digital Interface), WiGig, and any of a Wireless USB of the physical layer and MAC layer processing for the configuration to be performed may be.

Control module 426 may be configured to perform the source device 400, the communication control function. Communication control functions, and the ability to agree on a sink device, to set up a session with the sink device, and may be associated with a session maintenance, and management. Control module 426 may use the RTSP to communicate with the sink device. In addition, control module 426 may use the RTSP message transaction (transaction) to discuss the ability of the source device 400 and sink device to support the ability of UIBC,.

Feedback inverse-packetizer 428 of the human interface device command (HIDC), generic user inputs, the user inputs a particular OS, and can be parsed from the performance information of the feedback packet. Feedback category field, it is possible to feedback packet payload data identifies a generic type categories to indicate that the formatted using a generic information element. As another example, the feedback category field, it is also possible to identify a human interface device command (HIDC) input category. As another example, the feedback Category field may be identified to indicate that the payload data is formatted, OS specific type category based on the type of operating system (OS) used by either the source device or sink device, .

Feedback module 430, the feedback station - to receive performance information from the packetizer, and processing the performance information, the source device 400 makes it also possible to adjust the transmission of the media data on the basis of the capability information message.

The source device 400 provides an example of a source device configured to transmit the content to the second wireless computing device. Source device 400 includes a WI-FI display (WFD) initiating a connection, the first transmission of data to the second wireless computing device via the WFD connection from the mobile computing device, the first wireless computing device, a wireless client computing device, and executes the media sharing applications to share the media item in the play list, the information describing the media items of the playlist may be transmitted to the wireless client computing devices. The transmitting information describing the media item, causing a wireless client computing device, the wireless client device may be determined whether to output the media item, the media item may be transmitted to the wireless client computing devices.

Figure 5 is a block diagram illustrating an example of a sink device or a client device for implementing the technology for receiving video and / or other information from a source device. Sink or the client device 500 may be part of a system including a data communication WD model provided in Figure 3. In one example, the sink or the client device 500 may form a source device 400 and the WD system. Sink or the client device 500, a modem 502, a transmission module (504), A / V DEMUX (506), video station-packetizer 508, a video decoder 510, the display processor 512, a display ( 514), the audio station packetizer 516, an audio decoder 518, an audio processor 520, a speaker 522, a user input module 524, the performance analysis module 526, the feedback packetizer 528, and and a control module 530. Component of each of the sink or the client device 500, one or microprocessors of the excess, a digital signal processor (DSP) s, application specific integrated circuit (ASIC), field programmable gate array (FPGA) s, discrete logic software, hardware, firmware, or these may be implemented as any of a variety of any suitable circuitry, such as circuit coupled.

Modem 502 may be configured to perform a processing according to the physical and MAC layers that are used in the physical and MAC layers WD system. As described with respect to Figure 3, the physical and MAC layers, the physical signaling used for communications on the WD system may define addressing and channel access control. In one example, the modem 502, as provided by the WFD, Wi-Fi (e.g., IEEE 802.11x) to perform the physical layer and MAC layer processing on the physical and MAC layers as defined by the standard It may be configured. In other instances, the modem 502, WirelessHD, WiMedia, WHDI (Wireless Home Digital Interface), WiGig, and about any of the Wireless USB may also be configured to perform the physical layer and MAC layer processing.

Sending module 504 may process the received media data from the source device. In addition, the transmission module 504 may process the feedback packet for transmission to the source device. For example, the transmission module 504 may be configured to communicate using the IP, TCP, UDP, RTP, and RTSP. In addition, the transmission module 504, IP, TCP, UDP, RTP, and may also include a time stamp value in any combination of RTSP. Time stamp values ​​are the source device, one media data packet is able to identify that the reported experience performance degradation, and may be able to calculate the round trip delay on the WD system.

A / V DEMUX (506) for separating a D video payload data and audio payload data from the data stream, the multiplexing techniques may be applied. In one example, A / V DEMUX (506), the elements in packetized MPEG2 transport stream defined by the MPEG-2 Part 1 may be separate video and audio streams.

Video Station-packetizer 508 and video decoder 510, and also perform the reverse processing of the video packetizer and the video encoder that implement packetization and encoding techniques described herein, the display processor 512, may output the video data.

Display processor 512 may also obtain the captured video frame, it may process the video data for display on the display 514. Display 514 may comprise any of a variety of display devices such as liquid crystal display (LCD), a plasma display, an organic light emitting diode (OLED) display, or another type of display.

Audio reverse-packetizer 516 and the audio decoder 518, and also perform the reverse processing of the audio packetizer, and an audio encoder for implementing the described packetization and encoding described herein, the display processor 520 may output audio data.

Audio processor 520 may acquire the audio data from the audio decoder, and may process the audio data for output to the speaker 522. Speakers 522, headphone, Single-speaker system, the multi-device may comprise any of a variety of audio output device such as a speaker system or surround sound system.

A user input module 524 is, for example, a keyboard, a mouse, trackball, or trackpad, a touch screen, voice command recognition module, or the user input commands received by any other such user input device, user input devices, such as It may be formatted. In one example, the user input module 524, also in the human interface device commands described above with respect to 3 (HIDC) (330), a generic user input 322 and OS are defined according to the specific user inputs 336 a user input command may be formatted according to the format.

Performance analysis module 526 may determine the performance information on the basis of the media data packets received from the source device. Performance information may include delay jitter (jitter), packet loss, the error distribution in time, packet error rate, and other examples described herein, as well as the distribution of RSSI at the time. Performance analysis module 526 may calculate the performance information in accordance with any of the techniques described herein technology.

Feedback packetizer 528 to produce the feedback packet, and may process the user input information from the user input module 524 and the performance analysis module generator 526. In one example, feedback packets may use the message format described in Fig. Additionally, the feedback packetizer 528 may include a time stamp value in each of the feedback packets. Time stamp values ​​are the source device, one media data packet is able to identify that the reported experience performance degradation, and may be able to calculate the round trip delay on the WD system.

Control module 530 may be configured to perform the sink or the client device 500, the communication control function. Communication control functions, to consult the source device and the ability to set up a session with a source device, and may be associated with a session maintenance, and management. Control module 530 may use the RTSP to communicate with the source device. In addition, control module 530 may also negotiate the capability of the sink or the client device 500 and the source device to support the characteristics of UIBC,.

In one example, from the sink device 500, source device 400 (FIG. 4) discloses a WFD connected to the wireless source device, such as the source device, the source device via the WFD access to 400 400, It provides an example of a source device configured to receive the data. Wireless client computing devices similar to the sink device 500 or which may be the same, the wireless client device may perform a media client application can receive the shared media items of the playlist from the source device 400. A wireless client computing device may receive information describing the media items of the playlist from the source device 400,. Receiving information that describes the media item causing a wireless client computing device, a wireless client computing device may determine whether to output the media item. The wireless client computing device may receive a media item from the source device 400.

6 is a block diagram of a communication channel 150, a transmitter / receiver of Figure 1 to communicate with a 126 and an exemplary transmitter system that may be used by the transmitter and receiver 166, 610 and l receiver system 650 the Figure shows. At transmitter system 610, traffic data for a number of data streams is provided from a data source to the transmission (612), (TX) data processor 614. Each data stream may be transmitted over a respective transmit antenna. TX data processor 614 can format the traffic data for each data stream based on a particular coding scheme selected for each data stream, codes, and interleaves.

Coded data for each data stream using an orthogonal frequency division multiplexing (OFDM) technology, may be multiplexed with pilot data. Time division multiple access (TDMA), frequency division multiple access (FDMA), code division multiple access (CDMA), or OFDM, FDMA, TDMA and / or include any combination of CDMA, but this is not limit the wide variety of other wireless does communication techniques may also be used.

Consistent with Figure 3, the pilot data is typically a known data pattern processed in a known manner and may be used at the receiver system to estimate the channel response. Then, the multiplexed pilot and coded data for each data stream a particular modulation scheme selected for that data stream to provide modulation symbols (e.g., binary phase shift keying (BPSK), quadrature phase shift keying (QPSK), M-PSK, or M-QAM (quadrature amplitude modulation), wherein, M, for modulation (for example, which may be on the basis of the power of 2), and symbol maps). The data rate for each data stream, coding, and modulation may be determined by instructions performed by a memory 632 which may be coupled to the processor 630.

Then, the modulation symbols for the data streams are provided to a TX MIMO processor 620, the processor may be further process the modulation symbols (e.g., for OFDM). Then, TX MIMO processor 220 N_TThe modulation symbol streams to N_TIt can be provided to the transmitters (TMTR) (622a to 622t). In certain aspects, TX MIMO processor 620 to the symbols of the data streams, and applies beamforming weights to the antenna in the symbol is being transmitted.

Each transmitter 622 may provide the analog signal the one or more receives and processes a respective symbol stream, further conditioning of the analog signals (e.g., amplifies, filters, and upconverts), It may provide a modulated signal suitable for transmission over the MIMO channel. After that, from the transmitters (622a to 622t) N_TModulated signals are, respectively, N_TIt is transmitted from different antennas (624a to 624t).

At receiver system 650, the transmitted modulated signals are N_RIs received by the two antennas (652a to 652r), the received signal from each antenna 652 is provided to a respective receiver (RCVR) (654a to 654r). Receiver 654 (e.g., filters, amplifies, and downconverts) conditioning a respective received signal, digitizes the conditioned signal to provide samples, and the samples of further processing by a corresponding "received "it provides a stream of symbols.

A receive (RX) data processor 660 is N_RFrom the N receivers 654_RIt receives the reception symbol stream, and the processing of the symbol stream based on a particular receiver processing technique, N_TOne provides the "detected" symbol streams. Then, RX data processor 660 demodulates each detected symbol streams, deinterleaved, and decoded to recover the traffic data for the data stream. The processing by RX data processor 660 is complementary to the processing performed by TX MIMO processor 620 and TX data processor 614 at transmitter system 610.

Memory 672 coupled with the processor 670 may be a ring, which pre-coding matrix is ​​determined by whether or periodically used. The reverse link message may comprise various types of information regarding the communication link and / or the received data stream. Then, the reverse link message is then processed by a TX data processor 638, which also receives traffic data for a number of data streams from a data source 636, modulated by a modulator 680, transmitter ( conditioned by 654a through 654r), it is transmitted by the station transmitter system 610.

At transmitter system 610, in order to extract the reserve link message transmitted by the receiver system 650, the modulated signals from receiver system 650 are received by antennas 624, conditioned by receivers 622, conditioned by, demodulated by a demodulator 640, and is processed by a RX data processor 642. After that, the processor 630 is either free to determine the beamforming weights, - determining whether encoding matrix is ​​used, and then processes the extracted message.

Figure 7a is a block diagram illustrating an example sequence of messages passed between a part of the power source conference device 120 and sink device 160 to the WFD session. The capability negotiation is also occur as part of a larger WFD communication session establishment process between the source device 120 and sink device 160. These sessions include, for example, base (underlying) as a standard connection can be established using a direct or a WI-FI TDLS. WI-FI after setting a direct or TDLS session, sink device 160 may initiate a source device (120) with the TCP connection. As part of setting the TCP connection, and the control port to drive the Real Time Streaming Protocol (RTSP) it may be set to manage the communication session between the source device 120 and sink device 160.

Source device 120 In general, also may be operated in the same manner as described above for the source device 120 of the 1a, a sink device 160, in general, described above for the sink device 160 in FIG. 1A It may operate in the same manner as. The source device 120 and sink device 160 after establishing a connection, the source device 120 and sink device 160 may determine a set of parameters used for their subsequent communication session as part of the capabilities negotiated exchange, have.

The source device 120 and sink device 160 may consult the ability through a sequence of messages. Messages may include, for example, may deulil Real Time Streaming Protocol (RTSP) message. At any stage of the consultation, receiving the RTSP request message and may respond to the RTSP response including RTSP status code other than RTSP OK,, in that case, the message exchange, or it may be re-tried by using a different set of parameters ability It may be negotiated session ends.

The source device 120 can be sent to a sink device (160) a first message (RTSP OPTIONS request message) to determine a set of RTSP methods sink device 160 is supported. Upon receipt of the first message from the source device 120, the sink device 160 may respond with, sink a second message to a list of supported RTSP methods by 160 (RTSP OPTIONS response message). The second message may also include the RTSP OK state code.

After transmitting the second message to the source device 120, the sink device 160 can transmit the third message (RTSP OPTIONS request message) to determine a set of RTSP methods source device 120 is supported, . A sink device (160) upon receipt of a third message from the source device 120 may be responsive to the fourth message (RTSP OPTIONS response message) to the list of supported RTSP method by the source device 120, . The fourth message may also include the RTSP OK state code.

After transmitting the fourth message, the source device 120 can send a fifth message (RTSP GET_PARAMETER request message) to specify a list of capabilities of interest to the source device 120,. The sink device 160 may respond with a sixth message (RTSP GET_PARAMETER response message). The sixth message may include the RTSP state code. If the RTSP OK status code, the sixth message, also in the fifth message is supported by the sink device 160 may include a response parameter for a particular parameter is. The sink device 160 may ignore the parameters in the fifth message, the sink device 160 does not support.

6 based on the message, the source 120, it is possible to determine the optimal set of parameters used for the communication session, a seventh message (RTSP SET_PARAMETER request message) can be transmitted to the sink device 160. The seventh message may include a set of parameters to be used during the communication session between the source device 120 and sink device 160. The seventh message may include a WFD-Presentation-url illustrating an Universal Resource Identifier (URI) used at the RTSP setup request, to set up a communication session. WFD-Presentation-url is, the sink device 160 specifies a URI that can be used for the subsequent message exchange during the session. The parameters specified in the WFD-url0 and WFD-url1 values, 7 can correspond to the values ​​of the RTP-RTP-Port0 and port1 value of WFD-Client-RTP-Ports in the message. In this example, RTP generally, refers to a real-time protocol, which can be driven from the top of UDP.

Upon receiving the seventh message, the sink device 160 may be a set of parameters as specified in the seventh message in response to the eighth message with a status code indicating the RTSP was successful. As described above, the roles of the source device and the sink device may be changed or reversed in a different session. In some cases, the order of the messages for setting up a communication session may be defined for a device that operates as the source, it is also possible to define a device which operates as the sink.

Figure 7b is a block diagram showing another exemplary message delivery as part of the sequence between the source device 120 and sink device 160 the ability to conference session. Message transmission sequence of Fig. 7b is intended to provide a more detailed view of the transfer sequence described above for FIG. 7A,. In Figure 7b, the message "1b. GET_PARAMETER RESPONSE" is, the supported input category shows an example of a message identifying a plurality of lists, and list of supported types of input (e.g., generic and HIDC). Support input of a list of categories and each of the input category support, the supported type has a list of the associated (e.g., generic_cap_list and hidc_cap_list). In Figure 7b, the message "2a. SET_PARAMETER REQUEST", the support entered categories (e. G., Generic and HIDC) An example of the second message, identifying the plurality of the second list of the second list and supported type of be. Supporting the input category and each of the support entered the second list of the categories, the supported type and a second list of the associated (e.g., generic_cap_list and hidc_cap_list). Message "1b. GET_PARAMETER RESPONSE", the input identifying the type category and type supported by the sink device 160. Message "2a. SET_PARAMETER REQUEST", the source device 120, the input category, supported by, and identifying the input type, but it is, a comprehensive list of all the input category and the input type is supported by the source device 120 It may or may not have. Instead, the message "2a. SET_PARAMETER REQUEST" can be identified only by their message type categories and the input type identified in the "1b. GET_PARAMETER RESPONSE" as supported by the sink device 160. In this manner, the message "2a. SET_PARAMETER REQUEST" input category and are identified in the input type, the message "1b. GET_PARAMETER RESPONSE" may be formed of a subset of the input type and the identified category from the input.

8 according to the techniques of this invention, do WFD is a flow chart illustrating a method for transmitting the media item. The method of Figure 8 as an example, also may be performed by a device, such as source device 120 of 1a and 1b. Although Figure 8 is described with reference to the source device 120, a different source device also includes a source device 400 may also have four techniques of Figure 8 do. In the method of Figure 8, the source device 120 may initiate a connection to the WFD sink device 160 (Fig. 1A) (800). In some instances, the sink device 160 and client device 180 may be the same device.

Source device 120 includes a sink device 160 to display WI-FI (WFD) may initiate a connection (800). The source device 120 also includes a source device 120 is connected from the sink device via the WFD 160 may transmit the data (Fig. 1A) (802). In one example, it is from the source device 120 transmits data to the sink device 160, the sink device 160 may mirror the display output device, the source device 120. Source device 120 may also receive user input from a sink device (160).

The source device 120, source device 120 may execute a media sharing applications to share the media item of the playlist and the client device 180 (Fig. 1 b) (804). Source device 120 may send information describing the media item, describe the format of the play list of media items to the client device 180, 806. In some instances, the media item description information, XML (Extensible Markup Language), Binary, HTML (Hypertext Markup Language), and CSV (comma separate value) of at least one of the included. Information describing the media items may comprise at least one of the media items in the bit rate, level, resolution, and file type, and file name.

The source device 120 may also, of media items of the playlist and the playlist to WFD data related to at least one client may be transmitted to the wireless device 180 via the connection 2 WFD. Source device 120 may UIBC (user input back channel) additionally receive input commands from the client device 180 via the 2 WFD connection. UIBC in response to receiving the input command, the first wireless computing device may exit the 2 WFD connection.

The transmitting information describing the media item in the play list, allows the client device 180, the client device 180 may determine whether to output the media item (808). Source device 120 may send the media item to the client device 180, 810. Source device 120 may also receive a media playback command, which may include the RTSP Direct Executive (directive) from the client device 180 in some instances. In some examples, a source device 120 may be used to transmit the RTP media items. In some examples, a media item is to be transmitted to the source device 120, it may occur after receiving the media playback command from the client device 180.

Source device 120 may also receive the authentication information from the client device 180. The source device 120, on the basis of the authentication information to authenticate the wireless client device may, in response to authenticating the client device 180 and may grant the client device 180 access to the play list.

For the purpose of illustration are shown in a particular order, the method of Figure 8 may be performed in any order or in parallel, Fig. 8 The method steps and at the same time, media sharing applications, for transmitting the data using the WFD connection, It may further comprise the step of running.

In examples of one or more than, the functions described in the present invention may be implemented in hardware, software, firmware, or any combination thereof. If implemented in software, the functions are computer-readable storage as instructions or code, the one or more in the medium or may be transmitted through them, the hardware-based and executed by a processing unit. The computer-readable media include, a computer that corresponds to the type of (tangible) media such as the data storage medium-readable storage medium, or, for example, of a computer program to a different place from a place in accordance with the communication protocol, It may include communication media including any medium that facilitates transfer. In this manner, computer-readable media are generally (1) a non-transient type of computer-readable storage medium, or (2) or a carrier wave signal may correspond to the same communication medium. Data storage media are, any group that can be accessed by the processors of one or computers or one or more than of more than the command to the implementation of the described technique, in order to retrieve the code and / or data structure in the present invention It may deulil of available media. A computer program product is a computer-readable medium may include.

By way of example and not limitation, such computer-readable media include RAM, ROM, EEPROM, CD-ROM or other optical disk storage, storing magnetic disk unit, or other magnetic storage devices, flash memory, or instructions or data can be used to store desired program code in the form of the structure may be any other medium that can be accessed by a computer. Also, any connection means (connection) a computer-readable medium is referred to as appropriate. For example, commands are transmitted from a website, along the line (twisted pair), digital subscriber line (DSL), or (infrared, radio, and microwave and the like), a Web site by using a radio technology, server, or other remote source When transmitted from the (such as infrared, radio, and microwave and a) a coaxial cable, fiber optic cable, twisted pair, DSL, or wireless technologies are included in the definition of medium. However, the computer-readable data storage medium and the storage medium are connected, the carrier waves, instead of including the signal or other transient media instead of the non-should be understood that according to the type of temporary storage media. As used herein, the disk (disk) and a disk (disc) is a compact disk (disc) (CD), laser disc (disc), an optical disk (disc), DVD (digital versatile disc), a floppy disk (disk) and Blu-ray disc includes a (disc), wherein the disk (disk) are usually reproduce data magnetically, while discs (disc) can reproduce data optically with lasers. In addition, the combination of the computer are-to be included within the scope of readable media.

Instructions, one or a digital signal processor (DSP) in the the excess, general purpose microprocessors, an application specific integrated circuit (ASIC), field programmable logic array (FPGA), or other such equivalent integrated or discrete logic circuitry, and It may be performed by the one or more processors. Thus, as used in herein, the term "processor" may refer to that of any of any other structure suitable for implementation of the above-described structure or techniques described herein. Additionally, in some aspects, the functionality described herein are or may be provided within dedicated hardware and / or software modules configured for encoding and decoding, it may be included in a combined CODEC. In addition, the techniques may be implemented entirely in the circuit or the one or more logic elements.

Are the techniques of the present invention, a wireless handset, an integrated circuit (IC) or a set of IC (for example, a chipset) that includes a wide range can be implemented in a variety of devices or apparatus. The various components, modules, or units, the scope of this invention described to emphasize the aspects of device function configured to perform the techniques, however, do not necessarily require a realization by different hardware units. Rather, as described above, various units, or it may be coupled to the CODEC hardware unit, a set of hardware units interoperable including appropriate software and / or firmware in conjunction with one or processors of the excess as described above It may be provided by.

Various examples have been described. These and other examples are within the scope of the following claims.