CA2845987C

Management of delivery of multimedia components

Abstract

Systems, methods, apparatuses, and computer readable media may be configured for establishing at least one session for delivery of multimedia. In an aspect, a first transmission of data fragments of a first component and a second transmission of data fragments of a second component may be transmitted and synchronized for presentation. If an inactivity event is detected the session may be maintained while reducing bandwidth consumption.

CA2845987C, drawing sheet 1
Sheet 1 of 7

Term

7.5 yearsleft in the term

Expires 13 March 2034.

  1. Priority
  2. Filed
  3. Granted
  4. Today
  5. Expires

81 claims: 62 independent, 19 dependent

  1. 1
    CLAIMS:1. Λ method comprising: establishing at least one session for delivery of: a first component of a multimedia content item;and a second component of the multimedia content item;receiving, during the at least one session, a first transmission of data fragments of the first component and a second transmission of data fragments of the second component;synchronizing the first transmission of data fragments and the second transmission of data fragments to form synchronized data fragments;providing the synchronized data fragments for rendering of the multimedia content item;identifying an inactivity event after the rendering;after the identifying of the inactivity event, maintaining the at least one session in an active state and requesting that delivery of the first transmission of data fragments and the second transmission of data fragments be stopped;in response to identifying an activity event after the requesting, determining to resume the first component and not to resume the second componenh wherein the first component and the second component each comprise one of video, audio, or data components of the multimedia content item;and after the determining to resume the first component, sending a resumption request for resumption of delivery of the first component of the multimedia content item.
  2. 4
    The method of any one of claims 2 or 3, wherein the identifying the inactivity event is in response to determining that the activity timer has expired. -19Date Reçue/Date Received 2022-12-28
  3. 5
    The method of any one of claims 2-4, further comprising, after expiration of the activity timer, resetting the activity timer to monitor for an activity event during a predetermined amount of time.
  4. 7
    The method of any one of claims 1 -6, wherein die identifying of the inactivity event comprises detecting that a first graphical user interface presenting the first component is at least partially obscured by a second graphical user interface.
  5. 8
    The method of any one of claims 1-7, wherein the identifying the inactivity event comprises detecting that a device configured for presenting the finit component has been turned off.
  6. 9
    The method of any one of claims 1 -8, further comprising forwarding the data fragments of the first component to a first device and the data fragments of the second component to a second device.
  7. 10
    The method of any one of claims 1 -9, wherein die first transmission of the data fragments of the first component is received from a first server and the second transmission of the data fragments of the second component is received from a second server.
  8. 11
    The method of any one of claims 1-10, further comprising:receiving a user input comprising an indication of a resumption point, wherein the sending the resumption request further comprises sending die resumption point.
  9. 12
    A computer readable medium storing instructions that, when executed, cause performance of the method of any one of claims 1-11. -20Date Reçue/Date Received 2022-12-28
  10. 13
    An apparatus comprising:one or more processors;and memory storing instructions that, when executed by the one or more processors, cause the apparatus to perform the method of any one of claims 1-11.
  11. 14
    A system comprising:a first computing device configured to perform the method of any one of claims 1-11;and a second computing device configured to receive the resumption request.
  12. 15
    A method comprising:establishing at least one session for delivery of: a first component of a multimedia content item;and a second component of the multimedia content item;receiving, via the at least one session, a first transmission of data fragments of the first component and a second transmission of data fragments of the second component;synchronizing the first transmission of data fragments and die second transmission of data fragments;identifying an inactivity event;after the identifying of the inactivity event, maintaining the at least one session in an active state and requesting that delivery of the first transmission of data fragments and the second transmission of data fragments be stopped;determining an activity event during a predetermined amount of time after the requesting;in response to determining the activity event, determining to resume the first component and not to resume the second component, wherein the first component and the second component each comprise one of video, audio, or data components of the multimedia content item;and after the determining to resume the first component, sending a resumption request to resume delivery of the first component of the multimedia content item. -21Date Reçue/Date Received 2022-12-28
  13. 17
    The method of any one of claims 15 or 16, wherein the identifying the inactivity event comprises detecting that a first graphical user interface presenting the first component is at least partially obscured by a second graphical user interface.
  14. 18
    The method of any one of claims 15-17, wherein the identifying the inactivity event comprises detecting that a device configured for presenting the first component has been turned off.
  15. 19
    The method of any one of claims 15-18, further comprising:receiving a user input comprising an indication of a resumption point, wherein the sending tire resumption request further comprises sending the resumption point.
  16. 20
    The method of any one of claims 15-19, wherein tire first transmission of the data fragments of the first component is received from a first server and the second transmission of the data fragments of the second component is received from a second server.
  17. 21
    A computer readable medium storing instructions that, when executed, cause performance of the method of any one of claims 15-20.
  18. 22
    An apparatus comprising:one or more processors;and memory storing instructions that, when executed by the one or more processors, cause the apparatus to perform the method of any one of claims 15-20. -22Date Reçue/Date Received 2022-12-28
  19. 23
    A system comprising:a first computing device configured to perform the method of any one of claims 15-20;and a second computing device configured to receive the resumption request
  20. 24
    A method comprising:establishing at least one session for delivery of: a first component of a multimedia content item;and a second component of the multimedia content item;receiving, during die at least one session, a first transmission of data fragments of the first component and a second transmission of data fragments of die second component;synchronizing die first transmission of data fragments and the second transmission of data fragments to form synchronized data fragments;providing the synchronized data fragments for rendering of the multimedia content item;identifying an inactivity event after die rendering;after the identifying of the inactivity event, maintaining the at least one session in an active state and requesting that delivery of die first transmission of data fragments and the second transmission of data fragments be stopped;identifying an activity event after the requesting;and sending a resumption request for resumption of delivery of the first transmission of data fragments and die second transmission of data fragments, wherein the resumption request causes resumption of sending data fragments from a resumption point associated with a time of the inactivity event.
  21. 28
    The method of any one of claims 25-27, further comprising, after expiration of the activity timer, resetting the activity timer to monitor for the activity event during a predetermined amount of time.
  22. 30
    The method according to any one of claims 24-29, wherein the identifying the inactivity event comprises detecting that a first graphical user interface presenting the first component is at least partially obscured by a second graphical user interface.
  23. 31
    The method according to any one of claims 24-30, wherein the identifying the inactivity event comprises detecting that a device configured for presenting the first component has been turned off.
  24. 32
    The method according to any (me of claims 24-31, further comprising forwarding the data fragments of the first component to a first device and forwarding the data fragments of the second component to a second device.
  25. 35
    The method according to any one of claims 24-34, wherein the resumption point comprises a time of identifying the inactivity event
  26. 36
    The method according to any one of claims 24-34, wherein the resumption point comprises a time before an identification of the inactivity event.
  27. 37
    The method according to any one of claims 24-34, wherein the resumption point comprises a time specified by a user.
  28. 38
    A computer-readable medium storing instructions that, when executed, cause performance of the method of any one of claims 24-37.
  29. 39
    An apparatus comprising:one or more processors;and memory storing instructions that, when executed by the one or more processors, cause the apparatus to perform the method of any one of claims 24-37.
  30. 40
    A system comprising:a first computing device configured to perform the method of any one of claims 24-37;and a second computing device configured to receive the resumption request. -25Date Reçue/Date Received 2022-12-28
  31. 41
    A method comprising:establishing a session for delivery of: a first component of a multimedia content item;and a second component of the multimedia content item, wherein the first component and the second component each comprise a different one of video, audio, or data components of the multimedia content item;providing, during the session, the first component synchronized with the second component;monitoring network conditions, wherein the monitoring comprises comparing bandwidth utilization rates, for the session, to a bandwidth utilization rate threshold;determining an inactivity event during the session;and after determining the inactivity event maintaining the session in an active state;and based on a bandwidth utilization rate, of the compared bandwidth utilization rates and for a time associated with the inactivity event, exceeding the bandwidth utilization rate threshold: causing delivery of the first component to be stopped;and continuing delivery of the second component while delivery of the first component has stopped.
  32. 43
    The method of any one of claims 41-42, further comprising:providing, during the inactivity event and instead of die first component, one or more screen shots, wherein the first component comprises die video component of die multimedia content item, and wherein the second component comprises die audio component of the multimedia content item. -26Date Reçue/Date Received 2022-12-28
  33. 44
    The method of any one of claims 41-43, further comprising, based on a first network event and before the inactivity event:determining a first timestamp associated with the first component;and providing, instead of the first component and based on the first timestamp, a different version of the first component.
  34. 47
    The method of any one of claims 41-46, wherein the continuing delivery of the second component while delivery of the first component has stopped comprises continuing delivery of:a current data fragment, associated with a current time stamp of the multimedia content item and associated with the inactivity event, of the second component;and further data fragments, associated with subsequent time stamps of the multimedia content item, after the current time stamp. - 27Date Reçue/Date Received 2022-12-28
  35. 48
    The method of any one of claims 41-47, further comprising:based on a bandwidth utilization rate, of the compared bandwidth utilization rates and for delivery of the second component, falling below the bandwidth utilization rate threshold, resuming delivery of the first component.
  36. 49
    The method of any one of claims 41-48, wherein a bandwidth utilization rate, of the compared bandwidth utilization rates, comprises a netwoik bandwidth utilization rate that is based on a number of components of the multimedia content item delivered to a computing device over a specified period of time.
  37. 50
    The method of any one of claims 41-49, wherein the determining the inactivity event comprises determining that a first graphical user interface presenting the video component of the multimedia content item and the audio component of the multimedia content item is at least partially obscured by a second graphical user interface.
  38. 51
    The method of any one of claims 41-50, wherein the determining the inactivity event comprises determining that a user input has not been received for a period of time.
  39. 52
    The method of any one of claims 41-51, wherein the determining the inactivity event comprises determining user inattention to Ihe multimedia content item, wherein the first component comprises the video component and the second component comprises the audio component.
  40. 53
    A computer readable medium storing instructions that, when executed, cause performance of the method of any one of claims 41-52.
  41. 54
    An apparatus comprising:one or more processors;and memory storing instructions that, when executed by the one or more processors, cause the apparatus to perform the method of any one of claims 41-52. -28Date Reçue/Date Received 2022-12-28
  42. 55
    A system comprising:a first computing device configured to perform the method of any one of claims 41-52;and a second computing device configured to receive one of the first component or the second component
  43. 56
    A method comprising:providing a plurality of components of a multimedia content item, wherein the plurality of components comprises an audio component and a video component;monitoring network conditions, wherein the monitoring comprises comparing bandwidth utilization rates, for a session associated with delivery of the multimedia content item, to a bandwidth utilization rate threshold;based on a first event occurring while providing the plurality of components and based on a bandwidth utilization rate, of the compared bandwidth utilization rates and for a time associated with the first event, exceeding the bandwidth utilization rate threshold: causing delivery of the video component to be stopped;and continuing to provide the audio component while delivery of tire video component is stopped;and based on a second event occurring while delivery of the video component is stopped: determining a timestamp associated with the audio component or with the second event;and resuming, based on the timestamp, delivery of the video component.
  44. 59
    The method of any one of claims 56-58, further comprising providing a screen shot while deliveiy of the video component is stopped.
  45. 60
    The method of any one of claims 56-59, wherein each of foe first event and foe second event comprises one or more of:an event associated with a network condition;an event associated with inactivity;or an event associated with activity.
  46. 61
    The method of any one of claims 56-60, wherein foe first event comprises a determination that a first graphical user interface presenting foe video component and foe audio component is at least partially obscured by a second graphical user interface.
  47. 62
    The method of any one of claims 56-60, wherein foe first event comprises a determination that a user input has not been received for a period of time.
  48. 63
    The method of any one of claims 56-60, wherein foe first event is based on user inattention to foe multimedia content item, and wherein, based on foe user inattention, deliveiy of foe video component is stopped while deliveiy of foe audio component continues.
  49. 64
    The method of any one of claims 56-63, further comprising providing a smaller window for display of another version of foe video component while delivery of foe video component is stopped. -30Date Reçue/Date Received 2022-12-28
  50. 65
    The method of any one of claims 56-64, wherein the second event is based on a bandwidth utilization rate, of the compared bandwidth utilization rates and for providing the audio component, falling below the bandwidth utilization rate threshold.
  51. 66
    A computer readable medium storing instructions that, when executed, cause performance of the method of any one of claims 56-65.
  52. 67
    An apparatus comprising:one or more processors;and memory storing instructions that, when executed by the one or more processors, cause the apparatus to perform the method of any one of claims 56-65.
  53. 68
    A system comprising:a first computing device configured to perform the method of any one of claims 56-65;and a second computing device configured to receive a component of the multimedia content item.
  54. 69
    A method comprising:providing a plurality of components of a multimedia content item, wherein the plurality of components comprises an audio component of the multimedia content item and a first version of a video component of the multimedia content item;monitoring network conditions, wherein the monitoring comprises comparing bandwidth utilization rates, for a session associated with delivery of the multimedia content item, to a bandwidth utilization rate threshold;based on a first event and based on a bandwidth utilization rate, of the compared bandwidth utilization rates and for a time associated with the first event, exceeding the bandwidth utilization rate threshold: determining a first time associated with the first version;and -31Date Reçue/Date Received 2022-12-28 replacing the first version, based on the first time, with a second version of the video component of the multimedia content item;and based on a second event: determining a second time associated with the second version;and replacing the second version, based on the second time, with the first version.
  55. 74
    The meAod of any one of claims 69-73, wherein each of Ae first event and Ae second event comprises one or more of:an event associated wi A a network condition;-32Date Reçue/Date Received 2022-12-28 an event associated with inactivity;or an event associated with activity.
  56. 75
    The method of any one of claims 69-74, wherein the first event comprises a determination that a first graphical user interface presenting the first version and the audio component is at least partially obscured by a second graphical user interface.
  57. 76
    The method of any one of claims 69-74, wherein the first event is based on determining that output of the multimedia content item is at least partially obscured on a display;and wherein the second version of the video component comprises a lower quality version of the multimedia content item than the first version.
  58. 77
    The method of any one of claims 69-76, wherein the second event is based on a bandwidth utilization rate, of the compared bandwidth utilization rates and for providing the audio component, falling below the bandwidth utilization rate threshold.
  59. 78
    The method of any one of claims 69-77, wherein:the first version of the video component of the multimedia content item comprises high definition video;and ihe second version of the video component of the multimedia content item comprises standard definition video.
  60. 79
    A computer readable medium storing instructions that, when executed, cause performance of the method of any one of claims 69-78.
  61. 80
    An apparatus comprising:one or more processors;and memory storing instructions that, when executed by the one or more processors, cause the apparatus to perform the method of any one of claims 69-78. -33Date Reçue/Date Received 2022-12-28
  62. 81
    A system comprising:a first computing device configured to perform the method of any one of claims 69-78;and a second computing device configured to receive a component of the multimedia content item. -34Date Reçue/Date Received 2022-12-28
Independent claims62