System and method for transferring data over a network

CROSS REFERENCE TO RELATED APPLICATIONS

0001Not applicable.

FIELD OF THE INVENTION

0002The present invention relates to computer software and, more particularly, to a system and method for transferring data over a network such as the Internet.

BACKGROUND OF THE INVENTION

0003A computer system in which one or more client machines communicate with one or more servers over a network is a common arrangement. For example, there are millions of personal computers (PCs) connected to the Internet for communication with various servers. Many of these PC users acquire new or updated software on their PCs by downloading the software from a remote server over the Internet.

0004Conventional methods of uploading and downloading data, such as new and updated software to a PC over a network such as the Internet interfere with the PC user's ability to browse the Internet or to otherwise communicate over the network during the download. With increased processing speeds for PCs, it is the bandwidth to the Internet which is becoming a significant bottleneck to the user's browsing experience. Because conventional downloads typically occupy 100% of the user's available communication bandwidth until the download is complete, the user is unable to utilize the network for other tasks during the download. Moreover, if the download is interrupted for some reason (e.g., the network connection is lost), it may be necessary to restart the download from the beginning of the file, thus wasting significant network resources. Other conventional downloading software permits the user to schedule the download for a designated time. In any event, conventional methods for downloading software over a network such as the Internet severely limit the user's ability to engage in other network activity.

0005Providing software updates is beneficial to PC users because it corrects problems and improves the performance of their PCs. Additionally, the software vendor benefits from a reduction in the number of product support calls, which in turn reduces the substantial resources the vendor might otherwise allocate to handling such calls.

0006Microsoft Corporation provides a software update service in connection with its MICROSOFT WINDOWS family of operating system products under the mark “WINDOWS UPDATE”. By accessing the “WINDOWS UPDATE” Internet website, MICROSOFT WINDOWS users can have their system evaluated and download both critical and non-critical software updates (e.g., a fix or a patch) over the Internet. Upon determining there are updates available which are not already loaded on the user's PC, the user is notified that such updates are available, and the user is prompted to select one or more of them for downloading over the Internet. While this is a convenient method for providing software updates to users, such downloads could interfere with other network activity. Moreover, it is likely that many users will not take the initiative to navigate to the “WINDOWS UPDATE” website and download operating system updates for their PCs. Consequently, users who have not yet downloaded critical updates are more likely to encounter problems with their PCs, and they will likely call the vendor's product support line when a problem arises.

0007Accordingly, there is a need for an effective method for downloading software updates over a network so that interference with other network activity is minimized. One potential solution is simply to increase network bandwidth. However, increased bandwidth is expensive and has historically been followed by increased user demands. Thus, even as available bandwidth increases with technological advances, there will continue to be a need to eliminate interference with other network activity because of the corresponding increases in user demands.

SUMMARY OF THE INVENTION

0008In one aspect, the present invention is directed to a method of transferring a set of data over a network. The method includes the steps of monitoring the level of actual network bandwidth utilization and identifying a maximum monitored level of actual utilization. Then, the method calculates a threshold level of utilization as a function of the maximum monitored level of utilization. If the actual level is less than the threshold level, at least a portion of the set of data is received over the network.

0009Another aspect of the present invention is directed to a computer-readable medium having stored thereon a data structure which includes a first data field and a second data field. The first data field contains data representing a maximum monitored level of actual network bandwidth utilization. The second data field contains data representing a threshold level of network bandwidth utilization below which data may be transferred over the network without interfering with other network activity. The second data field is derived from the first data field by calculating the threshold level as a function of the maximum monitored level.

0010Yet another aspect of the present invention involves a computer-readable medium having computer-executable components for managing the transfer of data over a network The first component is a bandwidth monitoring component which monitors the level of actual bandwidth utilization for a network connection and identifies a maximum monitored level of utilization. The second component is a threshold calculating component which calculates a threshold level of utilization as a function of the maximum monitored level of utilization identified by the first component. The third component is a transfer management component which manages the transfer of data over the network when the level of actual bandwidth utilization is less than the threshold level of utilization.

0011Still another aspect of the present invention is directed to a method of communicating between a client process and a server process over a network. The method includes issuing to the server process a first download request which identifies a file and which requests that the server process download a first segment of the file over the network. The method also includes downloading, by the server process, the first segment of the file. Then, the method issues to the server process a further download request which is associated with the file and which requests that the server process download a further segment of the file over the network, provided the actual network bandwidth utilization is less than a threshold level. The method further includes downloading, by the server process, the further segment of the file. Finally, the method includes repeating the step of issuing a further download request and the step of downloading the further segment until the server process has downloaded each segment of the file over the network.

0012In an alternate embodiment of the present invention, an aspect is directed to a method of transferring a set of data over a network. The method includes the steps of monitoring the level of actual network bandwidth utilization and identifying an average monitored level of actual utilization. Then, the method calculates the size of a data block to be transferred as a function of current activity and bandwidth threshold. A block of the computed size is then downloaded.

0013Another aspect of an alternate embodiment of present invention is directed to a computer-readable medium having stored thereon a data structure which includes a first data field and a second data field. The first data field contains data representing a timestamp corresponding to the sample time of network utilization. The second data field contains data representing the total number of bytes that have passed through the network adapter.

0014Yet another aspect of an alternate embodiment of the present invention involves a computer-readable medium having computer-executable components for managing the transfer of data over a network. The first component is a bandwidth monitoring component which monitors the level of actual bandwidth utilization for a network connection and identifies an average monitored level of utilization. The second component is a transfer block size calculating component which calculates the block size to be transferred based on utilization as a function of the average level of utilization identified by the first component. The third component is a transfer management component which manages the transfer of data over the network at the computed block size.

0015Still another aspect of an alternate embodiment of the present invention is directed to a method of continuously refining network speed computations and consequently data block size computations. The method includes sampling network usage at intervals, and computing a moving average of the obtained speeds over a number of samples. The most recent sample is given a heavier weighting in the averaging computation. The sampling interval of the network is adjusted based on the speed of the network.

BRIEF DESCRIPTION OF THE SEVERAL VIEWS OF THE DRAWING

0016The present invention is described in detail below with reference to the attached drawing figures, wherein:

0017<figref idref="DRAWINGS">FIG. 1</figref> is a block diagram of a suitable computing system environment for use in implementing the present invention;

0018<figref idref="DRAWINGS">FIG. 2</figref> is a block diagram of a system including a client machine which communicates with a server over a network;

0019<figref idref="DRAWINGS">FIG. 3</figref> is a block diagram similar to <figref idref="DRAWINGS">FIG. 2</figref> but with first and second client machines connected to one another via an intranet;

0020<figref idref="DRAWINGS">FIG. 4</figref> is a diagram illustrating network bandwidth utilization over time with a curve representing the actual network bandwidth utilization and a broken line representing a threshold level of utilization calculated in accordance with the present invention;

0021<figref idref="DRAWINGS">FIG. 5</figref> is a block diagram illustrating the architecture of a client machine in accordance with the present invention;

0022<figref idref="DRAWINGS">FIG. 6</figref> is a block diagram of a data structure according to the present invention;

0023<figref idref="DRAWINGS">FIG. 7</figref> is a flowchart representative of a computer program for transferring data over a network in accordance with the present invention;

0024<figref idref="DRAWINGS">FIG. 8</figref> is a diagram illustrating network bandwidth utilization over time with a solid curve representing the actual network bandwidth utilization and broken line curve representing the observed transfer rate between client and server, and the data flow rate through the network in accordance with a further embodiment of the present invention;

0025<figref idref="DRAWINGS">FIG. 9</figref> is a block diagram of a data structure according to the further embodiment of the present invention; and

0026<figref idref="DRAWINGS">FIG. 10</figref> is a flowchart representative of a computer program for transferring data over a network in accordance with the further embodiment of the present invention.

DETAILED DESCRIPTION OF THE INVENTION

0027The present invention provides a system and method for transferring data over a network such as the Internet.

0028<figref idref="DRAWINGS">FIG. 1</figref> illustrates an example of a suitable computing system environment in which the invention may be implemented. The computing system environment is only one example of a suitable computing environment and is not intended to suggest any limitation as to the scope of use or functionality of the invention. Neither should the computing environment be interpreted as having any dependency or requirement relating to any one or combination of components illustrated in the exemplary operating environment.

0029The invention is operational with numerous other general purpose or special purpose computing system environments or configurations. Examples of well known computing systems, environments, and/or configurations that may be suitable for use with the invention include, but are not limited to, personal computers, server computers, hand-held or laptop devices, multiprocessor systems, microprocessor-based systems, programmable consumer electronics, network PCs, minicomputers, mainframe computers, distributed computing environments that include any of the above systems or devices, and the like.

0030The invention may be described in the general context of computer-executable instructions, such as program modules, being executed by a computer. Generally, program modules include routines, programs, objects, components, data structures, etc. that perform particular tasks or implement particular abstract data types. The invention may also be practiced in distributed computing environments where tasks are performed by remote processing devices that are linked through a communications network. In a distributed computing environment, program modules may be located in both local and remote computer storage media including memory storage devices.

0031With reference to <figref idref="DRAWINGS">FIG. 1</figref>, an exemplary system for implementing the invention includes a general purpose computing device in the form of a computer <b>20</b>. Components of computer <b>20</b> include, but are not limited to, a processing unit <b>22</b>, a system memory <b>24</b>, and a system bus <b>26</b> that couples various system components including the system memory to the processing unit <b>22</b>. The system bus <b>26</b> may be any of several types of bus structures including a memory bus or memory controller, a peripheral bus, and a local bus using any of a variety of bus architectures. By way of example, and not limitation, such architectures include Industry Standard Architecture (ISA) bus, Micro Channel Architecture (MCA) bus, Enhanced ISA (EISA) bus, Video Electronics Standards Association (VESA) local bus, and Peripheral Component Interconnect (PCI) bus also known as Mezzanine bus.

0032Computer <b>20</b> typically includes a variety of computer readable media. Computer readable media can be any available media that can be accessed by computer <b>20</b> and includes both volatile and nonvolatile media, removable and non-removable media. By way of example, and not limitation, computer readable media may comprise computer storage media and communication media. Computer storage media includes both volatile and nonvolatile, removable and non-removable media implemented in any method or technology for storage of information such as computer readable instructions, data structures, program modules or other data. Computer storage media includes, but is not limited to, RAM, ROM, EEPROM, flash memory or other memory technology, CD-ROM, digital versatile disks (DVD) or other optical disk storage, magnetic cassettes, magnetic tape, magnetic disk storage or other magnetic storage devices, or any other medium which can be used to store the desired information and which can be accessed by computer <b>20</b>. Communication media typically embodies computer readable instructions, data structures, program modules or other data in a modulated data signal such as a carrier wave or other transport mechanism and includes any information delivery media. The term “modulated data signal” means a signal that has one or more of its characteristics set or changed in such a manner as to encode information in the signal. By way of example, and not limitation, communication media includes wired media such as a wired network or direct wired connection, and wireless media such as acoustic, RF, infrared and other wireless media. Combinations of any of the above should also be included within the scope of computer readable media.

0033The system memory <b>24</b> includes computer storage media in the form of volatile and/or nonvolatile memory such as read only memory (ROM) <b>28</b> and random access memory (RAM) <b>30</b>. A basic input/output system <b>32</b> (BIOS), containing the basic routines that help to transfer information between elements within computer <b>20</b>, such as during start-up, is typically stored in ROM <b>28</b>. RAM <b>30</b> typically contains data and/or program modules that are immediately accessible to and/or presently being operated on by processing unit <b>22</b>. By way of example, and not limitation, <figref idref="DRAWINGS">FIG. 1</figref> illustrates operating system <b>46</b>, application programs <b>48</b>, other program modules <b>50</b>, and program data <b>52</b>.

0034The computer <b>20</b> may also include other removable/non-removable, volatile/nonvolatile computer storage media. By way of example only, <figref idref="DRAWINGS">FIG. 1</figref> illustrates a hard disk drive <b>34</b> that reads from or writes to non-removable, nonvolatile magnetic media, a magnetic disk drive <b>36</b> that reads from or writes to removable, nonvolatile magnetic disk <b>38</b>, and an optical disk drive <b>40</b> that reads from or writes to a removable, nonvolatile optical disk <b>42</b> such as a CD ROM or other optical media. Other removable/non-removable, volatile/nonvolatile computer storage media that can be used in the exemplary operating environment include, but are not limited to, magnetic tape cassettes, flash memory cards, digital video disks, digital video tape, Bernoulli cartridges, solid state RAM, solid state ROM, and the like. The hard disk drive <b>34</b>, magnetic disk drive <b>36</b>, and optical disk drive <b>40</b> are typically connected to the system bus <b>26</b> by a Small Computer System Interface (SCSI) <b>44</b>. Alternatively, the hard disk drive <b>34</b>, magnetic disk drive <b>36</b> and optical disk drive <b>40</b> may be connected to the system bus <b>26</b> by a hard disk drive interface, a magnetic disk drive interface, and an optical drive interface, respectively.

0035The drives and their associated computer storage media discussed above and illustrated in <figref idref="DRAWINGS">FIG. 1</figref>, provide storage of computer readable instructions, data structures, program modules and other data for the computer <b>20</b>. In <figref idref="DRAWINGS">FIG. 1</figref>, for example, hard disk drive <b>34</b> is illustrated as storing operating system <b>46</b>, application programs <b>48</b>, other program modules <b>50</b>, and program data <b>52</b>. Note that these components can either be the same as or different from operating system <b>46</b>, application programs <b>48</b>, other program modules <b>50</b>, and program data <b>52</b>. A user may enter commands and information into the computer <b>20</b> through input devices such as a keyboard <b>54</b> and pointing device <b>56</b>, commonly referred to as a mouse, trackball or touch pad. Other input devices (not shown) may include a microphone, joystick, game pad, satellite dish, scanner, or the like. These and other input devices are often connected to the processing unit <b>22</b> through a user input interface <b>58</b> or a serial port interface <b>60</b> that is coupled to the system bus, but may be connected by other interface and bus structures, such as a parallel port, game port or a universal serial bus (USB). A monitor <b>61</b> or other type of display device is also connected to the system bus <b>26</b> via an interface, such as a video adapter <b>62</b>. In addition to the monitor <b>61</b>, computers may also include other peripheral output devices such as speakers and printers, which may be connected through an output peripheral interface.

0036The computer <b>20</b> may operate in a networked environment using logical connections to one or more remote computers, such as a remote computer <b>64</b>. The remote computer <b>64</b> may be a personal computer, a server, a router, a network PC, a peer device or other common network node, and typically includes many or all of the elements described above relative to the computer <b>20</b>, although only a memory storage device has been illustrated in FIG. <b>1</b>. The logical connections depicted in <figref idref="DRAWINGS">FIG. 1</figref> include a local area network (LAN) <b>66</b> and a wide area network (WAN) <b>68</b>, but may also include other networks. Such networking environments are commonplace in offices, enterprise-wide computer networks, intranets and the Internet.

0037When used in a LAN networking environment, the computer <b>20</b> is connected to the LAN <b>66</b> through a network interface or adapter <b>70</b>. When used in a WAN networking environment, the computer <b>20</b> typically includes a modem <b>72</b> or other means for establishing communications over the WAN <b>68</b>, such as the Internet. The modem <b>72</b>, which may be internal or external, may be connected to the system bus <b>26</b> via the serial port interface <b>60</b> or other appropriate mechanism. In a networked environment, program modules depicted relative to the computer <b>20</b>, or portions thereof, may be stored in the remote memory storage device. By way of example, and not limitation, <figref idref="DRAWINGS">FIG. 1</figref> illustrates remote application programs <b>48</b> as residing on memory device <b>64</b>. It will be appreciated that the network connections shown are exemplary and other means of establishing a communications link between the computers may be used.

0038Although many other internal components of the computer <b>20</b> are not shown, those of ordinary skill in the art will appreciate that such components and the interconnection are well known. Accordingly, additional details concerning the internal construction of the computer <b>20</b> need not be disclosed in connection with the present invention.

0039Those skilled in the art will understand that program modules such as the operating system <b>46</b>, application programs <b>48</b> and data <b>52</b> are provided to the computer <b>20</b> via one of its memory storage devices, which may include ROM <b>28</b>, RAM <b>30</b>, hard disk drive <b>34</b>, magnetic disk drive <b>36</b> or optical disk drive <b>40</b>. Preferably, the hard disk drive <b>34</b> is used to store data <b>52</b> and programs, including the operating system <b>46</b> and application programs <b>48</b>.

0040When the computer <b>20</b> is turned on or reset, the BIOS <b>32</b>, which is stored in the ROM <b>28</b> instructs the processing unit <b>22</b> to load the operating system from the hard disk drive <b>34</b> into the RAM <b>30</b>. Once the operating system <b>46</b> is loaded in RAM <b>30</b>, the processing unit <b>22</b> executes the operating system code and causes the visual elements associated with the user interface of the operating system <b>46</b> to be displayed on the monitor <b>61</b>. When an application program <b>48</b> is opened by a user, the program code and relevant data are read from the hard disk drive <b>34</b> and stored in RAM <b>30</b>.

0041With reference to <figref idref="DRAWINGS">FIG. 2</figref>, an exemplary system for practicing the present invention is designated generally by reference numeral <b>74</b>. The system <b>74</b> includes a client machine such as a PC <b>76</b> and a communications device <b>78</b> such as a modem for accessing a network <b>80</b> (e.g., the Internet). A server <b>82</b> is also connected to the network <b>80</b> in a conventional manner. The PC <b>76</b> and modem <b>78</b> establish a connection with the server <b>82</b> over the network <b>80</b> to facilitate the transfer of data between the client and the server.

0042A system <b>84</b> set forth in <figref idref="DRAWINGS">FIG. 3</figref> is similar to the system <b>74</b> of <figref idref="DRAWINGS">FIG. 2</figref>, except that the system <b>84</b> includes a first client <b>86</b>A and a second client <b>86</b>B which are connected to one another over a link <b>88</b> such as an intranet. As with the system <b>74</b>, the communications device <b>78</b> (e.g., a modem) establishes a connection between the first client <b>86</b>A and the network <b>80</b>. Accordingly, the clients <b>86</b>A, <b>86</b>B can exchange data with the server <b>82</b> over the network <b>80</b>.

0043Those skilled in the art will readily appreciate that the present invention encompasses many possible variations to the systems <b>74</b>, <b>84</b> shown in <figref idref="DRAWINGS">FIGS. 2 and 3</figref>. Of course, any number of client and server machines may be connected to the network <b>80</b> (either directly or indirectly). For example, the system <b>84</b> could include more than two client machines, one of which would act as a proxy for the others. In that case, the client machines could be connected to one another over an intranet, and the network card in the proxy machine could be connected to a router which is linked to the network <b>80</b> over a T1 line. Moreover, the network <b>80</b> could be the Internet or any other public or private network. Additionally, the communications device <b>78</b> may be part of the PC <b>76</b> or an independent hardware device.

0044In one application of the present invention, the client machine is the PC <b>76</b>, the device <b>78</b> is a 56 Kbps (Kilobits per second) modem, the network <b>80</b> is the Internet, and the server <b>82</b> is a website accessible over the Internet for downloading software updates for the operating system of the PC. Referring to <figref idref="DRAWINGS">FIG. 4</figref>, a curve <b>90</b> represents the level of actual network bandwidth utilization for a client PC accessing the Internet over a period of time. The curve <b>90</b> rises from T₀through T₂to reflect the flurry of network activity which typically occurs as the user initially accesses the Internet. Then, after a brief decrease in network activity at T₃, the client's actual utilization again rises dramatically to a peak at T₄. This peak could represent any number of possible actions initiated by the client, such as the downloading of a webpage or the opening of an email message. While the user at the client machine reads the web page or the email message, or perhaps listens to music over the Internet, the actual network utilization decreases to a significantly lower level from T₅through T₈.

0045The relatively low level of actual network bandwidth utilization shown from T₅through T₈(<figref idref="DRAWINGS">FIG. 4</figref>) is sometimes referred to as “network idle.” This concept differs from “machine idle,” which occurs when a PC user is not currently using the keyboard or mouse. If the machine remains idle for a period of time, a screen saver may be invoked. However, network utilization may be high at the same time the machine is idle (e.g., during a download), and the network interface may be “idle” when the machine is not. Thus, the present invention is directed to the transfer of a set of data, such as a software update, over a network at a time when the network utilization is relatively low. This transfer of data is intended to be transparent to the user, and the user's machine need not be idle during the transfer. This transfer of data could just as easily relate to activities initiated by a user action on the PC, such as playing video games or downloading music MP3 files, eBooks and so on. Moreover, the data to be transferred may include text, image and/or audio data. The present invention is also equally applicable to uploads from the client to the server or other communication of data between computers.

0046As described below in connection with <figref idref="DRAWINGS">FIG. 7</figref>, the present invention monitors the level of actual utilization represented by the curve <b>90</b> (<figref idref="DRAWINGS">FIG. 4</figref>) and calculates a threshold level of utilization below which the transfer of data between the client and server is not likely to interfere with other network activity. In a preferred embodiment, the threshold level is equal to approximately 33% of the maximum detected level of actual network utilization. As shown in <figref idref="DRAWINGS">FIG. 4</figref>, the threshold level is generally designated by reference numeral <b>92</b> and is initially set to zero. Network activity is periodically sampled, and a new threshold level is calculated each time a new maximum is identified. At T₁, the level of actual bandwidth usage is 15 Kbps, which is a new maximum, so the threshold <b>92</b> is set to 5 Kbps. The level of actual bandwidth usage is again sampled at T₂, and another new maximum of 30 Kbps is identified. Consequently, the new threshold <b>92</b> is calculated to be 10 Kbps.

0047When the level of actual usage <b>90</b> drops below the threshold level <b>92</b>, as at T₃, a brief transfer of data should not significantly interfere with other network activity. The transfer of data could be initiated immediately upon first detecting that the actual usage is below the threshold level. However, a more conservative approach, in that it is more deferential to the user, is to detect at least two consecutive occurrences of low usage before initiating a download. In any event, a new maximum of 45 Kbps is detected at T₄, thereby triggering the calculation of an updated threshold level of 15 Kbps. Consequently, if any data transfer were initiated at T₃, then it would be immediately suspended at T₄. At T₅, the actual usage <b>90</b> once again drops below the threshold level <b>92</b>. This time, the level of actual usage <b>90</b> remains between 5-10 Kbps, which is less than the threshold level of 15 Kbps, from T₅to T₈. Thus, the transfer of data over the network would not interfere with other network activity during this time period.

0048A preferred architecture of the client of the present invention is set forth in <figref idref="DRAWINGS">FIG. 5. A</figref> client <b>94</b> includes an update client <b>96</b>, an update engine <b>98</b>, an update downloader <b>100</b> and an update applet <b>102</b>. The client <b>94</b> is connected to a server such as via an update website <b>104</b> over a pair of links <b>106</b>, <b>108</b>, which are preferably HTTP (Hypertext Transfer Protocol) links. The update client <b>96</b> is responsible for notifications and personalization options for the user. The update engine <b>98</b> controls content interaction with the update site <b>104</b> as well as detection, installation and logging of software updates. The update downloader <b>100</b> is responsible for implementing the packet background downloading/throttling and incoming packet queue management. The update applet <b>102</b> determines the configuration of update notifications to the user and other interactions with the user. The backend content and catalogs are available from the update site <b>104</b>.

0049The present invention utilizes a data structure <b>110</b> illustrated in FIG. <b>6</b>. The data structure <b>110</b> includes a first field <b>112</b> which contains the maximum identified level of actual bandwidth utilization and a second field <b>114</b> which contains the threshold level of utilization. As shown in <figref idref="DRAWINGS">FIG. 4</figref>, both the maximum identified level and the threshold level can vary over time depending on the level of actual utilization. As mentioned above, the threshold level is calculated as a function of the maximum identified level of actual usage. Therefore, a new threshold level is calculated each time a new maximum level is detected.

0050<figref idref="DRAWINGS">FIG. 7</figref> sets forth a flowchart representative of a computer program for selectively transferring data over a network in accordance with a preferred embodiment of the present invention. The program is started at step <b>120</b> when certain predetermined conditions are present. Typically, the client PC should be turned “on” and connected to the network before starting the program. While it would be possible for the program to establish the connection between the PC and the network, some PC users may be startled by the unexpected sound of their modem dialing up the network on its own. It is also possible that the client may be connected to another network (e.g., a private network) so that access to a webserver is not possible until the client disconnects from the private network and reconnects to the Internet. It can be confirmed that the client and server are connected to the same network by “pinging” the server and receiving an acknowledgment from the server. Those skilled in the art can readily determine which preliminary conditions would be appropriate in a given situation.

0051Once the client is connected to the same network as the server, the level of actual network bandwidth utilization is obtained at step <b>122</b>. As shown in <figref idref="DRAWINGS">FIG. 4</figref>, the actual usage is sampled periodically (e.g., every five seconds). Preferably, this is done by tracking the number of incoming and outgoing packets over a given time period (e.g., one second) at the communications interface between the client and the network. For a PC running the “WINDOWS 98” operating system, this information is available using the GetIfEntry function in “iphlpapi.dll”.

0052Relatively large files provide a more accurate basis for measuring the level of actual network bandwidth usage at the network interface. For example, it is difficult to accurately measure the download time for a 200 byte file because the overhead of measurement is significant and the small file does not saturate the available bandwidth. Consequently, the present invention preferably updates the maximum level of utilization only when the measurement of the actual level of utilization is based on the transfer speed of a file that is at least 4 KB in size.

0053Preferably, each of the “virtual devices” is enumerated to ensure accurate monitoring, especially in a system which is more complex than the system <b>74</b>. The term “virtual device,” as used herein, refers to any networking device with a device driver, such as modems (including cable modems and ISDN modems), network cards and DSLs (Digital Subscriber Lines). Each channel of a 2-channel ISDN modem is considered to be a separate virtual device for the purposes of the present invention.

0054Importantly, the level of actual network bandwidth utilization is monitored rather than simply relying on the rated or listed throughput of the network device. The rated value is not reliable because, as a practical matter, the maximum throughput achieved by a modem is less than its listed throughput and may be different for each network session. Variables such as the quality of the telephone connection typically result in a maximum available bandwidth of less than 50 Kbps for a 56 Kbps modem.

0055Moreover, rated values cannot be assumed to be accurate when a client is connected to the network by a proxy. In the system <b>84</b>, there is a peer-to-peer connection between the first client <b>86</b>A and the second client <b>86</b>B over the intranet <b>88</b>, and the first client <b>86</b>A is in turn linked to the network <b>80</b> by a modem <b>78</b>. Assuming a 56 Kbps modem and a 10 Mbps intranet, the modem <b>78</b> is the bottleneck to the network <b>80</b>. Thus, if the first client <b>86</b>A were utilizing 40 Kbps of the network bandwidth at the same time the second client <b>86</b>B is utilizing only 5 Kbps of the bandwidth, there would not be sufficient network bandwidth available to download a set of data (e.g., a software update) from the server <b>82</b> to either client without degrading their other network activity. Moreover, it would not be accurate to assume either that the second client <b>86</b>B has a maximum throughput of 10 Mbps or that substantial bandwidth is available because the second client <b>86</b>B is only using 5 Kbps of the network interface. Here, in the case of remote access, the level of actual bandwidth utilization for the second client <b>86</b>B can be obtained from the RAS (Remote Access Service) device table. Thus, monitoring the actual throughput at each virtual device advantageously adapts to configuration changes between sessions and is therefore a more reliable approach.

0056Referring again to <figref idref="DRAWINGS">FIG. 7</figref>, the maximum detected level of actual usage is initially set to zero. Then, at step <b>124</b>, it is determined whether the actual usage is greater than the current maximum. If not, the actual usage is sampled again at step <b>122</b>. However, if the actual usage is greater than the current maximum, then a new maximum is set equal to the current actual level at step <b>126</b>. Next, a threshold level is calculated as a function of the maximum at step <b>128</b>. The threshold is initially set to zero, and a new threshold is calculated each time a new maximum is detected. As a general proposition, the threshold level could be anywhere from approximately 5%-80% of the maximum detected level. However, the presently preferred threshold level for Internet applications is approximately 33% of the maximum detected level. Once the new threshold level has been calculated, the actual usage is sampled again at step <b>122</b>.

0057It should be noted that the present invention calculates the threshold level as a percentage of actual network bandwidth in Kilobits per second, as opposed to some other parameter, such as the percentage of time the network connection is busy over a given period. For example, a client machine utilizing its network connection 75% of the time over the course of an hour is not necessarily using 75% of its available bandwidth. In fact, if the user at the client PC is merely reading a webpage, reading email, listening to music or the like, it is likely that the level of actual bandwidth utilization is well below the maximum available bandwidth. Those skilled in the art will understand that the present invention, which is implemented at the client level, is fundamentally different from methods for limiting bandwidth at the hardware level (e.g., sockets).

0058Each time the level of actual network bandwidth utilization is obtained at step <b>122</b>, it is also compared to the current threshold level. At step <b>130</b>, it is determined whether the actual usage is less than the threshold level. If so, a software update (or other set of data) available from the server can be downloaded over the network to the client. To minimize interference with any other present or future network activity of the client, the download is preferably performed by downloading the software update in several segments. Accordingly, at step <b>132</b>, one segment of the file is downloaded from the server to the client. If the client's network activity increases after downloading the first segment, the download of the entire file can be suspended until the actual usage drops back down below the threshold level. However, if the network is idle for an extended period of time, the download can be accelerated by downloading progressively larger segments of the file over the network.

0059A counting device is provided in a preferred embodiment of the present invention to facilitate the downloading of progressively larger file segments. For example, a 144 KB file may be downloaded from the server to the client over the Internet by first transferring an 8 KB segment of the file at step <b>132</b> of <figref idref="DRAWINGS">FIG. 7. A</figref> small segment such as 8 KB has been found to be an effective default because it uses 100% of the pipeline for a short period of time and permits frequent monitoring of actual usage between segments. Even if a user clicks on an URL (Uniform Resource Locator) during the download of an 8 KB block, there will be no noticeable delay to the user. Moreover, in the event an interruption occurs, 8 KB is the most data that can be lost.

0060At step <b>134</b>, it is determined whether the entire file has been downloaded. Since the 8 KB block was the first segment of the 144 KB file, the entire file has not been downloaded and the counter, which is initially set to zero, is incremented to “1” at step <b>136</b>. The counter keeps track of the number of segments that have been downloaded consecutively without interruption so that the size of the segments can be increased so long as network activity remains low. As an example, the size of the segments could be increased to 16 KB if the counter is equal to “2”, and the size of the segments could be increased to 32 KB if the counter is equal to “4”. This would enable the 144 KB file to be downloaded in seven progressively larger segments as opposed to 18 of the smaller 8 KB segments, provided network activity stays below the threshold level. Although the larger segments take longer to download and therefore result in less frequent monitoring of the actual usage, this approach takes advantage of any extended periods of low network activity. Typically a header accompanies each segment, so transferring a smaller number of larger segments also reduces network overhead by reducing the total number of headers transferred over the network. Presently, a 64 KB segment is the largest segment that is preferred when using a 56 Kbps modem.

0061After incrementing the counter at step <b>136</b>, steps <b>122</b> and <b>130</b> are repeated. If the level of actual usage is no longer less than the threshold level, the file download is suspended and the counter is cleared (i.e., set to zero) at step <b>138</b>. Then, the actual utilization is sampled again at step <b>122</b>. In the event the download is suspended, the download will be resumed from the point of suspension. However, if the actual usage remains below the threshold level, the next segment is downloaded at step <b>132</b>, and the process is repeated until it is determined at step <b>134</b> that the entire file has been downloaded. If so, the counter is cleared at step <b>140</b> and the loop ends at step <b>142</b>.

0062It should be noted that the progressive download feature of the present invention may require filtering or a similar technique to overcome the limitations of some existing servers. While progressive downloads have been widely available at the FTP (file transfer protocol) level, they were not available at the HTTP level until HTTP 1.1 servers became available. As discussed above, the present invention utilizes a byte range approach with 8 KB file segments as a default. For the first segment, a byte range of “0-7999” is specified in the download request from the client, the range “8000-15999” is specified in the download request for the second segment, and so on. However, the byte range portion of the request would be lost if an HTTP 1.0 server is encountered, and the entire file would be downloaded at once. One way to avoid this problem is to use an ISAPI (Internet Server Application Programming Interface) filter to simulate an HTTP 1.1 byte request across an HTTP 1.0 proxy. Then, even if an HTTP 1.0 server is encountered, the byte range information will not be lost.

0063Of course, the preferred size of the segment or byte range can vary dramatically based on factors such as the speed of the modem. The foregoing examples (e.g., the default segment size of 8 KB) are based on the assumption that a large number of users will access the network with 56 Kbps modems. However, it may be appropriate to assume that a large number of users will access the network with 28 Kbps modems. In that case, the preferred default segment size would be 4 KB rather than 8 KB. Likewise, the progressively larger segments would be 8 KB and 16 KB rather than 16 KB and 32 KB. Those skilled in the art will appreciate that the use of a variety of other segment sizes is also contemplated by the present invention.

0064In another embodiment of the present invention, the monitoring of actual bandwidth usage during an extensive download may be given more weight than the monitoring of actual bandwidth usage before or after such a download. That is, if a predetermined number of segments are downloaded consecutively, the average level of usage for each of the segments is adopted as the new “maximum” level. For example, if the predetermined number of segments is 10, the average level of usage during the downloading of ten consecutive segments would replace the previous maximum level even if the average level is less than the previous maximum value. Moreover, if 11 segments are consecutively downloaded, the average level would be calculated for segments <b>2</b>-<b>11</b> so that a moving average of 10 downloads determines both a new maximum level and a new threshold level.

0065Using a moving average to identify the maximum level advantageously provides a dynamic increase or decrease to the threshold level in response to changing network traffic conditions without compromising the accuracy of the measurement. Preferably, the maximum level will remain frozen at the most recent moving average (of the predetermined number of segments) until another extensive download occurs. In other words, a maximum level based on an extensive download is deemed to be a more accurate reflection of available bandwidth than the initial maximum level measured prior to a download. Likewise, the download of an isolated segment may not provide an accurate reflection of available bandwidth. To keep track of the number of consecutive downloads for the moving average, a counter such as the one referenced in <figref idref="DRAWINGS">FIG. 7</figref> may be used.

0066Another embodiment of the present invention is described below in conjunction with <figref idref="DRAWINGS">FIGS. 8-10</figref>. With reference to <figref idref="DRAWINGS">FIG. 10</figref>, the further embodiment of the present invention monitors the level of actual network utilization represented by the curve <b>804</b> (<figref idref="DRAWINGS">FIG. 8</figref>) and calculates the size of a block of data that can be transferred within a predetermined interval (T_n-1-T_n) (<figref idref="DRAWINGS">FIG. 8</figref>) such that transfer of data between the client and server is not likely to interfere with other network activity. A block represents a portion of an entire set of data that is to be transferred or other independent useful unit of data. This further embodiment more fully utilizes the available bandwidth of a Network by computing block sizes and refining network speed estimates, as opposed to an embodiment as described above that utilizes a fixed threshold value to determine when to transfer data.

0067In practice and by way of example and not limitation, <figref idref="DRAWINGS">FIG. 8</figref> illustrates some concepts from the further embodiment of this invention. As shown in <figref idref="DRAWINGS">FIG. 8</figref>, the sampling time is generally designated by T_nand the interval T_n-1-T_nis initially set to a value such as 1 second. In <figref idref="DRAWINGS">FIG. 8</figref>, the region (Area <b>1</b>) under the external usage curve <b>804</b> between the intervals T₁and T₂(<b>808</b>) would represent the total number of bytes that were transferred by processes other than the current invention. The region (Area <b>2</b>) bounded by the observed network throughput <b>802</b>, the external usage curve <b>804</b>, and the intervals T₁and T2 (<b>808</b>), represent the amount of bytes that could potentially be assigned for a block size. As shown, the Network throughput <b>802</b> and external usage <b>804</b> fluctuate over time, thereby necessitating the re-computation of block sizes in order to fully utilize the available bandwidth. Network activity is sampled at various points during each interval. The sampling interval is then adjusted in response to the determined network speed and utilization, rather than being maintained at a fixed value in contrast to the embodiment of <figref idref="DRAWINGS">FIGS. 4-7</figref>. This reduces CPU and network overhead that arises from using block sizes that are not optimized for the Network.

0068This embodiment includes three components. There is a network interface component that collects data about the number of bytes sent and received through the Network interface hardware. There is a network speed calculator component that determines Global speed, Download speed and Free bandwidth. Finally, there is the Data Block Download component that uses the values computed by the speed component to compute a block size and download interval size.

0069The algorithms used by this further embodiment are detailed below. Here again, it should be noted that the references within the following algorithms are exemplary, since this algorithm is equally applicable to the upload of data.

0070The embodiment divides each time interval into two phases, a download phase and an idle phase. During the download phase, the software downloads a block of data from the server. During the idle phase, the software relinquishes the network to other applications.

0071The network-monitor component of the embodiment has access to a counter that records the number of bytes that have passed through the network interface at a given moment. The difference between two readings of the counter indicates the number of bytes that have been transferred in the time between the two readings.

0072During each time interval (T_n-1-T_n), the network-monitor component samples the system clock and bytes-transferred counter at three points: (1) the start of the interval, which is also the start of the download phase, (2) the end of the download phase, and (3) the end of the interval. The download component records the interval length, the size of the block to be downloaded, and the expected duration of the download phase. At the end of the interval, the network-speed component updates its speed estimates as follows: <ul id="ul0001" list-style="none"><li id="ul0001-0001" num="0000"><ul id="ul0002" list-style="none"><li id="ul0002-0001" num="0073">1. If a block was downloaded during the interval, the download rate is calculated: <br />last-rate=(block size+network header size)/(time at point <b>2</b>−time at point <b>1</b>)</li><li id="ul0002-0002" num="0074"> and the average download rate is updated. The current embodiment uses the formula <br />new-download-rate=old-download-rate*(sample-count-<b>1</b>)/sample-count  (1)<br />new-download-rate=new-download-rate+(last-rate/sample-count)  (2)</li><li id="ul0002-0003" num="0075"> with sample-count set to 3 however, many other averaging formulae could be used instead.</li><li id="ul0002-0004" num="0076">This is also true of the other average values that the downloader calculates. The average download rate will enable the block-download component to choose a block size that can be completed during the download phase of the next interval.</li><li id="ul0002-0005" num="0077">2. The component measures network utilization during the download phase to arrive at global-speed: <br />Bytes-transferred=(bytes at point <b>2</b>−bytes at point <b>1</b>)<br />Download-phase-length=(time at point <b>2</b>−time at point <b>1</b>)<br />last-global-speed=bytes-transferred/download-phase-length</li><li id="ul0002-0006" num="0078"> If this is the first interval since the start of the downloader, the global-speed is set to last-global-speed. <ul id="ul0003" list-style="none"><li id="ul0003-0001" num="0079">Otherwise, <br />if last-global-speed&lt;global-speed/2<br />then global-speed=(global-speed*0.9).</li></ul></li><li id="ul0002-0007" num="0080">Last-global-speed is averaged into global-speed by the same algorithm used for the average download rate. Global-speed is used as an estimate of the total throughput of the network interface.</li><li id="ul0002-0008" num="0081">3. Measure the network utilization over the whole interval, calculate the portion that is from sources external to the downloader, and calculate percent-free: <br />Bytes-transferred=(bytes at point <b>3</b>−bytes at point <b>1</b>)−(block size+overhead)<br />Actual-interval-length=(time at point <b>3</b>−time at point <b>1</b>)<br />External-utilization=bytes-transferred/actual-interval-length<br />Percent-free=100*(1−external-utilization/global-speed)</li></ul></li></ul>

0082The block-downloader component uses Percent-free to choose the relative length of the download phase and idle phase of the following download interval. The further embodiment limits percent-free to 80% as insurance against an increase in external activity, other similar policies are also possible.

0083The further embodiment adjusts the duration of the sampling interval depending upon the network speed and utilization, rather than using a fixed value as in <figref idref="DRAWINGS">FIGS. 1-7</figref>. This reduces CPU and network overhead that arises from using block sizes that are not optimized for the Network. For instance, in many implementations, using a very large block size would require dedicating a prohibitive amount of memory as a buffer. Conversely, sending data as a series of very small blocks may waste resources by requiring extra network header fields and network protocol acknowledgements. Deriving block sizes that take full advantage of Network bandwidth and that minimize the interference to Network traffic is an advantage of this further embodiment. There are several steps and components involved in determining appropriate block sizes.

0084For the purpose of further illustration and with reference to <figref idref="DRAWINGS">FIG. 8</figref>, assume that the upper bound for a block size, which is dictated by the memory of the downloader, is 30 Kb, i.e. the downloader can hold 30 Kb of data before it needs to write to a disk. Assume further that that the default interval duration is one second and the computed block size for interval T₅-T₆is 35 Kb, which is beyond the maximum. As such, the algorithms of the present invention will shrink the durations of the next interval intervals T₆-T₇in order to reduce the block size below the maximum. Continuing with this illustration, if the interval T₆-T₇were reduced to 0.8 seconds for example, it will result in a computed block size of 28 Kb, which is within the bounds for a block size. Thus the next interval T₇-T₈(<b>820</b>) will also be set at 0.8 seconds instead of 1 second. Those skilled in the art will appreciate that the use of a variety of interval values and other block size boundaries are also contemplated by the present invention. Conversely, a block size is considered to be too small when the computed size falls below a default lower boundary which has been determined to be an inefficient size of data to transfer in the given interval. In this case, the downloader may choose to download the minimum size and then download nothing for one or more intervals, or it may choose to increase the interval length.

0085Several conservative approaches are taken in this further embodiment to support an acceptable level of system responsiveness while more fully utilizing available network bandwidth. Those skilled in the art will appreciate that any number of more or less conservative approaches could be used and are contemplated by the present invention. More specifically, a smoothing of the sampled network data is achieved by using an average for the Global Speed and Download Speed wherein, the average is weighted in favor of the most recent sample. In computing the running average, the latest sample counts for 30% of the new total, with the previous value counting for 70%. While this particular method of diluting the latest value with previous averages is used, other implementations would achieve the same result of allowing recovery from spikes in network activity. For example, keeping the last 10 samples and then re-computing an average using all the saved samples and the newly obtained sample each time would achieve the same result. Another approach that is taken involves a global rate that is determined to be less than one half of the average usage rate. In this case, it is assumed that the reduction is a result of client inactivity rather than a sudden loss of bandwidth. Thus, the newly determined Global speed value is not introduced into the average because that would unduly reduce the bandwidth average. However, the Global speed average is slightly reduced by a value such as 10%, in case the bandwidth really has changed. An example of such a bandwidth change would be if the telephone line noise suddenly increased due to a thunderstorm in the area. Yet another conservative approach that is taken involves limiting the Percent-free to a value such as 80%, in order to leave a little cushion for other applications.

0086The further embodiment of the present invention utilizes a data structure <b>900</b> illustrated in FIG. <b>9</b>. The data structure <b>900</b> includes a first field <b>912</b> which contains the time at which the identified level of actual bandwidth utilization was taken and a second field <b>914</b> which contains the total number of bytes through the network interface, a monotonically increasing counter of the bytes that have been sent or received by the adapter. As shown in <figref idref="DRAWINGS">FIG. 8</figref>, both the timestamp and the bytes count vary with each sampling, depending on the level of actual utilization <b>802</b>. By subtracting consecutive measurements of these values, an interval period and number of bytes transferred during the interval period are obtained.

0087<figref idref="DRAWINGS">FIG. 10</figref> sets forth a flowchart representative of a computer program for selectively transferring data over a network in accordance with the further embodiment of the present invention. The program is started at step <b>1000</b> when certain predetermined conditions are present. Once the client is connected to the same network as the server, the block size, Percent-free, and sampling interval are initialized to default values at step <b>1002</b>. As shown in <figref idref="DRAWINGS">FIG. 8</figref>, the actual usage is sampled periodically (e.g., every second). Preferably, as discussed above, this is done by tracking the number of incoming and outgoing bytes at important moments of the interval sample period (e.g., Start of interval, end of block transfer and end of interval) at the communications interface between the client and the network.

0088Referring again to <figref idref="DRAWINGS">FIG. 10</figref>, based on the initialized values for block size, Percent-free and interval, a block download and network data collection take place at step <b>1004</b>. Then, at step <b>1006</b>, the network speed related elements namely Download speed, Global speed and Percent-free are refined and updated accordingly. Next, a block size is calculated as a function of the network speed related elements at step <b>1008</b>. A new block size is calculated each time after a block download. As a general proposition, the block size could be anywhere between the size of communications packet header and the size of the memory allocated for the downloader. The presently preferred minimum block size for Internet applications is approximately 1000 bytes, 500 for block data and 500 for HTTP request and reply packet headers. Once the size has been calculated, the actual usage is sampled again at step <b>1004</b>.

0089At step <b>1006</b>, an average of download speed and Global speed are computed, along with the network Percent-free value. As previously discussed with reference to <figref idref="DRAWINGS">FIG. 8</figref>, during this process, it is determined whether the observed Global speed is within an acceptable range of the average Global speed, and whether Percent-free is less than a predetermined maximum fraction of bandwidth value. In the further embodiment of this invention, the observed Global speed must be greater than one half of the average Global speed in order to be included in the computation of a new average Global speed. Otherwise, the new average is determined to be 90% of the previous average Global speed. With regards to Percent-free, the further embodiment of this invention may require that a computed Percent-free value can be no greater than 80%.

0090Software updates (or other set of data) available from the server can be downloaded over the network to the client. As discussed above, to minimize interference with any other present or future network activity of the client, the download is preferably performed by downloading the software update in several segments otherwise referred to as a block. Accordingly, at step <b>1004</b>, one segment of the file is downloaded from the server to the client. If the client's network activity increases after downloading the first segment, the further embodiment will download smaller blocks unless the block size drops below the previously discussed minimum. However, if the network becomes idle, the next iteration of step <b>1006</b> will increase the block size appropriately.

0091At step <b>1008</b>, the computed block size is bounded to a lower and upper value. The lower boundary is a size so small that it is more efficient to do nothing in that particular interval. If a computed block size is below this boundary during two consecutive intervals, the size of the interval is incremented and no block is downloaded during this second interval, as shown at step <b>1010</b>. If the computed block size remains below the lower boundary during the newly incremented interval, the block size is set to a “Busy-block-size” and the interval is set to a default interval value. Busy-block-size is a value that allows a minimal download to occur such that, 1) some progress is made in the download process, 2) the invention is able to address a situation wherein a server is so slow that the calculated block size may never rise to the downloader minimum, and 3) the process of downloading allows the refinement of estimated network speeds. A block size that exceeds the maximum boundary results in a shrinking of the interval so that the computed block size can be kept within bounds.

0092The present invention has been described in connection with exemplary embodiments which are intended to be illustrative rather than restrictive. For example, the invention has been described in the context of downloading software updates for the operating system of the PC. The software updates could just as easily relate to many other types of software, such as updates to video games on the PC. Moreover, the data to be downloaded may include text, image and/or audio data. The present invention is also equally applicable to uploads from the client to the server.

0093Alternative embodiments of the present invention will become apparent to those skilled in the art to which it pertains upon review of the specification, including the drawing figures. Accordingly, the scope of the present invention is defined by the appended claims rather than the foregoing description.