Delegation of metadata management in a storage system by leasing of free file system blocks and i-nodes from a file system owner

BACKGROUND OF THE INVENTION

[0001] 1. Field of the Invention

[0002] The present invention relates generally to data storage systems, and more particularly to network file servers. The present invention specifically relates to a network file server in which file access is shared among a number of processors by granting file locks and distributing file metadata to the processors.

[0003] 2. Description of the Related Art

[0004] Mainframe data processing, and more recently distributed computing, have required increasingly large amounts of data storage. This data storage is most economically provided by an array of low-cost disk drives integrated with a large semiconductor cache memory.

[0005] In a network environment, at least one data mover computer is used to interface the cached disk array to the network. The data mover computer performs file locking management and mapping of the network files to logical block addresses of storage in the cached disk array, and moves data between network clients and the storage in the cached disk array.

[0006] In relatively large networks, it is desirable to have multiple data mover computers that access one or more cached disk arrays. Each data mover computer provides at least one network port for servicing client requests. Each data mover computer is relatively inexpensive compared to a cached disk array. Therefore, multiple data movers can be added easily until the cached disk array becomes a bottleneck to data access.

[0007] Unfortunately, data consistency problems may arise if concurrent client access to a read/write file is permitted through more than one data mover. These data consistency problems can be solved in a number of ways. For example, as described in Vahalia et al., U.S. Pat. No. 5,893,140 issued Apr. 6, 1999, entitled “File Server Having a File System Cache and Protocol for Truly Safe Asynchronous Writes,” incorporated herein by reference, locking information can be stored in the cached disk array, or cached in the data mover computers if a cache coherency scheme is used to maintain consistent locking data in the caches of the data mover computers.

[0008] When a large number of clients are concurrently accessing shared read-write files, there may be considerable access delays due to contention for locks not only on the files but also on the file directories. One way of reducing this contention is to assign each file system to only one data mover assigned the task of managing the locks on the files and directories in the file system. This permits the data mover file manager to locally cache and manage the metadata for the files and directories of the file system. For example, as described in Xu et al., U.S. Pat. No. 6,324,581, issued Nov. 27, 2001, incorporated herein by reference, the data mover acting as the manager of a file grants a lock on the file and provides metadata of the file to another data mover servicing a client request for access to the file. Then the data mover servicing the client request uses the metadata to directly access the file data in the cached disk array. Moreover, in some network configurations, the clients can be trusted to access directly the data in the cached disk array. In such a configuration, a network client can send a request for a file lock and file metadata directly to the file manager. Upon being granted a lock on the file and receiving the file metadata, the trusted client can access directly the file data in the cached disk array.

SUMMARY OF THE INVENTION

[0009] It has been discovered that in a file server of the kind that uses a file manager to manage file locks and file metadata for an assigned file system, it is possible for the file manager to delegate certain metadata management tasks to another processor or to a trusted client. By delegating these metadata management tasks, there is a reduction in the amount of data traffic with the file manager when accessing the metadata of the assigned file system. This is especially advantageous for avoiding peak load conditions when the file manager might concurrently receive a large number of requests for locks and metadata.

[0010] In accordance with one aspect of the invention, there is provided a method of operating a primary data processor and a secondary data processor for access to a file system in data storage. The method includes the primary data processor managing locks upon files in the file system, and managing allocation of free blocks of the file system. The method further includes the secondary data processor appending new data to a file in the file system by obtaining an allocation of at least one free block from the primary data processor, writing the new data to the free block, obtaining a lock on the file from the primary data processor, and linking the free block to the file.

[0011] In accordance with another aspect, the invention provides a method of operating a primary data processor and a secondary data processor for access to a file system in data storage. The method includes the primary data processor managing locks upon objects in the file system, and managing allocation of free blocks and free inodes (i.e., index nodes) of the file system. The method further includes the secondary data processor creating a new file of the file system by the secondary data processor obtaining an allocation of a free inode and at least one free block from the primary data processor, the secondary data processor writing file attributes to the free inode and linking the free block to the free inode, the secondary data processor obtaining, from the primary data processor, a lock on a directory of the file system to contain an entry for the new file, and the secondary data processor inserting the entry for the new file into the directory.

[0012] In accordance with yet another aspect, the invention provides a method of operating a primary data processor and a secondary data processor for access to a file system in data storage. The method includes the primary data processor managing locks upon objects in the file system, and managing allocation of free blocks and free inodes of the file system. The method further includes the secondary data processor accessing objects of the file system by obtaining an allocation of free blocks and free inodes of the file system from the primary data processor, obtaining locks on the objects of the file system from the primary data processor, using the free blocks and free inodes to create new structure in the file system, and writing new metadata of the file system objects to storage over a data path that bypasses the primary data processor.

[0013] In accordance with still another aspect, the invention provides a storage system. The storage system includes data storage containing a file system, a primary data processor linked to the data storage for access to metadata of the file system for locking files of the file system and allocating free blocks in the file system, and a secondary data processor linked to the data storage for access to data and metadata of the file system over a data path that bypasses the primary data processor, and linked to the primary data processor for requesting and obtaining locks on the files in the file system and requesting and obtaining allocations of free blocks in the file system. The secondary processor is programmed for writing data to a specified file in the file system by obtaining an allocation of at least one free block from the primary data processor, writing data to the free block, obtaining a lock on the specified file from the primary data processor, and appending the free block to the specified file by writing new metadata for the specified file to the file system in the data storage over the data path that bypasses the primary data processor.

[0014] In accordance with yet still another aspect, the invention provides a file server including a cached disk array containing a plurality of file systems, and a plurality of data mover computers each linked to the cached disk array over a respective data path that bypasses the other data mover computers for accessing data and metadata of the file systems. Each of the data mover computers also has a port for connection to a data network for receiving file system access requests from clients in the data network. Locks upon files in each file system are exclusively managed by a respective one of the data movers that is primary with respect to the file system. The data mover that is primary is with respect to each file system also allocates free blocks of the file system. Each data mover computer that is secondary with respect to each file system is programmed to obtain an allocation of free blocks of the file system from the data mover computer that is primary with respect to the file system. Each data mover computer that is secondary with respect to each file system is programmed to respond to a client request for writing data to a specified file in the file system by appending the data to the specified file in the file system by requesting the data mover computer that is primary with respect to the file system to grant a lock upon the specified file to the data mover computer that is secondary with respect to the file system, writing the data to at least one free block of the file system allocated to the data mover computer that is secondary with respect to the file system, and once the data mover computer that is primary with respect to the file system grants the requested lock upon the specified file, the data mover computer that is secondary with respect to the file system appending the at least one free block of the file system to the specified file by writing new metadata for the specified file to the file system in the cached disk array over the respective data path that bypasses the data mover computer that is primary with respect to the file system.

BRIEF DESCRIPTION OF THE DRAWINGS

P-0015[0015] Other objects and advantages of the invention will become apparent upon reading the following detailed description with reference to the accompanying drawings wherein:

P-0016[0016]FIG. 1 is a block diagram of a data storage network in which a client requests a distributed file lock from a file manager and receives metadata from the file server in order to directly access the data and metadata of the file in data storage of the file server;

P-0017[0017]FIG. 2 is a block diagram of a more complex data storage network including more than one file manager and more than one file system, in which access to each file system is managed by one and only one of the file managers;

P-0018[0018]FIG. 3 is a block diagram of a data processing system including a network file server having a plurality of data mover computers, each of which manages a respective file system;

P-0019[0019]FIG. 4 is a block diagram of a file system, showing various inodes and blocks;

P-0020[0020]FIG. 5 is a block diagram showing the management of metadata by a file manager or data mover that owns a file system in storage, and a client or data mover that is secondary with respect to the file system;

P-0021[0021]FIGS. 6 and 7 comprise a flow chart showing a method of delegating metadata management from the file manager or primary data mover in FIG. 5 to the client or secondary data mover in FIG. 5;

P-0022[0022]FIG. 8 is a flow chart showing specific steps for performing an append operation in accordance with the method of FIG. 7;

P-0023[0023]FIG. 9 is a flow chart showing specific steps for performing a truncation operation in accordance with the method of FIG. 7;

P-0024[0024]FIG. 10 is a flow chart showing specific steps for performing a file creation operation in accordance with the method of FIG. 7; and

P-0025[0025]FIG. 11 is a flow chart showing specific steps for performing a file deletion operation in accordance with the method of FIG. 7.

P-0026[0026] While the invention is susceptible to various modifications and alternative forms, specific embodiments thereof have been shown in the drawings and will be described in detail. It should be understood, however, that it is not intended to limit the invention to the particular forms shown, but on the contrary, the intention is to cover all modifications, equivalents, and alternatives falling within the scope of the invention as defined by the appended claims.

DESCRIPTION OF ILLUSTRATIVE EMBODIMENTS

P-0027[0027] Referring to FIG. 1, there is shown a network file server architecture that uses distributed locking. In this example, a file server <b>20</b> includes a file manager <b>21</b> and data storage such as a file system <b>22</b> in a cached disk array <b>23</b>. The file manager <b>21</b>, for example, is a high-end commodity computer including a single-chip processor, a PCI or EISA bus, random access memory, a hard disk drive for nonvolatile program storage, and a floppy disk drive for loading programs. The cached disk array <b>23</b>, for example, is a Symmetrix 5500 (Trademark) cached disk array manufactured and sold by EMC Corporation, 35 Parkwood Drive, Hopkinton, Mass. 01748.

P-0028[0028] The file manager <b>21</b> manages locking information for the files in the file system <b>22</b>. The locking information is stored in the cached disk array <b>23</b>, and the file manager <b>21</b> maintains a cache memory of recently accessed locking information and other related metadata.

P-0029[0029] As shown in FIG. 1, the file manager <b>21</b> has at least one network port <b>131</b> connected through a data network <b>30</b> to a first client <b>24</b> and a second client <b>25</b>. The network port <b>31</b> is shared among requests from the clients <b>24</b>, <b>25</b>, although a separate respective network port could be provided for each of the clients <b>24</b>, <b>25</b>. Each client <b>24</b>, <b>25</b> also has a respective bypass data path <b>26</b>, <b>27</b> that bypasses the file manager <b>21</b> for reading data and metadata from and writing data and metadata to the file system <b>22</b>. The cached disk array <b>23</b> has one network port <b>132</b> for the bypass data path <b>26</b>, and another network port <b>133</b> for the bypass data path <b>27</b>. Alternatively, the two bypass data paths <b>26</b>, <b>27</b> could share one network port of the cached disk array <b>23</b>, although such sharing could limit the maximum data transfer rate to the data storage in the cached disk array for simultaneous data access by the clients <b>24</b>, <b>25</b>.

P-0030[0030] Before reading or writing to the file system <b>22</b>, a client first issues a request for a lock to the file manager <b>21</b>. The file manager <b>21</b> responds by placing a lock on the file to be accessed, and returning metadata including at least one pointer to where the data or additional metadata to be accessed is stored in the file system. The client uses the pointer to formulate a read or write request sent over the bypass data path to the file system <b>22</b>.

P-0031[0031] With reference to FIG. 2, there is shown a more complex network file server architecture that permits storage resources to be incrementally added to provide sufficient storage capacity for any desired number of file systems. In this example, a data network <b>40</b> includes a first file manager <b>31</b>, a second file manager <b>32</b>, a first cached disk array <b>35</b>, a second cached disk array <b>36</b>, a first client <b>38</b>, and a second client <b>39</b>. In this example, the data movers <b>31</b>, <b>32</b> and the cached disk arrays <b>35</b>, <b>36</b> could be spaced from each other, placed at various geographic locations, and interconnected by high-speed Fibre Channel data links. Alternatively, the cached disk arrays <b>35</b>, <b>36</b> and file managers <b>31</b>, <b>32</b> could be placed in the same geographic location. For example, if the cached disk arrays and file managers were placed in the same geographic location, they could be constructed and interconnected as shown in Vahalia et al. U.S. Pat. No. 5,893,140, issued Apr. 6, 1999, incorporated herein by reference.

P-0032[0032] In FIG. 2, the first file manager <b>31</b> manages the file locking information of a first file system <b>33</b> in the first cached disk array <b>35</b>, and the second file manager <b>32</b> manages the locking information of a second file system <b>34</b> in the second cached disk array <b>36</b>. In particular, the locking information for each file system <b>33</b>, <b>34</b> is managed exclusively by only one of the file managers <b>31</b>, <b>32</b>. This exclusive relationship will be referred to by saying each file system has a respective file manager that is the owner of the file system. Therefore, the first file manager <b>31</b> is the owner of the first file system <b>33</b>, and the second file manager <b>32</b> is the owner of the second file system <b>34</b>.

P-0033[0033] The first file manager <b>31</b> is connected to the first cached disk array <b>35</b> for the communication of metadata of the first file system <b>33</b>, and the second file manager <b>32</b> is connected to the second cached disk array <b>36</b> for the communication of metadata of the second file system <b>34</b>. The first file manager <b>31</b> is connected to the second file manager <b>32</b> for the communication of metadata and control information with respect to the first file system <b>33</b> and the second file system <b>34</b>. The first file manager <b>31</b> is linked to a first client <b>38</b> for the communication of metadata and control information with respect to the first file system <b>33</b> and the second file system <b>34</b>. The second file manager <b>32</b> is linked to a second client <b>39</b> for the communication of metadata and control information with respect to the first file system <b>33</b> and the second file system <b>34</b>.

P-0034[0034] The first client <b>38</b> has a bypass data path <b>42</b> to the first file system <b>33</b> for bypassing the first file manager <b>31</b>, and a bypass data path <b>43</b> to the second file system <b>34</b> for bypassing the first file manager <b>31</b> and also bypassing the second file manager <b>32</b>. The second client <b>39</b> has a bypass data path <b>44</b> to the first file system <b>33</b> for bypassing the first file manager <b>31</b> and the second file manager <b>32</b>, and a bypass data path <b>45</b> to the second file system <b>34</b> for bypassing the second file manager <b>32</b>.

P-0035[0035] The first client <b>38</b> accesses the first file system <b>33</b> in the fashion described above with respect to FIG. 1, by obtaining a lock from first file manager <b>31</b> and then accessing the first file system <b>33</b> over the bypass data path <b>42</b>. To access the second file system <b>34</b>, however, the first client issues a request for a lock to the first file manager <b>31</b>. The first file manager <b>31</b> recognizes that it is not the owner of the file system to be accessed, and therefore forwards the request to the second file manager <b>32</b>. The second file manager <b>32</b> responds by placing an appropriate lock on the file to be accessed, and returning metadata including at least one pointer to where the data or additional metadata to be accessed is stored in the second file system <b>34</b>. The first file manager <b>31</b> relays the pointer to the first client <b>38</b>. The first client uses the pointer to formulate a read or write request sent over the bypass data path <b>43</b> to the second file system <b>34</b>.

P-0036[0036] In a similar fashion, the second client <b>39</b> accesses the second file system <b>34</b> in the fashion described above with respect to FIG. 1, by obtaining a lock from the second file manager <b>32</b> and then accessing the second file system <b>34</b> over the bypass data path <b>45</b>. To access the first file system <b>33</b>, the second client <b>39</b> issues a request for a lock to the second file manager <b>32</b>. The second file manager <b>32</b> recognizes that it is not the owner of the file system to be accessed, and therefore forwards the request to the first file manager <b>31</b>. The first file manager <b>31</b> responds by placing a lock on the file to be accessed, and returning metadata including at least one pointer to where the data or additional metadata to be accessed is stored in the first file system <b>33</b>. The second file manager <b>32</b> relays the pointer to the second client <b>38</b>. The second client uses the pointer to formulate a read or write request sent over the bypass data path <b>44</b> to the first file system <b>33</b>.

P-0037[0037] In the storage network of FIG. 2, the file managers may also access file data in the file systems <b>33</b>, <b>34</b> in the cached disk arrays <b>35</b>, <b>36</b>. For example, the first file manager <b>31</b> has a data path <b>46</b> to the first cached disk array <b>35</b>, and a data path <b>47</b> to the second cached disk array <b>36</b> that bypasses the second file manager <b>32</b>. The second file manager <b>32</b> has a data path <b>48</b> to the second cached disk array <b>36</b>, and a data path <b>49</b> to the first cached disk array that bypasses the first file manager <b>31</b>. If a file manager desires to access directly data of a file in a file system that is owned by another file manager, it must ask the owner for a lock on the file before accessing the file data.

P-0038[0038] The file system management method introduced in FIG. 2 can also be used in a network file server having multiple processors for servicing client requests. With reference to FIG. 3, a network file server <b>110</b> has a plurality of data mover computers <b>115</b>, <b>116</b>, <b>117</b>, each of which manages a respective file system. Each data mover computer <b>115</b>, <b>116</b>, <b>117</b> has a respective port to a data network <b>111</b> having a number of clients including work stations <b>112</b>, <b>113</b>. The data network <b>111</b> may include any one or more network connection technologies, such as Ethernet, and communication protocols, such as TCP/IP or UDP. The work stations <b>112</b>, <b>113</b>, for example, are personal computers.

P-0039[0039] The preferred construction and operation of the network file server <b>110</b> is further is described in Vahalia et al., U.S. Pat. No. 5,893,140 issued Apr. 6, 1999, incorporated herein by reference. The network file server <b>110</b> includes a cached disk array <b>114</b>. The network file server <b>110</b> is managed as a dedicated network appliance, integrated with popular network operating systems in a way, which, other than its superior performance, is transparent to the end user. The clustering of the data movers <b>115</b>, <b>116</b>, <b>117</b> as a front end to the cached disk array <b>114</b> provides parallelism and scalability. Each of the data movers <b>115</b>, <b>116</b>, <b>117</b> is a high-end commodity computer, providing the highest performance appropriate for a data mover at the lowest cost. The data movers may communicate with each other over a dedicated dual-redundant Ethernet connection <b>118</b>. The data mover computers <b>115</b>, <b>116</b>, and <b>117</b> may communicate with the other network devices using standard file access protocols such as the Network File System (NFS) or the Common Internet File System (CIFS) protocols, but the data mover computers do not necessarily employ standard operating systems. For example, the network file server <b>110</b> is programmed with a Unix-based file system that has been adapted for rapid file access and streaming of data between the cached disk array <b>114</b> and the data network <b>111</b> by any one of the data mover computers <b>115</b>, <b>116</b>, <b>117</b>. Therefore, each client <b>112</b>, <b>113</b> may access any of the file systems through any one of the data mover computers <b>115</b>, <b>116</b>, <b>117</b>, but if the data mover computer servicing the client does not own the file system to be accessed, then a lock on the file system to be accessed must be obtained from the data mover computer that owns the file system to be accessed.

P-0040[0040] In the data storage networks of FIGS. 1, 2 or <b>3</b>, it is possible for a write operation to change the attributes of a file, for example, when the extent of a file is increased by appending data to a file. When a write operation will change the metadata of a file, the metadata must be managed in a consistent fashion, in order to avoid conflict between the file manager owning the file, and the client or file manager performing the write operation. For example, as described in the above-cited Xu et al., U.S. Pat. No. 6,324,581, when a write operation changes the metadata of a file, the new metadata is written to the file manager owning the file. This ensures that the file manager owning the file maintains consistent metadata in its cache.

P-0041[0041] It has been discovered that in a file server of the kind that uses a file manager to manage locks for an assigned file system, it is possible for the file manager to delegate certain metadata management tasks to another file manager or to a trusted client. By delegating these metadata management tasks, there is a reduction in the amount of data traffic with the file manager when accessing the file system owned by the file manager. This is especially advantageous for avoiding peak load conditions when the file manager might concurrently receive a large number of requests for locks.

P-0042[0042] With reference to FIG. 1, for example, the file manager <b>21</b> delegates metadata management tasks to the clients <b>24</b>, <b>25</b> so that the clients may read or write certain metadata directly to and from the file system <b>22</b> in the cached disk array <b>23</b> instead of reading or writing that metadata to and from the file manager <b>21</b>. This may increase the performance of the system in FIG. 1 when the client access to the file manager is more limited than the client access to the cached disk array.

P-0043[0043] With reference to FIG. 2, the delegation of metadata management tasks to the clients <b>38</b>, <b>39</b> is useful for avoiding peak loading upon the file manager owner <b>31</b> or <b>32</b> when the clients <b>38</b>, <b>39</b> would happen to perform concurrent write operations to the same one of the file systems <b>33</b> or <b>34</b>. The delegation of metadata management tasks to the clients <b>38</b>, <b>39</b> also reduces data traffic between the file managers <b>31</b>, <b>32</b>.

P-0044[0044] With reference to FIG. 3, the data mover owning a particular file system will be referred to as the primary data mover for that file system, and the data movers that do not own that file system will be referred to as the secondary data movers for that file system. For example, in FIG. 3, the file system “B:” <b>120</b> is owned by the data mover <b>116</b>, so that the data mover <b>116</b> is the primary data mover for the file system “B:” and the data movers <b>115</b> and <b>117</b> are secondary data movers with respect to the file system “B:”,

P-0045[0045] In the network file server <b>110</b> of FIG. 3, the delegation of metadata management tasks to the secondary data movers <b>115</b>, <b>116</b>, <b>117</b> is useful for avoiding peak loading upon the primary data movers <b>115</b>, <b>116</b>, or <b>117</b> when the client workstations <b>112</b>, <b>113</b> would happen to perform concurrent write operations to the same one of the file systems <b>119</b>, <b>120</b>, <b>121</b>, or <b>122</b>. The delegation of metadata management tasks to the secondary data movers <b>115</b>, <b>116</b>, <b>117</b> also reduces data traffic over the link <b>118</b> between the data movers.

P-0046[0046] In a preferred implementation, the file system owner delegates the task of metadata management in order to permit a client, secondary file manager or secondary data mover to modify metadata of a file or directory in the on-disk file system. For example, the metadata of a file may be changed during an append or truncation of a file, and the metadata of a directory may be changed during the creation or deletion of a file in the directory. In order to delegate these tasks, the file system owner not only grants locks upon the file or directory to a client, secondary file manager or secondary data mover, but also “leases” inodes and blocks of the file system to the client, secondary file manager or secondary data mover.

P-0047[0047]FIG. 4 shows various inodes and blocks in a UNIX (Trademark) based file system, such as the System V file system (s5fs) and the Berkeley Fast File System (FFS), as described in chapter 9 of Uresh Vahalia, <i>UNIX Internals: The New Frontier, </i>Prentice-Hall, Inc., 1996, p. 261-289. In general, a file system includes a hierarchy of directories, and each directory can be an index for a number of subdirectories or files. For the particular file system shown in FIG. 4, the hierarchy of directories has a top-level root directory <b>51</b>, which is an index to a subdirectory <b>52</b> and a subdirectory <b>53</b>. The subdirectory <b>53</b> has been expanded to show that it is comprised of a directory inode <b>54</b> and a directory block <b>57</b>. The directory inode <b>54</b> includes attributes <b>55</b> of the subdirectory <b>53</b> (such as the file type, access permissions, owner information, and access history) and other metadata such as block numbers <b>56</b>, one of which points to the directory block <b>57</b>. The directory block <b>57</b> contains a table of inode numbers associated with respective file names of the subdirectories and files indexed by the subdirectory <b>53</b>. For example, the first inode number points to a file inode <b>58</b> containing attributes <b>59</b> of a file and block numbers <b>60</b> pointing to file blocks <b>61</b> and <b>62</b> containing data of the file. The file block <b>62</b> is a so-called indirect block, which contains a pointer to another file block <b>63</b> of the file.

P-0048[0048]FIG. 5 shows the management of metadata by a primary data mover or file manager <b>140</b> that owns a file system <b>143</b> in storage of a cached disk array <b>142</b>, and a data mover or client <b>141</b> that is secondary with respect to the file system. The on-disk file system <b>143</b> includes free blocks <b>144</b>, free inodes <b>145</b>, allocated blocks <b>146</b>, and allocated inodes <b>147</b>. The allocated blocks <b>146</b> may contain valid file or directory data, and the allocated inodes <b>147</b> may contain valid file or directory attributes.

P-0049[0049] The primary data mover or file manager <b>140</b> manages leasing of the free blocks <b>144</b> and free inodes <b>145</b> to the secondary data mover or client <b>141</b>. In response to a lease request for free blocks or free inodes, the primary data mover or file manager <b>140</b> allocates a number of the free blocks <b>144</b> or free inodes <b>145</b> to the secondary data mover or client <b>141</b>, and returns to the secondary a list of pointers (block numbers or inode numbers) to the leased blocks and inodes. For lease management, the primary <b>140</b> maintains leasing information <b>148</b> including a pointer to a next free block <b>144</b> not yet leased or allocated, and a pointer to a next free inode <b>146</b> not yet leased or allocated. For recovering from a “crash” or failure of the secondary data mover or client <b>141</b>, the leasing information <b>148</b> may also include a log of the leased blocks and inodes and the lease holders.

P-0050[0050] The primary data mover or file manager <b>140</b> also manages the granting of locks on files and directories to the secondary data mover or client <b>141</b>. The primary data mover or file manager <b>140</b> maintains locking information <b>149</b> identifying the locked file system objects and lock holders. The locking information may also include, for each locked object, a list of outstanding requests for a conflicting lock.

P-0051[0051] In operation, the secondary data mover or client <b>141</b> maintains a list <b>150</b> of pointers to leased free blocks, and a list of pointers <b>151</b> to leased free inodes. When the list <b>150</b> or <b>151</b> is nearly empty, or when the secondary <b>141</b> needs more pointers to free blocks or inodes for the delegated metadata management, the secondary <b>141</b> sends a lease request to the primary data mover or client <b>140</b> to obtain more pointers.

P-0052[0052] When the secondary data mover or client <b>141</b> needs to read or write to a directory or file in the file system <b>143</b> owned by the primary data mover or file manager <b>140</b>, the secondary <b>141</b> first sends a lock request to the primary <b>140</b>. The lock request, for example, specifies the path name of the file or directory, and the type of access (read-only or read-write). The primary data mover or file manager <b>140</b> does a file system lookup on the path name of the directory or file in order to find the directory block entry (see <b>57</b> in FIG. 4) including the directory or file name and the file inode number associated with the directory or file name. The primary data mover or file manager <b>140</b> checks whether there is a read or write lock presently held on the associated directory or file inode, and checks whether any lock presently held conflicts with the requested lock. The primary data mover or file manager <b>140</b> may also check for conflict with any access permission attribute in the associated directory or file inode. If there is no conflict, then the primary data mover or file manager <b>140</b> returns a lock grant to the secondary data mover or client <b>141</b>, including the inode number of the associated directory or file inode. The secondary data mover or client <b>141</b> then uses the inode number to directly access the metadata in the directory or file inode in the on-disk file system <b>143</b>.

P-0053[0053] For certain write operations, the secondary data mover or client <b>141</b> may change the metadata in the directory or file inode in the on-disk file system <b>143</b>, without writing the new metadata to the primary data mover or file manager <b>140</b>. If the primary data mover or file manager <b>140</b> keeps a local cache of the directory or file inode, then the directory or file inode in that local cache should be invalidated when the primary <b>140</b> grants a write lock on the directory or file inode to the secondary data mover or client <b>141</b>. Therefore, if and when the primary data mover or client manager <b>140</b> would later need to access the directory or file inode, the primary <b>140</b> would first check that there is no conflicting lock on the directory or file inode, and then grant itself a lock on the directory or file inode, and then refresh its local cache by fetching the directory or file inode from the on-disk file system <b>143</b>. In this fashion, new metadata from the secondary data mover or client <b>141</b> is written to the cached disk array <b>142</b> and transferred to the primary data mover or file manager <b>140</b>. Because of the “fast write” capability of the cached disk array (i.e., data written to the cache of the cached disk array is considered to be in the on-disk file system <b>143</b> before the data is actually written to disk of the cached disk array), there can be a very rapid transfer of metadata through the cached disk array <b>142</b> from the secondary data mover or client <b>141</b> to the primary data mover or file manager <b>140</b>.

P-0054[0054] For certain write operations, the delegated metadata management alters the structure of the file system by adding blocks or inodes. For extending a directory or file, the secondary data mover or client <b>141</b> removes one of the pointers from the list <b>150</b> to obtain the block number of a free block to become the block appended to the directory or file. The secondary data mover or client <b>141</b>, for example, transfers the free block from the pool of free blocks <b>144</b> in the on-disk file system <b>143</b> and links it into the file system data structure of allocated inodes <b>147</b>. For creating a new directory or a new file, the secondary data mover or client <b>141</b> removes one of the pointers from the list <b>151</b> to obtain the inode number of a free inode to become the inode of the new directory or new file. The secondary data mover or client <b>141</b>, for example, transfers the free inode from the pool of free inodes <b>145</b> in the on-disk file system <b>143</b> and links it into the file system data structure of allocated inodes <b>147</b> in the on-disk file system.

P-0055[0055]FIGS. 6 and 7 further show the delegation of metadata management from the primary data mover or file manager to the secondary data mover or file manager or client. In a first step <b>161</b>, the secondary asks the primary for a set of free blocks and free inodes of a file system owned by the primary. In step <b>162</b>, the primary receives the request, and allocates the set of free blocks and free inodes of the file system. For example, if the secondary asks for sixty-four free blocks, then the primary will advance its “pointer to next free block” by sixty-four blocks through the pool of free blocks (<b>144</b> in FIG. 5) of the on-disk file system, to obtain a set of sixty-four block numbers for the secondary. The pool of free blocks, for example, is maintained as a linked list of block numbers, so that the primary may keep a local cache of the linked list of block numbers, and refresh the linked list in its local cache from the linked list in the on-disk file system when its “pointer to next free block” nearly reaches the end of its local copy of the linked-list.

P-0056[0056] In step <b>163</b>, the secondary receives the block numbers and inode numbers of the leased set of free blocks and free inodes of the file system. Some time later, in step <b>164</b>, the secondary receives a request from a client or application program instance for access to an object (such as a directory or file) in the file system. Execution continues from step <b>164</b> to step <b>165</b> in FIG. 7.

P-0057[0057] In step <b>165</b> in FIG. 7, the secondary asks the primary for a lock upon the object in the file system. In step <b>166</b>, the primary receives the request, grants to the secondary a lock upon the object in the file system, and returns the inode number of the object to the secondary. In step <b>167</b>, the secondary receives the inode of the object, indicating that the requested lock has been granted. In step <b>168</b>, the secondary uses the inode number of the object and at least one of the block numbers of the free blocks or at least one inode number of the free inodes to perform an append, truncate, create, or delete operation upon the object without further assistance from the primary. In step <b>169</b>, the lock on the object is released from the secondary.

P-0058[0058] After step <b>169</b>, execution loops back to step <b>161</b> of FIG. 6 to replenish the secondary's set of leased free blocks and free inodes of the file system owned by the primary, at least if the number of the leased free blocks or the number of the leased free inodes has been depleted. In this fashion, the secondary's access of objects of the file system in steps <b>164</b> to <b>169</b> is not delayed in order to obtain free blocks and free inodes of the file system owned by the primary.

P-0059[0059]FIG. 8 shows specific steps for performing an append operation in accordance with the method of FIG. 7. In step <b>171</b>, the secondary asks the primary for a lock on the file. In step <b>172</b>, the secondary writes data to at least one of the free blocks indicated by the block numbers obtained from the primary. In step <b>173</b>, when the secondary receives the inode number indicating the grant of the requested lock on the file, the secondary appends the block(s) to the file by updating the file metadata in the on-disk file system. Finally, in step <b>174</b>, the secondary releases the lock on the file, for example, when requested by the primary.

P-0060[0060]FIG. 9 shows specific steps for performing a truncation operation in accordance with the method of FIG. 7. In step <b>181</b>, the secondary asks the primary for a lock on the file. In step <b>182</b>, when the secondary receives the inode number from the primary indicating the grant of the requested lock on the file, the secondary removes at least one block from the file by updating the file metadata in the on-disk file system. In step <b>183</b>, the secondary may use the freed block(s), and return any unused free block to the free buffer pool in the on-disk file system. Finally, in step <b>184</b>, the secondary releases the lock on the file, for example, when requested by the primary.

P-0061[0061]FIG. 10 shows specific steps for performing a file creation operation in accordance with the method of FIG. 7. In a first step <b>191</b>, the secondary asks the primary for a lock on the directory that will contain the file. In step <b>192</b>, the secondary uses one of the pointers to the leased free inodes and at least one of the pointers to the free blocks to put attributes of the new file into a free inode linked to at least one free block. In step <b>193</b>, when the secondary receives the inode number from the primary indicating the grant of the requested lock on the directory, the secondary inserts an entry for the file into the directory by updating the directory in storage. Finally, in step <b>194</b>, the secondary releases the lock on the directory, for example, when requested by the primary.

P-0062[0062]FIG. 11 is a flow chart showing specific steps for performing a file deletion operation in accordance with the method of FIG. 7. This particular file deletion operation can be performed on a file that is a directory so long as the directory is empty. In other words, before deleting a directory, all of the subdirectories and files in the directory should be deleted.

P-0063[0063] In a first step <b>201</b> of FIG. 11, the secondary asks the primary for a lock on the file and a lock on the directory containing the file. In step <b>202</b>, when the secondary receives the file inode number and the directory inode number from primary indicating the grant of the requested locks, the secondary removes the file entry from the directory by updating the directory in storage. This not only deletes the file but also has the side-effect of releasing the lock on the file. In step <b>203</b>, the secondary may use the inode and blocks of the file, and return any unused inode and blocks of the file to the free inode pool and free block pool in the on-disk file system. Finally, in step <b>204</b>, the secondary releases the lock on the directory, for example, when requested by the primary.

P-0064[0064] In view of the above, there has been described a method of delegation of metadata management in a file server or storage network from a primary data processor to a secondary data processor in order to reduce data traffic between the primary data processor and the secondary data processor. The primary data processor retains responsibility for managing locks upon objects in the file system that it owns, and also retains responsibility for allocation of free blocks and inodes of the file system. By leasing free blocks and inodes to the secondary and granting locks to the secondary, the secondary can perform the other metadata management tasks such as appending blocks to a file, truncating a file, creating a file, and deleting a file.

P-0065[0065] It should be understood that the preferred embodiment as described above can be modified in various ways without departing from the scope of the invention as defined by the appended claims. For example, it is not necessary to delegate all of the metadata management functions described above to the secondary. Depending on the margin of loading of the primary to secondary data path relative to the margin of loading of the secondary to storage data path, some but not all of the metadata management functions may be delegated in order to balance the margin of loading of the data paths. For example, in a particular file server configuration, it may be desirable to delegate only the “append to a file” and “truncate a file” functions. This provides a modest decrease in loading of the primary to secondary data path, and a low level of implementation complexity, because the primary need not lease inodes.