Data communication protocol

CROSS-REFERENCE TO RELATED APPLICATIONS

0001The present application claims priority to United States provisional patent application serial no. <patcit id="pcit0001" dnum="US60685008B"><text>60/685,008, filed May 25, 2005</text></patcit>, and herein incorporated by reference. The present application is related to copending United States patent application entitled "Data Communication Coordination with Sequence Numbers" attorney docket number 5660/313764, filed concurrently herewith, assigned to the assignee of the present invention, and hereby incorporated by reference.

BACKGROUND

0002Many data communication protocols that are still in use today, such as the SMB (Server Message Block) protocol, were developed at a time when computing resources were very different, e.g., network bandwidth was typically limited and memory was very precious. As a result, when used in contemporary networks, such protocols may limit overall performance. For example, because of having been designed when memory was limited, small buffer sizes are used, requiring more round trips to communicate large amounts of data.

0003Moreover, the existing SMB protocol has other limitations that have become apparent over time. For example, the existing SMB protocol is susceptible to denial of service attacks; the design of the protocol makes it difficult to fight these attacks. Likewise, the method for ensuring packet security is cumbersome. Also, there is no current mechanism for performing quality of service-like operations, in that a trusted client, for example, obtains the same server resources as an untrusted client.

0004Although various revisions, or dialects, of the SMB protocol have been developed over time, each those dialects are essentially patch-based approaches that tweak various parts to add some additional features. Thus, extensibility is not straightforward. In sum, while still a frequently-used and valuable protocol, existing SMB versions are less than ideal when used with contemporary network resources.

SUMMARY

0005Briefly, various aspects of the present invention are directed towards a data communication protocol, which a client and server use for communication, such as for file sharing. The client sends a negotiation packet to a server that identifies a set of protocol dialects the client understands. The packet is in a format such that without requiring another request, a server incapable of communicating via the second data communication protocol will indicate the first communication protocol should be used. If the server is capable of communicating via the second data communication protocol, it will respond as such. The client will invoke a driver that handles communication with the server via the corresponding protocol indicated by the server. In one example implementation, the second communication protocol is SMB 2.0 or greater.

0006Other aspects and enhancements of the protocol may include a create command with additional context data attached, and a compound command comprising a plurality of related commands or unrelated commands. Still other aspects and enhancements include a multi-channel command related to requesting data transfer on a separate data channel, a signed capability verification request to ensure that a secure connection is established, and the ability to transfer extended error data from the server in response to a request.

0007When a server receives a compound request, the server determines whether the compound request contains unrelated commands or related commands. When the compound request contains unrelated commands, each request is handled as a separate request, otherwise, when the compound request contains related commands, each request is handled sequentially. When the related commands including a create / open command, the file handle from the create / open command is used for each subsequent related command at the server, e.g., without needing to wait for the handle back from the client.

0008Other advantages will become apparent from the following detailed description when taken in conjunction with the drawings.

BRIEF DESCRIPTION OF THE DRAWINGS

0009The present invention is illustrated by way of example and not limited in the accompanying figures in which like reference numerals indicate similar elements and in which:

0010<figref idref="f0001">FIGURE 1</figref> shows an illustrative example of a general-purpose computing environment into which various aspects of the present invention may be incorporated.

0011<figref idref="f0002">FIG. 2</figref> is a block diagram representing an example network environment in which a client communicates with a server in accordance with various aspects of the present invention.

0012<figref idref="f0003">FIG. 3</figref> is a timing diagram representing an example negotiation and session setup between a client and server in accordance with various aspects of the present invention.

0013<figref idref="f0004">FIG. 4</figref> is a timing diagram representing various commands including a create command with create contexts in accordance with various aspects of the present invention.

0014<figref idref="f0005">FIG. 5</figref> is a timing diagram representing compound requests and possible responses between a client and server, in accordance with various aspects of the present invention.

0015<figref idref="f0006">FIG. 6</figref> is a representation of client-server communication over multiple channels, in accordance with various aspects of the present invention.

0016<figref idref="f0007">FIG. 7</figref> is a representation of verification of a secure connection, in accordance with various aspects of the present invention.

0017<figref idref="f0008">FIG. 8</figref> is a representation of extended error return information using an example based upon symbolic links, in accordance with various aspects of the present invention.

DETAILED DESCRIPTION

<u style="single">EXEMPLARY OPERATING ENVIRONMENT</u>

0018<figref idref="f0001">FIGURE 1</figref> illustrates an example of a suitable computing system environment 100 on which the invention may be implemented. The computing system environment 100 is only one example of a suitable computing environment and is not intended to suggest any limitation as to the scope of use or functionality of the invention. Neither should the computing environment 100 be interpreted as having any dependency or requirement relating to any one or combination of components illustrated in the exemplary operating environment 100.

0019The invention is operational with numerous other general purpose or special purpose computing system environments or configurations. Examples of well known computing systems, environments, and/or configurations that may be suitable for use with the invention include, but are not limited to: personal computers, server computers, handheld or laptop devices, tablet devices, multiprocessor systems, microprocessor-based systems, set top boxes, programmable consumer electronics, network PCs, minicomputers, mainframe computers, distributed computing environments that include any of the above systems or devices, one of variety of network appliance devices, such as print servers or printers themselves, as well as NAS storage devices, and the like.

0020The invention may be described in the general context of computer-executable instructions, such as program modules, being executed by a computer. Generally, program modules include routines, programs, objects, components, data structures, and so forth, which perform particular tasks or implement particular abstract data types. The invention may also be practiced in distributed computing environments where tasks are performed by remote processing devices that are linked through a communications network. In a distributed computing environment, program modules may be located in local and/or remote computer storage media including memory storage devices.

0021With reference to <figref idref="f0001">FIG. 1</figref>, an exemplary system for implementing the invention includes a general purpose computing device in the form of a computer 110. Components of the computer 110 may include, but are not limited to, a processing unit 120, a system memory 130, and a system bus 121 that couples various system components including the system memory to the processing unit 120. The system bus 121 may be any of several types of bus structures including a memory bus or memory controller, a peripheral bus, and a local bus using any of a variety of bus architectures. By way of example, and not limitation, such architectures include Industry Standard Architecture (ISA) bus, Micro Channel Architecture (MCA) bus, Enhanced ISA (EISA) bus, Video Electronics Standards Association (VESA) local bus, and Peripheral Component Interconnect (PCI) bus also known as Mezzanine bus.

0022The computer 110 typically includes a variety of computer-readable media. Computer-readable media can be any available media that can be accessed by the computer 110 and includes both volatile and nonvolatile media, and removable and non-removable media. By way of example, and not limitation, computer-readable media may comprise computer storage media and communication media. Computer storage media includes volatile and nonvolatile, removable and non-removable media implemented in any method or technology for storage of information such as computer-readable instructions, data structures, program modules or other data. Computer storage media includes, but is not limited to, RAM, ROM, EEPROM, flash memory or other memory technology, CD-ROM, digital versatile disks (DVD) or other optical disk storage, magnetic cassettes, magnetic tape, magnetic disk storage or other magnetic storage devices, or any other medium which can be used to store the desired information and which can accessed by the computer 110. Communication media typically embodies computer-readable instructions, data structures, program modules or other data in a modulated data signal such as a carrier wave or other transport mechanism and includes any information delivery media. The term "modulated data signal" means a signal that has one or more of its characteristics set or changed in such a manner as to encode information in the signal. By way of example, and not limitation, communication media includes wired media such as a wired network or direct-wired connection, and wireless media such as acoustic, RF, infrared and other wireless media. Combinations of the any of the above should also be included within the scope of computer-readable media.

0023The system memory 130 includes computer storage media in the form of volatile and/or nonvolatile memory such as read only memory (ROM) 131 and random access memory (RAM) 132. A basic input/output system 133 (BIOS), containing the basic routines that help to transfer information between elements within computer 110, such as during start-up, is typically stored in ROM 131. RAM 132 typically contains data and/or program modules that are immediately accessible to and/or presently being operated on by processing unit 120. By way of example, and not limitation, <figref idref="f0001">FIG. 1</figref> illustrates operating system 134, application programs 135, other program modules 136 and program data 137.

0024The computer 110 may also include other removable/non-removable, volatile/nonvolatile computer storage media. By way of example only, <figref idref="f0001">FIG. 1</figref> illustrates a hard disk drive 141 that reads from or writes to non-removable, nonvolatile magnetic media, a magnetic disk drive 151 that reads from or writes to a removable, nonvolatile magnetic disk 152, and an optical disk drive 155 that reads from or writes to a removable, nonvolatile optical disk 156 such as a CD ROM or other optical media. Other removable/non-removable, volatile/nonvolatile computer storage media that can be used in the exemplary operating environment include, but are not limited to, magnetic tape cassettes, flash memory cards, digital versatile disks, digital video tape, solid state RAM, solid state ROM, and the like. The hard disk drive 141 is typically connected to the system bus 121 through a non-removable memory interface such as interface 140, and magnetic disk drive 151 and optical disk drive 155 are typically connected to the system bus 121 by a removable memory interface, such as interface 150.

0025The drives and their associated computer storage media, described above and illustrated in <figref idref="f0001">FIG. 1</figref>, provide storage of computer-readable instructions, data structures, program modules and other data for the computer 110. In <figref idref="f0001">FIG. 1</figref>, for example, hard disk drive 141 is illustrated as storing operating system 144, application programs 145, other program modules 146 and program data 147. Note that these components can either be the same as or different from operating system 134, application programs 135, other program modules 136, and program data 137. Operating system 144, application programs 145, other program modules 146, and program data 147 are given different numbers herein to illustrate that, at a minimum, they are different copies. A user may enter commands and information into the computer 110 through input devices such as a tablet, or electronic digitizer, 164, a microphone 163, a keyboard 162 and pointing device 161, commonly referred to as mouse, trackball or touch pad. Other input devices not shown in <figref idref="f0001">FIG. 1</figref> may include a joystick, game pad, satellite dish, scanner, or the like. These and other input devices are often connected to the processing unit 120 through a user input interface 160 that is coupled to the system bus, but may be connected by other interface and bus structures, such as a parallel port, game port or a universal serial bus (USB). A monitor 191 or other type of display device is also connected to the system bus 121 via an interface, such as a video interface 190. The monitor 191 may also be integrated with a touch-screen panel or the like. Note that the monitor and/or touch screen panel can be physically coupled to a housing in which the computing device 110 is incorporated, such as in a tablet-type personal computer. In addition, computers such as the computing device 110 may also include other peripheral output devices such as speakers 195 and printer 196, which may be connected through an output peripheral interface 194 or the like.

0026The computer 110 may operate in a networked environment using logical connections to one or more remote computers, such as a remote computer 180. The remote computer 180 may be a personal computer, a server, a router, a network PC, a peer device or other common network node, and typically includes many or all of the elements described above relative to the computer 110, although only a memory storage device 181 has been illustrated in <figref idref="f0001">FIG. 1</figref>. The logical connections depicted in <figref idref="f0001">FIG. 1</figref> include a local area network (LAN) 171 and a wide area network (WAN) 173, but may also include other networks. Such networking environments are commonplace in offices, enterprise-wide computer networks, intranets and the Internet.

0027When used in a LAN networking environment, the computer 110 is connected to the LAN 171 through a network interface or adapter 170. When used in a WAN networking environment, the computer 110 typically includes a modem 172 or other means for establishing communications over the WAN 173, such as the Internet. The modem 172, which may be internal or external, may be connected to the system bus 121 via the user input interface 160 or other appropriate mechanism. In a networked environment, program modules depicted relative to the computer 110, or portions thereof, may be stored in the remote memory storage device. By way of example, and not limitation, <figref idref="f0001">FIG. 1</figref> illustrates remote application programs 185 as residing on memory device 181. It will be appreciated that the network connections shown are exemplary and other means of establishing a communications link between the computers may be used.

<u style="single">DATA COMMIINICATION PROTOCOL</u>

0028Various aspects of the technology described herein are directed towards a data communication protocol, such as a later version (2.x or greater) of the SMB protocol. In one example implementation generally described herein, the SMB protocol is used for file data transfer. However, as can be readily appreciated, the present invention is not limited to file data, let alone any particular implementation or examples described herein. Instead, numerous ways to implement the present invention are feasible, including for use in communication with printers, named data pipes, generic devices and so forth. As such, the present invention is not limited to any of the particular file-based examples used herein, but rather may be used numerous ways that provide benefits and advantages in computing in general.

0029Other various aspects of the technology described herein are directed towards a new revision of SMB upon which file-server interaction may be built. As will be understood, a more lightweight protocol is provided that supports existing (up-level) functionality, along with being more scalable and easier to update with new features.

0030Turning to <figref idref="f0002">FIG. 2</figref> of the drawings, there is shown a block diagram representing an example networking environment in which a client 202 communicates with a server 204 through one or more communication channels. Although the functions and components of the client machine 202 and the server 204 are described as being located within two separate computers, such as the main computer system 110 and remote computer system 180 of <figref idref="f0001">FIG. 1</figref>, the components of these two computers or the functions performed thereby may be provided on one machine, or may be distributed over a number of computers.

0031Network file system commands from an application program 206 are handled by a client redirector component 208, which communicates with a counterpart common network module (SRVNET) 210 to carry out the commands on the file system 212. Before such commands are processed, a communication protocol that the client and server agree upon, generally the most recent version / dialect that both understand, is negotiated.

0032In general, the client 202 establishes a connection and then negotiates with the server 204 to ultimately set up a session, as generally represented in <figref idref="f0003">FIG. 3</figref>. While a client may directly indicate to a server that it is an SMB 2.x client, (wherein as used herein, the number 2.x represents any newer version relative to existing SMB 1.x versions), a client may also negotiate via a backwards-compatible negotiation packet. In this way, a client can also communicate with a server that is only SMB 1.x capable, yet do so without needing to set up a separate connection should an attempt at a higher-level negotiation fails. At the same time, the code for implementing each protocol may be packaged into its own independent driver.

0033In one example implementation, a client SMB engine component 220 provides a packet to a server (e.g., the server 204) that indicates that the client 202 is negotiating at least an SMB 1.0 session. For a client 202 that speaks both the SMB1 dialects and the new SMB2 revision of the protocol, the client may send a traditional SMB1 negotiate packet, but that further contains an indication that this packet is actually requesting SMB 2.x, if available. An SMB2-capable server will detect this request and respond with an SMB2 negotiate response. More particularly, to indicate that the client 202 is capable of SMB 2.x, the SMB 1.0 negotiation packet includes a set of dialect strings, one of which indicates that the client is also capable of SMB 2.x communication.

0034The client 202 thus sends an initial negotiate that includes the minor revision numbers that the client 202 supports. One current revision is 0 (zero), i.e., SMB 2.0; in the future, a client may claim to support any subset of the dialect revisions.

0035When the server 204 receives the packet, it will respond based on its capabilities. A server 204 may respond with an SMB 1.0 negotiation response, along with any 1.x dialect information, or if capable of SMB 2.x communication, will respond with an SMB 2.0 negotiation response. A particular SMB dialect revision may also be returned that matches one of the dialect strings, ordinarily the largest numbered version that the server 204 can handle among the dialect versions that the client 202 provided.

0036To this end, once the server 204 knows which dialect revisions the client 202 speaks, it compares these to the revisions that the server 204 understands, and returns the preferred common dialect revision (which will usually be the highest). For example, if the server supports dialects 1-8, but the client only supports 1, 2 and 4, the server will return 4. This gives the client 202 a clear understanding of which commands it will be able to send to the server 204. To select which dialect to use, the SRVNET module 210 essentially starts a negotiation, handing the packet to each SMB provider 222₁-222_m that it has, from highest to lowest in order with respect to versions / dialects, until one SMB provider agrees to handle this communication session based on the packet contents. Thereafter, communications on this connection are routed to that provider, in this example the SMB 2.0 provider 222_m.

0037At the client end, the SMB engine component 220 receives the response, and based on the version / dialect information in the response, knows which client SMB component 224₁-224_n to use to communicate with the server. In this manner, both the client 202 and server 204 agree on which SMB dialect to use for a given session. Note that a client may have multiple SMB components 224₁-224_n running at the same time, each a different version / dialect, whereby, for example, a client may be communicating with one server over SMB 1.x at the same time the client is communicating with another server over SMB 2.x.

0038The server 204 also returns other information to the client, including a security mode which tells the client 202 whether the server 204 will require security signatures. Note that previously, security signatures were available, however the first few (e.g., capabilities negotiation) packets were in the clear, whereby an attacker could force a client into a lower-level protocol in which the attacker knows its vulnerabilities.

0039Secure connect operates by providing another, capabilities verification round-trip that is signed, (regardless of whether signing is enabled or not). <figref idref="f0007">FIG. 7</figref> shows such a request / response following session setup. Other information can be put in the packet, such as an IP address, so that the server can actually verify that it, and not another entity, responded. Signing can be turned off if IPSEC or any other form of network security is active.

0040The server 204 may return capabilities bits for the server, e.g., whether the server is DFS (Distributed File System) aware, and whether it is LWIO (Lightweight IO) capable. The client 202 disregards any capability bits it does not understand, which may happen if the server 204 has a newer version than the client's corresponding version. Other information that may be returned in the negotiate exchange includes the server's unique ID, the maximum read/write size the server will accept, a data offset hint for faster write processing, the current system time of the server, and security information used to seed authentication in the case of extended security.

0041Session setup handles the authentication process for a new session, which may be a multiple round-trip event. The client 202 queries the local security system for a security blob to send over the network, and sends the first session setup, filling in the capabilities, the maximum size fields, and a VcNumber, described below. The server 204 receives this blob and gives it to the security system. If the server 204 determines that more information is needed, it will return its own security blob with the error code STATUS_MORE_PROCESSING_REQUIRED. The client 202 passes this blob back to the local security system, and the process will repeat until a failure occurs or authentication is successful.

0042The VcNumber tells the server 204 whether there may be other connections established from this same client 202. If this is zero, the server 204 assumes no other connections have been made from this client, and will tear down any such connections it finds (assuming them to be stale). If the VcNumber is one or more, the server 204 will not tear down any existing connections.

0043The Channel tells the server 204 that this client 202 is attempting to establish another connection with an existing session. The session can be identified by the user/computer pair from which this session setup was received. The channels share the same TreeId/UserId/ProcessId/FileId information. For a channel authentication, the authentication blob may be a challenge-response that is encrypted across the first channel and sent back out across the second channel to allow the client 202 and server 204 to mutually authenticate each other. On a successful response, the server 204 will also notify the client 202 if it has been authenticated as Guest or as a Null user, if either is applicable.

0044Once a session is set up, the client 202 may perform data transfer using the various commands described below, including create, read, write and close, as well as perform file locking and directory-related operations. As described in the aforementioned "Data Communication Coordination with Sequence Numbers" patent application, when using these commands, the server is able to control the client's use of server resources. Also, the protocol provides a number of efficiency improvements with respect to what information is communicated, and how it is communicated.

0045As generally represented in <figref idref="f0004">FIG. 4</figref>, the create command has been extended to allow context information to be attached to the command; in general, the context information comprises arbitrary extra create parameters that are tagged to the create command. For example, a transaction identifier for a transactional file system-related create command may be attached. As long as the server understands the extra context information, the server can be informed of the extended information, (note that servers will ignore extra data that they not understood), and return information associated with the context. As can be readily appreciated, this provides for additional functionality without changing the protocol, essentially providing built-in extensibility.

0046Command IDs and dialect revision numbers are provided for in a new SMB header, set forth below. The header has a USHORT for the command field as opposed to a UCHAR; by using the first byte of this USHORT to denote the dialect, and the latter byte to denote the command, the command table is well defined for existing commands, with a large proportion open for later expansion. In general, the client may maintain a table for each dialect that contains the pointers to the function to issue a given command. For a client with a single dialect supported, the table would be as set forth below: <tables id="tabl0001" num="0001"><table frame="all"><tgroup cols="2"><colspec colnum="1" colname="col1" colwidth="21mm" /><colspec colnum="2" colname="col2" colwidth="23mm" /><thead><row><entry valign="top"><b>Command</b></entry><entry valign="top"><b>Dialect #1</b></entry></row></thead><tbody><row><entry>Create</entry><entry>SmbCreate1</entry></row><row><entry>Read</entry><entry>SmbRead1</entry></row><row><entry>Write</entry><entry>SmbWrite1</entry></row><row><entry>Close</entry><entry>SmbClose1</entry></row></tbody></tgroup></table></tables>

0047For caching functionality, more information may be retrieved from the file on Close. As such, a new Close command is provided to support this new functionality. Now the client supports two dialects, and the table is as set forth below: <tables id="tabl0002" num="0002"><table frame="all"><tgroup cols="3"><colspec colnum="1" colname="col1" colwidth="21mm" /><colspec colnum="2" colname="col2" colwidth="23mm" /><colspec colnum="3" colname="col3" colwidth="23mm" /><thead><row><entry valign="top"><b>Command</b></entry><entry valign="top"><b>Dialect #2</b></entry><entry valign="top"><b>Dialect #1</b></entry></row></thead><tbody><row><entry>Create</entry><entry>SmbCreate1</entry><entry>SmbCreate1</entry></row><row><entry>Read</entry><entry>SmbRead1</entry><entry>SmbRead1</entry></row><row><entry>Write</entry><entry>SmbWrite1</entry><entry>SmbWrite1</entry></row><row><entry>Close</entry><entry>SmbClose2</entry><entry>SmbClose1</entry></row></tbody></tgroup></table></tables>

0048Note that most of the functionality stayed the same, except for the changed Close command. Also, the client can now talk to Dialect 2 servers and use the new functionality, but for Dialect 1 servers it still uses the old functionality. There are no changes to the communicating with Dialect 1 servers.

0049As technology evolves, new network hardware becomes available, such as capable of performing relatively much larger reads and writes. For this release, Dialect #3 is provided, whereby the table is enlarged as follows: <tables id="tabl0003" num="0003"><table frame="all"><tgroup cols="4"><colspec colnum="1" colname="col1" colwidth="21mm" /><colspec colnum="2" colname="col2" colwidth="23mm" /><colspec colnum="3" colname="col3" colwidth="23mm" /><colspec colnum="4" colname="col4" colwidth="23mm" /><thead><row><entry valign="top"><b>Command</b></entry><entry valign="top"><b>Dialect #3</b></entry><entry valign="top"><b>Dialect #2</b></entry><entry valign="top"><b>Dialect #1</b></entry></row></thead><tbody><row><entry>Create</entry><entry>SmbCreate1</entry><entry>SmbCreate1</entry><entry>SmbCreate1</entry></row><row><entry>Read</entry><entry>SmbRead3</entry><entry>SmbRead1</entry><entry>SmbRead1</entry></row><row><entry>Write</entry><entry>SmbWrite3</entry><entry>SmbWrite1</entry><entry>SmbWrite1</entry></row><row><entry>Close</entry><entry>SmbClose2</entry><entry>SmbClose2</entry><entry>SmbClose1</entry></row></tbody></tgroup></table></tables>

0050A client with such a table can speak the three dialects, and will take advantage of the functionality that is available in each dialect. Some advantages of using this method include that each SMB command can be mapped back to the dialect it was introduced into, because the command is made of (Dialect | Command). This makes it easy to determine when commands were introduced, and what servers support them. If the functionality for a given command is not changed in a new dialect, the code does not change. If the functionality is changed, the down-level interface code does not change, but rather new code is added to support the new functionality.

0051On the server side, a server dispatch table becomes a double switch between (Dialect) and (Command). This allows for logically separating the new functionality in the code, making it easier to understand and change.

0052Turning to one aspect of the protocol that provides efficiency, multiple commands may be compounded into a single packet, (or some lesser number of packets). Complex tasks may thus be performed in a manner that reduces the number of round trips between the client 202 and server 204. By way of example, a compound request packet may contain a command to create/open a file, a command to write to the file and a command read from the file. Compounding thus works with related operations, (e.g., having the same file handle) and also provides for unrelated operations to be combined.

0053An example of compounding related requests is generally represented in <figref idref="f0005">FIG. 5</figref>, where (in contrast to <figref idref="f0004">FIG. 4</figref>, for example) a single request can handle a write and read, providing the appropriate parameters. Note that as represented in <figref idref="f0005">FIG. 5</figref>, a single request may receive a compound response and/or individual responses, depending, for example, on when they complete. More complex requests, such as create/open, read, write and close may be in a single request. This is accomplished by marking a packet as having related operations; the server will know that the file handle it receives following the create/open applies to the other commands in the compound request. Note, however, that related compound requests are handled in the order they are packaged, and thus it is up to the client to ensure they are ordered correctly before sending.

0054Compounding in SMB2 is simpler than the complex rules that existed in SMB1. To this end, the SMB2_HEADER (detailed below) contains a "NextOffset" that is used to identify the offset of the header of the next command from the header of the current command. Each command has its own SMB2_HEADER, including a separate MessageId. The server response or responses may come as a single compounded response, or as separate responses, as represented in <figref idref="f0005">FIG. 5</figref>. In the event of a failure, the response would be the same as any other failed command.

0055For unrelated messages, the commands will always be processed as if they were received separately. This allows a redirector or intermediate component to automatically compound packets that are unrelated. A delay may be used to obtain packets to compound, particularly if the delay time is small relative to the round-trip time. Because the server treats them as received separately, the server need not be otherwise modified to unpack such compound unrelated requests. The entity that performed the compounding may have to separate any compound responses, however, since the server may combine otherwise separate responses.

0056The related mode allows the client to send a series of commands that are to be executed in sequence with the result of one command potentially being used in the next command. Such commands share the same Session/Process/Tree/File ID, they will be executed sequentially, and will stop processing on the first error. If there were other commands to process after the failure, the operations are immediately failed with STATUS_NOT_PROCESSED. An example of how this may be used is to pair a Session Setup with a Tree Connect. If the session fails to be established, the tree connect will never be attempted and will fail with STATUS_NOT_PROCESSED. If the session setup succeeds, the tree connect is done using the SessionId from the session setup command. The same method could be used to do a Create followed by a QueryFileInformation, or even a Create-Read-Close set.

0057Conditional and implied compounding are also feasible. For example, a conditional compound command may be sent, such as open and also read if the file is less than 64KB, thus opening and automatically obtaining small files in one round trip, but only opening large files. Implied compounding, such as automatically returning directory enumeration data in response to an open directory request, even if not expressly requested, may also cut down round trips. The benefits and advantages to such enhanced compounding increase in high-latency networks.

0058Another way in which the protocol facilitates improved efficiency is via multiple channel communication. Between a client and server, a transport connection for commands may be used, with a command that specifies an alternate channel to stream data. For example, a read request may specify the offset and length as well as an alternate channel to read data into; a write request operates similarly. <figref idref="f0006">FIG. 6</figref> shows an example of a 1GB read request starting from offset 0 and requesting the data to be streamed to data channel 5.

0059Streaming data on an alternate channel provides a number of benefits, includes eliminating the need to include and process packet headers. The client can pre-post a buffer and have the data streamed therein, eliminating the need to copy from one buffer to another as in conventional single-channel communication. Fairness is another benefit, in that, for example, one request on the control channel will not have to wait for a large amount of data (e.g., 5GB) to complete be transmitted before that other request is handled, because the 5GB will go over the data channel.

0060As multiple NIC's are becoming more common, the protocol takes advantage of any available network bandwidth. This includes working across multiple connections for the same session, regardless of the transport (or NIC) on which they are established. Specialized hardware may be employed.

0061Thus, with SMB 2.x, a session is not bound to a connection. Instead, multiple "channels" may be established that exist across different physical connections. Sessions can exist on each of these connections, and the IDs used to refer to files and processes are common across channels. This allows for having a normal channel for doing namespace operations and creates, but using specialized network hardware for reads and writes when available. Still further, small network glitches may not result in lost data, because as long as one channel remains open to a session, the session stays alive. Various implementation details are described herein with reference to the Session Setup command and the Read/Write commands.

0062By way of example, consider a client that establishes a connection over simple TCP to the server over an enterprise's public network. This is the first connection, so it is always channel 0. Once both sides detect that they have a private network for doing data transfers, (e.g., each has a gigabit card), the client and server may establish a second connection over this card, as channel 1. While the client is browsing some files, the directory queries are being sent over channel 0, while the data is being sent over channel 1. If the client wants to browse into some directories that are encrypted on the server, when the client requests the data, the redirector realizes that the data is sensitive, so it establishes a new channel (channel 2) to the server that has IP Sec (IP security) active on it. When the client requests the sensitive data, it will ask it be sent over channel 2, while normal less-sensitive data could continue to come over channel 1 (as it is faster).

0063As can be readily appreciated, the opportunity for QoS and security improvements, along with the simple bandwidth gain, provides significant benefits. Note that on a channel read/write, the server/client can lay down the receive buffer before any data is read, so the mechanism can further eliminate the need to copy out of the data movement, which can also improve server/client scalability.

0064Further, SMB error packets are allowed to be tagged with arbitrary data. Thus, a description of why something failed, which may provide value. Symbolic link evaluation is one example where tagging with arbitrary data provides a client with useful information, as generally represented in <figref idref="f0008">FIG. 8</figref>. Essentially, a client create request may fail by asking for a path that is actually a symbolic link to another path. Instead of simply failing the request, information providing the new path allows the client to change to a reparse path, which will ultimately succeed; note that iteration over a number of requests may be required to find a path that will succeed.

<u style="single">EXAMPLE PROTOCOL DEFINITION</u>

0065The new header is a 64-byte structure (e.g., twice the size of one current structure). <pre listing-type="program-listing"> typedef struct _SMB2_HEADER { UCHAR Protocol [4]; // Contains OxFE, 'S', 'M', 'B' USHORT StructureSize; // = sizeof(SMB2_HEADER). // (versioning) USHORT Epoch; // incremented every time the // server restarts NTSTATUS Status; // Status of the command USHORT Command; // The command for this packet // union { USHORT CreditsRequested; // On client send, request for more // credits USHORT CreditsGranted; // On server response, credits // granted to client }; ULONG Flags; ULONG Reserved; UINT64 MessageId; // Identifies this message // send/response union { struct { UINT64 ProcessId; // Process identifier UINT64 SessionId; // Session identifier ULONG TreeId; // Tree Connect identifier }; struct { UINT64 AsyncId; // Used to identify long standing // commands }; }; UCHAR Signature[8]; // Signature for the packet ULONG NextCommand; // Offset from to next } _SMB2_HEADER, *PSMB2_HEADER;</pre>

0066Protocol is simply the protocol identifier, to identify the packet. For the existing SMB implementations, this consists of {0xFF, 'S', 'M', 'B' }. For the new protocol this shall be { 0xFE, 'S', 'M', 'B' }.

0067StructureSize identifies the size of the SMB2_HEADER structure, and will be used for minor versioning within the Header itself, if other changes are introduced later on.

0068Epoch represents the "version count" of a server. This is incremented when a server is cycled (or the server service is stopped and started) to indicate to the client whether the server might have maintained state across a disconnect. This is for future use with persistent handles, and can be considered "Reserved" for the time being.

0069Status gives the error status for a given operation, as in the existing SMB implementation.

0070Command identifies the command for the packet, as described herein.

0071CreditsGranted/CreditsRequested are used by the client on a send to request more credits, and by the server on the response to grant more credits within the new credit management scheme, as described in the related patent application entitled "Data Communication Coordination with Sequence Numbers."

0072Flags related to the message include: <ul id="ul0001" list-style="none" compact="compact"><li>#define SMB2_FLAGS_SERVER_TO_REDIR 0x00000001</li><li>When present, indicates the message is a response as opposed to a request</li><li>#define SMB2_FLAGS_ASYNC_COMMAND 0x00000002</li><li>On response, the server returns STATUS_PENDING with this flag set to indicate that we are processing it asynchronously.</li><li>#define SMB2_FLAGS_RELATED_OPERATIONS 0x00000004</li><li>Set on a client message send of a compounded message to indicate that the operations are related, so the file opened in the Create is used as the FileId for later operations.</li><li>#define SMB2_FLAGS_SIGNED 0x00000008</li><li>Set when the packet has been signed. The receiver should verify the signature. The key used for signing is based on the session that sent the packet.</li><li>#define SMB2_FLAGS_DFS_OPERATION 0x10000000</li></ul>

0073This is a DFS operation. The server should allow DFS to munge the name. This could be replaced with a create option.

0074MessageId Identifies a message being sent with its response.

0075ProcessId describes the client-side identification of the process issuing the command.

0076SessionId identifies the established session for the command, or 0 if no session is being used.

0077TreeId Identifies the tree connect for the command, or 0 if no tree connect is being used.

0078AsyncId: as described in the related patent application entitled "Data Communication Coordination with Sequence Numbers," message IDs are actually sequence numbers, and the window of available sequence numbers is always set to slide to the right. A command that will run for an extremely long time (such as a named-pipe read or change-notification, or a create that pends on an oplock break, any of which can block indefinitely) may hold up the ability of the window to slide. To work around this issue, the server can optionally respond to any command with STATUS_PENDING and setting the SMB2_FLAGS_ASYNC_COMMAND flag mentioned above and providing a unique identifier in place of the Session/Tree/ProcessId. This means the client can continue sliding the window as if it received a response. At some point later, the true response will come with a matching AsyncId (and CommandId) to satisfy the request. In the event that the client wants to cancel such a command, the client sends a cancel with the flag set and the matching AsyncId.

0079The security signature is the same as in the previous protocol, except that there is no longer a hidden index number. The index is not necessary with the use of sequence numbers for the MID. (This prevents replayability directly). This allows the use of security signatures without forcing the operations to be sequenced on their way to the transport. NextCommand is the offset of the next command in the message from the beginning of this header. Messages should be quad-aligned. The use of the SMB2_FLAGS_RELATED_COMMAND allows various abilities for compounding, as described above.

COMMAND FORMATS

<i>NEGOTIATE</i>

0080As described above, the client and server exchange negotiate request and response as part of the handshake that helps them determine each other's capabilities. <pre listing-type="program-listing"> Format #define SMB2_NEGOTIATE_SIGNING_ENABLED 0x01 #define SMB2_NEGOTIATE_SIGNING_REQUIRED 0x02 #define SMB2_GLOBAL_CAP_DFS 0x00000001 #define SMB2_GLOBAL_CAP_LWIO 0x00000002 #define SMB2_GLOBAL_CAP_TXF 0x00000004 #define SMB2_GLOBAL_CAP_CSE 0x00000008 typedef struct _SMB2_REQ_NEGOTIATE { USHORT StructureSize; // = sizeof(SMB2_REQ_NEGOTIATE) USHORT Reserved; // = 0 ULONG DialectCount; // Number of dialects we support USHORT Dialects[]; // Array of dialect revision // numbers. } 5MB2_REQ_NEGOTIATE, *PSMB2_REQ_NEGOTIATE; typedef struct SMB2 RESP NEGOTIATE { USHORT StructureSize; // = sizeof(SMB2_RESP_NEGOTIATE) USHORT SecurityMode; // = signing flags USHORT DialectRevision; // Server selected dialect from // received list USHORT Reserved; GUID ServerGuid; // Server generated GUID ULONG Capabilities; // Global server capability flags ULONG MaxTransactSize; // Largest transact buffer we will // accept or send ULONG MaxReadSize; // Largest size read supported ULONG MaxWriteSize; // Largest size write supported UINT64 SystemTime; // System (UTC) time on the server USHORT EncryptionKeyOffset; USHORT EncryptionKeyLength; USHORT SecurityBufferOffset; USHORT SecurityBufferLengch; UCHAR Buffer [1]; } SMB2_RESP_NEGOTIATE, *PSMB2_RESP_NEGOTIATE;</pre>

<i>SESSION SETUP</i>

0081As described above, Session Setup handles the authentication process for a new session. <pre listing-type="program-listing"> Format typedef struct _SMB2 _REQ_SESSION SETUP { USHORT StructureSize; // = sizeof(SMB2_REQ_SESSION_SETUP) USHORT VcNumber; // 0 = first connection, nonzero = // additional ULONG Capabilities; // Capabilities of the client. ULONG Channel; // nonzero = binding new channel to // session USHORT SecurityBufferOffset; USHORT SecurityBufferLength; UCHAR Buffer[1]; // Security buffer } SMB2_REQ_SESSION_SETUP, *PSMB2_REQ_SESSION_SETUP; #define SMB2_SESSION_FLAG_IS_GUEST 0x0001 #define SMB2_SESSION_FLAG_IS_NULL 0x0002 typedef struct SMB2 RESP SESSION SETUP { USHORT StructureSize; // = // sizeof(SMB2_RESP_SESSION_SETUP) USHORT SessionFlags; USHORT SecurityBufferOffset; USHORT SecurityBufferLength; UCHAR Buffer[1]; // Security buffer } LOGOFF Logs off an existing session. Format typedef struct SMB2_REQ_LOGOFF { USHORT StructureSize; USHORT Reserved; } SMB2_REQ_LOGOFF; typedef struct_SMB2_RESP_LOGOFF { USHORT StructureSize; USHORT Reserved; } SMB2_RESP_LOGOFF;</pre>

0082This command tears down the session with the SessionId specified in the header. Open files are closed, and other existing structures (tree connects, etc.) are torn down. No more operations can be processed for the given SessionId.

<i>TREE CONNECT</i>

0083Creates a tree connection to a shared resource on the server machine. <pre listing-type="program-listing"> Format typedef struct _SMB2 REQ_TREE CONNECT { USHORT StructureSize; // = sizeof (SMB2_REQ_TREE_CONNECT) USHORT Reserved; USHORT PathOffset; // Full path (i.e. \\SERVER\SHARE) USHORT PathLength; UCHAR Buffer [1]; } 5MB2_REQ_TREE_CONNECT, *PSMB2_REQ_TREE_CONNECT; #define SMB2_SHAREFLAG_MANUAL_CACHING 0x00000000 #define SMB2_SHAREFLAG_AUTO_CACHING 0x00000001 #define SMB2_SHAREFLAG_VDO_CACHING 0x00000002 #define SMB2_SHAREFLAG_NO_CACHING 0x00000003 #define SMB2_SHAREFLAG_CACHING_FLAGS 0x00000003 // Reserved share cap 0x00000001 // Reserved share cap 0x00000002 // Reserved share cap 0x00000004 #define SMB2_SHARE_CAP_DFS 0x00000008 // This is a DFS share #define SMB2_SHARE_TYPE_DISK 0x01 #define SMB2_SHARE_TYPE_PIPE 0x02 typedef struct _SMB2_RESP TREE_CONNECT { USHORT StructureSize; // = sizeof(SMB2_RESP_TREE_CONNECT) UCHAR ShareType; UCHAR Reserved; ULONG ShareFlags; ULONG Capabilities; } 5MB2_RESP_TREE_CONNECT, *PSMB2_RESP_TREE_CONNECT;</pre>

0084The client issues this command to the server to establish a tree connection. The Path is of the form \\server\share and is filled into the buffer. Inclusion of the server name allows for features like share scoping.

0085On successful response from the server, the client receives the TreeId in the header along with the ShareFlags and ShareCapabilities. Currently, the share flags indicate to the client what the CSC caching properties are for a share, but more may be added later on. The capabilities tell the client whether the file system backing the share supports either file-level security, timewarp, TxF (transactional file system), or client-side encryption. If a file system supports these properties on some subtrees but not all (such as the case of mount points), it should return that it does support them and simply fail the individual requests to use them in cases where it is not allowed. The client should ignore any flags or capabilities it does not understand.

<i>TREE DISCONNECT</i>

0086Tears down an existing TreeConnect. <pre listing-type="program-listing"> Format typedef struct _SMB2_REQ_TREE_DISCONNECT { USHORT StructureSize; USHORT Reserved; } SMB2_REQ_TREE_DISCONNECT; typedef struct _SMB2_REQ_TREE_DISCONNECT { USHORT StructureSize; USHORT Reserved; } 5MB2_REQ_TREE_DISCONNECT;</pre>

0087Once the command is processed, no more operations can be successfully completed on the given TreeId. The TreeId is taken from the header.

<i>CREATE</i>

0088Opens a file, printer, or pipe. <pre listing-type="program-listing"> Format #define SMB2_OPLOCK_LEVEL_NONE 0 #define SMB2_OPLOCK_LEVEL_II 1 #define SMB2_OPLOCK_LEVEL_EXCLUSIVE 8 #define SMB2_OPLOCK_LEVEL_BATCH 9 #define SMB2_OPLOCK_LEVEL_DIRCHANGE 16 typedef struct _SMB2_REQ_CREATE { USHORT StructureSize; // = sizeof(SMB2_REQ_CREATE) UCHAR SecurityFlags; // QOS security flags UCHAR RequestedOplockLevel; // Desired oplock level ULONG ImpersonationLevel; // QOS security info UINT64 SmbCreateFlags; UINT64 RootDirectoryFid; // For relative opens ACCESS_MASK DesiredAccess; ULONG FileAttributes; ULONG ShareAccess; ULONG CreateDisposition; ULONG CreateOptions; USHORT NameOffset; // Name relative to share USHORT NameLength; ULONG CreateContextsOffset; // Extra create parameters ULONG CreateContextsLength; UCHAR Buffer[1]; // Name[], CreateContexts[] } 5MB2_REQ_CREATE, *PSMB2_REQ_CREATE; typedef struct SMB2 CREATE CONTEXT { ULONG Next; USHORT NameOffset; USHORT NameSize; USHORT Reserved; USHORT DataOffset; ULONG DataSize; UCHAR Buffer [1] ; // Name [ ], Data [ ] } 5MB2_CREATE_CONTEXT, *PSMB2_CREATE_CONTEXT; typedef struct _SMB2_RESP_CREATE { USHORT StructureSize; // = sizeof(SMB2_RESP_CREATE) UCHAR OplockLevel; // The oplock granted on the file UCHAR Reserved; ULONG CreateAction; // Action taken by create UINT64 FileId; // ID for this open UINT64 CreationTime; // File time information UINT64 LastAccessTime; UINT64 LastWriteTime; UINT64 LastChangeTime; UINT64 AllocationSize; // File size information UINT64 EndOfFile; ULONG FileAttributes; // NT attributes of the file ULONG Reserved2; // For 8-byte alignment ULONG CreateContextsOffset; // Responses for Extra Create // Parameters ULONG CreateContextsLength; UCHAR Buffer[1]; // CreateContexts[] } 5MB2_RESP_CREATE. *PSMB2_RESP_CREATE; #define SMB2_CREATE_EA_BUFFER (ULONG) ('AtxE') #define SMB2_CREATE_SD_BUFFER (ULONG)('DceS') #define SMB2_CREATE_MARSHALLED_TRANSACTION (ULONG)('xTrM') #define SMB2_CREATE_MINIVERSION (ULONG)('rVnM') #define SMB2_CREATE_VERSION (ULONG)('sreV') #define SMB2_CREATE_NTFS_FID . (ULONG)('diFN') #define SMB2_CREATE_TIMEWARP_TOKEN (ULONG)('prWT') #define SMB2_CREATE EFS_STREAM (ULONG) ('sfES') #define SMB2_CREATE_CLIENT_SIDE_ENCRYPTION (ULONG)('1ESC')</pre>

0089The create request is a variable length request to allow creation of files with various attributes other than the traditional well-defined attributes. The standard case (where no extended attributes are present) is straightforward; the client fills in the RootDirectoryFid (for a relative open if desired), the DesiredAccess, FileAttributes, ShareAccess, CreateDisposition, and CreateOptions. They set the desired oplock level, and fill in the SecurityFlags &amp; Impersonation level for QoS. Currently there are no SmbCreateFlags defined but space has been allocated for their use. The client sends this packet to the server, which opens the file and either returns a failure code, or returns Success along with the FileId that identifies the file, the Creation/LastAccess/LastWrite/LastChangeTime, the AllocationSize and EndOfFile information, and the FileAttributes. That is the normal case that operates in much the same way that the current protocol does. For more advanced cases, consider that the user wants to create a file with extended attributes (EAs). In the previous protocol, there was an entirely different way of handling this, through a Transact call. Now, the client can build up the create request as normal, but also add a CreateContext to the end of the create request. The request would have the name "ExtA" and the Data would contain the EAs to set on the file. When the server receives this, it would parse out the EA data and issue it with the create. Create contexts can also be returned on the create response to provide additional information. For the first iteration, the names will be of length 4 so we can format them as a long and switch on them. The current list of CreateContext's is as follows: <ol id="ol0001" compact="compact"><li>1) "ExtA" - Data contains the extended attributes to put on the created file.</li><li>2) "SecD" - Data contains a self-relative security descriptor to put on the created file.</li><li>3) "TWrp" - Data contains a timewarp timestamp that should be used to find the file to open. The timestamp is in the System Time format.</li><li>4) "MrTx " - Data contains a marshalled transaction to be used when opening files transactionally.</li><li>5) "MnVr" - Data contains a mini-version number (ULONG) to open a transacted file</li><li>6) "Vers" - Data contains the version number (ULONG) of the file opened (create response)</li><li>7) "NFid" - Data contains the NTFS Fid (LARGE_INTEGER) of the file opened (create response)</li><li>8) "$Efs" - Data contains the $EFS stream to be stamped on a new encrypted file</li><li>9) "CSE1" - Data contains the $EFS stream of the encrypted file opened (create response)</li></ol>

0090More CreateContext values can be added as servers support them. (As values are added they would either have a capability bit associated with them or be associated with a new dialect revision such that the client knows which tags the server supports before it issues the create request.) A server that receives a create request with an unrecognized context tag would fail the request.

<i>CLOSE</i>

0091A client sends a Close to close an instance of a file that was opened previously. Once a close is processed, no file operations are allowed on the previous FID. <pre listing-type="program-listing"> Format typedef struct _SMB2_REQ_CLOSE { USHORT StructureSize; USHORT Reserved; ULONG Flags; UINT64 FileId; UINT64 LastWriteTime; } SMB2_REQ_CLOSE, *PSMB2_REQ_CLOSE; typedef struct _SMB2_RESP_CLOSE { USHORT StructureSize; USHORT Reserved; } 5MB2_RESP_CLOSE, *PSMB2_RESP_CLOSE;</pre>

0092For the Close command, the client specifies the FileId of the file being closed, along with the LastWriteTime (in SystemTime format). This allows the client to set the last time a cached write was performed on the file as the last written time on the file. The client can also send zero for the LastWriteTime to indicate that they do not wish to specify one. The structure also allots room for Close flags which are currently undefined, but may be used at a later point.

<i>FLUSH</i>

0093A flush command informs the server to flush out all cached data on a given file. <pre listing-type="program-listing"> Format typedef struct _SM82_REQ_FLUSH { USHORT StructureSize; USHORT Reserved1; ULONG Reserved2; UINT64 FileId; } SMB2_REQ_FLUSH, *PSMB2_REQ_FLUSH; typedef struct _SMB2_RESP_FLUSH { USHORT StructureSize; USHORT Reserved; }</pre>

0094Upon successful response from the server, the client is guaranteed that all cached data has been flushed to its backing persistent store. The client specifies the FileId of the file it wishes to flush. A flush on a pipe will not return until all data is consumed from that pipe, which may take a while.

READ

0095Reads data from an open file. <pre listing-type="program-listing"> Format typedef struct _SMB2_REO_READ { USHORT StructureSize; // = sizeof(SMB2_REQ_READ) UCHAR Padding; // Requested padding of read data // response from beginning of header UCHAR Reserved; ULONG Length; // The length of the read to send on // this channel UINT64 Offset; // Offset of the read UINT64 FileId; // Identifier of the file // being read ULONG MinimumCount; // The minimum bytes to read and // consider success ULONG Channel; // The channel to send the remaining // data on ULONG RemainingBytes; // If channel != 0, additional bytes to // be read and sent on channel, // otherwise how much more planned to read USHORT ReadChannelInfoOffset; // If channel 1= 0, information about USHORT ReadChannelInfoLength; // channel to send additional data on. UCHAR Huffer[1]; // ReadChannelInfo } SMB2_REQ_READ, *PSMB2_REQ_READ; typedef struct _SMB2_RESP_READ { USHORT StructureSize; // = sizeof(SMB2_RESP_READ) UCHAR DataOffset; // Offset to data in the packet UCHAR Reserved; ULONG DataLength; // Length of data returns as part of // this packet ULONG DataRemaining; // Length of data that is being sent on // the alternate channel if specified, // otherwise how much more we are ready // to have read UCHAR Buffer[1]; // Pad[], Data[] } SMB2_RESP_READ, *PSMB2_RESP_READ;</pre>

0096Read is pretty self explanatory. The client specifies the file (via FileId), the offset, and the length of the read, and the server returns the data. There are a couple other things the client can specify. The MinCount tells the server the minimum amount it will read from a file for a successful return. If the read comes up short, the server will simply return a failure instead of returning the entire data buffer. The client can also recommend Padding for better processing. This is the offset into the read response packet where the server should put the data. This allows the client to lay down the read response buffers in a more efficient way when it receives the information off the transports. The remaining field indicates to the server how much the entire read will be for if this is only a section of the read. Thus, if the client is going to read 8k in 1k chunks, it would issue a read for 1k with Remaining=7k. This allows the server the option to optimize by reading the entire 8k in one operation and buffering the data back to the client.

0097On the server response, it indicates how much data it is returning (in the DataLength field) along with the DataRemaining that was specified in the read command. If the channel specified in the command is not the channel that the command came in on, than the user is asking for a channel read. This means that if I request a read on channel 0 with "channel = 1" and "Length=0, Remaining=64k", the server will respond with "DataLength = 0, DataRemaining=64k" and the next 64k bytes that come across Channel 1 will be the data. The client is responsible for synchronizing this to make sure no data responses are outstanding on channel 1 when this command is issued. A client could also issue (on channel 0) "read Channel=1,DataLength=1k, Remaining=7k", such that the response would contain the first 1k of data and the rest of the data (the last 7k) would be streamed across channel 1.

<i>WRITE</i>

0098Writes data to an open file. <pre listing-type="program-listing"> Format typedef struct _SMB2_REQ_WRITE { USHORT StructureSize; // = sizeof(SMB2_REQ_WRITE) USHORT DataOffset; // Offset to data from header ULONG Length; // Length of data being written UINT64 Offset; // File offset of the write UINT64 FileId; // Identifier for the file being // written to ULONG Channel; // If non-zero, the channel where // the remaining data should be sent ULONG Remaining; // Number of bytes to be sent on channel USHORT writeChannelInfoOffset; // If channel != 0, information // about the channel USHORT WriteChannelInfoLength; // we wish to write data to. ULONG Flags; UCHAR Buffer[1]; // WriteChannelInfo } SMB2_REQ_WRITE, *PSMB2_REQ_WRITE; typedef struct _SMB2_RESP_WRITE { USHORT StructureSize; // = sizeof(SMB2_RESP_WRITE) USHORT Reserved; ULONG Count; // How much of the data was written ULONG Remaining; // How many bytes we can receive on // the channel USHORT WriteChannelInfoOffset; // If channel != 0, optional // information about the channel we USHORT WriteChannelInfoLength; // wish to write data to. UCHAR Buffer[1]; // WriteChannelInfo } SMB2_RESP_WRITE, *PSMB2_RESP_WRITE;</pre>

0099The client fills in the file (identified by the FileId), the offset, and the length for the write, and attached the data. It is recommended that the data be padded as returned in the original negotiate response to help server performance. The client can also indicate how much more data it will write to the server to allow the server to optimize. On the response, the server indicates how much was written, and returns the amount it is still expecting. If the channel specified in the write is not the channel the command came in on, than the client is asking to stream the data on another channel. An example would be a write received on channel 0 with "Channel=1, Length=0, Remaining=64k". The client is asking to stream a 64k write on Channel 1. The server would respond with "Count=0, Remaining=64k" to allow the write. The response will include and AsyncId for a second response that will come after the data is sent on the channel and ack'd. Then the next 64k bytes streamed on Channel 1 would be the data. (No header). Upon completion, the server will send a SMB2_RESP_WRITE on channel 0 to indicate the success/failure of the operation and use the AsyncId information to send a second reply, unless the specific channel allows for inherent acknowledgement in which case it will occur on the channel itself.

<i>BREAK_OPLOCK</i>

0100Used to request and acknowledge the release of opportunistic locks taken on a file. <pre listing-type="program-listing"> Format typedef struct _SMB2_REQ_BREAK_OPLOCK { USHORT StructureSize; // = sizeof(SMB2_REQ_BREAK_OPLOCK) UCHAR OplockLevel; // Level to break to. (Leve12 or None) UCHAR Reserved; ULONG Reserved2; // Timeout in seconds UINT64 FileId; // Identifier of the file being locked/unlocked } SMB2_REQ_BREAK_OPLOCK, *PSMB2_REQ_BREAK_OPLOCK; typedef struct _SMB2_RESP_BREAK_OPLOCK { USHORT StructureSize; // = sizeof(SMB2_RESP_LOCK) UCHAR OplockLevel; // Level broken to (&lt;= level requested) UCHAR Reserved; ULONG Reserved2; UINT64 FileId; } 5MB2_RESP_BREAK_OPLOCK, *PSMB2_RESP_BREAK_OPLOCK;</pre>

0101When another user requests access to a file that a client holds an opportunistic lock on in a fashion that requires breaking the existing lock, SRV will send an SMB2_RESP_BREAK_OPLOCK to the client. The client is then expected to send a REQ_BREAK_OPLOCK for the given file to release their oplock, and SRV will respond again to acknowledge this.

<i>LOCK</i>

0102Used to request byte-range locks, and also used to request oppurtunistic locks (and inform the client when one is broken). <pre listing-type="program-listing"> Format #define SMB2_LOCKFLAG_SHARED_LOCK 0x01 #define SMB2_LOCKFLAG_EXCLUSIVE_LOCK 0x02 #define SMB2_LOCKFLAG_UNLOCK 0x04 #define SMB2_LOCKFLAG_FAIL_IMMEDIATELY 0x10 typedef struct _SMB2_LOCK { UINT64 Offset; UINT64 Length; ULONG Flags; ULONG Reserved; } SMB2_LOCK, *PSMB2_LOCK; typedef struct _SMB2_REQ_LOCK { USHORT StructureSize; // = sizeof(SMB2_REQ_LOCK) UCHAR LockCount; ULONG Reserved; UINT64 FileId; // Identifier of the file being // locked/unlocked SMB2_LOCK Locks[1]; // Array of size (LockCount) } SMB2_REQ_LOCK, *PSMB2_REQ_LOCK; typedef struct _SMB2_RESP_LOCK { USHORT StructureSize; // = sizeof(SMB2_RESP_LOCK) USHORT Reserved; } SMB2_RESP_LOCK, *PSMB2_RESP_LOCK;</pre>

0103Syntax for the LOCK request is similar to the SMB1 Lock request. The client specifies the FileId, and one or more SMB_LOCK structures indicating the offset and length they wish to lock. All of these LOCK structures must be either locks or unlocks. However, you can mix shared and exclusive lock requests in a single batched lock operation. The most common use for lock batching would be claiming a series of locks as part of a batch oplock break, and is most useful when you are assured that all the locks will succeed. A successful return indicates to the client that they attained (or released) the requested byte range locks. On the failure case, the byte range locks were not granted.

<i>ECHO</i>

0104Echo is used by a client to determine whether a server is still up at a given point in time. Upon receipt of this command, the server will simply turn it around and return success. <pre listing-type="program-listing"> Format typedef struct _SMB2_REQ ECHO { USHORT Structuresize; USHORT Reserved; } SMB2_REQ_ECHO, *PSMB2_REQ_ECHO; typedef struct SMB2_RESP ECHO { USHORT StructureSize; USHORT Reserved; } SMB2_RESP_ECHO, *PSMB2_RESP_ECHO;</pre>

0105The server responds to the packet to indicate it is working properly. Used to allow the client to "ping" the server.

<i>CANCEL</i>

0106Used by the client to request the cancellation of a sent operation. <pre listing-type="program-listing"> Format typedef struct _SMB2_REQ_CANCEL { USHORT StructureSize; USHORT Reserved; } SMB2_REQ_CANCEL, *PSMB2_REQ_CANCEL;</pre>

0107A cancel has no response, but should result in the command itself either being completed successfully, or failing with STATUS_CANCELLED, and it should happen as soon as possible. The operation being sent is identified because it will share the MessageId of the cancel command. This is the one case where a MessageId sent to the server may already have been used previously. If a response came with an AsyncId, that should be present in the header, and will be used to locate the command on the server.

<i>IOCTL</i>

0108Ioctl is used to issue a Device Control or a File System Control command across the network. <pre listing-type="program-listing"> Format // Request typedef struct _SMB2_REQ_IOCTL { USHORT StructureSize; // = sizeof(SMB2_REQ_TRANSACT) USHORT Reserved; ULONG CtlCode; UINT64 Filerd; ULONG InputOffset; // Bytes for input buffer ULONG InputCount; // Count of parameter bytes in this // message ULONG MaxInputResponse; // Max bytes server can return for // response parameters ULONG OutputOffeet; // Data bytes location ULONG OutputCount; // Count of data bytes in this // message ULONG MaxOutputResponse; // Max bytes server can return for // response data ULONG Flags; ULONG Reserved2; UCHAR Buffer[1]; // Parameters[], Data[] } SMB2_REQ_IOCTL, *PSMB2_REQ_IOCTL; // Response typedef struct _SMB2_RESP_IOCTL { USHORT StructureSize; // = sizeof(SMB2_RESP_TRANSACT) USHORT Reserved; ULONG CtlCode; UINT64 FileId; ULONG InputOffset; // Bytes for input buffer ULONG InputCount; // Count of parameter bytes in this // message ULONG OutputOffset; // Data bytes location ULONG OutputCount; // Count of data bytes in this // message ULONG Flags; ULONG Reserved2; UCHAR Buffer [1] ; // Parameters [], Data [] } SMB2_RESP_IOCTL, *PSMB2_RESP_IOCTL;} SMB2_RESP_TRANSACT, *PSMB2_RESP_TRANSACT;</pre>

0109An IOCTL is used for issuing a generic file system or device control command across the network. It packs the input and output buffers based on the METHOD of the control code and sends them across the network. The server side than repackages them and issues the FSCTL/IOCTL against the file object. The results are likewise packed up and returned to the user with the status code. The set of allowable FSCTL/IOCTL codes can be limited by both SRV or the underlying file systems. (Not all are necessarily valid remotely.)

0110For buffered or direct requests, only Input is valid on request and Output is sent on response. For neither requests, both Input and Output are sent both ways.

<i>QUERY DIRECTORY</i>

0111Allows the client to query directory enumerations on an open directory handle across the network. <pre listing-type="program-listing"> Format // // QUERY_DIRECTORY Command // #define SMB2_REOPEN 0x10 // Request typedef struct _SMB2_REQ_QUERY DIRECTORY { USHORT StructureSize; // = // sizeof(SMB2_REQ_QUERY_DIRECTORY) UCHAR FileInformationClass; UCHAR Flags; // SL_/SMB2_ flags ULONG FileIndex; UINT64 FileId; USHORT FileNameOffset; USHORT FileNameLength; ULONG OutputBufferLength; UCHAR Buffer[1]; // FileName parameter } SMB2_REQ_QUERY_DIRECTORY, *PSMB2_REQ_QUERY_DIRECTORY; // Response typedef struct _SMB2_RESP_QUERY_DIRECTORY { USHORT StructureSize; // = sizeof(SMB2_RESP_QUERY_DIRECTORY) USHORT OutputBufferOffset; ULONG OutputBufferLength; UCHAR Buffer[1]; // Response data } SMB2_RESP_QUERY_DIRECTORY, *PSMB2_RESP_QUERY_DIRECTORY;</pre>

0112The QueryDirectory call matches existing NT semantics very closely. The caller provides the InfoClass, the FileId for the directory open, the filename portion (that specifies either the wildcard/file search params or the resume name for an existing search) and any valid SL_ flags associated with the call, and SRV will return a buffer up to OutputBufferLength. There is also a new flag (SMB2_REOPEN) that can be included in the QueryDirectory flags structure. This flag is a stronger version of the SL_RESTART_SCAN flag. The latter only allows restarting scans where the search specified hasn't changed. (i.e. restart a *.* or a t* search.) The latter tells the server to restart a scan where the search specified has changed. To use this flag, the caller must guarantee exclusive use across the call, and no outstanding operations (such as change notifies). The server takes the appropriate steps to perform this operation, which may involve closing and reopening the underlying directory handle on the server side. This is transparent to the client.

<i>CHANGE NOTIFY</i>

0113This potentially long-running operation allows a client to register for change notifications on a directory. <pre listing-type="program-listing"> Format // // CHANGE_NOTIFY Command // // Request typedef struct _SMB2 REQ CHANGE NOTIFY { USHORT StructureSize; // = // sizeof(SMB2_REQ_CHANGE_NOTIFY) USHORT Flags; // SL_WATCH_TREE? ULONG OutputBufferLength; UINT64 FileId; ULONG CompletionFilter; ULONG Reserved; } 5MB2_REQ_CHANGE_NOTIFY, *PSMB2_REQ_CHANGE_NOTIFY; // Response typedef struct _SMB2_RESP_CHANGE_NOTIFY { USHORT StructureSize; // = // sizeof(SMB2_RESP_CHANGE_NOTIFY) USHORT OutputBufferOffset; ULONG OutputBufferLength; UCHAR Buffer[1]; // Notify data } SMB2_RESP_CHANGE_NOTIFY, *PSMB2_RESP_CHANGE_NOTIFY;</pre>

0114The caller sends the FileId for the directory along with a CompletionFilter specifying which changes the caller is interested in. They also can send the SL_WATCH_TREE flag to indicate a recursive notify operation. This operation will almost always invoke the "async" behavior since it can pend for an infinite amount of time. Also note that any further change notify requests on the same handle will pend waiting for the first to complete, just as in local file system behavior.

<i>QUERY INFO</i>

0115Allows the client to query information from the remote system. Currently this can be used to query file information, file-system information, security information, or quota information. <pre listing-type="program-listing"> Format // // QUERY_INFO // #define SMB2_0_INFO_FILE 0x01 #define SMB2_0_INFO_FILESYSTEM 0x02 #define SMB2_0_INFO_SECURITY 0x03 #define SMB2_0_INFO_QUOTA 0x04 typedef struct _SMB2_QUERY_QUOTA_INFO { UCHAR ReturnSingleEntry; // Indicates that only a single entry // should be returned rather than // filling the buffer with as // many entries as possible. UCHAR RestartScan; // Indicates whether the scan of the // quota information is to be // restarted from the beginning. USHORT Reserved; ULONG SidListLength; // Supplies the length of the SID // list if present ULONG StartSidLength; // Supplies optional SID that // indicates the returned information // is to start with an entry other // than the first. This parameter is // ignored if a SidList is given ULONG StartSidOffset; // Supplies the offset of Start Sid // in the buffer } SMB2_QUERY_QUOTA_INFO, *PSMB2_QUERY_QUOTA_INFO; // Request typedef struct _SMB2_REQ_QUERY_INFO { USHORT StructureSize; // = sizeof(SMB2_REQ_QUERY_INFO) UCHAR InfoType; // Determines info type // (SMB2_0_INFO_*) UCHAR FileInfoClass; ULONG OutputBufferLength; USHORT InputBufferOffset; // Input buffer only valid on // Quota calls USHORT Reserved; ULONG InputBufferLength; union { ULONG SecurityInformation; // For Query Security calls ULONG EaIndex; // For QueryEA calls }; ULONG Flags; UINT64 Filerd; UCHAR Buffer[1]; } SMB2_REQ_QUERY_INFO, *PSMB2_REQ_QUERY_INFO; // Response typedef struct _SMB2_RESP_QUERY_INFO { USHORT StructureSize; // = sizeof(SMB2_RESP_OUERY_INFO) USHORT OutputBufferOffset; ULONG OutputBufferLength; UChAR Buffer[1]; // File Info } SMB2_RESP_QUERY_INFO, *PSMB2_RESP_QUERY_INFO;</pre>

0116The client specifies in the InfoType the SMB2_0_INFO_* options to indicate whether this is a request for file information, file system information, security information, or quota information. The FileId denotes the file in question (for file info or security information.) The volume the file resides on is used for file system info or quota requests. The sub-information level is filled into FileInfoClass, and is dependent on the type of information being queried. For file information queries it will be a FILE_INFORMATION_CLASS, where as for file system information it will be a FS_INFORMATION_CLASS. For quota and security, it will be 0. The input buffer is currently only used for Quota requests, as they take the SMB2_QUERY_QUOTA_INFO structure on input to determine what is being asked for. For the other requests it will be empty. OutputBufferLength specifies the maximum amount of data to return to the user.

<i>SET INFO</i>

0117Allows the client to set information on the remote system. Currently this can be used to set file information, file-system information, security information, or quota information. <pre listing-type="program-listing"> Format // // SET_INFO // // Request typedef struct SMB2_REQ SET_INFO { USHORT StructureSize; // = sizeof(SMB2_REQ_SET_INFO) UCHAR InfoType; UCHAR FileInfoClass; ULONG BufferLength; USHORT BufferOffset; USHORT Reserved; union { ULONG Reserved2; ULONG SecurityInformation; // For SET_SECURITY calls }; UINT64 FileId; UCHAR Buffer[1]; // File info } SMB2_REQ_SET_INFO, *PSMB2_REQ_SET_INFO; // Response typedef struct _SMB2_RESP_SET_INFO { USHORT StructureSize; // = sizeof(SMB2_RESP_SET_INFO) } SMB2_RESP_SET_INFO, *PSMB2_RESP_SET_INFO;</pre>

0118The type of information being set and the specific class are set in the Flags and FileInfoClass fields as described for QUERY_INFO. The input buffer provided is the information being set, and the FileId identifies the file. For SetSecurity calls, the SecurityInformation field denotes the info being set. (i.e. OWNER_SECURITY_INFORMATION, etc.)

<u style="single">CONCLUSION</u>

0119While the invention is susceptible to various modifications and alternative constructions, certain illustrated embodiments thereof are shown in the drawings and have been described above in detail. It should be understood, however, that there is no intention to limit the invention to the specific forms disclosed, but on the contrary, the intention is to cover all modifications, alternative constructions, and equivalents falling within the spirit and scope of the invention.

The following is a list of further preferred embodiments of the invention:

0120<ul id="ul0002" list-style="none"><li>Embodiment 1: In a network computing environment, a method comprising: <ul id="ul0003" list-style="none"><li>sending a communication from a client to a server, the communication including data that identifies a first data communication protocol and a second data communication protocol, the communication formatted such that without requiring another request, a server incapable of communicating via the second data communication protocol will respond with data indicating the first communication protocol, while a server capable of communicating via the second data communication protocol will respond with data indicating the second communication protocol;</li><li>receiving a response indicating the second communication protocol; and</li><li>invoking a driver that handles communication via the second protocol to handle communication from that server.</li></ul></li><li>Embodiment 2: The method of embodiment 1 wherein the second communication protocol is server message block (SMB) 2.0 or greater, and the communication from the client is otherwise formatted as an SMB1 packet with the second data communication protocol identified therein.</li><li>Embodiment 3: The method of embodiment 1 further comprising, sending a create command from the client to the server, the create command having additional context data attached.</li><li>Embodiment 4: The method of embodiment 1 further comprising, sending a compound command from the client to the server, the compound command comprising a plurality of related commands.</li><li>Embodiment 5: The method of embodiment 1 further comprising, sending a compound command from the client to the server, the compound command comprising a plurality of unrelated commands.</li><li>Embodiment 6: The method of embodiment 1 further comprising, sending a data-related command from the client to the server, the data-related command requesting data on a data channel.</li><li>Embodiment 7: The method of embodiment 1 further comprising, sending a signed capability verification request from the client to the server to ensure that a secure connection is established.</li><li>Embodiment 8: The method of embodiment 1 further comprising, receiving at the client extended error data from the server in response to a request.</li><li>Embodiment 9: The method of embodiment 1 further comprising, sending at least one command from a set of commands from the client to the server, the set containing a create command having additional context data attached, a related compound command comprising a plurality of related commands, an unrelated compound command comprising a plurality of unrelated commands, and/or a data-related command requesting data communication on a separate data channel.</li><li>Embodiment 10: The method of embodiment 1 further comprising, sending a communication from a client to another server, the communication including data that identifies a first data communication protocol and a second data communication protocol, wherein the other server is incapable of communicating via the second data communication protocol, and the client invokes another driver that handles communication via the first protocol with the other server at essentially the same time the client is communicating with the server via the second protocol.</li><li>Embodiment 11: At least one computer-readable medium having computer-executable instructions, which when executed perform steps, comprising: <ul id="ul0004" list-style="none"><li>receiving, at a server, a compound request containing a plurality of commands from a client;</li><li>determining whether the compound request contains unrelated commands or related commands; and</li><li>when the compound request contains unrelated commands, handling each request as a separate request; and</li><li>when the compound request contains related commands, handling each request sequentially.</li></ul></li><li>Embodiment 12: The computer-readable medium of embodiment 11 wherein the compound request contains related commands including a create / open command, and wherein handling each request sequentially comprises using a file handle from the create / open command for each subsequent related command.</li><li>Embodiment 13: The computer-readable medium of embodiment 11 having further computer-executable instructions comprising, processing additional context data received with the create command.</li><li>Embodiment 14: The computer-readable medium of embodiment 11 having further computer-executable instructions comprising, handling an I/O-related request on a data channel that is separate from the channel on which the compound request was received.</li><li>Embodiment 15: The computer-readable medium of embodiment 11 further comprising, receiving at least one command from a set of commands that is sent from the client to the server, the set containing a create command having additional context data attached, a related compound command comprising a plurality of related commands and an unrelated compound command comprising a plurality of unrelated commands, and/or a data-related command requesting data communication on a separate data channel.</li><li>Embodiment 16: In a computing network, a data communication protocol in which a client and server connect for communication, comprising: <ul id="ul0005" list-style="none"><li>a plurality of commands, including at least one command of a set containing:</li><li>a multi-channel I/O command for requesting data communication on a separate data channel from the channel on which the multi-channel command was sent;</li><li>a create command containing means for attaching additional context data;</li><li>a compound command containing a plurality of other commands;</li><li>and/or</li><li>a multi-protocol negotiate command that allows a server to negotiate which of a plurality of dialect revisions provided by a client are to be used for communication.</li></ul></li><li>Embodiment 17: The data communication protocol of embodiment 16 further comprising at least one other command of a set, containing, a session setup command, a logoff session command, a tree connect command and/or a tree disconnect command.</li><li>Embodiment 18: The data communication protocol of embodiment 16 further comprising at least one other command of a set, containing, a close command, a flush command, a read command, a write command, a break_oplock command, a lock command, an echo command, a cancel command, an ioctl command, a query directory command, a change notify command, a set information command, and a query information command.</li><li>Embodiment 19: The communication protocol of embodiment 16 wherein the multi-channel I/O command comprises a read command that results in the server streaming read data to the client via the separate data channel.</li><li>Embodiment 20: The communication protocol of embodiment 16 wherein the multi-channel I/O command comprises a write command that results in the client streaming read data to the server via the separate data channel.</li></ul>