Queued posted-write disk write method with improved error handling

~ 3 ~ QUEUED POSTED-WRITE DISK WRITE METHOD WITH IMPROVED ERROR HANDLING This invention relates to a method for queuing posted-write disk write operations, with improved error handling.

Disk Caching Posted writes to a disk are roughly analogous in some ways to cached reads from a disk. Disk caching, as is well known to those of ordinary skill, is a method of keeping a copy of the information last read from a relatively slow storage devi~e (e.g., a fixed or "hard" disk) in much faster read-write random~access memory (RAM). This permits quicker processing of subsequen~ requests for that-data.

Disk caching typically operates in conjunction with read-operation requests by application programs or other programs (referred to here as "tasks").

Generally speaking, when a task initiates a read operation, it reserves a certain portion of RAM, referred to as a "buffer," and r~quests that the information stored in one or more disk sectors be copied to the buffer.

Once this information is copied to RAM, the task can manipulate the information much more rapidly than on the disk. In part, this is because manipulation of the information on the disk requires activation of mechanical components of a disk drive, whereas manipulation in RAM is done entirely electronically~ When disk caching is used, each time a task requests that a certain disk sector be read (i.e.~ copied into RAM), not only is the requested sector read, but in addition certain adjacent sectors are also copied into a special RAM "cache buffer." This is done on the assumption that these disk sectors are likely to be read soon themselves.

Consequently, if one or more of those adjacent sectors is indeed the subject of a subsequent read request, the request can be filled from the RAM cache buffer.

Since the relatively slow disk drives need not be acti~5 vated, and the request is thus filled entirely electronic ally, this subsequent read request is completed much faster than the first one.

When disk caching is enabled, whenever a read request for specified disk sectors is initiated, the cache buffer is checked first to see if the desired disk sectors have already been read into the cache buffer. Only if the information is not in the cache buffer is an actual disk read operation initiated, whereupon the new information i5 itself copied to the cache buffer. "Old" information in the cache buffer is removed from the buffer; generally -3- ~3~ speaking, the information that is removed is the least recently used information.

Interrupts s The operation of the present invention makes use of a special capability designed into many computer architec - tures, known as "interrupts" and "interrupt handlers." Interrupts cause a central processing unit (CPU) of a computer to suspend execution of the current program instruction(s); to execute a specific "interrupt handler" routine or set of instructions; and then to resume execution of the suspended current program instruction(s) at the point where it left off.

Interrupts can be generated by software, i.e., by special instructions built into a program known as "soft ware interrupts." When the CPU encounters a software interrupt in a program, among other things it executes theassociated interrupt handler routine, then returns to execution of the program into which the software interrupt was built. A return from an interrupt-generated call to an interrupt handler routine is known as an interrupt return or "IRET." Interrupts can also be generated by appropriately designed hardware: many CPUs (e.g., the Intel 8086 family, including the 8086, 8088, 80286, and 80386) are designed so that other hardware components in the computer system can cause an interrupt by transmitting special signals to the CPU.

3 ~ Disk Write Interrupts Interrupts are commonly used to initiate disk write operations. A disk write operation typically entails copying of information to the disk from RAM that is in use bya task.

A disk-write interrupt might be generated by a task.

For example, a spreadsheet program could initiate such a request in order to save the user's work.

(In this discussion, a computer program itself is sometimes referred to as performing one or another operation. In reality, it is a hardware component such as the ~15 CPU that actually performs the operation under control of ;the program.

This is a common shorthand in the art.) Disk Write Interrupt Handler in ISA BIOS A common disk-write interrupt in the "industry standard architecture" (ISA) causes execution of a specific interrupt handler (known as INT 13H) that is part of the BIOS (basic input/output services) program.

The industry standard architecture is exemplified by, e.g., the IBM PC and the ~ompaq Deskpro 286.

The BIOS proyram typically is stored in a read-only memory (~OM) installed in the ISA csmputer, and so the BIOS program itself is sometimes referred to as simply "the ROM." In processing the disk write re~uest, the INT 13H interrupt handler does two things ~among others). The explanation below uses a write operation to a fixed disk as an example.

-5- 'JqLfo~ First, INT 13H copies the specified data to be written to disk (referred to here as a "write buffer") to a buffer under the control of a disk controller associated with the specified disk drive (e.g., in RAM that is installed with the disk controller and not as part of "main" memory). It then directs the disk controller to copy the data to a specified sector(s) on the disk.

i That having been done, INT 13H itself calls the INT 15H WAIT interrupt handler. By default, INT 15 WAIT simply returns to the calling function, i.e., to the INT 13H interrupt handler.

INT 13H then enters a wait loop: in each iteration of the loop, it checks to see if a flag has been set to indicate that a fixed disk hardware interrupt has occurred; if the flag has not been set, the loop continues.

In other words, the CPU is now busy waiting for the fixed disk hardware-interrupt-occurred flag to be set -- and has not resumed executing the task's instructions.

Nhen the disk controller has completed the write operation, it generates a hardware interrupt that causes the CPU to set the fixed disk hardware-interrupt-occurred flag and execute the INT 15~ POST interrupt handler. This routine typically performs an IRET back to the INT 13H wait loop~ Now that the fixed disk hardware-interrupt-occurred flag has been set, the INT 13H wait loop is ended, whereupon INT 13H clears the flag, finishes its processing, and performs an IRET to return control to the task.

In effect, the design of the INT 13~ interrupt handler routine forces the CPU to sit idle until the disk controller (which, once activated, does not need the CPU to -6- ~3~ perform its data-writing functions) has completed its work.

It will be recognized by those of ordinary skill that the above description relates to a relatively simple case of writing to disk. As is well known to those of ordinary skill, some write operations require multiple hardware interrupts thereby causing multiple WAITs and POSTs.

Queued Write Operations Write queuing, generally speaking, involves directing some or all disk write requests to a queue buffer instead of to the disk in question, and control is given back to the task. ~he actual physical writing to disk is performed later on whenever convenient, thus reducing the delay in resuming execution of the calling task.

A posted-write queuing program for writing information sectors to disk sectors includes error-handling routines to minimize the risk of data loss upon specified types of errors. Upon timeouts, queuing is suspended and all information sectors pending in the queue are written out to the corresponding disk sectors. Upon specified types of write errors, gueuing is discontinued and repeated attempts are made to write out all information sectors to the corresponding disk sectors. For each unsuccessful attempt, the corresponding information sector is saved in the queue; the user is alerted, and subsequent read or write requests directed to the correspondin~ disk sector is serviced from the saved information sector in the queue.

-6A- ~ 31~ ~ Summary of the Invention The invention herein pertains to a method of maintaining a posted-write queue upon a timeout, to which queue information sectors addressed to respective corresponding disk sectors may be added and from which queue information sectors may be written out to the respective corresponding disk sectors.

In one broad aspect, the method comprises the steps of blocking the addition of information sectors to the queue and writing out to the corresponding disk sector each information sector already added to the queue.

In another aspect, the method comprises the steps of blocking the addition of information sectors -to the queue, attempting to write out to the corresponding disk sector each information sector already added to the queue and for each attempt that is unsuccessful, saving the information sector in the queue.

The method may also include the step of servicing from the queue any subsequent read request or write request directed to a disk sector corresponding to any of the saved information sector.

-7- ~3~ Posted-Write Q~Leueina in Disk Cache UtilitY The present invention is illustrated by the following description of a set of routines for posting and queuing 5 write requests generated by tasks. The routines operate as a part of a disk-cache installable device driver under the MS-DOS operatiny system (versions 3.10 through 3.39).

Appendix 1 is a copy of the assembler source code for the routines.

'' 10 The posted-write queuing routines operate in ¦ conjunction with a disk cache utility that maintains a cache buffer and a cache directory. In the illustration described here, the posted-write queuing routines are written as a part of such a disk cache utility, which forms no part of the present invention (except to the extent claimed) and is not otherwise described.

, It will be understood that the description is presen¦ 20 ted by way of illustration and not as a limitation on the subject matter claimed.

Substitution of Interrupt Handlers ;

¦ ~ 25 Several interrupt handlers in the BIOS program have their behavior altered (sometimes referred to as "hooked," "trapped," or "grabbed") in the conventional manner.

Generally speaking, this involves (a) saving the vectors that are stored in low memory and are associated with the respective interrupt handlers; these vectors ordinarily point to the respective addresses of the normal BIOS interrupt handler routines; and (b) overwriting these vectors with new vectors pointing to the addresses of substitute interrupt handler routines.

-8- ~3~ In particular, the respective handlers for INT 13H, for INT 15H WAIT and INT 15H POST, and for timeouts and write errors, are replaced. Appendix 2 sets forth a pseudocode description of the substitute routines, briefly explainin~ in general terms the matters set forth in detailin ~ppendix l.

As is conventional, a substitute routine may call the original interrupt handler; this is done by simply calling the original handler, whose address was saved as part of the overwriting process described above. For example, Appendix 2 shows that this is done in the substitute routine for INT 13H.

Memory Allocation for Oueue The posted-write queuing routines use an 8K FIFO (first-in, first-out) buffer in main memory for queuing write requests. More specifically, the queue utilizes the base memory that is reserved by the cache driver during its installation.

The queue is kept relatively small to reduce the chance of data loss due to the user turning off the computer when it appears that the write is complete ~when infact it is not).

Sinqle-Sector Writes If the write buffer of a disk write request will occupy no more than one sector on the disk (i.e., if the request is for a single-sector write), then broadly speaking, the write request is queued and posted as complete, and control is returned to the task.

- 9 ~ 3 ~ More specifically, the substitute INT 13H routine queues the write request and jumps to a DEQUEUE routine.

The DEQUEUE routine in turn generates its own conventional INT 13H write request that specifies the queue as the write bu~fer.

When the conventional INT 13H interrupt handler calls the INT 15H WAIT routine, the substitute INT 15H WAIT routine saves the wait environment and returns back to the callinq task (instead of to the conventional INT 13H routine that called it), even though the disk controller may not yet have reported completion of the write operation. In effect, this leaves the conventional INT 13H routine in something like a state of suspension.

When the disk controller does complete its write operation, it generates a hardware interrupt, thus causing the fixed disk hardware-interrupt-occurred flag to be set and causing the INT 15H POST routine to be called. The substitute INT 15H POST routine restores the previouslysaved wait environment and returns control to the previously "suspended" conventional INT 13H write routine, in effect reactivating that routine.

Because the fixed disk hardware-interrupt-occurred flag is now set, the now-reactivated conventional INT 13H write routine does not stay in its wait loop waiting for that interrupt (as described above).

Instead, the conventional INT 13H write routine finishes its processing and performs an IRET to return control to the DEQUEUE routine that originally called it.

The DEQUEUE routine in turn returns control to the calling task, but at the point where the last hardware interrupt occurred, not at the point where the write request was generated.

-10- ~ Error Handlinq On any time out, queuing is discontinued (i.e., no more write requests are added to the queue) and all write requests already queued are written out individually.

~imeout error logic is employed while waiting for the queue to become empty or not full to ensure that a cache controller failure is the only possible cause of an unrecoverable error.

! The timeout error logic uses fla~s to determine where the write operation timed out.

This aids in making a determination whether or not the last sector sent to the conventional INT 13H write routine was actually wxitten out to the disk. It also aids in determinin~ whether the timeout was caused by hardware te.g., controller failure) or software (e.g., conflicting programs) and in giving the user an appropriate error message.

On any sector-not-found write error or address-notfound write error, repeated attempts (e.g., 5 disk resets and retries) are made to write out each sector in the queue to disk, one at a time.

If any given sector(s) cannot be written out, queuing is permanently discontinued luntil a reset, of course) and the sector(s) in question are saved in the queue.

Subsequent to such action (until power reset), each disk read req~est and each disk write request is checked to determine whether any requested sector is in the queue (meaning that the actual disk sector is out of date or perhaps even unaccessible). Such requests are serviced from the queue buffer; if the sector in question is written to, it is updated in the queue buffer. ~ suitable alarm prompts the user to back up the disk (the backup request will be serviced in part from the queue).

~ 3 ~ 9 ~ ~ ~ Efficiencv Considerations Queueing of disk writes takes place only for singlesector writes. Only single-sector writes are queued because the queue is small and most writes will be either single-sector or very large multi-sector writes. To accommodate large writes would require too much complexity and overhead; it is regarded as more efficient to handle only the other most common write size, i.e., single-sector j 10 writes. (The source code, Appendix 1, includes routines for multi-sector writes.) If either a multi-sector write request or a disk read request is generated, the queue is forced empty (i.e., i.e., written out to the diskl or "flushed"~ before the requested operation is performedO If disk reads are cached, the queue is flushed only if the desired sectors to be read are not present in the cache. This queue flushing is a convenient, low-overhead way of ensuring that the data in the queue is always current.

No check is performed for duplication of write requests in the queue. Such a check would theoretically eliminate the extra disk write, but the associated overhead is regarded as not worth the trade-off, because only comparatively rarely will the queue contain two writes to the same disk sector.

Likewise, the queue is not sorted, because the queue is small and since most single-sector writes will either be sequential or will vary greatly across the disk. The overhead associated with moving data (in sorting or in copying to the dlsk controller buffer) is very high, so in this embodiment the queue is copied once and not moved.

-12- ~ f~ At any given time, the queue may contain write requests for a number of sectors (i.e., if write requests are generated in quick succession by the task). If successive write requests in the queue are directed to successive disk sectors, a more efficient disk write can beaccomplished when emptying the queue by performing a multi-sector write from the queue.

Toward this end, the queue in the embodiment described is circular and has a fixed buffer location;furthermore, the head and tail pointers are both placed at the top of the queue when the queue is empty.

Appendixes 3 and 4 outline additional considerations directed to efficient implementation of the posted-write queuing routines.

The foregoing description of the invention has been directed to a particular preferred embodiment for purposes of explanation and illustration. If will be apparent, however, to those skilled in the art having the benefit of this disclosure that many modifications and changes may be made without departing from the essence of the invention.

It is the Applicant's intention in the following claims to cover all equivalent modifications and variations as fall within the scope of the invention.