Deadlock management in database systems with demultiplexed connections

CA 02322604 2000-10-06

DEADLOCK MANAGEMENT IN DATABASE SYSTEMS WITH DEMULTIPLEXED CONNECTIONS

FIELD OF THE INVENTION

The present invention is directed to an improvement in computing systems and in particular to computer systems for managing deadlocks in demultiplexed connection database management system environments.

BACKGROUND OF THE INVENTION

In database management systems (DBMSs) it is possible to provide concurrent connections to a database by using demultiplexed connection environments. In such DBMSs, worker agents carry out processes in response to requests made by applications (or clients). Often agents are associated with applications by an application scheduler or manager for the life of a transaction. To handle the potentially large number of inbound connections being demultiplexed across a smaller number of worker agents, DBMSs use schedulers and wait queues.

In DBMSs such as relational DBMSs, applications are able to obtain locks on portions of a database. A row, a page or a table, for example, may be locked by an application, depending on the operation that the application is carrying out on the database in an RDBMS. Typically such locks are held on data representations in the DBMS but more generally are considered to be locks on database resources. Where locks are held and other applications seek to obtain locks, deadlocks may occur. In the prior art, such deadlocks may be detected by a deadlock detector in the DBMS. The deadlock detector may identify an application that will be required to release a held lock to break the deadlock.

Prior art systems have been developed to detect and recover from deadlocks as described above. For example, deadlock detectors are described in each of the following United States Patents: No. 5,095,421 (Freund, March 10,1992), No. 5,845,117 (Fujita, December 1,1998), No. 5,459,871 (Van Den Berg, October 17,1995), No. 5,440,743 (Yokota, August 8, 1995), and No. 5,682,537 (Davies

CA9-2000-0031

CA 02322604 2000-10-06 et al., October 28, 1997). In U.S. Patent No. 5,832,484 (Sankaran et al., November 3, 1998), a deadlock detector and a method to avoid potential deadlock detection by deferring the deadlock detection steps is described. These prior art methods are generally concerned with systems that do not include a demultiplexing component for the processes which seek to acquire locks on resources.

In a demultiplexed connection DBMS, where there are worker agents assigned to applications, it is possible for an application to become inactive but to retain locks on portions of the database. In this case, the application will be disassociated from a worker agent and yet the application may retain locks on data in the DBMS. Where this occurs, and where both the inactive application is unable to acquire a worker agent and other applications are waiting for the inactive application to relinquish its lock, it is possible to have deadlocks in the DBMS.

In the prior art it is known that such deadlocks may occur in a DBMS and users of such systems must restart the system and make modifications to the number of worker agents available to permit processing in the database to continue. Such a disruption to the database system is undesirable where the database is required to be continually available.

It is therefore desirable to provide a computer system for the detection and management of deadlocks in a demultiplexed connection environment DBMS.

SUMMARY OF THE INVENTION

According to one aspect of the present invention, there is provided an improved system for deadlock management in demultiplexed connection environments.

According to another aspect of the present invention, there is provided a deadlock management system for a database system, the database system including a set of applications selectively requesting and holding locks on database resources, a pool of worker agents including normal worker agents and overflow worker agents, an application scheduler, a wait queue, a priority queue, and a deadlock detector, the database system supporting an application holding a lock while

CA9-2000-0031

CA 02322604 2000-10-06 disassociated from a worker agent, the deadlock management system including means for marking an application with a flag value based on the existing application flag value and on the state of applications requesting and holding locks on database resources, including, means for marking an application with a flag value W where the application becomes disassociated from a worker agent, means for marking an application with a flag value H where the application has a flag value W and where the application holds a lock on a database resource requested by another application, means for marking an application with a flag value D where the application requests a worker agent, has a flag value H and there is no normal worker agent or overflow worker agent available for the application, means for marking an application with the flag value Q where the application is placed on the wait queue, and means for marking an application with the flag value D where the application has the flag value Q and a worker agent associated with another application requests a lock held by the application having the flag value Q.

means for the application scheduler to respond to an application request for a worker agent from the pool and to selectively provide a normal worker agent, an overflow worker agent, or place the application on the wait queue or on the priority queue, based on the application flag value, including means for responding to a request for a worker agent from an application with flag value H

CA9-2000-0031

CA 02322604 2000-10-06 by obtaining a normal worker agent if available and alternatively providing an overflow worker agent, further including means for placing the application on the priority queue where no overflow worker agent is available, and means for responding to a request for a worker agent from an application with flag value W by obtaining a normal worker agent if available and alternatively by placing the application on the wait queue.

means for clearing the application flag value when an application is provided with a worker agent, means for the deadlock detector to poll an application and means for the deadlock detector to declare a deadlock where the application has a specified flag value and the application holds a lock on a database resource requested by another application, including, means for declaring a deadlock where an application has a flag value D and the application holds a lock on a database resource that is requested by another application, the deadlock detector further including a lock wait deadlock graph and a resource representation, the lock wait deadlock graph including means to represent applications requesting and holding locks on database resources whereby the deadlock detector determines if an application holds a lock requested by another application, and means for selecting an application holding a lock and for requiring the application to release the lock, following detection of a deadlock on the lock

According to another aspect of the present invention, there is provided a method of deadlock management for a database system, the database system including a set of applications selectively requesting and holding locks on database resources, a pool of worker agents including normal worker agents and overflow worker agents, a wait queue, and a priority queue, the database system supporting an application holding a lock while disassociated from a worker agent, the method of

CA9-2000-0031

CA 02322604 2000-10-06 deadlock management including the steps of:

1. marking an application with a flag value based on the existing application flag value and on the state of applications requesting and holding locks on database resources, including the steps of:

i) marking an application with a flag value W where the application becomes disassociated from a worker agent, ii) marking an application with a flag value H where the application has a flag value W and where the application holds a lock on a database resource requested by another application, iii) marking an application with a flag value D where the application requests a worker agent, has a flag value H and there is no normal worker agent or overflow worker agent available for the application, iv) marking an application with the flag value Q where the application is placed on the wait queue, and

v) marking an application with the flag value D where the application has the flag value Q and a worker agent associated with another application requests a lock held by the application having the flag value Q,

2. responding to an application request for a worker agent from the pool and selectively providing a normal worker agent, an overflow worker agent, or placing the application on the wait queue or on the priority queue, based on the application flag value, including the steps of:

i) responding to a request for a worker agent from an application with flag value H by obtaining a normal worker agent if available and alternatively by providing an overflow worker agent, further including the step of placing the application on the priority queue where no overflow worker agent is available, and ii) responding to a request for a worker agent from an application with flag value W by obtaining a normal worker agent if available and alternatively by placing the application

CA9-2000-0031

CA 02322604 2000-10-06 on the wait queue.

3. clearing the application flag value when an application is provided with a worker agent, and

4. polling an application and declaring a deadlock where the application has a specified flag value and the application holds a lock on a database resource requested by another application, including the step of declaring a deadlock where an application has a flag value D and the application holds a lock on a database resource that is requested by another application, the database system further including a lock wait deadlock graph and a resource representation, the lock wait deadlock graph including means to represent applications requesting and holding locks on database resources whereby the step of declaring a deadlock comprises the step of determining if an application holds a lock requested by another application by accessing the lock wait graph, and

5. selecting an application holding a lock and requiring the application to release the lock, following detection of a deadlock on the lock.

According to another aspect of the present invention, there is provided a computer program product for deadlock management in a database system, the computer program product including a computer usable medium having computer readable code means embodied in the medium, including computer readable program code means for carrying out the above method.

Advantages of the present invention include the improved detection and management of deadlocks in DBMSs and include detection and elimination of a deadlock without requiring the DBMS to become unavailable to users.

BRIEF DESCRIPTION OF THE DRAWINGS

The preferred embodiment of the invention is shown in the drawings, wherein:

Figure 1 is a block diagram illustrating how a deadlock may occur in a demultipexed

CA9-2000-0031

CA 02322604 2000-10-06 connection DBMS.

Figure 2 is a block diagram illustrating a portion of the architecture of a DBMS in accordance with the preferred embodiment.

In the drawings, the preferred embodiment of the invention is illustrated by way of example. It is to be expressly understood that the description and drawings are only for the purpose of illustration and as an aid understanding, and are not intended as a definition of the limits of the invention.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENT

Figure 1 shows, in a block diagram, an arrangement of applications 10, 12, 14, worker agents 16, 18 and lock 20 which may result in deadlock in a database system. Figure 2 shows, in a block diagram, components of the demultiplexed database of the preferred embodiment. The example of Figure 2 shows clients 30,32,34. Clients run applications that access the database using the DBMS. Within the DBMS of the preferred embodiment, clients are associated with application control blocks or logical agents. In the example of Figure 2, application control blocks 36, 38 are shown associated with clients 30, 32, respectively. The demultiplexed database system of the preferred embodiment also includes worker agents (sometimes referred to as physical agents). These are tasks or processes which carry out the data retrieval or modification as required by the clients or applications. In Figure 1 worker agents 16, 18 are shown.

In database systems it is common to provide locks on portions of the data. The granularity of the lock may vary from a table to an attribute in a row of a table. Database systems typically associate applications with worker agents on a transactional basis. Worker agents are reassigned to applications on transaction boundaries. However, in certain database systems it is possible to maintain locks on data across a transaction boundary. For example the WITHHOLD CURSOR command in DB2 UDB (trade-mark) permits an application to keep a cursor open between transactions. In this case, a lock may be maintained by the application after it is disassociated from its worker agent.

CA9-2000-0031

CA 02322604 2000-10-06

The example of Figure 1 shows application 10 holding lock 20. In this example, application 10 is shown without an associated worker agent. Applications 12,14 each have associated worker agents (worker agent 16, 18). Where application 12 and application 14 each request lock 20 and there is no worker agent available for application 10, a deadlock will ensue. Application 10 is unable to obtain a worker agent because the transactions of applications 12, 14 are not complete. Those applications cannot complete their transactions because lock 20 is unavailable. In the prior art, once such a deadlock occurred it was necessary to interrupt the processing of the DBMS and increase the number of available worker agents to avoid the deadlock.

Figure 2 shows, in a block diagram format, an example architecture of a DBMS including the deadlock detection and management of the preferred embodiment. Figure 2 shows clients 30, 32, 34 and application control blocks 36,38. Application scheduler 40 provides access to worker agents maintained in worker agent pool 42. Where application scheduler 40 is unable to obtain a free worker agent from worker agent pool 42 the application control block seeking access to a worker agent is placed on wait queue 44. Also shown in Figure 2 is deadlock detector 46 which accesses resource representation 48 and lock wait graph 50 to carry out deadlock detection. Lock wait graph 50 is directed graph representing applications and locks in the DBMS. When an application requests or is granted a lock the graph is updated to show the application and the lock it is waiting on or holds.

In the system of the preferred embodiment a deadlock detector process is associated with each database in the DBMS. The deadlock detector polls application control blocks and makes decisions regarding deadlocks. In the system of the preferred embodiment worker agent pool 42 includes a set overflow worker agents. These are worker agents that are intended to be used where a potential deadlock has been identified. In addition to wait queue 44 a priority queue 52 maintains a list of applications to be provided priority access to worker agent pool 42 and to the overflow worker agents within that pool. The details of worker agent allocation are understood by those skilled in the art.

CA9-2000-0031

CA 02322604 2000-10-06

Deadlock detector 46 has associated resource representation 48 and lock wait graph 50. These maintain information about system resources and applications waiting on those resources. Lock wait graph 50 includes data indicating which applications are waiting on locks.

As mentioned above, each application control block has an associated flag, used in deadlock detection. The flags associated with applications are set in the following manner:

1. Where an application control block becomes disassociated from a worker agent but the application maintains a lock on data (for example by use of a WITHHOLD CURSOR command), the application is marked with flag W.

2. When deadlock detector 46 polls an application control block having a flag W and determines that the application holds a lock that is required by another application, the first application is marked with flag H.

3. When application scheduler 40 is subject to a request for a worker agent and the application making the request has a flag H, application scheduler 40 will attempt to locate a worker agent in worker agent pool 42. If there is no such worker agent available, application scheduler 40 will seek to obtain an overflow worker agent from worker agent pool 42. If no overflow worker agent is available application scheduler 40 will put the application into priority queue 32 and mark the application with flag D.

4. When a request is made to application scheduler 40 from an application control block with flag W and there is no worker agent in worker agent pool 42 to serve the application, the application is placed on wait queue 44 and marked with flag Q.

5. When a worker agent associated with an application requests a lock for the application and determines that the lock is held by an application marked with flag Q, the worker agent changes the flag Q to a flag D.

6. When deadlock detector 46 polls an application control block and the application has flag D, deadlock detector 46 will determine from lock wait graph 50 whether the application holds a lock required by another application. If this condition is found, deadlock detector 46 declares a deadlock.

CA9-2000-0031

CA 02322604 2000-10-06

7. Where an application becomes associated with a worker agent from worker agent pool 42 by application scheduler 40, the flag for the application is cleared.

By placing applications on priority queue 52 or by associating applications with overflow worker agents it is possible to reduce the number of deadlocks that might otherwise occur. Where the deadlock state is not avoided, the deadlock detector 46 is able to select a transaction from worker agent pool 42 and rollback that transaction to free up a worker agent so that the deadlock condition is no longer present. This rollback of a single transaction will resolve the deadlock state in the database and permit processing to continue, without requiring that the database processing be otherwise interrupted.

Considering the operation of the preferred embodiment with respect to the example in Figure 1, if application 10 in Figure 1 becomes disassociated from a worker agent but maintains a lock (for example where there is an open withhold cursor) the flag for application 10 is set to W. If application 10 then makes a request for a worker agent and there is no worker agent available, application 10 will be placed on wait queue 44 and have its flag set to Q. If application 12 then requests lock 20, held by application 10, application 10 will have its flag set to D. Deadlock detector 46, when polling application 10 will then find flag D and determine from lock wait graph 50 that application 12 is seeking lock 20 now held by application 10. A deadlock state will be declared by deadlock detector 46.

Another possible scenario is for application 10 to hold lock 20 and be disassociated from a worker agent resulting in application 10 having flag W. Before application 10 requests a worker agent application 12 may request 20. At this point application 10 is given flag H. If application 10 requests a worker agent and there is no worker agent available, application scheduler 40 will seek to make available an overflow worker agent. If there is no overflow worker agent available in worker agent pool 42, application 10 will be placed on priority queue 52. Where another application such as application 12 requests lock 20, flag for application 10 will be changed to flag D. By making available an overflow worker agent, and by placing application 10 or priority queue 52, the

C A9-2000-0031

CA 02322604 2000-10-06

DBMS seeks to avoid a deadlock. Where such a deadlock is unavoidable (no overflow agent is freed up before application 12 requests lock 20), the deadlock detector will declare a deadlock and will rollback a transaction to resolve the deadlock state.

Although a preferred embodiment of the present invention has been described here in detail, it will 5 be appreciated by those skilled in the art that variations may be made thereto without departing from the spirit of the invention or the scope of the appended claims.

CA9-2000-0031