Test support device and method

The present invention relates to a test support device and a test support method, and is particularly suitable for use in performing a system test in an application program development process.

One of the system tests in the application program development process is that when the developed program is operated under the same conditions as the actual business environment, the development program itself operates normally and there are no problems with other programs. There is an operation test to verify that it does not occur. Then, as a result of performing the above operation test, if it is determined that no particular problem occurs, the above development program may be incorporated into an actual business system (hereinafter referred to as a production system) that is already in operation, or the above production may be performed. I was trying to replace it with a system system.

In recent years, since the importance of electronic information handled in business has increased, companies and the like are sending and receiving the above electronic information regardless of time. However, in the production system of the core system that processes the basic business that supports daily corporate activities, there must be no temporary interruption or error in transmission / reception. For this reason, the production system is generally configured so that electronic information can be exchanged smoothly with each department or each department at all times.

Therefore, when conducting an operation test of a development program, it is required to minimize various influences on the above-mentioned production system. In order to meet such a demand, the operation test is performed without stopping the normal operation of the production system.

That is, on the premise that the production system operates, a system that verifies that the developed program operates normally (hereinafter referred to as a test system) is operated, and the so-called production system and the test system are parallel to each other. I was trying to carry out a driving test (paralan).

When performing the above parallel operation test, a message with the same content as the message sent from the existing computer of the production system to the communication device on the other side is also sent to the test system, and the new computer and the pseudo partner device in the test system are sent. I am trying to confirm that the above message is sent and received normally.

As a result, in the test system, it is possible to carry out a transmission / reception test using the data actually used in the production system, and perform a confirmation test in the test system in consideration of the actual business operation status in the production system. Is possible.

FIG. 4 is a block diagram showing a schematic configuration of a conventional test support system. As shown in FIG. 4, the conventional test support system includes a production system 40 composed of an existing computer 41 and a communication device 42 on the other side, and a test system 50 composed of a new computer 51 and a pseudo partner device 52. It is composed of.

In the conventional test support system configured in this way, when the production system 40 and the test system 50 are operated in parallel to perform an operation test for updating the aging, for example, the existing computer 41 The transmission means 411 of the above is modified to provide a first transmission means 413 for the test system for transmitting to the test system 50. Further, the receiving means 412 of the existing computer 41 is modified to provide a second test system transmitting means 414 for transmitting to the test system 50.

The transmission means 413 for the first test system duplicates a message (hereinafter referred to as a communication packet) transmitted from the transmission means 411 to the communication device 42 on the other side, and transmits the duplicated communication packet via the communication line 53. Send to test system 50.

Further, the transmission means 414 for the second test system duplicates the communication packet when the communication packet transmitted from the transmission means 422 of the communication device 42 on the other side is received by the reception means 412 of the existing computer 41. And send it to the test system 50.

On the other hand, the test system 50 is provided with a new computer 51 and a pseudo partner device 52, and the new computer 51 is a receiving means 511 for receiving a communication packet and for transmitting the communication packet to the pseudo partner device 52. A transmission means 512 for a pseudo partner is provided. Further, the pseudo partner device 52 is provided with a receiving means 521 for receiving a communication packet.

The receiving means 511 receives the communication packets transmitted from the first test system transmitting means 413 and the second test system transmitting means 414, respectively. Further, the pseudo partner transmitting means 512 transmits the communication packet received by the receiving means 511 to the receiving means 521 of the pseudo partner device 52. By constructing such a configuration and executing parallel operation, the receiving means 511 and the pseudo partner transmitting means 512 in the new computer 51 have the same functions as the transmitting means 411 and the receiving means 412 in the existing computer 41. Confirmation is made.

In addition, various technologies are available for replicating or transferring a message (communication packet) addressed to a multicast group to all devices (nodes) participating in the multicast group connected to the network. It is disclosed (eg, Patent Document 1 or Patent Document 2).

<patcit num="1"><text>JP-A-2002-314605</text></patcit><patcit num="2"><text>Japanese Unexamined Patent Publication No. 2002-118570</text></patcit>

<p> However, in the parallel operation test between the production system and the test system, the message (communication packet) transmitted / received in the production system must be passed to the test system as well. There was a problem that the configuration of was had to be modified.</p><p> In particular, when verifying that data transmission / reception is performed correctly between multiple transmission / reception devices, the corresponding data between each transmission / reception device must be passed to the test system and modified so that parallel operation tests can be performed. In addition, there is a problem that the remodeling man-hours in the production system are significantly increased.</p><p> In addition, if a mistake occurs when modifying the production system, problems such as the messages exchanged in the production system not being sent and received normally will occur, which will have a significant impact on the execution of actual business. There was a problem.</p><p> Furthermore, when conducting a parallel operation test to replace an existing computer in a production system with a new computer in a test system to perform an aging update, if personnel are not assigned, it will occur when a problem occurs in the above new computer. There was a problem that it could not be detected reliably. That is, there is a problem that the cause analysis of the problem that occurs in the new computer cannot be efficiently performed unless a lot of manpower is put into it.</p><p> Therefore, in view of the above-mentioned problems, the present invention enables a parallel operation test for replacing an existing computer in a production system with a new computer in a test system to perform an aging update without much manpower. The first purpose is to make it. The second purpose of the parallel operation test is to enable the production system to be carried out without modification.</p>

<p> The test support device of the present invention is a test support device that supports a parallel operation test between an existing computer operating in a production system and a new computer that is operated by replacing the existing computer, and is output from the existing computer. As a result of comparison between the operation result performed and the operation result output from the new computer, and the comparison result by the comparison means, the operation result output from the existing computer and the operation result output from the new computer. It is characterized by having an operation history saving means for storing the operation history in the new computer when the above is different from the above.</p><p> The test support method of the present invention is a test support method that supports a parallel operation test between an existing computer operating in a production system and a new computer that is operated by replacing the existing computer, and is output from the existing computer. As a result of the comparison step for comparing the operation result and the operation result output from the new computer, and the comparison result by the comparison step, the operation result output from the existing computer and the operation result output from the new computer. It is characterized by having an operation history saving step for saving the operation history in the new computer when the above is different.</p>

<p> According to the present invention, as a result of comparing the operation result output from the existing computer operating in the production system and the operation result output from the new computer, the operation results output from each computer do not match. Since the operation history of the new computer is saved when the difference is different, it is possible to reliably detect a defect of the new computer without constantly manually monitoring the parallel operation test. As a result, when a problem occurs, the cause can be investigated for all of them, and a parallel operation test (paralan) between the production system and the test system, which was conventionally performed by allocating personnel. Can be performed unattended.</p><p> In addition, since the capture means for capturing the information transmitted and received in the production system is provided, the operation test of the new computer can be performed using the same information as that used in the production system. This makes it possible to eliminate the trouble of preparing test data in the test system. In addition, since the operation test can be performed under the same conditions as the operating environment of the actual work, it is possible to confirm the operation (function) of the device with high accuracy.</p><p> In addition, since it is possible to perform an operation test of a new computer without modifying the configuration of the production system, the production system can always be operated stably and can be executed without any time limit. A possible parallel operation test can be realized.</p>

Next, various embodiments of the test support device and the test support method of the present invention will be described with reference to the drawings.

The present invention is applied to, for example, the test support device 21 as shown in FIG. The test support device 21 according to the present invention supports a parallel operation test between the production system 10 and the test system 20, and replaces the existing computer 11 of the production system 10 with the new computer 22 of the test system 20 to update the aging system. Is for doing. This will be described in detail below.

(First Embodiment) FIG. 1 is a block diagram showing a schematic configuration of a test support system including a test support device 21 in the first embodiment. As shown in FIG. 1, the test support system includes a production system 10 and a test system 20. The contents will be described below.

&lt;Overall configuration of production system 10&gt; First, the production system 10 will be described. As shown in FIG. 1, the production system 10 includes an existing computer 11 and a communication device 12 on the other side, which are connected via a communication line 13 such as Ethernet (R). Further, the existing computer 11 has a first transmitting means 111 and a first receiving means 112, and the communication device 12 on the other side has a second receiving means 121 and a second transmitting means 122. , It is configured to exchange communication packets with each other.

The communication packet generated by the existing computer 11 is transmitted from the first transmitting means 111, and is sent to the second receiving means 121 of the other party's communication device 12 via the communication line 13. On the other hand, the communication packet (for example, reception response notification) generated by the communication device 12 on the other side is sent from the second transmission means 122 and sent to the reception means 112 of the existing computer 11 via the communication line 13. Be done.

&lt;Overall configuration of test system 20&gt; Next, the test system 20 will be described. As shown in FIG. 1, the test system 20 includes a test support device 21 and a new computer 22 according to the present embodiment, and these are connected to each other so as to be able to communicate with each other via a communication line. Further, the test support device 21 is connected to the production system 10 by a communication line 23 such as Ethernet (R).

-Configuration of test support device 21- The test support device 21 is transmitted and received between the existing computer 11 and the communication device 12 on the other side via the communication line 23 branched from the communication line 13 in the production system 10. The capturing means 211 that captures the existing communication packet, the transmission packet storage unit 212 that stores the communication packet (transmission packet) output from the existing computer 11 to the communication device 12 on the other side, and the communication packet output from the existing computer 11. When the communication packet output from each computer is different as a result of comparison between the output comparison means 213 that compares (transmitted packet) and the communication packet output from the newly installed computer 22 and the output comparison means 213, a new one is installed. It is configured to include an operation history storage means 214 that controls the operation history of the computer 22 to be stored. Here, specific operation history includes communication log, task startup log / file input / output log, contents of application file, and the like.

Further, the capture means 211 transfers the transmission packet capture unit 2111 that captures the communication packet (transmission packet) output from the existing computer 11 to the communication device 12 on the other side and the captured communication packet to the transmission packet storage unit 212. Transmission packet transfer unit 2113, receive packet capture unit 2112 that captures communication packets (received packets) input from the other party's communication device 12 to the existing computer 11, and transfers the captured communication packets to the new computer 22. It has a received packet transfer unit 2114.

-Configuration of new computer 22- The new computer 22 communicates with the received packet receiving means 221 that receives the communication packet (received packet) transferred from the received packet transfer unit 2114 of the test support device 21 via the communication line. Receives instructions from the application 222 that processes packets (received packets), the processing result output means 223 that outputs the communication packet newly generated by the application 222 to the test support device 21, and the test support device 21 to save the operation history. In this case, the operation history acquisition means 224 for acquiring the operation history of the own device and the operation history storage unit 225 for storing the acquired operation history are provided.

&lt;Operation of the test support device 21&gt; Next, the operation of the test support device 21 according to the present embodiment will be described. FIG. 2 is a flowchart showing an operation procedure of the test system 20 including the test support device 21 according to the embodiment of the present invention. In the following description, the operation procedure shown in FIG. 2 will be described in correspondence with each configuration of the test support system shown in FIG.

First, as shown in FIG. 2, in the first step S201, transmission / reception is performed between the existing computer 11 of the production system 10 connected via the communication line 23 and the communication device 12 on the other side according to a predetermined communication protocol. The communication packet is captured by the capture means 211.

Subsequently, in step S202, the communication packet captured by the capturing means 211 is a communication packet (transmission packet) output from the existing computer 11 to the communication device 12 on the other side, or from the communication device 12 on the other side. It is determined whether the communication packet (received packet) is input to the existing computer 11. As a result of this determination, if the communication packet captured in step S201 is a transmission packet, the process proceeds to step S203. On the other hand, if the communication packet captured in step S201 is a received packet as a result of the determination in step S202, the process proceeds to step S205.

Subsequently, in step S203, the communication packet (transmission packet) output from the existing computer 11 is captured by the transmission packet capturing means 2111. Subsequently, in step S204, the communication packet (transmission packet) captured in step S203 is stored and held in the transmission packet storage unit 212 via the transmission packet transfer unit 2113.

On the other hand, in step S205, the communication packet (received packet) input to the existing computer 11 is captured by the received packet capturing means 2112. Subsequently, in step S206, the communication packet (received packet) captured in step S205 is transferred to the new computer 22 via the received packet transfer unit 2114.

Here, a method of capturing communication packets will be briefly described. A communication packet transmitted from one device (for example, computer A) to another device (for example, computer B) via a communication line is first arranged in a form that facilitates communication according to a predetermined communication protocol. That is, a communication packet is generated by dividing the data to be transmitted into an appropriate size and adding the header information for communication corresponding to the so-called packet tag.

At this time, the header information for each protocol layer is added to the divided communication packets in advance of the data actually exchanged. Specifically, for example, when an application program exchanges data (communication packets) using the TCP / IP protocol, the header information includes a TCP header, an IP header, and a header of a data link layer (for example, Ethernet (for example, Ethernet). R) Header) is added.

Normally, when the communication packet on the communication line 13 is transmitted to the destination specified by the header information, the communication packet is transmitted to all the computers connected to the communication line 13. Then, the computer other than the destination computer considers that an unnecessary communication packet that is not the address to itself has been sent, discards the received communication packet, and only the destination computer finally receives the communication packet. .. In this way, the communication packet is received only by the destination computer based on the comparison of the header information.

Since communication packets are transmitted and received in this way, if the destination address is not collated by comparing the header information added to the communication packets, each computer receives all the communication packets flowing through the communication line 13. It is possible. Further, if the header information of the communication packet is obtained, it becomes possible to investigate what kind of communication the communication packet flowing on the communication line 13 is performing and to know the content of the communication packet.

The capture means 211 uses a transmission method for obtaining the header information of the communication packet described above. For example, in the present embodiment, header information (source address and destination address) when a communication packet is transmitted from the existing computer 11 in the production system 10 to the communication device 12 on the other side, and the communication device 12 on the other side. The capture means 211 is notified in advance of the header information (source address and destination address) for transmitting the communication packet from the to the existing computer 11.

The capturing means 211 of the present embodiment captures this communication packet when it is confirmed from the header information of the received communication packet that it is a communication packet exchanged in the production system 10. Next, the capture means 211 duplicates the captured communication packet and resets the destination address to the test support device 21 and the new computer 22 so as to transfer the duplicated communication packet.

Specifically, the transmission packet transfer unit 2113 transfers the transmission packet captured by the transmission packet capture unit 2111 by adding header information with the transmission packet storage unit 212 as the destination address. Similarly to this, the received packet transfer unit 2114 transfers the received packet captured by the received packet capture unit 2112 by adding header information having the received packet receiving means 221 as the destination address.

Here, the explanation will be given again by returning to the flowchart of FIG. In step S206, the new computer 22 that received the communication packet (received packet) transferred from the received packet transfer unit 2114 by the received packet receiving means 221 subsequently receives the received communication packet (received packet) in step S207. Processed by application 222. Subsequently, in step S208, the new computer 22 outputs the newly generated communication packet as a result of processing by the application 222 to the test support device 21 via the processing result output means 223.

Subsequently, in step S209, the output comparison means 213 newly generates the communication packet (transmission packet) output from the existing computer 11 stored in the transmission packet storage unit 212 and the application 222 of the new computer 22. Compare with the communication packet that was made.

Subsequently, in step S210, as a result of comparison by the output comparison means 213, it is determined whether or not the communication packet (transmission packet) output from the existing computer 11 and the communication packet output from the new computer 22 match. .. If the communication packets output from each computer match as a result of this determination, the processing of this flowchart ends. On the other hand, as a result of the determination in step S210, if the communication packets output from each computer do not match and are different, the process proceeds to step S211.

Subsequently, in step S211, the operation history saving means 214 is controlled to save the operation history of the new computer 22. Specifically, the operation history saving means 214 instructs the new computer 22 to save the operation history. In response to this, the newly installed computer 22 acquires the operation history of its own device in the operation history acquisition means 224, and stores the acquired operation history in the operation history storage unit 225.

According to the test support device 21 of the present embodiment, as a result of comparing the communication packet output from the existing computer 11 operating in the production system 10 with the communication packet output from the new computer 22, each computer is used. When the communication packets output from 11 and 22 do not match and are different, the operation history of the new computer 22 is automatically saved, so the defect of the application 222 in the new computer 22 is reliably detected. At the same time, the cause of the problem can be investigated. This makes it possible to perform an unmanned parallel operation test (paralan) between a production system and a test system, which was conventionally impossible to perform a high-precision test without allocating personnel.

In addition, since the communication packets transmitted and received by the production system 10 are captured by the capturing means 211 via the communication line 23, the same communication packets (data) used in the production system 10 are used. , The operation test of the new computer 22 can be performed. As a result, it is possible to eliminate the trouble of preparing test data in the test system 20. In addition, since the operation test can be performed under the same conditions as the operating environment of the actual work, it is possible to confirm the operation (function) of the device with high accuracy.

In addition, since it is possible to perform an operation test of the new computer 22 without modifying the configuration of the production system 10, the production system 10 can always be operated stably and the time is limited. It is possible to realize a parallel operation test that can be executed without.

(Second Embodiment) FIG. 3 is a block diagram showing a schematic configuration of a test support system including a test support device 31 in the second embodiment. The components common to the test support device 21 in the first embodiment are designated by the same reference numerals, and detailed description thereof will be omitted.

In the test support system of the present embodiment, an operation history storage unit 215 for storing the operation history of the newly installed computer 32 is provided on the test support device 31 side. Regarding the operation of the test support system in the present embodiment, the processes from step S201 to step S210 in FIG. 2 are the same as the processes in the test support system in the first embodiment, but the processes in step S211. The flow is different.

Specifically, the newly installed computer 32, which has been instructed by the operation history storage means 214 of the test support device 31 to save the operation history of its own device, acquires the operation history of its own device by the operation history acquisition means 224. .. Then, the acquired operation history is transmitted to the test support device 31. Upon receiving this, the test support device 31 stores the received operation history in the operation history storage unit 215.

According to the test support device 31 of the present embodiment, since the operation history of the new computer 32 is stored in the own device, in addition to the effect of the test support device in the first embodiment described above, further , It is possible to reduce the load of the storage capacity due to the storage of the operation history in the new computer 32.

In the configurations of the test systems 20 and 30 in the first and second embodiments, the communication line 23 is configured as a separate line branched from the communication line 13, but the embodiment of the present invention is not limited to this. , The same communication line 13 may be configured.

(Other Embodiments of the Present Invention) Each means constituting the test support device in the first embodiment and the second embodiment described above, and each step of the test support method in the test system (FIG. 2). Steps S201 to S211) can be realized by operating a program stored in the RAM or ROM of the computer. This program and a computer-readable storage medium on which the program is recorded are included in the present invention.

Specifically, the program is recorded on a recording medium such as a CD-ROM, or provided to a computer via various transmission media. As a recording medium for recording the above program, a flexible disk, a hard disk, a magnetic tape, a magneto-optical disk, a non-volatile memory card, or the like can be used in addition to the CD-ROM. On the other hand, as the transmission medium of the above program, a communication medium (wired line such as an optical fiber) in a computer network (LAN, WAN such as the Internet, wireless communication network, etc.) system for propagating and supplying program information as a carrier wave. Wireless line etc.) can be used.

Further, by executing the program supplied by the computer, not only each function in the first and second embodiments described above is realized, but also the OS (operating system) or the OS (operating system) in which the program is running in the computer is realized. When each function in the first and second embodiments described above is realized in collaboration with other application software, etc., or all or part of the processing of the supplied program is a computer function expansion board or function expansion. Such a program is also included in the present invention when it is performed by the unit and each function in the first and second embodiments described above is realized.

<figref num="1">It is a block diagram which shows the schematic structure of the test support system including the test support device in 1st Embodiment.</figref><figref num="2">It is a flowchart which shows the operation procedure of the test system including the test support apparatus which concerns on embodiment of this invention.</figref><figref num="3">It is a block diagram which shows the schematic structure of the test support system including the test support device in the 2nd Embodiment.</figref><figref num="4">It is a block diagram which shows the schematic structure of the conventional test support system.</figref>

Code description

10 Production system 11 Existing computer 111 First transmission means 112 First reception means 12 Communication equipment on the other side 121 Second reception means 122 Second transmission means 13 Communication lines 20, 30 Test systems 21, 31 Tests Support device 211 Capture means 211 Send packet capture unit 2112 Receive packet capture unit 2113 Transmission packet transfer unit 2114 Receive packet transfer unit 212 Transmission packet storage unit 213 Output comparison means 214 Operation history storage means 22, 32 New computer 221 Received packet receiving means 222 Application 223 Processing result output means 224 Operation history acquisition means 215, 225 Operation history storage unit 23 Communication line