Test program, testing device, and test method

The present invention relates to a test program, a test device, and a test method for testing a target device.

Conventionally, technology for evaluating performance between a client and a server has been disclosed (for example, refer to Patent Documents 1 and 2 below), but in order to quickly and accurately verify a backup server when migrating a system. Performance evaluation test technology is required. Conventionally, such a performance evaluation technique has been processed as follows.

FIG. 11 is an explanatory diagram showing an example of the relative performance evaluation processing between the conventional main server and the standby server. In FIG. 11, it is assumed that the main server A and the test terminal C are in Osaka, and the standby server B is in Tokyo. The main server A is, for example, a working computer currently running in the system. The standby server B is a computer scheduled to be migrated from the main server A. In this case, when the tester tests with the same pattern (packet and its response packet), the test terminal C captures the packet from the main server A, and the captured packet has the same sequence as the main server A. It will be sent to the backup server B in a pattern.

FIG. 12 is an explanatory diagram showing another example of the performance evaluation processing relative to the conventional main server and the standby server. In FIG. 12, it is assumed that the main server A is in Osaka, the standby server B is in Tokyo, and the test terminal C is in both Tokyo and Osaka. In this case, the tester performs packet communication between the test terminal C and the main server A in Osaka, and at the same time interval as the main server A in Tokyo, the test terminal C and the standby server B Perform packet communication between. As a result, the relative performance evaluation between the main server A and the standby server B is performed.

<p><patcit num="1"><text>Japanese Unexamined Patent Publication No. 2003-8648</text></patcit><patcit num="2"><text>Japanese Unexamined Patent Publication No. 9-62601</text></patcit></p>

<p> However, in the case of FIG. 11, since the main server A and the spare server B are located in different locations, the difference (distance) in RTT (Round Trip Time) between the main server A and the spare server B Positive correlation) affects the processing interval (processing load) of the main server A and the standby server B. That is, since the packet transmission / reception interval of the standby server B is larger than the packet transmission / reception interval of the main server A, there is a problem that the performance cannot be evaluated under the same load and the quality of the performance evaluation is deteriorated.</p><p> On the other hand, in the case of FIG. 12, in order to test with the same load, as shown in FIG. 12, the tester captures the packet sequence for the main server A and the site where the backup server B is located (Tokyo). Go to. Then, packets are sent out in the same sequence based on the captured data. Therefore, there is a problem that labor is generated due to the movement of the tester and the burden on the tester increases.</p><p> An object of the present invention is to provide a test program, a test apparatus, and a test method capable of efficiently performing a high-quality performance evaluation test in order to solve the above-mentioned problems caused by the prior art.</p>

<p> In order to solve the above-mentioned problems and achieve the purpose, the present test program, the test apparatus, and the test method acquire the packet, detect the acquisition time of the acquired packet, and the packet becomes the first target device. In the case of the transmitted first packet, the destination of the first packet is set to the address of the second target device, and the acquisition time of the detected first packet is set to the transmission time. , The first packet is converted into a second packet to the second target device, and the second packet is transmitted to the second target device at the transmission time of the converted second packet. Is a requirement.</p>

<p> According to this test program, test equipment, and test method, it is possible to efficiently perform a high-quality performance evaluation test.</p>

<figref num="1">It is explanatory drawing which shows an example of the performance evaluation test in this embodiment.</figref><figref num="2">It is a block diagram which shows the hardware structure of the computer used in embodiment.</figref><figref num="3">It is a block diagram which shows the functional structure of a test apparatus.</figref><figref num="4">It is explanatory drawing which shows an example of the storage contents of DB.</figref><figref num="5">It is explanatory drawing which shows the packet conversion example.</figref><figref num="6">It is explanatory drawing which shows the transmission result of the 2nd packet.</figref><figref num="7">It is a flowchart which shows the packet capture processing procedure of the test apparatus which concerns on embodiment.</figref><figref num="8">It is a flowchart which shows the packet conversion / transmission processing procedure by the test apparatus which concerns on embodiment.</figref><figref num="9">It is a flowchart which shows the relative performance evaluation processing procedure of the 1st and 2nd target apparatus.</figref><figref num="10">It is a flowchart which shows the relative performance evaluation processing procedure of the 1st and 2nd target apparatus.</figref><figref num="11">It is explanatory drawing which shows an example of the relative performance evaluation processing of a conventional main server and a standby server.</figref><figref num="12">It is explanatory drawing which shows another example of the performance evaluation processing relative with the conventional main server and the standby server.</figref>

Hereinafter, embodiments of a test program, test apparatus, and test method according to the present invention will be described in detail with reference to the accompanying drawings.

FIG. 1 is an explanatory diagram showing an example of a performance evaluation test according to the present embodiment. In FIG. 1, the test terminal C and the main server A, which is an example of the first device to be tested, are located in Osaka, and the standby server, which is an example of the second device to be tested. B is in Tokyo. Note that the placement positions of the servers A and B are examples, and other placement relationships may be used. The main server A is, for example, a working computer currently running in the system. The standby server B is a computer scheduled to be migrated from the main server A.

The test device 100 is communicably connected to the test terminal C, the main server A, and the standby server B. For example, the test apparatus 100, the test terminal C, and the main server A are in the same network Na, and can communicate with the network Nb in which the backup server B exists.

For example, when the test terminal C sends the packet S1A to the main server A, the main server A sends the packet R1A to the test terminal C as a response. Next, the test terminal C transmits the packet S2A to the main server A, and the main server A transmits the packet R2A as a response to the test terminal C. At this time, the test apparatus 100 captures the packets S1A, S2A, R1A, and R2A.

Further, the test apparatus 100 rewrites the captured destinations of the packets S1A and S2A from the address of the main server A to the address of the backup server B, and generates the packet S1A as the packet S1B and the packet S2A as the packet S2B. Then, the test apparatus 100 transmits the generated packets S1B and S2B to the backup system server B in the same sequence (time interval) as described above.

For example, the test apparatus 100 obtains the time interval Td between the acquisition times of the packets S1A and S2A, and transmits the packet S2B when only the Td time has elapsed after the transmission of the packet S1B. As a result, the test apparatus 100 can transmit the generated packets S1B and S2B to the backup system server B in the same sequence (time interval) as described above.

Also, the time Td1 elapsed from the first reference time (for example, a certain time set before the reception of packet S1A (at the start of the test, etc.)) to the acquisition time of packet S1A and the acquisition time of packet S1B. When the time Td1 elapses from the second reference time (test start time of the standby server B, etc.), the packet S1B is transmitted, and when the time Td2 elapses, the packet S2B is transmitted. This also allows the test apparatus 100 to transmit the generated packets S1B and S2B to the standby server B in the same sequence (time interval) as described above.

As a result, the standby server B that has received the packets S1B and S2B returns the packets R1B and R2B. In any case, it is allowed to transmit the packet S2B without waiting for the reception of the packet R1B from the standby server B, which is the response of the packet S1B. Further, by setting the source of the packets S1B and S2B to the address of the test device 100, the transmission destination of the response packets R1B and R2B from the backup system server B can be set to be the test device 100. The test terminal C can also receive the response without changing the source.

That is, since the time interval da of the packets S1A and S2A and the time interval db of the packets S1B and S2B are the same, the processing interval Da of the packets S1A and S2A on the main server A and the packets S1B and S2B on the standby server B. The processing interval Db of is also the same. In this way, by absorbing the difference in the installation location by converting the packets S1A and S2A, the main server A and the standby server B are subjected to the performance evaluation test with the same load. After that, by comparing the packets R1A and R2A from the main server A with the packets R1B and R2B from the standby server B, the relative performance evaluation between the main server A and the standby server B is executed. be able to.

(Computer hardware configuration) FIG. 2 is a block diagram showing an example of the hardware configuration of the computer (test terminal C, test device 100, main server A, standby server B) used in the embodiment. In FIG. 2, the computer includes a CPU (Central Processing Unit) 201, a ROM (Read-Only Memory) 202, a RAM (Random Access Memory) 203, a magnetic disk drive 204, a magnetic disk 205, and an optical disk drive 206. , Optical disk 207, display 208, I / F (Interface) 209, keyboard 210, mouse 211, scanner 212, and printer 213. Further, each component is connected by a bus 200.

Here, the CPU 201 controls the entire computer. ROM202 stores various programs such as OS (Operating System) and applications. RAM203 is used as a work area for CPU201. The magnetic disk drive 204 controls the read / write of data to the magnetic disk 205 according to the control of the CPU 201. The magnetic disk 205 stores data written under the control of the magnetic disk drive 204.

The optical disk drive 206 controls data read / write to the optical disk 207 according to the control of the CPU 201. The optical disk 207 stores the data written under the control of the optical disk drive 206, and causes the computer to read the data stored in the optical disk 207.

The display 208 displays data such as documents, images, and functional information, as well as cursors, icons, and toolboxes. For the display 208, for example, a CRT, a TFT liquid crystal display, a plasma display, or the like can be adopted.

The interface (hereinafter abbreviated as "I / F") 209 is connected to a network 214 such as LAN (Local Area Network), WAN (Wide Area Network), and the Internet through a communication line, and the other is connected via this network 214. Connected to the device. The I / F 209 controls the internal interface with the network 214 and controls the input / output of data from the external device. For the I / F209, for example, a modem or a LAN adapter can be adopted.

The keyboard 210 is provided with keys for inputting characters, numbers, various instructions, etc., and inputs data. Further, it may be a touch panel type input pad, a numeric keypad, or the like. The mouse 211 moves the cursor, selects a range, moves the window, and resizes the window. A trackball, a joystick, or the like may be used as long as it has the same function as a pointing device.

The scanner 212 optically reads the image and captures the image data in the computer. The scanner 212 may have an OCR (Optical Character Reader) function. The printer 213 prints image data and document data. For the printer 213, for example, a laser printer or an inkjet printer can be adopted.

(Functional configuration of test device 100) Next, the functional configuration of the test apparatus 100 will be described. FIG. 3 is a block diagram showing a functional configuration of the test apparatus 100. The test apparatus 100 includes an acquisition unit 301, a detection unit 302, a calculation unit 303, a generation unit 304, a transmission unit 305, an execution unit 306, an output unit 307, and a database (hereinafter, DB310) 310.

Specifically, the acquisition unit 301 to the output unit 307 may be, for example, by causing the CPU 201 to execute a program stored in a storage device such as ROM 202, RAM 203, magnetic disk 205, or optical disk 207 shown in FIG. The function is realized by I / F209. Specifically, the DB310 realizes its function by, for example, a storage device such as ROM202, RAM203, magnetic disk 205, and optical disk 207 shown in FIG.

The acquisition unit 301 has a function of acquiring a packet. Specifically, for example, a packet communicated between the test terminal C and the main server A and a packet communicated between the standby server B and the test terminal C are captured. The packet acquired by the acquisition unit 301 is subjected to header / payload analysis and stored in the DB 310.

The detection unit 302 has a function of detecting the acquisition time from the start of the test of the target device of the transmission destination of the packet acquired by the acquisition unit 301 to the acquisition of the packet, and the response packet of the packet from the target device of the transmission destination. Has. Specifically, for example, the elapsed time when a packet is acquired with reference to the test start time of the target device of the transmission destination is detected as the acquisition time. If the acquired packet is a synchronous packet indicating the start of a session, the start time is not set, so the acquisition time t of the synchronized packet is set to t = 0, that is, the test start time of the target device of the destination. Will be done. The acquisition time detected by the detection unit 302 is stored in the DB 310. Further, the test start time of the target device of the transmission destination may be set to be the same as that of the test terminal C and the test device 100 in advance.

The calculation unit 303 has a function of calculating the time interval from the capture of a certain packet to the capture of the packet that responds to the packet. Specifically, the absolute value of the difference between the acquisition time of a certain packet and the acquisition time of the response packet that responds to that packet is calculated as the time interval. The details of the calculation unit 303 will be described later. The time interval calculated by the calculation unit 303 is stored in the DB 310 as an RTT.

The DB 310 has a function of storing the information described in the acquired packet, the acquisition time detected by the detection unit 302, and the time interval calculated by the calculation unit 303.

FIG. 4 is an explanatory diagram showing an example of the stored contents of the DB 310. In FIG. 4, the DB 310 has a session ID item, a time information item, an IP (Internet Protocol) header information item, a TCP (Transmission Control Protocol) header information item, an application header information item, and a payload item. The value of each item is stored in DB310 for each packet. The session ID is stored in the session ID item. If it is the same session, the same session ID is stored.

The time information item has a time item and an RTT item. The time item stores the acquisition time from the start of the test of the target device of the destination to the acquisition of the packet. For the packet (synchronous packet) captured first in the same session ID, the reference time 0 is stored as the acquisition time.

For example, since record r1 is the record of the first captured packet in records r1 to r7 of session ID: abc, the reference time t = 0 is stored. Similarly, since the record r8 is the record of the first captured packet in the records r8 to r10 of the session ID: def, the reference time t = 0 is stored.

If the captured packet is from the main server A or the standby server B, the RTT is also stored in the RTT item. RTT is the time interval between when a packet is captured and when the response packet is captured. RTT is calculated by the calculation unit 303.

The IP header information item has a source IP item and a destination IP item. The source IP address described in the header of the captured packet is stored in the source IP item. In addition, the destination IP address described in the header of the captured packet is stored in the destination IP item. In FIG. 4, the IP address of the test terminal C is set to "10.10.10.10", and the IP address of the main server A is set to "20.20.20.20". Therefore, the record r1 on the first line shows the packet from the test terminal C to the main server A, and the record r2 on the second line shows the response packet.

TCP header information items include source port item, destination port item, sequence number item, acknowledgment number item, and various flags (SYN (synchronous) / ACK (acknowledgement) / PSH (push) / FIN (communication end) / RST. (Reset request)) Has an item. The source port item stores the source port number described in the header of the captured packet. The destination port number item stores the destination port number described in the header of the captured packet.

In the sequence number item, the sequence number described in the header of the captured packet is stored. The sequence number is a random value given at the source of the captured packet.

The acknowledgment number item stores the acknowledgment number described in the header of the captured packet. The acknowledgment number is a value given by the receiving computer based on the sequence number of the received packet. For example, the value obtained by adding 1 to the sequence number of the received packet is used as the confirmation response number.

The flag item stores a flag that specifies the packet type (SYN / ACK / PSH / FIN / RST). For example, the packet on record r1 is a SYN packet.

The application header information item stores header information related to each application such as HTTP (HyperText Transfer Protocol) and POP (Post Office Protocol) 3 / IMAP (Internet Message Access Protocol).

In the payload item, the payload that is the data body of the captured packet excluding the header is stored. The payload of the packet may be stored or discarded.

In addition, communication according to TCP / IP consists of a series of processes that execute session establishment, data transfer, and session termination by a 3-way handshake. In the 3-way handshake, the test terminal C first sends a SYN packet (sequence number: random number on the test terminal C side, acknowledgment number: 0, SYN flag) to the main server A as a packet.

Next, the main server A that receives the SYN packet tests the SYN / ACK packet (sequence number: random number on the main server A side, acknowledgment number: SYN packet sequence number + 1, SYN flag, ACK flag). Send to terminal C. Furthermore, the test terminal C that received the SYN / ACK packet uses the ACK packet (sequence number: acknowledgment number on the main server A side, acknowledgment number: SYN / ACK packet sequence number, ACK flag) as the main packet. Send to server A.

In the example shown in FIG. 4, the packet group of records r1 to r3 and the packet group of records r8 to r10 are the packet group for executing the 3-way handshake.

When the packet is the first packet transmitted to the first target device, the generation unit 304 generates a second packet in which the destination of the information of the first packet is rewritten to the address of the second target device. Has the function of

Specifically, for example, the transmitted packet information for the past X minutes is acquired X minutes after the start of the test. , Rewrite the destination IP address, destination port number, sequence number, and acknowledgment number. Since the sequence number and the acknowledgment number use random numbers when establishing the session, the session is established in advance.

In TCP / IP communication, the sequence number and acknowledgment number after the session is established by the 3-way handshake are determined by the length of the packet when transferring data, so if the processing content is known, It is possible to predict future values. Here, an example of converting the packets of the records r4 to r7 shown in FIG. 4 will be described.

Note that record r4 shows a packet with an acknowledgment number: 5001 sent from the test terminal C to the main server A 2.1 seconds after the start of communication. In addition, record r6 shows a packet with an acknowledgment number: 7001 sent from test terminal C to main server A 2.4 seconds after the start of communication as a result of the packet of record r4 being sent to main server A. ..

FIG. 5 is an explanatory diagram showing an example of packet generation. In FIG. 5, explanations are given in chronological order in the order of (A) to (D). In (A) of FIG. 5, record r14 is a record of a packet (second packet) generated from the packet (first packet) of record r4 of FIG. In the generation unit 304, the session ID is rewritten from "abc" to "ijk" in order to send the converted second packet to the standby server B.

Also, the destination IP address of the packet of record r4 sent to the main server A is rewritten to the IP address of the standby server B: 20.20.20.80. Furthermore, the confirmation response number: 5001 is added with the preset amount of change: 6000, and the result is rewritten to the acknowledgment number: 11001. Acquisition time: 2.1 seconds is left as it is, and is set to the acquisition time from the test start time of the second target device (server B) to the acquisition of the second packet. Let r14 be the record after generation.

Next, in FIG. 5B, record r16 is a record of a packet (second packet) generated from the packet (first packet) of record r6 in FIG. In the generation unit 304, the session ID is rewritten from "abc" to "ijk" in order to send the converted second packet to the standby server B.

Also, the destination IP address of the packet of record r6 sent to the main server A is rewritten to the IP address of the standby server B: 20.20.20.80. Furthermore, the confirmation response number: 7001 is added with the preset amount of change: 6000, and the confirmation response number is rewritten to 13001. Acquisition time: 2.4 seconds is left as it is, and is set to the acquisition time from the test start time of the second target device (server B) to the acquisition of the second packet. Let r16 be the converted record.

In FIG. 3, the transmission unit 305 transfers the second packet generated by the generation unit 304 to the second packet when the acquisition time from the start of the test of the second target device to the acquisition of the first packet has elapsed. It has a function of transmitting to the target device. For example, in (A) and (B) of FIG. 5, the second packet is transmitted to the standby server B according to the acquisition time of the records r14 and r16 of the second packet to be transmitted to the standby server B which is the destination after generation. Specifically, the packet of record r14 is transmitted to the standby server B 2.1 seconds after the start of the test, and the packet of record r16 is transmitted to the standby server B 2.4 seconds after the start of the test.

When the packet of record r14 is transmitted to the backup system server B, the standby system server B transmits the response packet to the test terminal C. The acquisition unit 301 captures this response packet and stores it in the DB 310 as a record r15 in (C). Since the acquisition time until this capture is 3.5 seconds after the start of the test of the standby server B, "3.5" is stored in the time item of record r15. In addition, the calculation unit 303 also calculates 1.4 seconds (= 3.5-2.1) as RTT.

Similarly, when the packet of record r16 is transmitted to the backup system server B, the standby system server B transmits the response packet to the test terminal C. The acquisition unit 301 captures this response packet and stores it in the DB 310 as a record r17 in (D). Since the acquisition time until this capture is 3.8 seconds after the start of the test of the standby server B, "3.8" is stored in the time item of record r17. In addition, the calculation unit 303 also calculates 1.4 seconds (= 3.8-2.4) as RTT.

FIG. 6 is an explanatory diagram showing a transmission result of the second packet. The packet of record r4 is packet S1A, the packet of record r5 is packet R1A, the packet of record r6 is packet S2A, and the packet of record r7 is packet R2A.

Further, the packet of record r14 shown in FIG. 5 is packet S1B, the packet of record r15 is packet R1B, the packet of record r16 is packet S2B, and the packet of record r17 is packet R2B.

As shown in FIG. 6, the transmission of the packet S2B to the backup system server B is executed prior to the reception of the packet R1B from the backup system server B. Therefore, the time interval of the packets S1A and S2A transmitted to the main server A and the time interval of the packets S1B and S2B transmitted to the standby server B are the same.

In this way, in TCP / IP-based communication, by appropriately rewriting the header information, it is possible to continue sending packets from the main server A without waiting for a response from the remote standby server B. As a result, the standby server B executes the same processing as the main server A at the same timing, and the same load test as the main server A can be reproduced for the standby server B.

Further, in FIG. 3, the calculation unit 303 calculates the RTT which is the time interval. Specifically, for example, the first packet transmitted from the test terminal C to the first target device and the third packet from the first target device to the test terminal C, which is the response packet thereof, are captured. The calculation unit 303 subtracts the acquisition time from the start of the test of the first target device to the acquisition of the first packet from the acquisition time from the start of the test of the first target device to the acquisition of the third packet. By doing so, the first time interval is calculated.

For example, in FIG. 6, from the acquisition time t = 2.3 from the start of the test of the main server A to the acquisition of the packet R1A (third packet), the packet S1A (first packet) from the start of the test of the main server A. By subtracting the acquisition time t = 2.1 until the acquisition of, the first time interval da = 0.2 is calculated as RTT. Therefore, in FIG. 4, "0.2" is stored in the RTT of the record r5 of the packet R1A.

Similarly, the first time interval is calculated between the packet R2A and the packet S2A. Specifically, in FIG. 6, from the acquisition time t = 2.6 from the start of the test of the main server A to the acquisition of the packet R2A (third packet), the packet S2A (first) from the start of the test of the main server A. The first time interval da = 0.2 is calculated as RTT by subtracting the acquisition time t = 2.4 until the packet) is acquired. Therefore, in FIG. 4, "0.2" is stored in the RTT of the record r7 of the packet R2A.

Further, the second packet transmitted from the test device 100 to the second target device and the fourth packet from the second target device to the test terminal C, which is the response packet thereof, are captured. The calculation unit 303 subtracts the acquisition time from the start of the test of the second target device to the acquisition of the second packet from the acquisition time from the start of the test of the second target device to the acquisition of the fourth packet. By doing so, the second time interval is calculated.

For example, in FIG. 6, from the acquisition time t = 3.5 from the start of the test of the standby server B to the acquisition of packet R1B (fourth packet), the packet S1B (second packet) from the start of the test of the standby server B. By subtracting the acquisition time t = 2.1 until the acquisition of, the second time interval db = 1.4 is calculated as RTT. Therefore, in FIG. 5, "1.4" is stored in the RTT of the record r15 of the packet R1B.

Similarly, the second time interval is calculated between the packet R2B and the packet S2B. Specifically, in FIG. 6, from the acquisition time t = 3.8 from the start of the test of the standby server B to the acquisition of the packet R2B (fourth packet), the packet S2B (second packet) from the start of the test of the standby server B The second time interval db = 1.4 is calculated as RTT by subtracting the acquisition time t = 2.4 until the packet) is acquired. Therefore, in FIG. 5, "1.4" is stored in the RTT of the record r17 of the packet R2B.

The execution unit 306 has a function of executing relative performance evaluation processing of the first and second target devices. Specifically, for example, the relative performance evaluation processing of the first and second target devices is executed based on the first time interval da, the second time interval db, and the third time interval dc. Here, the third time interval dc means that a packet is transmitted from the first target device to the second target device, and as a result, the response packet from the second target device is received by the first target device. It is RTT until. The third time interval dc is measured in advance and stored in DB310. As a result, when the execution unit 306 performs processing, it can be read from the DB 310.

The execution unit 306 executes the relative performance evaluation processing of the first and second target devices as follows using the first to third time intervals da to dc. For example, the magnitude of the subtraction result of the second time interval db from the third time interval dc and the magnitude of the first time interval da are compared.

When da&gt; dc-db, it is judged that the standby system server B, which is the second target device, has higher performance than the main server A, which is the first target device.

When da &lt;dc-db, it is judged that the main server A, which is the first target device, has higher performance than the standby server B, which is the second target device.

When da = dc-db, it is judged that the main server A, which is the first target device, and the standby server B, which is the second target device, have the same performance.

The output unit 307 has a function of outputting the execution result by the execution unit 306. Specifically, for example, the result of the relative performance evaluation of the first and second target devices by the execution unit 306 is displayed on the display or printed out.

(Test processing procedure) Next, the test processing procedure of the test apparatus 100 according to the embodiment will be described with reference to FIGS. 7 to 9.

FIG. 7 is a flowchart showing a packet capture processing procedure of the test apparatus 100 according to the embodiment. First, the test apparatus 100 waits until the acquisition unit 301 captures the packet (step S701: No). If the packet is captured (step S701: Yes), test equipment 100 checks the destination IP address described in the header of the captured packet (step S702).

If the destination IP address is the first target device (step S702: first target device), the test device 100 checks whether the captured packet is a synchronous packet (step S703). If it is a synchronous packet (step S703: Yes), the test apparatus 100 sets t = 0 as the elapsed time from the start of the test of the first target apparatus (step S704), and starts timing (step S705). Then, the process proceeds to step S707.

On the other hand, when it is determined in step S703 that the packet is not a synchronous packet (step S703: No), since the time counting in step S705 has already started, the test apparatus 100 starts the packet (first) from the start of the test of the first target apparatus. The acquisition time up to the time when the packet) was captured is detected (step S706). Then, the process proceeds to step S707.

In step S707, test equipment 100 analyzes the header and payload of the captured packet (step S707) and records the acquisition time, header, and payload in DB310 (step S708). Then, the process proceeds to step S713.

Further, in step S702, when it is determined that the destination IP address is the IP address of the test terminal C (step S702: test terminal C), the time counting by step S705 has already started, so that the test apparatus 100 is the first. The acquisition time from the start of the test of the target device in 1 to the time when the packet (third packet) is captured is detected (step S709).

Then, the test apparatus 100 analyzes the header and payload of the captured packet (step S710), and calculates the RTT by subtracting the acquisition time of the corresponding first packet from the acquisition time of the third packet. (Step S711). After that, the test apparatus 100 records the acquisition time, RTT, header, and payload in the DB 310 (step S712), and proceeds to step S713.

In step S713, the test apparatus 100 determines whether or not packet processing has been completed (step S713). For example, the test apparatus 100 determines whether or not the packet captured this time is a FIN packet. If the packet processing is not completed (step S713: No), the process returns to step S701. On the other hand, when the packet processing is completed (step S713: Yes), the packet capture processing is terminated. As a result, the first and third packets are stored in the DB 310 shown in FIG.

FIG. 8 is a flowchart showing a packet conversion / transmission processing procedure by the test apparatus 100 according to the embodiment. First, the test apparatus 100 determines whether or not there is an unselected first packet (record) in the predetermined time zone X in the DB 310 (step S801). If there is an unselected first packet (step S801: Yes), test equipment 100 selects the unselected first packet (step S802). Then, the test apparatus 100 generates the selected first packet as a second packet by the generation unit 304, stores it in the DB 310 (step S803), and returns to step S801.

On the other hand, in step S801, when there is no unselected first packet (step S801: No), the test apparatus 100 starts timing (step S804) and starts timing (test start of the second target apparatus). It is determined whether or not there is a second packet having the same acquisition time as the elapsed time of (step S805). If there is a second packet with the same acquisition time (step S805: Yes), the test device 100 sends the corresponding second packet to the second target device (step S806) and returns to step S805.

On the other hand, in step S805, when there is no second packet having the same acquisition time as the current elapsed time (step S805: No), the test apparatus 100 determines whether or not the fourth packet has been acquired (captured). Determine (step S807). If not (step S807: No), return to step S805.

On the other hand, when the packet is acquired (step S807: Yes), the test apparatus 100 detects the acquisition time from the start of the test of the second target apparatus to the time when the packet (fourth packet) is captured (step S808). Then, the header and payload are analyzed (step S809), and the test apparatus 100 calculates the RTT by subtracting the acquisition time of the corresponding second packet from the acquisition time of the fourth packet (step S810).

After that, the test apparatus 100 records the acquisition time, RTT, header, and payload in the DB 310 (step S811), and determines whether or not all the fourth packets have been received (step S812). For example, it is determined whether or not the RTT is calculated using the corresponding second packet.

If all have not been received (step S812: No), the process returns to step S805. On the other hand, when all are received (step S812: Yes), the packet conversion / transmission process is terminated. As a result, the second and fourth packets are stored in the DB 310 as shown in FIG.

FIG. 9 is a flowchart showing the relative performance evaluation processing procedure of the first and second target devices. First, the test apparatus 100 calculates the first time interval da and the second time interval db (step S901), and subtracts the third time interval dc from the second time interval db (step S902). Then, the test apparatus 100 compares the first time interval da with the subtraction result (db-dc) (step S903).

In the case of da&gt; db-dc (step S903:&gt;), the test apparatus 100 determines that the second target apparatus has higher performance (step S904), and proceeds to step S907. Further, in the case of da &lt;db-dc (step S903: &lt;), the test apparatus 100 determines that the first target apparatus has higher performance (step S905), and proceeds to step S907.

Further, in the case of da = db-dc (step S903: =), the test apparatus 100 determines that the first target apparatus and the second target apparatus have the same performance (step S906), and proceeds to step S907. In step S907, the test apparatus 100 outputs the determination results of steps S904 to S906 (step S907). As a result, the access intervals between the first target device and the second target device can be made equal, and it is possible to carry out a reproduction test in which the loads of the respective target devices are equalized.

Moreover, since the difference in RTT between the first target device and the second target device can be ignored, the test time can be shortened. In this way, the performance evaluation of the target device can be evaluated quickly and with high accuracy.

Further, in the above-described embodiment, the performance is evaluated using the first time interval da, the second time interval db, and the third time interval dc, but the third time interval dc is not measured. In some cases or when measurement is not possible, the above-mentioned performance evaluation cannot be performed. In such a case, the first reception interval det1 of the third packet from the first target device in the test device 100 and the second packet in the test device 100 of the fourth packet from the second target device are det1. Performance evaluation may be performed by calculating the reception interval det2.

Specifically, for example, to explain with reference to FIG. 6, the calculation unit 303 calculates the difference between the acquisition time of the packet R2A and the acquisition time of the packet R1A as the first reception interval det1. Similarly, the difference between the acquisition time of packet R2B and the acquisition time of packet R1B is calculated as the second reception interval det2.

Then, the execution unit 306 executes the relative performance evaluation processing of the first and second target devices as follows by comparing the magnitude of the first reception interval det1 and the second reception interval det2. To do.

When det1&gt; det2, it is determined that the standby server B, which is the second target device, has higher performance than the main server A, which is the first target device.

When det1 &lt;det2, it is determined that the main server A, which is the first target device, has higher performance than the standby server B, which is the second target device.

When det1 = det2, it is judged that the main server A, which is the first target device, and the standby server B, which is the second target device, have the same performance. By doing so, the performance can be evaluated even when there is no third time interval dc.

FIG. 10 is a flowchart showing the relative performance evaluation processing procedure of the first and second target devices. First, the test apparatus 100 calculates the first reception interval det1 (step S1001) and calculates the second reception interval det2 (step S1002). Then, the test apparatus 100 compares the first reception interval det1 and the second reception interval det2 (step S1003).

When det1&gt; det2 (step S1003:&gt;), the test device 100 determines that the second target device has higher performance (step S1004), and proceeds to step S1007. If det1 &lt;det2 (step S1003: &lt;), the test device 100 determines that the first target device has higher performance (step S1005), and proceeds to step S1007.

Further, when det1 = det2 (step S1003: =), the test apparatus 100 determines that the first target apparatus and the second target apparatus have the same performance (step S1006), and proceeds to step S1007. In step S1007, the test apparatus 100 outputs the determination results of steps S1004 to S1006 (step S1007). As a result, the access intervals between the first target device and the second target device can be made equal, and it is possible to carry out a reproduction test in which the loads of the respective target devices are equalized.

Moreover, since the difference in RTT between the first target device and the second target device can be ignored, the test time can be shortened. In this way, the performance evaluation of the target device can be evaluated quickly and with high accuracy.

As described above, according to the test device 100, the test method, and the test program, the destination of the packet to the first target device is changed to the second target device, and the same time as the transmission to the first target device. Will be sent to the second target device. Therefore, by pretending to the second target device that the communication distance is the same as the communication distance of the first target device, it is possible to perform a reproduction test with the same load.

In addition, by performing performance evaluation using the first time interval da, the second time interval db, and the third time interval dc, the access intervals between the first target device and the second target device are made equal. It is possible to carry out a reproduction test in which the loads of each target device are equalized.

Moreover, since the difference in RTT between the first target device and the second target device can be ignored, the test time can be shortened. In this way, the performance evaluation of the target device can be evaluated quickly and with high accuracy.

Further, by performing the performance evaluation using the first reception interval det1 and the second reception interval det2, the performance evaluation can be performed even when there is no third time interval dc.

The test method described in this embodiment can be realized by executing a program prepared in advance on a computer such as a personal computer or a workstation. This test program is executed by being recorded on a computer-readable recording medium such as a hard disk, flexible disk, CD-ROM, MO, or DVD, and read from the recording medium by the computer. In addition, this test program may be distributed via a network such as the Internet.

The following additional notes are further disclosed with respect to the above-described embodiment.

(Appendix 1) On the computer, Acquires the first packet and the second packet sent to the first device, Based on the acquired first packet, a third packet with the destination of the first packet set to the second device is transmitted. When a time interval equal to the time interval between the acquisition of the first packet and the acquisition of the second packet elapses from the transmission of the third packet, the second packet is based on the acquired second packet. Send a fourth packet with the packet destination set to the second device. A test program characterized by executing a process.

(Appendix 2) The test program according to Appendix 1, wherein the computer is made to execute a process of setting the source of the third packet and the source of the fourth packet.

(Supplementary Note 3) The description in Appendix 1 or 2, wherein the first packet and the second packet correspond to consecutive packets transmitted in order from the same device to the first device. Exam program.

(Appendix 4) The first time corresponding to the time elapsed from the first reference time to the acquisition time of the first packet, and the time elapsed from the first reference time to the acquisition time of the second packet. Let the computer execute the process of acquiring the second time corresponding to The third packet is transmitted when a time corresponding to the first time elapses from the second reference time, and the fourth packet is the time corresponding to the second time from the second reference time. The test program described in any one of Appendix 1 to 3, which is characterized in that it is transmitted after the lapse of time.

(Appendix 5) The first time interval from the acquisition of the first packet to the acquisition of the third packet, and the period from the acquisition of the second packet to the acquisition of the fourth packet. Relative to the first and second devices, based on the second time interval of the first and third time intervals measured by transmission and reception between the first device and the second device. The test program according to any one of Supplementary note 1 to 4, wherein the computer is made to execute a process for executing a performance evaluation process.

(Appendix 6) When the first time interval is larger than the subtraction result obtained by subtracting the second time interval from the third time interval, the second target device is larger than the first target device. The test program according to Appendix 5, characterized in that the computer executes a process of determining that the performance is high and outputting the determination result.

(Appendix 7) When the first time interval is smaller than the subtraction result obtained by subtracting the second time interval from the third time interval, the first device has better performance than the second device. The test program according to Appendix 5, wherein the computer executes a process of determining that the value is high and outputting the determination result.

(Appendix 8) When the first time interval is equal to the subtraction result obtained by subtracting the second time interval from the third time interval, the first device and the second device have the same performance. The test program according to Appendix 5, characterized in that the computer executes a process of determining that the existence exists and outputting the determination result.

(Appendix 9) The first reception time interval of the third packet from the first target device is calculated. The second reception time interval of the fourth packet from the second target device is calculated, and the interval is calculated. Based on the first and second reception time intervals, the relative performance evaluation process of the first and second devices is executed, and the computer is made to execute the process of outputting the execution result. The test program described in any one of Appendix 1 to 4.

(Appendix 10) When the first reception time interval is larger than the second reception time interval, it is determined that the second target device has higher performance than the first device, and the determination result is output. The test program according to Appendix 9, wherein the computer is used to perform the processing.

(Appendix 11) When the first reception time interval is smaller than the second reception time interval, it is determined that the first device has higher performance than the second device, and the determination result is output. The test program according to Appendix 9, wherein the processing is performed by the computer.

(Appendix 12) Means for acquiring the first packet and the second packet transmitted to the first device, and A means for transmitting a third packet in which the destination of the first packet is set to the second device based on the acquired first packet, and When a time interval equal to the time interval between the acquisition of the first packet and the acquisition of the second packet elapses from the transmission of the third packet, the second packet is obtained based on the acquired second packet. A means for transmitting a fourth packet in which the destination of the packet is set to the second device, and A test device comprising.

(Appendix 13) The computer Acquires the first packet and the second packet sent to the first device, Based on the acquired first packet, a third packet with the destination of the first packet set to the second device is transmitted. When a time interval equal to the time interval between the acquisition of the first packet and the acquisition of the second packet elapses from the transmission of the third packet, the second packet is based on the acquired second packet. Send a fourth packet with the packet destination set to the second device. A test method characterized by performing a process.

100 test equipment 301 Acquisition Department 302 detector 303 Calculation unit 304 Generator 305 transmitter 306 Execution section 307 Output 310 DB A Main server B Reserve server C test terminal