System for visualization of business situation

The present invention relates to a work situation visualization system, and more particularly to a work situation visualization system that visualizes the situation of nursing work performed by a nurse on a patient in a medical field.

As a conventional system of this type, the nursing support system described in Non-Patent Document 1 is known. In this background technology, the information terminal carried by the nurse has functions such as displaying patient information and recording the work implementation status and body temperature measurement results, while the implementation information and measurement information recorded by the information terminal are displayed on the screen of the server PC. By displaying on, the efficiency of nursing work is improved.<nplcit num="1"><text>"Development and Evaluation of Nursing Support Systems Using Mobile Information Terminals" (Hiroko Sukeda et al., IPSJ Transactions, Vol.40, No.10, pp.3782 ~ 3791, October 1999)</text></nplcit>

<p> However, with the above background technology, although implementation information etc. is displayed on the screen of the server PC, it is difficult to grasp the situation of each nurse and the work execution history for each patient at a glance, so managers such as the teacher Could not further improve work efficiency by changing the work allocation according to the situation of each nurse or giving advice to the nurse in charge of the patient whose work execution is delayed. It was. Since each nurse also knows only his or her own situation, it was not possible for the nurses to work together to improve efficiency.</p><p> Therefore, the main object of the present invention is to provide a new business situation visualization system.</p><p> Another object of the present invention is to visualize the work situation at a glance so that the situation of each nurse (each worker who executes the work) and the work execution history for each patient (each target person who receives the work) can be grasped at a glance. To provide a system.</p>

<p> The present invention has adopted the following configuration in order to solve the above problems. The reference numerals and supplementary explanations in parentheses indicate the correspondence with the embodiments described later in order to help the understanding of the present invention, and do not limit the present invention in any way.</p><p> The first invention is a business situation visualization system that visualizes the business situation, and is a detection means that detects the situation of each worker who performs business based on information from a sensor, and a worker including a detection result of the detection means. A first storage means that stores status information together with time information based on a clock, and a worker status image that shows the status of each worker at an arbitrary time based on the worker status information stored in the first storage means on a monitor. It is provided with a first display means for displaying a list.</p><p> In the first invention, the business situation visualization system (100) includes a detection means (20 to 22), a first storage means (26), and a first display means (32, S91 to S97, S101 to S113). The detection means detects the situation of each worker performing the work based on the information from the sensors (12 to 16). In the first storage means, worker status information including the detection result of the detection means is stored together with the time information based on the clock (12T to 16T). The first display means is a worker status image (i1X to i1Z, i2X to i2Z, i3, i4) showing the status of each worker at an arbitrary time based on the worker status information stored in the first storage means. Is listed on the monitor (52).</p><p> According to the first invention, since the status of each worker at an arbitrary time is displayed in a list on the monitor, the status of each worker can be grasped at a glance.</p><p> The second invention is a business situation visualization system subordinate to the first invention, in which the sensors include an infrared sensor and a motion sensor, and the detection means estimates the position of each worker based on the information from the infrared sensor. The worker status information includes position information which is an estimation result of the estimation means and behavior information which is an identification result of the identification means. And the worker status image shows the position and behavior of each worker.</p><p> In the second invention, the sensor includes an infrared sensor (12) and a motion sensor (14), and the detection means includes an estimation means (20) and an identification means (22). The estimating means estimates the position of each worker based on the information from the infrared sensor, and the identifying means identifies the behavior of each worker based on the information from the motion sensor. In addition, the estimation result of the estimation means and the information from other sensors may be referred to in the identification. Therefore, the worker situation information accumulated by the first storage means includes the position information which is the estimation result of the estimation means and the action information which is the identification result of the identification means, and the worker situation image displayed by the first display means is The result shows the position and behavior of each worker.</p><p> According to the second invention, the position and behavior of each worker can be grasped at a glance.</p><p> The third invention is a business situation visualization system subordinate to the second invention, in which the sensor further includes a proximity sensor, and the detection means identifies the proximity target of each worker based on the information from the proximity sensor. Further including means, the worker status information further includes proximity target information which is a specific result of the specific means, and the worker status image further indicates the proximity target of each worker.</p><p> In the third invention, the sensor includes the proximity sensor (16) in addition to the estimation means and the identification means, and the detection means includes the identification means (23) in addition to the estimation means and the identification means. Since the specific means identifies the proximity target of each worker based on the information from the proximity sensor, the worker status information accumulated by the first storage means is a specific result of the specific means in addition to the position information and the action information. The proximity target information is also included, and the worker situation image displayed by the first display means shows the proximity target in addition to the position and action of each worker.</p><p> According to the third invention, the position, behavior, and proximity object of each worker can be grasped at a glance.</p><p> The fourth invention is a business situation visualization system subordinate to the third invention, and the proximity target of each worker includes the equipment close to the worker among the equipment for business use.</p><p> In the fourth invention, the worker situation image displayed by the first display means shows the proximity equipment in addition to the position and action of each worker.</p><p> According to the fourth invention, the position, behavior, and proximity equipment of each worker can be grasped at a glance.</p><p> The fifth invention is a business situation visualization system subordinate to the third or fourth invention, and the proximity target of each worker includes the target person who is close to the worker among the target persons who receive the work. Based on the worker status information accumulated in the first storage means, the target person history information indicating the work execution history for each target person is created and stored in the memory, and each at an arbitrary time based on the target person history information. It is further provided with a second display means for displaying a list of the target person's business history images showing the business execution history to the target person on the monitor.</p><p> In the fifth invention, the proximity target of each worker includes the target person who is close to the worker among the target persons who receive the work. Therefore, the worker situation image displayed by the first display means may show the proximity equipment and / or the proximity target person in addition to the position and action of each worker. The business status visualization system further includes a second display means (30, S21 to S56, S71 to S85), and the second display means is based on the worker status information stored in the first storage means. Create target person history information indicating the work execution history to and store it in the memory (72,74), and perform work to each target person at an arbitrary time based on the target person history information stored in this memory. The target person's business history images (W1, W2) showing the history are displayed in a list on the monitor.</p><p> According to the fifth invention, since the work execution history for each target person is displayed in a list on the monitor at an arbitrary time, the work execution history for each target person can be grasped at a glance.</p><p> The sixth invention is a business situation visualization system subordinate to the fifth invention, and is based on a clock based on sensor information including at least one of information from an infrared sensor, information from a motion sensor, and information from a proximity sensor. A second storage means that stores the time information together with the time information, and a third display means that displays an image showing the detection result of the sensor at an arbitrary time on the monitor based on the sensor information stored in the second storage means are further provided.</p><p> In the sixth invention, the business situation visualization system further includes a second storage means (28) and a third display means (34). The second storage means stores sensor information including at least one of information from the infrared sensor, motion sensor, and proximity sensor together with time information based on the clock, and the third display means is stored in the second storage means. Based on the accumulated sensor information, an image showing the sensor detection result at an arbitrary time is displayed on the monitor.</p><p> According to the sixth invention, the detection result of the sensor at an arbitrary time can also be known.</p><p> The seventh invention is a business situation visualization system subordinate to the sixth invention, in which the display on the monitor is divided into a plurality of display means including the first to third display means based on the operation of the input device (54). It is further provided with switching means (S3 to S11) for switching between a plurality of corresponding screens.</p><p> According to the seventh invention, by operating the input device, the user can arbitrarily select one of a plurality of screens including the status screen of each worker, the work execution history screen for each target person, and the detection result screen of the sensor. You can display one of them on the monitor.</p><p> The eighth invention is a work situation visualization system that visualizes the work situation, an estimation means that estimates the position of each worker who performs the work based on information from an infrared sensor, and a motion sensor that moves the behavior of each worker. Identification means for identifying based on information from, identification means for identifying a proximity target of each worker based on information from a proximity sensor, position information which is an estimation result of an estimation means, behavior information which is an identification result of an identification means And the storage means that stores the worker status information including the proximity information that is the specific result of the specific means together with the time information based on the clock, and to each target person who receives the work based on the worker status information stored in the storage means. Target person history information showing the work execution history is created and stored in the first memory, and the target person work history image showing the work execution history to each target person at an arbitrary time is listed on the monitor based on the target person history information. A display means for displaying is provided.</p><p> In the eighth invention, the business situation visualization system (100) includes an estimation means (20), an identification means (22), a specific means (23), a storage means (26), and a display means (30, S21 to S56, S71 to). Equipped with S85). The estimation means estimates the position of each worker performing the work based on the information from the infrared sensor (12), and the identification means identifies the behavior of each worker based on the information from the motion sensor (14), and The identification means identifies the proximity target of each worker based on the information from the proximity sensor (16). In the storage means (26), the worker status information including the position information which is the estimation result of the estimation means, the behavior information which is the identification result of the identification means, and the proximity information which is the specific result of the specific means is stored in the clock (12T ~). It will be accumulated together with the time information based on 16T). The display means creates target person history information indicating the work execution history for each target person who receives the work based on the worker status information stored in the storage means, and stores it in the first memory (72,74). Then, based on the target person history information stored in the first memory, the target person business history images (W1, W2) showing the business execution history for each target person at an arbitrary time are displayed in a list on the monitor.</p><p> According to the eighth invention, since the work execution history for each target person is displayed in a list on the monitor at an arbitrary time, the work execution history for each target person can be grasped at a glance.</p><p> The ninth invention is a business situation visualization system subordinate to the eighth invention, and the display means stores the target person schedule information indicating the business execution schedule for each target person in the second memory (66,68). A message that compares the target person history information and the target person schedule information at the current time and notifies the difference in the business history image of the target person who has a difference between the business execution history and the business execution schedule ( Highlight M1 to M3) (S55, S37, S39).</p><p> According to the ninth invention, if there is a target person whose business implementation status is different from the schedule at the present time, the target person and the difference can be known.</p><p> The tenth invention is a business situation visualization system subordinate to the ninth invention, and the message notifies the non-execution of the scheduled work.</p><p> The eleventh invention is a business situation visualization system subordinate to the ninth invention, and the message notifies the time difference between the implementation time and the scheduled time.</p><p> The twelfth invention is a business situation visualization system subordinate to the ninth invention, and the message notifies the execution of unscheduled business.</p><p> The thirteenth invention is a business situation visualization system subordinate to the ninth invention, and the display means is also a wireless communication module (10L) for the mobile terminal (40) of the worker who is in charge of the work for the target person having a difference. , 40L) to display the message (S56, S38, S40).</p><p> According to the thirteenth invention, if there is a target person whose work implementation status is different from the schedule at the present time, the worker in charge of the target person can be notified of the difference directly.</p>

<p> According to the present invention, a work situation visualization system that can grasp the situation of each nurse and the work execution history for each patient at a glance is realized. As a result, the manager should improve work efficiency by changing the work allocation according to the situation of each nurse and giving advice to the nurse in charge of the patient whose work execution is delayed. Can be done. It is also possible for nurses to work together to improve efficiency.</p><p> The above-mentioned objectives, other objectives, features and advantages of the present invention will become more apparent from the detailed description of the following examples made with reference to the drawings.</p>

<figref num="1">It is a block diagram which shows the structure of the business situation visualization system which is one Example of this invention.</figref><figref num="2">It is a schematic diagram which shows the application example to a nursing work.</figref><figref num="3">It is a block diagram which shows the configuration example of a PC.</figref><figref num="4">It is a schematic diagram which shows the memory map of the main memory of a PC.</figref><figref num="5">It is a flow chart which shows a part of the CPU operation of a PC.</figref><figref num="6">It is a flow chart which shows the other part of the CPU operation of a PC.</figref><figref num="7">It is a flow chart which shows the other part of the CPU operation of a PC.</figref><figref num="8">It is a schematic diagram which shows an example of a nurse situation table.</figref><figref num="9">It is a schematic diagram which shows an example of the patient treatment schedule data, (A) shows the treatment schedule data of patient A, and (B) shows the treatment schedule data of patient B.</figref><figref num="10">It is a schematic diagram which shows an example of patient treatment history constant data, (A) shows the treatment history data of patient A, and (B) shows the treatment history data of patient B.</figref><figref num="11">It is a schematic diagram which shows an example of a patient situation RT screen.</figref><figref num="12">It is a schematic diagram which shows another example of patient treatment history constant data, (A) shows the treatment history data of patient A, and (B) shows the treatment history data of patient B.</figref><figref num="13">It is a schematic diagram which shows another example of a patient situation RT screen.</figref><figref num="14">It is a flow chart which shows the other part of the CPU operation of a PC.</figref><figref num="15">It is a schematic diagram which shows another example of a patient situation PB screen.</figref><figref num="16">It is a flow chart which shows the other part of the CPU operation of a PC.</figref><figref num="17">It is a schematic diagram which shows another example of a nurse situation table.</figref><figref num="18">It is a schematic diagram which shows an example of a nurse situation RT screen.</figref><figref num="19">It is a flow chart which shows the other part of the CPU operation of a PC.</figref>

With reference to FIG. 1, the business situation visualization system 100, which is an embodiment of the present invention, includes a PC 10, a mobile terminal 40, an infrared sensor 12, a motion sensor 14, a proximity sensor 16, and a microphone 18. The infrared sensor 12, motion sensor 14, proximity sensor 16 and microphone 18 are provided with clocks 12T, 14T, 16T, and 18T, respectively, and each clock 12T to 18T is a clock 10T on the PC10 side (see Fig. 3: Synchronized with (described later).

In addition, the infrared sensor 12 is further provided with a wireless LAN module 12L, and the mobile terminal 40, motion sensor 14, proximity sensor 16 and microphone 18 are further provided with Bluetooth® modules 40B, 14B, 16B and 18B, respectively. The wireless LAN module 12L performs wireless LAN communication with the wireless LAN module 10L on the PC10 side (see Fig. 3: described later), and each Bluetooth module 14B to 18B is connected to the Bluetooth module 40B of the mobile terminal 40. Perform Bluetooth communication.

Therefore, in this embodiment, the signal from the infrared sensor 12 is directly transmitted to the PC 10 by wireless LAN, while the signals from the motion sensor 14, the proximity sensor 16 and the microphone 18 are aggregated to the mobile terminal 40 by Bluetooth. After that, it is transmitted to PC10 by wireless LAN.

In another embodiment, it is possible to omit the mobile terminal 40 so that the motion sensor 14, the proximity sensor 16, and the microphone 18 directly communicate with the PC 10 via wireless LAN. That is, the Bluetooth modules 14B, 16B and 18B provided on the motion sensor 14, proximity sensor 16 and microphone 18 are replaced with wireless LAN modules 14L, 16L and 18L (not shown), and each wireless LAN module 14L to 18L is on the PC10 side. Wireless LAN communication may be performed with the wireless LAN module 10L of.

Further, for the connection between the PC 10 and the infrared sensor 12, instead of the wireless LAN method, another short-range wireless communication method such as ZigBee (registered trademark) may be used, and a wired communication method via a LAN cable or the like may be used. It is also possible to use.

Further, for the connection between the motion sensor 14, the proximity sensor 16 and the microphone 18 and the mobile terminal 40, another short-range wireless communication method may be used instead of the Bluetooth method, and the short-range wireless communication differs depending on the connection location. It is also possible to use the method.

Figure 2 shows an example of application of the work status visualization system 100 to nursing work. In the application example of FIG. 2, the PC10 is installed anywhere in the ward, for example, at a nurse station. The infrared sensor 12 is composed of an infrared transmitter 12a and an infrared receiver 12b, and the infrared transmitter 12a is attached to the head of nurse X. The infrared receiver 12b is installed at a predetermined position in the ward, for example, near the entrance / exit ENT of each room or a sink for hand washing (see FIGS. 11 and 18: described later).

An ID is attached to each of the infrared transmitter 12a and the infrared receiver 12b, and the infrared transmitter 12a periodically transmits its own ID in infrared rays. When the infrared receiver 12b receives the ID from the infrared transmitter 12a, it transmits this ID and its own ID to the PC 10 through the wireless LAN module 12L together with the type stamp based on the clock 12T. That is, the ID data output by the infrared sensor 12 includes a pair of IDs and a time stamp.

The motion sensor 14 is composed of acceleration sensors 14a to 14d, and the acceleration sensors 14a to 14d are attached to the upper left arm, upper right arm, chest and waist of the nurse X, respectively, and repeat acceleration in three axes (for example, 1/100 second). Detect (by cycle). The motion sensor 14 transmits the detection results of the acceleration sensors 14a to 14d to the PC 10 through the Bluetooth modules 14B and 40B and the wireless LAN module 40L together with the time stamp based on the clock 14T. That is, the motion data output by the motion sensor 14 includes the acceleration value of the 3 × 4 = 12 component and the time stamp.

The proximity sensor 16 is composed of Bluetooth modules 16a and 16b, the Bluetooth module 16a is for nurse X (mobile terminal 40), the Bluetooth module 16b is for shared nursing equipment 42 (such as a sphygmomanometer) and the patient's bed 44 (for the patient). It will be provided for each item (which may be your belongings or the patient himself). The nursing equipment 42 is stored in a predetermined place, for example, a nurse station, and is taken out to a hospital room or the like as needed.

The Bluetooth module 16a provided in the nurse X (mobile terminal 40) detects the ID (MAC address) of the Bluetooth module 16b provided in the nursing equipment 42 or the bed 44, and obtains this ID and its own ID. It is transmitted to the PC10 through the Bluetooth modules 16B and 40B and the wireless LAN module 40L, along with the current electrolytic strength (RSSI) and time stamp based on the clock 16T. That is, the proximity data output by the proximity sensor 16 includes a pair of IDs, an electric field strength value, and a time stamp.

The microphone 18 is mounted near the mouth of the nurse X and captures and encodes the voice including the utterance of the nurse X. The voice data obtained by encoding is transmitted to the PC 10 through the Bluetooth modules 18B and 40B and the wireless LAN module 40L together with the time stamp based on the clock 18T. That is, the voice data output by the microphone 18 is also given a time stamp.

Similarly, each of the other nurses Y, Z, ... Is equipped with an infrared transmitter 12a, an acceleration sensor 14a to 14d, a Bluetooth module 16a (a mobile terminal 40 provided with the Bluetooth module 16a), and a microphone 18. To.

With reference to Figure 1 again, PC10 is a position estimation engine 20, behavior identification engine 22, target identification engine 23, speech recognition engine 24, context management server 26, sensor data manager 28, patient status viewer 30, nurse status viewer. It is equipped with 32 and a sensor data viewer 34. The context management server 26 includes a real-time DB (database) 26r and a history DB 26h, and the sensor data manager 28 contains a sensor DB 28s.

The functions of these components (20-34, 26r, 26h and 28s) are the hardware resources shown in Figure 3, namely clock 10T, wireless LAN module 10L, CPU50, LCD monitor 52, key input device 54 and main memory 56. And the software resources stored in the main memory 56. Software resources are layered in multiple layers including the middleware layer, context management layer, and application layer. The position estimation engine 20, behavior identification engine 22, target identification engine 23, and voice recognition engine 24 are in the middleware layer, and context management. The server 26 and the sensor data manager 28 belong to the context management layer, and the patient status viewer 30, the nurse status viewer 32 and the sensor data viewer 34 belong to the application layer, respectively.

The ID data from the infrared sensor 12 is given to the position estimation engine 20 via a buffer (not shown). The position estimation engine 20 estimates the current position of the nurses X, Y, ... Based on the given ID data, and outputs the estimation result (position information) to the context management server 26 and the behavior identification engine 22.

The proximity data from the proximity sensor 16 is given to the target identification engine 23 via a buffer (not shown). The target identification engine 23 identifies the proximity target (patient A, B or nursing equipment 42) of the nurse X, Y, ... based on the given proximity data, and manages the specific result (proximity target information) in context. Output to server 26 and behavior identification engine 22.

The motion data from the motion sensor 14 is given to the behavior identification engine 22 via a buffer (not shown). The behavior identification engine 22 identifies the behavior of the nurses X, Y, ..., mainly based on the given motion data, with reference to the estimation result of the position estimation engine 20 and the identification result of the target identification engine 23. , Output the identification result (behavior information) to the context management server 26.

The voice data from the microphone 18 is given to the voice recognition engine 24 via a buffer (not shown). The voice recognition engine 24 identifies the utterance voice of the nurse X, Y, ... Based on the given voice data, and outputs the identification result (speech information) to the context management server 26.

The context management server 26 aggregates the information collected in the middleware layer for each nurse and manages it as a nursing context.

Specifically, the real-time DB26r in the context management server 26 stores the nurse status table 74 configured as shown in FIGS. 8 and 17. The nurse status table 74 consists of a plurality of data fields, each of which corresponds to one nurse, and each data field includes a data field ID, a nurse ID, a behavioral state, a behavioral state change time, a position ID, and a position change time. , Target patient ID, target patient change time, target equipment ID, target equipment change time, voice ID, voice recognition result and voice change time are included.

When the context management server 26 receives the estimation result of the position estimation engine 20, the estimation result of the behavior identification engine 22, the identification result of the target identification engine 23, and the recognition result of the voice recognition engine 24, these are aggregated for each nurse. , The result is sequentially written to the nurse status table 74 in the real-time DB26r. When the nurse status table 74 in the real-time DB26r is updated, the update history data is added to the history DB26h in the context management server 26. The context management server 26 can reproduce the nurse status table 74 at an arbitrary time from the business start time to the current time (or business end time) by referring to the update history data of the history DB 26h.

The context management server 26 also provides a nursing context at the current time or a specified time, as requested by the patient status viewer 30 or the nurse status viewer 32. As the nursing context at the current time, the nurse status table 74 in the real-time DB26r is provided, and as the nursing context at the specified time, the nurse status table 74 reproduced from the historical data in the history DB26h is provided.

The sensor day manager 28 manages the raw data detected by the various sensors 12 to 16. That is, the ID data from the infrared sensor 12, the motion data from the motion sensor 14, and the proximity data from the proximity sensor 16 are also given to the sensor day manager 28. The sensor day manager 28 saves the given data in the sensor DB 28s, and if requested by the sensor data viewer 34, reads the corresponding data from the sensor DB 28s and provides the data.

The patient status viewer 30 receives a nursing context from the context management server 26 and displays a list of each patient status at the current time or a specified time.

Specifically, the data area 56b of the main memory 56 stores patient treatment schedule data 66,68 indicating the treatment schedule of each patient A and B as shown in FIGS. 9 (A) and 9 (B). There is. For example, patient A's scheduled treatment data 66 consists of multiple data fields, each corresponding to one treatment for patient A, where each data field ID, treatment content, location, nurse ID, start time and end. Includes time. The patient treatment schedule data 66 and 68 can be updated at any time by operating the key input device 54.

The patient status viewer 30 acquires the nurse status table 74 at the current time or the specified time as shown in FIG. 8 from the context management server 26, and obtains FIG. 10 (A), FIG. 10 (B) or FIG. 12 (A). ), Treatment history data 70 and 72 for each patient A and B as shown in Fig. 12 (B) are created. The patient treatment history data 70,72 has the same configuration as the patient treatment schedule data 66,68 (see FIGS. 9 (A) and 9 (B)) described above. Then, based on the created patient treatment history data 70,72, the patient situation real-time (RT) screen as shown in FIGS. 11 and 13 or the patient situation playback (PB) screen as shown in FIG. 15 is displayed on the LCD monitor. Display at 52.

For example, in the patient status RT screen of FIG. 11, the status window W1 showing the treatment status of patient A and the status window W2 showing the treatment status of patient B are displayed on the floor plan FP of the ward. In each status window W1 and W2, "scheduled", "history", and "in charge" at the current time are displayed in the form of a band along the time axis. "Schedule" is based on "treatment content", "start time" and "end time" described in patient treatment schedule data 66,68, and "history" is "treatment content" described in patient treatment history data 70,72. , "Start time" and "End time", and "Responsible" is based on the "Nurse ID in charge" described in patient treatment history data 70,72 or patient treatment schedule data 66,67. The contents of each status window are then updated over time, for example every 5 seconds.

When there is a gap between "Schedule" and "History" in each status window W1 and W2, a message (M1 to M3) notifying this is highlighted in the status window W1 and W2. On the patient status RT screen shown in FIG. 11, the examination a scheduled to be performed on patient A from 9:30 has not yet started even after 9:40, so the patient A status window W1 is displayed with "Caution". ! The message M1 "Inspection a has not been performed" is displayed. This message M1 can also be displayed on the mobile terminal 40 of the nurse Y who is in charge via wireless LAN.

On the other hand, the infusion scheduled to be performed by nurse X from 9:00 for patient B started at 8:57, so in the situation window W2 of patient B, "the infusion is 3 minutes earlier than planned. The message M2 is displayed. This message M2 can also be displayed on the mobile terminal 40 of the nurse X who is in charge via wireless LAN.

On the patient status RT screen in Fig. 13, the procedure scheduled for patient A from 13:30 is examination b, but the nurse X in charge is performing examination c at 13:32. For this reason, the message M3 "Caution! This is an unscheduled procedure" is displayed in the status window W1 of patient A. This message M3 can also be displayed on the mobile terminal 40 of Nurse X via wireless LAN. Scheduled treatment is being performed for patient B on time, so no message is displayed in patient B's status window W2.

Similarly, on the patient status PB screen of FIG. 15, status windows W1 and W2 showing the treatment status of each patient A and B are displayed on the floor plan FP of the ward, but here they are shown in the status windows W1 and W2. Is "Schedule", "History" and "Responsible" at the specified time, not the current time. On this patient status PB screen, the time bar TB corresponding to the period from the start to the end of the work is displayed below the floor plan FP, and the user can use a pointing device that does not show the pointer Pt on this time bar TB. When the desired time is specified by moving or by directly inputting a number with the key input device 54, the status windows W1 and W2 display "Schedule", "History", and "Responsible" at the specified time. Is displayed. After that, the display contents of each status window WI and W2 are updated with the passage of time, for example, every 5 seconds.

The nurse status viewer 32 receives the provision of the nursing context from the context management server 26, and displays a list of the statuses of each nurse X, Y, ... at the current time or the specified time. Specifically, the nurse status viewer 32 acquires the nurse status table 74 at the current time or the specified time as shown in FIG. 17 from the context management server 26, and obtains the nurse status RT screen or the illustration as shown in FIG. Not nurse status Display the PB screen on the LCD monitor 52.

On the nurse status RT screen of FIG. 18, for each nurse X to Z, the position and action state at the current time (18:23:32) are in the mode of the position icons i1X to i1Z and the action state icons i2X to i2Z. Floor plan Shown on FP. The position icon i1X and the behavioral state icon i2X indicate that Nurse X is performing a hand wash in the nurse station from time 18:23. The position icon i1Y and the behavioral state icon i2Y indicate that nurse Y is performing the entry operation from time 18:19 in the nurse station. The position icon i1Z and the behavioral state icon i2Z indicate that Nurse Z is walking down the corridor from time 18:19.

In addition, the target equipment icon i3 indicating the sphygmomanometer 03 is displayed in the vicinity of the position icon i1Z and the action state icon i2Z, which indicates that the nurse Z is carrying the sphygmomanometer 03.

After that, if nurse Z measures the blood pressure of patient B lying on bed 44 in room 202, the target patient indicating patient B is further near the position icon i1Z, the behavioral state icon i2Z, and the target equipment icon i3. The icon i4 is displayed. At this time, the behavioral state icon i2Z indicates blood pressure measurement_18: 20 ~. These icons i1Z, i2Z, i3 and i4 indicate that Nurse Z is measuring patient B's blood pressure from 18:20 in Room 202.

The above four types of icons i1 to i4 are based on the nurse status table 74 at the current time as shown in FIG. 17, and are subsequently updated every 5 seconds, for example, with the passage of time. On the nurse status PB screen (not shown), similar icons i1 to i4 are displayed based on the nurse status table 74 at the specified time, and are updated in the same manner.

The sensor data viewer 34 acquires raw data at the current time or a designated time from the sensor data manager 28, and displays various sensor information such as an acceleration waveform (not shown) based on motion data on the LCD monitor 52. The sensor information is also updated over time, for example, every 5 seconds.

In this way, if the work status visualization system 100 is applied to nursing work, the status of each patient and each nurse can be listed in real time (or by playback) on the screen of PC10, so that the work management by the manager such as the teacher can be performed. It will be easier and information sharing between nurses will be promoted. In addition, if the execution status (history) of the work is out of schedule, a warning or notification will be given through the screen of the PC 10 or the mobile terminal 40, so the quality of the nursing work should be improved without increasing the burden on the administrator. Can be done.

Hereinafter, specific information processing for realizing such business situation visualization will be described. Figure 4 shows a part of the memory map of the main memory 56 (the part allocated to the application layer). The main memory 56 includes a program area 56a and a data area 56b, and the display control program 60 and the communication control program 62 are stored in the program area 56a. The display control program 60 is a program for realizing the various viewers 30 to 34 described above, and is the main thread shown in FIG. 5, the patient status RT display thread shown in FIGS. 6 and 7, and the patient shown in FIG. It includes a status PB display thread, a nurse status RT display thread shown in FIG. 16, a nurse status PB display thread shown in FIG. 19, and a sensor data RT / PB display thread (not shown). The communication control program 62 is a program for controlling the wireless LAN module 10L to perform wireless LAN communication between the PC 10 and the infrared sensor 12 and the mobile terminal 40.

The patient status RT display thread and the patient status PB display thread correspond to the patient status viewer 30, the nurse status RT display thread and the nurse status PB display thread correspond to the nurse status viewer 32, and the sensor data RT / PB display. The thread corresponds to the sensor data viewer 34. These display threads are started / terminated by the main thread.

In the data area 56b, the current display mode information 64, the treatment schedule data of patient A 66, the treatment schedule data of patient B 68, the treatment history data of patient A 70, the treatment history data of patient B 72, and the nurse status table 74 Etc. are memorized. The current display mode information 64 is information indicating the display mode currently selected from the plurality of display modes corresponding to the plurality of display threads. Patient A's treatment schedule data 66 is shown in FIG. 9 (A), patient B's treatment schedule data 68 is shown in FIG. 9 (B), and patient A's treatment history data 70 is shown in FIG. 10 (A) or FIG. 12 (A). , Patient B's treatment history data 72 is shown in FIG. 10 (B) or FIG. 12 (B), and the nurse status table 74 is shown in FIG. 8 or 17, respectively.

When the business status visualization system 100 is started, the CPU 50 starts processing of the main thread. With reference to FIG. 5, the first step S1 executes the initial processing, and the next step S3 starts the display thread corresponding to the current display mode information 64 (see FIG. 4). The process then enters the event waiting loop of steps S5 to S7.

The CPU 50 can execute a plurality of threads in parallel, and thereafter, the main thread and the started display thread among the plurality of display threads are executed in parallel. The processing of each display thread will be described later.

When the end operation is performed, the process proceeds from step S5 to step S9, the current display mode is memorized, and the current display thread is terminated. Then, this main thread itself is terminated. On the other hand, when the mode specification operation is performed, the process proceeds from step S7 to step S11, the current display thread is terminated, and the display thread corresponding to the specified mode is started. Then, after updating the current display mode information 64, the process returns to the operation waiting loop of steps S5 to S7.

When the patient status RT display thread is started, the processes shown in FIGS. 6 and 7 are executed. In the first step S21, the initial setting is performed for the context management server 26. Specifically, when the target patient ID is changed in any of the data fields of the nurse status table 74 in the real-time DB26r, the data field (that is, the status data of the nurse in charge) is moved to the patient status viewer 30 side. Set to notify. As a result, for example, when the target patient ID changes from - to patient B in the data field 3 of the nurse status table 74 in FIG. 8, the content of this data field 3 (nurse X, intravenous drip, 09:37, ..., Intravenous drip, 9:35) will be notified.

In the next step S22, the nurse status table 74 is retrieved from the context management server 26 and stored in the data area 56b, and the treatment history data for each patient ID, here patient A's treatment history data 70 and patient B's treatment. Create history data 72 in the data area 56b. Then, in step S23, the patient status RT screen as shown in FIGS. 11 and 13 is initially displayed on the LCD monitor 52 based on the treatment history data 70 of patient A and the treatment history data 72 of patient B. After that, the process branches into steps S27 to S40 and steps S41 to S56 depending on whether or not there is a notification from the context management server 26.

First, when notified, in step S27, the nurse status table 74 and the treatment history data (70 or 72) of the target patient ID are updated based on the notified data field. As a result, the change on the real-time DB26r side is reflected in the nurse status table 74 and the treatment history data 70 of patient A or the treatment history data 72 of patient B.

In the next step S29, the treatment schedule data (66 or 68) and the treatment history data (70 or 72) are collated at the current time with respect to the target patient ID, and the match flag is controlled based on the collation result. For example, when the target patient ID is patient B, the treatment schedule data 68 of patient B and the treatment history data 72 of patient B are collated. Patient B's scheduled treatment data 68 is shown in FIG. 9 (B), patient B's treatment history data 72 is shown in Figure 10 (B), and the current time is 09:40. In some cases, both treatments are "drip", so the match flag is set to True.

When the target patient ID is patient A, the treatment schedule data 66 of patient A and the treatment history data 70 of patient A are collated. Patient A's scheduled treatment data 66 is shown in FIG. 9 (A), patient A's treatment history data 70 is shown in Figure 12 (A), and the current time is 13:32. In some cases, the treatment content is "inspection b" in the former but "inspection c" in the latter, so False is set in the match flag.

Then, in step S31, it is determined whether or not the match flag is True, and if YES, the process proceeds to step S32, and if NO, the process proceeds to step S39. In step S32, the time difference is further calculated based on the above collation result. Here, the difference between the scheduled start time and the history start time is regarded as the time difference. Therefore, in the example of infusion for patient B described above, the time difference is calculated as "3 minutes".

In step S33, it is further determined whether the time difference is less than the default value (for example, 2 minutes), and if YES, the status window (W1 or W2) of the patient ID is displayed in the treatment history data in step S35. After updating based on (70 or 72), return to step S25.

If it is NO in step S33, the process proceeds to step S37, and a message indicating that the treatment is being performed out of the scheduled time and a time difference, for example, message M2 shown in the status window W2 in FIG. "I'm doing it 3 minutes earlier" is highlighted in the status window (W1 or W2) of the patient ID. A similar message (M2) may be sent to the mobile terminal 40 of the nurse (X) in charge in the next step S38. Then, the process returns to step S25.

On the other hand, in step S39, the status window (W1 or W2) of the patient ID is highlighted to indicate that unscheduled treatment is being performed. For example, the message M3 shown in the status window W1 in Figure 13, "Caution! Unplanned action," corresponds to this highlighting. A similar message (M3) may be sent to the mobile terminal 40 of the nurse (X) in charge in the next step S40. Then, the process returns to step S25.

On the other hand, if there is no notification, in step S41, it is determined whether or not there is an unselected target patient ID among all target patient IDs (patient A and patient B in this case). If YES here, one is selected from the unselected target patient IDs in step S43, all or part of the series of processes of steps S45 to S56 is executed for the target patient ID, and then the process returns to step S41. And repeat the same process. If the determination result in step S41 is NO, the process returns to step S25.

In step S45, the status window (W1 or W2) of the patient ID is updated based on the treatment history data (70 or 72) of the patient ID. In step S47, the treatment schedule data (66 or 68) and the treatment history data (70 or 72) are collated at the current time with respect to the target patient ID, and treatment omission is detected. For example, when the target patient ID is patient A, the treatment schedule data 66 of patient A and the treatment history data 70 of patient A are collated. Patient A's scheduled treatment data 66 is shown in FIG. 9 (A), patient A's treatment history data 70 is shown in FIG. 10 (A), and the current time is 09:40. In some cases, the start time of inspection a is "2009.01.27_09: 30" in the former, but "-" in the latter, so a treatment omission of "inspection a" is detected.

In step S49, it is determined whether or not treatment omission is detected, and if NO, the process returns to step S41, while if YES, the process proceeds to step S51. In step S51, the delay time (difference between the scheduled start time and the current time) is calculated for the detected treatment omission. In step S53, it is determined whether or not the calculation result exceeds the default value (for example, 8 minutes), and if NO, the process returns to step S41, while if YES, the process proceeds to step S55. For example, if the above-mentioned inspection b is omitted, the delay time is calculated to be 10 minutes in step S51, and YES is determined in step S53.

In step S55, a message notifying the detected omission of treatment, for example message M1 shown in FIG. 11, that is, "Caution! Examination a has not been performed" is highlighted in the status window (W1 or W2) of the patient ID. To do. A similar message (M1) may be sent to the mobile terminal 40 of the nurse (X) in charge in the next step S56. Then, the process returns to step S41.

When the patient status PB display thread is started, the process shown in FIG. 14 is executed. In the first step S71, the patient status table 74 is acquired from the context management server 26 , and the treatment history data 70 of each patient A and B over the period from the start time (8:00) to the end time (18:00). , 72 are created in the data area 56b. In the next step S73, the patient status PB screen as shown in FIG. 15 is initially displayed on the LCD monitor 52 based on the treatment history data 70 and 72 of A and B at the start time. The process then enters the event waiting loop of steps S75 to S79.

When the time designation end operation is performed, the process proceeds from step S75 to step S77, the patient status PB screen is updated based on the treatment history data 70 and 72 of patients A and B at the designated time, and then the events of steps S75 to S79 are performed. Return to the wait loop. When a certain period of time (for example, 5 seconds) has elapsed from the initial display of the patient status PB screen or the previous update, the process proceeds from step S79 to S81 to determine whether or not the current time exceeds the end time. If YES, the process proceeds to step S83, and if NO, the process proceeds to step S85.

In step S83, the patient status PB screen is updated based on the treatment history data 70 and 72 of patients A and B at the end time, and then the process returns to the event waiting loop of steps S75 to S79. In step S85, the patient status PB screen is updated based on the treatment history data 70 and 72 of the post-lapse patients A and B at a time (for example, 5 seconds) after the start time or the time of the previous update, and then step S75. Return to the event waiting loop of ~ S79.

When the nurse status RT display thread is started, the process shown in FIG. 16 is executed. In the first step S91, the initial setting is performed for the context management server 26. This initial setting is the same as that of step S21 described above. In the next step S93, the nurse status table 74 as shown in FIG. 17 is acquired from the context management server 26 and stored in the data area 56b, and the nurse status RT screen as shown in FIG. 18 is initially displayed on the LCD monitor 52. .. Then, in step S95, the notification from the context management server 26 is waited, and when the notification is received, the process proceeds to step S97 to update the status icon of the nurse ID (for example, the status icon i1Z, i2Z, i3, i4 of the nurse Z). To do. After updating, the process returns to step S95.

When the nurse status PB display thread is started, the process shown in FIG. 19 is executed. In the first step S101, the patient status table 74 at the start time is acquired from the context management server 26, and the patient status PB screen (not shown) is initially displayed on the LCD monitor 52. The process then enters the event waiting loop of steps S103 to S105.

When the time specification end operation is performed, the process proceeds from step S103 to step S107, the patient status table 74 at the specified time is acquired from the context management server 26, the nurse status PB screen is updated, and then the events in steps S103 to S105 are performed. Return to the wait loop. When a certain time (for example, 5 seconds) has elapsed from the initial display of the nurse status PB screen or the previous update, the process moves from step S105 to S109 to determine whether the current time has exceeded the end time. If YES, the process proceeds to step S111, and if NO, the process proceeds to step S113.

In step S111, the patient status table 74 at the end time is acquired from the context management server 26, the nurse status PB screen is updated, and then the process returns to the event waiting loop in steps S103 to S105. In step S113, the patient status table 74 at the start time or a time after a certain time (for example, 5 seconds) after the last update time is acquired from the context management server 26 to update the nurse status PB screen, and then steps S103 to S105. Return to the event waiting loop.

Although not shown, the sensor data RT display thread first acquires the sensor data at the current time from the sensor data manager 28 and initially displays the sensor data RT screen, and thereafter every fixed time (for example, 5 seconds). The process of acquiring the sensor data at the current time and updating the sensor data RT screen is repeated.

Although not shown, the sensor data PB display thread first acquires the sensor data at the start time from the sensor data manager 28 and initially displays the sensor data RT screen, and thereafter from the start time or the time of the previous update. The process of acquiring the sensor data at a time after a certain time (for example, 5 seconds) and updating the sensor data PB screen is repeated.

As is clear from the above, the business status visualization system 100 of this embodiment includes the PC 10. The PC10 detects the situation of each nurse with the position estimation engine 20, the behavior identification engine 22, and the target identification engine 23 based on the information from the infrared sensor 12, the motion sensor 14, and the proximity sensor 16, and the detection result is clock 12T ~. It is stored in the context management server 26 in the form of the nurse status table 74 (see Fig. 8 etc.) together with the time information (time stamp) based on 16T. Then, based on the accumulated nurse status table 74, the icons (i1X to i1Z, i2X to i2Z, i3, i4) indicating the status of each nurse at an arbitrary time are listed on the LCD monitor 52 by the nurse status viewer 32. Display (see Figure 18). In addition, based on the accumulated nurse status information, treatment history data (70,72) for each patient is created, and windows (W1, W2) showing the treatment history for each patient at an arbitrary time are displayed in the patient status. List on the LCD monitor 52 with the viewer 30 (see Fig. 11, Fig. 13, and Fig. 15). This makes it possible to grasp the situation of each nurse and the treatment history for each patient at a glance.

In this embodiment, four acceleration sensors 14a to 14d were attached to both upper arms, chest, and waist of the subject, but the number of acceleration sensors and the attachment site can be changed as appropriate. Other motion sensors, such as a gyro sensor, may be used in place of or in addition to the accelerometer.

In the above, an example of application to nursing work has been described, but the present invention can also be applied to other work such as manufacturing and distribution.

10 ... PC 12 ... infrared sensor 12a ... infrared transmitter 12b ... infrared receiver 14 ... motion sensor 14a ~ 14d ... Accelerometer 16 ... Proximity sensor 16a, 16b ... Bluetooth module 20 ... Position estimation engine 22 ... Behavior identification engine 23 ... Targeted engine 26 ... Context management server 28 ... Sensor data manager 30 ... Patient Status Viewer 32 ... Nurse Situation Viewer 34 ... Sensor data viewer 40 ... mobile device 50 ... CPU 52 ... LCD monitor 54 ... Key input device 56 ... main memory 10T ~ 18T ... Clock 10L, 12L, 40L ... Wireless LAN module 14B ~ 18B ... Bluetooth module 42 ... Nursing equipment (sphygmomanometer) 44 ... bed 100 ... Business status visualization system