A co-presence data retrieval system which indicates observers of data

A CO-PRESENCE DATA RETRIEVAL SYSTEM WHICH

INDICATES OBSERVERS OF DATA

Eitan, Pearl, Latzer & Cohen-Zedek P-562-IL1 WO 99/57653 PCT/IL99/00239

A CO-PRESENCE DATA RETRIEVAL SYSTEM WHICH INDICATES

OBSERVERS OF DATA

FIELD OF THE INVENTION 5 The present invention relates to data retrieval systems generally and to data retrieval systems with co-presence mechanisms in particular.

BACKGROUND OF THE INVENTION

Data retrieval systems are known in the art. A typical one is shown in Fig. 1 to which reference is now made. Data retrieval systems typically consist of io a data server 10 and multiple data-retrieval clients 12 which are typically separate computers. Upon command of a data-retrieval client 12, the data server 10 accesses a data repository 14, or database, that contains data objects 16 therein. Data objects 16 are typically files of information. The data-retrieval clients 12 also communicate with a user 17, typically through an interactive display 18. 15 A typical data retrieval operation, depicted in Fig. 2 to which reference is now made, proceeds as follows; upon receipt of an instruction (arrow 1) from the user 17 to retrieve a certain data object 16, the data-retrieval client 12 sends (arrow 2) a request to the data server 10 on which the object resides. The data server 10 retrieves the requested data object 16 (arrow 3) from the data repository 20 14 and sends the object 16 back (arrow 4) to the data-retrieval client 12. The data-retrieval client 12 then displays (arrow 5) the retrieved data object 16 to the user 17. i WO 99/57653 PCT/IL99/00239

Additional features incorporated in a data retrieval system may include a data-management mechanism that allows a data-retrieval client 12 to create a new data object 16, to modify a retrieved data object 16 and to send the created or modified data object 16 back to the data server 10 for storage in the data 5 repository 14, and a permission mechanism that allows the server 10 to approve or deny certain client requests.

Examples of data retrieval systems, some of which include the additional features, include the file transfer protocol (FTP), hypertext transfer protocol (HTTP), Gopher and network file systems (NFS) standards, network news servers io (NNTP), DEC* Notes of Digital Electric Corporation of the USA, Lotus Notes of Lotus Inc. of the USA, Novell NetWare of Novell Inc. of the USA, and the relational database management systems (RDBMS) such as those manufactured by Oracle, Sybase, and Informix, all of the USA. 2 WO 99/57653 PCT/IL99/00239

SUMMARY OF THE PRESENT INVENTION

There is provided, in accordance with a preferred embodiment of the present invention, a data retrieval system has a data server, a co-presence server and at least one awareness co-presence client. The data server retrieves at least one data object from among a plurality of data objects stored in a data repository. The co-presence server opens communication and observation channels associated with at least one of the data objects. The awareness co-presence clients communicate with the co-presence server and define an awareness state of the client. The co-presence server opens a communication channel or an observation channel with each client depending on the awareness state of each client per retrieved data object. For observation channels, the co-presence server indicates to each client which other clients have retrieved the same data object. The co-presence server opens a communication channel associated with a retrieved data object to those clients which retrieved the data object and which are in a communication type of awareness state.

Additionally, in accordance with a preferred embodiment of the present invention, for a data object retrieved by the data server for one of the awareness co-presence clients, the co-presence server indicates to the one client which other clients have retrieved the same data object and provides a communication channel associated with the retrieved data object to those clients which retrieved the data object and which are in a communication type of awareness state. 3 WO 99/57653 PCT/IL99/00239

Moreover, in accordance with a preferred embodiment of the present invention, the co-presence server generates one virtual place per data object retrieved from the data server, associates each virtual place with its data object once its data object is accessed and generates communication and observation channels to awareness co-presence clients in response to the awareness state of each the client. 1

Further, in accordance with a preferred embodiment of the present invention, the awareness co-presence client associates a data object received from the data server with one of the at least one virtual places in the co-presence server. *

In addition, there is also provided, in accordance with a preferred embodiment of the present invention, a method of data retrieval which includes the steps of: retrieving by a client at least one data object from among a plurality of data objects stored in a data repository; defining an awareness state of the client per retrieved data object; opening communication and observation channels associated with at least one of the data objects wherein the type and number of channels opened with each the client depends on the awareness state of each the client per retrieved data object.

In addition, there is also provided, in accordance with a preferred embodiment of the present invention, a method of data retrieval which includes the steps of: 4 WO 99/57653 PCT/IL99/00239 retrieving by at least two clients at least one data object from among a plurality of data objects stored in a data repository; defining an awareness state of each the client per retrieved data object; for a retrieved data object for one of the clients, indicating to the one client 5 which other clients have retrieved the same data object; and providing a communication channel associated with the retrieved data object to those clients which retrieved the data object and which are in a communication type of awareness state.

Further, in accordance with a preferred embodiment of the present 10 invention, the $tep of opening includes the steps of: generating one virtual place per retrieved data object; associating each virtual place with its data object once its data object is accessed; and generating communication and observation channels to the clients in 15 response to the awareness state of each the client.

Finally, in accordance with a preferred embodiment of the present invention, the awareness state is one of: public observation, private observation and communication. 5 WO 99/57653 PCT/IL99/00239

BRIEF DESCRIPTION OF THE DRAWINGS

The present invention will be understood and appreciated more fully from the following detailed description taken in conjunction with the drawings in which: 5 Fig. 1 is a schematic illustration of a prior art data retrieval system;

Fig. 2 is a schematic illustration of one prior art data retrieval operation; Fig. 3 is a schematic illustration of a data retrieval system with a co-presence server, constructed and operative in accordance with a first preferred embodiment of the present invention; % io Fig. 4 is a schematic illustration of a co-present data retrieval operation;

Fig. 5 is a schematic illustration of an alternative embodiment of a co-present data-retrieval system and its operation; and

Fig. 6 is a schematic illustration of a further alternative embodiment of a co-present data-retrievai system and its operation. 15 6 WO 99/57653 PCT/IL99/00239

DETAILED DESCRIPTION OF PREFERRED EMBODIMENTS

Reference is now made to Figs. 3 and 4 which illustrate the data-retrieval system of the present invention. The system of the present invention typically comprises data server 10 and data repository 14 as in the prior art. It also comprises, in accordance with a preferred embodiment of the present invention, a co-presence server 20 and a multiplicity of co-presence data-retrieval clients 22 each communicating with data server 10, co-presence server 20, and, through the associated display 18, with a user 17.

As in the prior art, each data-retrieval client 22 requests a data object 16 through the data server 10 which retrieves the requested data object 16 from the data repository 14. In addition, in accordance with a preferred embodiment ofthe present invention, at the same time, the co-presence data-retrieval client 22 also informs the co-presence server 20 that it has retrieved a specific data object 16, for example object 16a. In response, the co-presence server 20 adds the data-retrieval client 22 to a virtual place 24 associated with the retrieved data object 16a. Client 22 associates virtual places 24a - 24c with retrieved data objects 16a - 16c.

For the purposes of clarity of discussion, we will state that the co-presence server 20 maintains a virtual place 24 for each data object 16 stored in the data server 10. It will be appreciated that the co-presence server 20 can also create a virtual place 24 on demand, when the first user becomes present at the data object 16, and can remove the virtual place 24 when no one is present.

All users which access a data object 16 via data-retrieval client 22 are added to the virtual place 24 associated with the data object 16 that they 7 WO 99/57653 PCT/IL99/00239 accessed. In addition, co-presence server 20 provides each virtual place 24 with inter-user communication capabilities such that any user which accesses a data object 16 can communicate, if he so desires, with the other users which are currently utilizing the same data object 16. The co-presence server 20 allows a user 17 who is present at a data object 16 to become aware of other co-present users 17 and provides a means for co-present users 17 to communicate with each other in real time. The communication between users 17 can also be client-to-client if communication through the co-presence server 20 is slow.

The co-presence server 20 essentially turns each data object into a virtual place v^ere users 17 can meet to view the data object 16, to modify it, and to discuss it. For example, if a data server 10 contains user manuals for a certain product, then it might be useful for the product's vendor to place a help-desk person at the virtual place, or places, associated with the user manuals. The help-desk person can then assist, in real-time, those users who access the user manuals, if they need additional assistance or have difficulties "finding their way" through the product's documentation.

The co-presence server 20 and the co-presence data-retrieval client 22 follow a co-presence protocol which is illustrated with arrows 31 - 38 of Fig. 4. A user 17 retrieves a data object 16d from a certain data server 10 in accordance with the protocol described in the prior art (arrows 31 - 35, similar to arrows 1 - 5 of Fig. 2). At the same time, the co-presence data-retrieval client 22 sends (arrow 36) a message to virtual place 24d within the co-presence server 20 which is associated with the data object 16d, to the effect that the user has accessed the data object 16d. (Typically, the data objects 16 have well-defined 8 WO 99/57653 PCT/IL99/00239 names on the data server 10. Clients 22 utilize the same or corresponding names to identify the corresponding virtual places 24). The virtual place 24d then adds (step 37) the user to the list of co-present users, and sends a message (arrow 38) to that effect to all co-present users, including to the user which just joined the virtual place 24d.

When a user 17 present at a data object 16 wishes to send a message to selected ones of the co-present users 17, the first user 17 sends a message to that effect, via co-presence data-retrieval client 22 and the co-presence server 20, to the associated virtual place 24 which, in turn, relays the message to the selected users ;17 present at the data object 16.

When a user 17 ceases to be present at a data object 16 (either due to the retrieval of another data object 16 from the same or another data server 10 or due to closure of its co-presence data-retrieval client 22), the co-presence data-retrieval client 22 sends a message (arrow 36) to that effect to the virtual place 24 which, in turn, deletes the user 17 from the list of co-present users. Virtual place 24 then sends a message (arrow 38) to all remaining co-present users 17 notifying them of the event.

The co-presence protocol can be described by the operations performed by the co-presence data-retrieval client 22 and by the co-presence server 20 and virtual place 24. The following pseudocode describes the protocol;

For the client 22 of user U:

Assume user U already has document D1 from server S1. - When user U requests document D2 from server S2; 1. Attempt to retrieve document D2 from server S2; 9 WO 99/57653 PCT/IL99/00239 2. If the retrieval is successful, send the following message to the virtual place P(D1) in co-presence server C(S1) corresponding to document D1: "U left for virtual place D2 in server S2". - When user U requests to say text T: send the message "U said Τ' to the co-presence server C(S2). - Upon receipt of message "User V entered (or left) for (from) virtual place P(Dj) in server Sk": display to user U the current list of users in the virtual place. - Upon receipt of the message "V said Τ': display to user U the message "V said Τ'.

For the virtual place P(Di) on co-presence server C(Si)

Let the set of co-present users be CP: - Upon receipt of message "U left for virtual place P(Dj) in server Sk: 1. Delete user U from the set CP of co-present users 2. Send to every remaining user V in CP the message: "U left for virtual place P(Dj) in server Sk - Upon receipt of the message "U entered from virtual place P(Dj) in server Sk: 1. Add user U to the set CP of co-present users 2. Send to every user V in the set CP of co-present users the message "U entered from virtual place P(Dj) in server Sk. - Upon receipt of message "U said Τ'

Send the message "U said Τ' to every user in the set CP of co-present users, io WO 99/57653 PCT/IL99/00239

The co-presence server 20 can be implemented in any way which provides co-presence. In one embodiment, the co-presence server 20 is implemented as a UNIX process, executing a concurrent programming language called flat concurrent Prolog (FCP). Using an FCP internal light-weight process mechanism, as described in U.S. Patent 5,222,221 to Houri et al. which is hereby incorporated by reference, each virtual place 24 can be implemented as a place process, each formed of a collection of FCP processes. Each FCP process obeys the co-presence protocol described hereinabove.

The co-presence server 20 receives communications on a pre-assigned and published ;port whose identity is incorporated in the co-presence data-retrieval client 22. The co-presence server 20 typically receives messages from the co-presence data-retrieval clients 22 and provides them to the appropriate virtual place 24. In addition, if desired, the managing UNIX process (the co-presence server 20) can also create a featherweight process (virtual place 24) whenever a first user accesses a data object 16 and can remove a process whenever there cease to be users co-present at the relevant virtual place 24.

It will be appreciated that, because communication with the co-presence server 20 is separate from the data-retrieval operations, the data-retrieval system ofthe present invention can operate with standard data-retrieval clients 12 which do not have any co-presence capability.

It will further be appreciated that the system of the present invention can easily be created from an existing prior art data-retrieval system. The upgrading process involves adding a co-presence server 20, as described hereinabove, and 11 WO 99/57653 PCT/IL99/00239 modifying the data-retrieval clients 12 to become co-presence data-retrieval clients 22 through the addition of the following capabilities: a) the ability to open an additional communication channel with the co-presence server 20; 5 b) the ability to map data objects 16 to virtual places 24; c) the ability to display co-presence information; d) the ability to enable users 17 to communicate in real time; and e) the ability to notify the co-presence server 20 when the client 22 is terminated or closed down. io It wj|l be appreciated that data-retrieval clients which have not been upgraded can still operate within the data-retrieval system of Figs. 3 and 4.

Reference is now made to Fig. 5 which illustrates an alternative embodiment of the present invention. In this embodiment, the data-retrieval system comprises the same elements but they are configured in a different 15 manner. Specifically, the data-retrieval system comprises co-presence data-retrieval clients, labeled 40, and a co-presence data-retrieval server 42, as well as data server 10 and data repository 14 as in the prior art.

In this alternative embodiment, the co-presence data-retrieval clients 40 communicate only with the co-presence data-retrieval server 42, providing to it 20 their data retrieval requests, which the server 42, in turn, passes to the data server 10, and their co-presence communication. The co-presence data-retrieval server 42 includes virtual places 44. There can also be many servers 42, each of which handles data retrieval requests for its associated data server 10. 12 WO 99/57653 PCT/IL99/00239

The following is a pseudo code describing the protocol between clients 40 and server 42:

For client 42 of user U:

Assume user currently has document D1 in server S1. - When user requests document D2 from server S2: 1. Send message "U requests to enter from place P(D1) in server S1" to place P(D2) in co-presence server C(S2) 2. If data-retrieval is successful, send the message "U Left for place P(D2) in server S2" to place P(D1) in co-presence server C(S1) - When user U requests to say text T:

Send the message "U said Τ' to the co-presence server C(S2) - Upon receipt of message "V entered (left) for (from) place Dj in server

Si":

Display to the user U the current co-present users in the place P(Dj) - Upon receipt of message "V said Τ':

Display to the user U the message from user V.

For the virtual place P(Di) on co-presence server C(Si)

Let the set of co-present users be CP: - Upon receipt of message "U left for virtual place P(Dj) in server Sk”: 1. Delete user U from the set CP of co-present users 2. Send to every remaining user V in CP the message: "U left for virtual place P(Dj) in server Si" - Upon receipt of the message "U requests to enter from virtual place P(Dj) in server Sk": 13 1. Attempt to retrieve data from data server 10 WO 99/57653 PCT/IL99/00239

<img img-format="tif" img-content="drawing" file="IL139291AD00021.tif" id="idf0001" />

io 15 2. If successful:

a. Send the data to client 42 of user U b. Add user U to the set CP of co-present users c. Send to every user V in the set CP of co-present users the message "U entered from virtual place P(Di) in server Si".

- Upon receipt of message "U said T

Send the message "U said Τ' to every user in the set CP of co-present users.

In th$ previous embodiments, the co-presence data retrieval client placed the user in communication with the other user’s at the data object as soon as the user retrieved to the data object. This is similar to walking into a room and having to talk with everyone before knowing how many and who the people in the room are.

Reference is now made to Fig. 6 which illustrates an alternative embodiment of the present invention in which the user can define an awareness state by which he is aware ofthe people who had requested the same data object 16. Fig. 6 is similar to Fig. 3, and thus, similar reference numerals refer to similar elements, except that the data retrieval clients are awareness data retrieval clients 20 50 which have two, mutually exclusive, states 52 of awareness associated therewith. Fig. 6 shows two clients 50a and 50b which, respectively, have the states of observation (52a) and communication (52b) associated therewith with respect to the same data object. If desired, the state of observation can be defined as either public or private. 14 WO 99/57653 PCT/IL99/00239

If the user is defined as in the communication state, the co-presence system operates as described hereinabove wherein a message is sent to all other users when a new user requests the same data object. The new user joins the associated virtual place 24 and the communication channel is opened to that user. The new user can then send and receive messages with the other users who are in the communication state.

In the observation state, an observation channel, but no communication channel, is opened in which the user receives an indication of (i.e. is aware of) how many and which people are at the virtual place. When new people retrieve the same data; object, the indication is updated. The indication only includes information regarding public observers; private observers will receive the indication and its update but are not listed therein.

Although not shown in Fig. 6, at any time the user can define in his client a list of data objects of interest. Associated with each data object is an awareness state. Thus, the user can have multiple channels, some for communications and some for observation. For each, the user will be aware of any change regarding the users associated with these data objects.

For both states, a list of who is currently publicly at the virtual place, and in which state, can be retrieved. Typically, the identification is by email address or by some other name.

In this embodiment, when the user requests a data object, the client 50 sends his request to the data server 10 which retrieves the object and returns it to the client 50. Client 50 also sends a message to the associated virtual place 24 within the co-presence server 20 which is associated with the retrieved data object 15 WO 99/57653 PCT/IL99/00239 16, to the effect that the user has accessed the data object 16. For this embodiment, the message includes the awareness state 52 of the user, for that data object 16. The virtual place 24 then adds the user, and its awareness state, to the list of co-present users. For client 50b, whose awareness state 52b is that 5 of communication, the virtual place 24 opens a communication channel 54, shown in solid lines, thereto.

For client 50a, the virtual place 24 opens an observation channel 56 and sends along it the number and/or the list of names of the users at the virtual place 24 which are communicating and the number and/or the list of names of the users io which are publicly observing. At any time, the user can redefine his awareness state for that data object and the virtual place at which he is present will change the channel (communication or observation) accordingly.

At any time, a user can request a list of users currently at the virtual place along with an indication of their awareness state. With this information, a 15 user can ‘scope out’ the virtual place before deciding to begin communication.

It will be appreciated by persons skilled in the art that the present invention is not limited to what has been particularly shown and described hereinabove. Rather the scope of the present invention is defined by the claims which follow: 16