System and method for passive decoding of social network activity using replica database

SYSTEM AND METHOD FOR PASSIVE DECODING OF SOCIAL NETWORK

ACTIVITY USING REPLICA DATABASE

FIELD OF THE DISCLOSURE

The present disclosure relates generally to Web intelligence, and particularly to methods and systems for analyzing social network activity.

BACKGROUND OF THE DISCLOSURE

In recent years, social networks such as Facebook, Twitter, Linkedln, YouTube and others have become a popular scene for interaction between network users. These social networks accumulate large amounts of information regarding the users and the interactions between them. As such, social networks can be used for obtaining valuable information regarding target users.

U.S. patent application publication 2012/0124202 describes a method, system, and computer program product for identifying and tracking social identities.

patent a method patent systems application publication 2002/0116512 of surveilling internet communication, application and methods publication 2010/0235489 for determining electronic

U.S.

describes

U.S.

describes relationships .

U.S. patent describes systems application publication 2 and methods for web decoding.

SUMMARY OF THE DISCLOSURE

An embodiment that is described herein provides a method including monitoring communication between one or more users of a communication network and one or more servers of a social network that maintains a user profile database. A replica database is constructed based on the monitored communication. The replica database replicates a portion of the user profile database relating to one or more predefined target users. Activity of a target user in the social network is reconstructed using the monitored communication and the replica database.

In some embodiments, constructing the replica database includes establishing a correlation between first and second information objects extracted from the monitored communication, and reconstructing the activity includes deducing the activity of the target user from

1011-1077S3 the correlation. Establishing the correlation may include correlating a page of the social network with a response made to an element of the page. Additionally or alternatively, establishing the correlation may include correlating first and second objects posted at different times on a page of the social network.

In an embodiment, reconstructing the activity includes reconstructing one or more sessions conducted by the target user in the social network. In another embodiment, reconstructing the activity includes reconstructing one or more links of the target user with respective other users of the social network. In a disclosed embodiment, monitoring the communication includes passively receiving the communication without affecting the communication network or the social network.

In some embodiments, reconstructing the activity includes detecting an event related to the activity of the target user in the social network, and outputting an indication of the event. Detecting the event may include detecting, using the replica database, that the target user deleted a contact from his list of contacts. In another embodiment, detecting the event may include detecting, using the replica database, a new comment that is added to a given information object.

There is additionally provided, in accordance with an embodiment that is described herein, apparatus including a network interface and a processing unit. The network interface is configured to monitor communication between one or more users of a communication network and one or more servers of a social network that maintains a user profile database. The processing unit is configured

1011-1077S3 to construct, based on the monitored communication, a replica database that replicates a portion of the user profile database relating to one or more predefined target users, and to reconstruct activity of a target user in the social network using the monitored communication and the replica database.

The present disclosure will be more fully understood from the following detailed description of the embodiments thereof, taken together with the drawings in which:

BRIEF DESCRIPTION OF THE DRAWINGS

Fig.

is a block diagram that schematically illustrates a system for decoding social network activity, rn accordance with an embodiment that is described herein;

Fig.

is a diagram showing an example model of data extracted from social networks, rn accordance with an embodiment that is described herein;

and

Fig.

is a flow chart that schematically illustrates a method for decoding social network communication, in accordance with an embodiment that is described herein.

DETAILED DESCRIPTION OF EMBODIMENTS

OVERVIEW

Embodiments that are described herein provide improved methods and systems for obtaining valuable information regarding target users from social networks. The disclosed methods and systems can be used, for example, for reconstructing activities of target users in social networks, such as for decoding and displaying social network sessions held by a target user, or

1011-1077S3 identifying other users who are associated with the target user. This analysis is typically carried out based on passive monitoring of network traffic.

Communication traffic in a social network has unique characteristics that present a challenge to information gathering and analysis. For example, the time scale over which monitoring and analysis should be performed is often large. The correlation between communication interactions of a given target user may be loose and hard to establish based on the communication traffic alone.

Consider, for example, a scenario in which a target user browses a certain social network page. At a later point in time, possibly days after the initial browsing, the target user comments on a certain event or responds to some component of the same social network page. Even if the communication traffic of both interactions intercepted in full, it is extremely difficult to correlate them and reconstruct the complete session of the target individual with the page, because of the large time gap between the interactions.

In some embodiments that are described herein, a social network decoding system overcomes these challenges by constructing and maintaining a replica database, which mimics a portion of the user profile database maintained by the social network servers. Typically, the social network servers maintain a database of user profiles, which stores information such as the users' pages, personal information, communication interactions, and/or association with other users (sometimes nicknamed friends, contacts, links, connections or followers).

1011-1077S3

The social network decoding system monitors network traffic between users and social network servers. Based on the monitored traffic, the system gradually constructs a replica database that attempts to replicate a portion of the social network user profile database, relating to one or more predefined target users.

Using the replica database, the system is able to correlate loosely-coupled information objects, events and interactions between the target users and social network pages. Using this correlation, the system can later reconstruct activities of target users in the social network. The reconstructed target user activity can be used, for example, for decoding and displaying entire sessions held by target users in the social network, or for identifying other users who are connected to the target users. The system is typically passive, i.e., carries out the activity reconstruction processes based on passive monitoring of network traffic without intervening or affecting the communication network or the social network in any way.

In other words, the disclosed techniques establish correlations between information objects of social network pages (e.g., posts, comments, contact lists or images). Such correlations are hard to establish when the information objects are obtained by passive traffic monitoring and not by actively accessing the social network Web site. In the disclosed embodiments, correlations between such objects are found using the replica database, as will be explained below. The established correlations can then be used to track the social network activities of target users.

1011-1077S3

It is possible in principle to track the activities of target users in a social network using active, open source intelligence techniques that collect information directly from the social network site. The passive, interception-based techniques described herein have distinct advantages over active open source techniques. For example, the disclosed techniques enable law enforcement agencies to show the exact time at which a target user saw or wrote specific information.

As another example, the disclosed techniques are able to access social network pages that are defined as private, as well as user groups or forums that are defined as private.

Such private information is not accessible to active open source techniques. As yet another example, the disclosed techniques are unaffected by target users who use aliases instead of real names to hide their social network activities.

SYSTEM DESCRIPTION

Fig. 1 is a block diagram that schematically illustrates a system 20 for decoding social network activity, in accordance with an embodiment that is described herein. System 20 monitors network communication traffic in a passive manner, and reconstructs social network activities and contacts of target users using techniques that are described below. The reconstructed social network activities are presented to an operator 24. Systems of this sort may be used, for example, by government and law enforcement agencies.

System 20 is connected to a communication network 28, typically the Internet, for monitoring communication traffic that is exchanged over the network. In

1011-1077S3 particular, system 20 monitors traffic that is exchanged between network users 32 and servers 36 of a social network. The social network in question may comprise, for example, Facebook, Twitter, Linkedln, Googlet, YouTube, or any other suitable social network application.

Typically, the social network servers maintain a user profile database 40. For each user of the social network, database 40 stores information such as the user pages, personal information, communication interactions of the user, a list of contacts (sometimes nicknamed friends, links rr \\ r of the user with other users, sent and received contact requests, user preferences, user location, images, affiliation of the user with affiliation groups, updates or modifications performed in the user profile over time, interactions of the user with various social network pages and/or any other suitable information.

In the example configuration of Fig. 1, system 20 comprises an interface 44 for monitoring the network traffic, and a processing unit 48 that carries out the disclosed techniques. Interface 44 may comprise, for example, a passive network probe that intercepts traffic from network 28. Interface 44 typically also applies some filtering to the monitored traffic, e.g., retains only the traffic related to the social network, to certain target users, to certain servers, and/or to certain IP addresses. The traffic that is intercepted by interface

44, typically Internet Protocol (IP) packets, is provided to unit 48 for processing.

Processing unit 48 comprises one or more decoders 52 that extract and decode various content elements from the monitored traffic. When a user browses a social network

1011-1077S3 page, for example, then entire content of the page is transferred over the network. Decoders 52 decode the page content elements. When a user responds or comments on a certain element of a social network page, decoders 52 identify and decode this response.

In an example implementation, decoders 52 break the Web pages into individual objects such as posts, comments, contact lists, images and other suitable object types. Every object in a page is assigned an 'object ID', which is associated with the 'user ID' of both the user who posted the object and the user on whose page the object was posted. When an object on a page relates to another object on the page, such as a comment to another post, the object ID is also associated with the object Id of the object to which it relates. Typically, the object IDs used by decoders 52 are the same object IDs used by the social network servers.

Processing unit 48 comprises a replica database 56, which aims to replicate a portion of user profile database 40 of the social network. Typically, database 40 is not accessible to system 20, and it is only available for internal use by servers 36 of the social network. Thus, processing unit attempts to replicate a portion of database 40 that relates to a predefined list of target users of interest.

For each target user, replica database 56 stores similar content as database 40 for each target user, e.g., user pages, personal information, communication interactions of the user, a list of contacts of the user with other users, sent and received contact requests, user preferences, user location, images, affiliation of the user with affiliation groups, updates or 8

1011-1077S3 modifications performed in the user profile over time, interactions of the target user with various social network pages (e.g., LIKEs and addition of content to pages), and/or any other suitable information.

Processing unit 48 constructs and maintains replica database 56 based on the monitored network traffic. For example, when a target user browses a certain social network page, the page content is transferred over network the traffic that carries the page, decoders 52 decode the page and processing unit 48 stores the page in replica database

56. When the target user later comments on a certain component of this page, the comment is intercepted and decoded by interface 44 and decoders 52, and processing unit 48 stores this comment in the replica database.

As explained above, decoders 52 break the page into individual information objects. Each object has a unique object ID (which is typically the same ID used by social network servers 36) . For each object, unit 48 stores in the replica database a list of identifiers of the user who placed the object, the user on whose wall the object was placed, object IDs of related objects, and other related information such the time and date at which the object was placed, the time and date at which the object was intercepted, location information, IP address of the users, and/or any other suitable information.

Processing unit 48 finds correlations between objects based on the information stored in the replica database, such as the object IDs and user IDs. The correlation between object IDs enables, for example, tracking the sequence of comments to a given information object. Correlation between user IDs, for example,

1011-1077S3 provides information about communication between users. Cross correlating the communication sequence and links between users provides information about the strength of the relationship between the users.

The process of updating the replica database by unit 48 continues over time and resembles the process of updating database 40 by servers 36. Gradually, replica database becomes a reliable replica of the relevant portion of database

40. Using this process, processing

Replica overcomes database magnitude smaller its inability to is typically access database 40.

several orders of than database 40, since it stores information that is focused on a list of target users only a fraction of the total user population of the social network.

In some embodiments, replica database 56 holds the stored information for a relatively long but limited period of time, e.g., between one and four weeks. This time period may be set to the same order of magnitude as the time period of user browser caching. The rationale is that if the user browser does not cache certain information, then it will have to download the full page again, in which case the new download transaction will be intercepted.

Processing unit 48 further comprises a product database 60, which stores information products that are produced by processing unit 48 using replica database 56. Products may comprise, for example, reconstructed sessions of a target user in the social network, identified links of a target user with other users, and/or any other suitable product that can provide valuable information to operator 24. For example, processing unit 48 may reconstruct the wall story of a

221,176/2 target user regardless of the long period of time over which the wall story was created.

In some cases, the communication traffic monitored by system

0 is encrypted, for example using an encryption protocol such as

Secure Socket Layer (SSL) or

Transport

Layer Security (TLS). In some embodiments, processing the encryption protocol using

Man-In-The-Middle (MITM) techniques in order to enable processing in accordance with the disclosed techniques.

MITM techniques are described, for example, in U.S.

entitled System and method for selective inspection of encrypted traffic, filed April 13, 2012, which is assigned to the assignee of the present patent application .

The system configuration of system shown in Fig.

is an example configuration, which is chosen purely for the sake of conceptual clarity .

In alternative embodiments, any other suitable system configuration can also be used. For example, system 20 may monitor traffic of more than one social network (e.g., both Facebook and

Twitter), construct respective replica databases for the monitored social networks, and extract and correlate information regarding target users who are active in the different social networks.

The elements of system

20, such as processing unit

48, may be implemented in hardware, in software, or using a combination of hardware and software elements. Databases 56 and 60 may be implemented using any suitable storage devices, such as solid state or magnetic disks. In some embodiments, certain functions of system 20 can

1011-1077S3 be implemented using one or more general-purpose processors, which are programmed in software to carry out the functions described herein. The software may be downloaded to the processors in electronic form, over a network, for example, or it may, alternatively or additionally, be provided and/or stored on non-transitory tangible media, such as magnetic, optical, or electronic memory.

SOCIAL NETWORK DECODING USING REPLICA

Fig. 2 is a diagram showing an example

DATABASE model of data extracted from social networks, in accordance with an embodiment that is described herein.

Data models of this sort can be constructed by system 20 in replica database

56. As explained above, the data model represents correlations between information objects of social network pages that are established by system 20. The example of Fig. 2 shows several Facebook target users (FB123, target user (TT123) . At least some of the users are associated with respective profiles and possibly profile updates .

The information regarding target user

FB999 comprrses the target user's contact list (999

CONTACT are connected indicates that target users to FB999. Similarly, the contact list of target user FB123 indicates that and

FB999 are connected to

FB123.

The data model also comprrses the wall story of a target user FB111, and indicates that target user

FB999 responded with a LIKE to this wall story, and that target user FB123 is connected to this wall story.

1011-1077S3

The data model also indicates that, based on monitored chat content over the social network, target users FB123, FB789 and FB456 are connected to one another since they interact via this chat.

Fig. 3 is a flow chart that schematically illustrates a method for decoding social network communication, in accordance with an embodiment that is described herein. The method begins with interface 44 of system 20 monitoring traffic communication between users 32 and social network severs 36 over network 28, at a monitoring step 70.

Processing unit 48 constructs replica database 56, at a replica construction step 74. The replica database imitates the portion of user profile database 40 of the social network that is related to one or more predefined target users .

Based on the replica database, processing unit 48 reconstructs sessions of target users in the social network, at a session reconstruction step 78. Additionally or alternatively, processing unit 48 uses the replica database to reconstruct links or contacts of the target users with one another and/or with other users, at a link analysis step 82.

Certain events related to the reconstructed sessions or links may have considerable value for operator 24. In some embodiments, processing unit 48 detects such events and alerts the operator accordingly. For example, deletion of a contact from a target user's may comprise a strong indication of an attempt to hide an illegitimate activity or association. As another example, processing unit 48 may generate an alert upon detecting a new comment that is added to an information object (e.g.,

221,176/2 post) that was previously marked by operator 24 (e.g., analyst). Assume, for example, that a suspect target user wrote a post about a certain location. The analyst that reviews the intercepted traffic marks this post. If one of the suspect's contacts comment about this post, unit 48 detects the new comment and alerts the analyst.

Although the embodiments described herein mainly address gathering information on target users, the principles of the present disclosure can also be used for other purposes. For example, financial institutions and other enterprises are required by regulatory bodies to log all external communication of employees, and store the communication for several years. This information can be used later in case of investigation or commercial dispute. Solutions of this sort are offered, for example, by Actiance, Inc. (Belmont, California) and Dell SonicWall (San Jose, California). The disclosed techniques can be used for analyzing such information.

It will thus be appreciated that the embodiments described above are cited by way of example, and that the present disclosure is not limited to what has been particularly shown and described hereinabove. Rather, the scope of the present disclosure includes both combinations and sub-combinations of the various features described hereinabove, as well as variations and modifications thereof which would occur to persons skilled in the art upon reading the foregoing description and which are not disclosed in the prior art.