Method and apparatus for recommending entity

CROSS-REFERENCE TO RELATED APPLICATIONS

This application is related to and claims priority from Chinese patent application no. <patcit id="pcit0001" dnum="CN201810317390"><text>201810317390.3</text></patcit>, filed with the State Intellectual Property Office of the People's Republic of China (SIPO) on April 10, 2018, the entire disclosure of the Chinese application is hereby incorporated by reference.

TECHNICAL FIELD

Embodiments of the present disclosure relate to the field of the Internet, specifically relate to the search field, and more specifically relate to a method and apparatus for recommending entity.

BACKGROUND

Entity recommendation is defined as a series of operations to provide entity suggestions to users, and to help the users to discover information they are interested in.

In the prior art, entity recommendation is usually performed by using a collaborative filtering approach. The collaborative filtering algorithm discovers the user's preferences by mines the user's historical behavior data, divides users based on different preferences, finds (interested) users similar to the specified user in the user group, summarizes comments on certain information by these similar users, and forms a system's preference prediction for the specified user for this information.

SUMMARY

Embodiments of the present disclosure provides a method and apparatus for recommending entity.

In a first aspect, the embodiments of the present disclosure provides a method for recommending entity, including: acquiring a candidate entity set associated with a to-be-searched entity, in response to receiving a user's search request for an entity; inputting the candidate entity set into a pre-trained ranking model to obtain a candidate entity sequence; and selecting a candidate entity from the candidate entity sequence and recommending the selected candidate entity to the user. The ranking model ranks the candidate entity set based on at least one of: a degree of correlation between each candidate entity in the candidate entity set and the to-be-searched entity; a degree of interest of the user in the each candidate entity in the candidate entity set; and a degree of expectation of the user for the each candidate entity in the candidate entity set.

In some embodiments, the acquiring a candidate entity set associated with a to-be-searched entity further includes: adding a candidate entity to the candidate entity set, in response to an existence of an association between the candidate entity and the to-be-searched entity in a preset knowledge graph.

In some embodiments, the acquiring a candidate entity set associated with a to-be-searched entity further includes: adding a candidate entity to the candidate entity set, in response to a number of co-occurrences of the candidate entity and the to-be-searched entity in a search session history exceeding a preset first threshold.

In some embodiments, the acquiring a candidate entity set associated with a to-be-searched entity further includes: determining an entity having a co-occurrence relationship with the to-be-searched entity in a preset corpus as a co-occurrence candidate entity; and adding a co-occurrence candidate entity having a degree of correlation with the to-be-searched entity exceeding a preset second threshold to the candidate entity set.

In some embodiments, the ranking model is obtained by training through the following steps: generating a training sample set, each training sample in the training sample set including a triplet and a click behavior tag, the triplet including a user identification, a first entity, and a second entity, and the click behavior tag being used to indicate whether the user clicked on the second entity in a search result obtained by searching the first entity; generating a feature vector of a training sample, for each training sample in the generated training sample set; inputting the training sample set and the generated feature vector into a pre-established gradient boosting decision tree model, and training the gradient boosting decision tree model based on a stochastic gradient descent algorithm; and generating the ranking model, in response to a minimum cross-entropy loss function. The feature vector includes a feature value for indicating at least one of: a degree of correlation between the first entity and the second entity in the triplet; a degree of interest of the user of the triplet in the second entity in the triplet; and a degree of expectation of the user of the triplet for the second entity in the triplet.

In some embodiments, a component for indicating the degree of correlation between the first entity and the second entity in the triplet includes at least one of: a degree of correlation of the first entity and the second entity in the triplet in a preset knowledge graph; a degree of co-occurrence of the first entity and the second entity in the triplet in a search session history; a degree of co-occurrence of the first entity and the second entity in the triplet in a preset corpus; and a subject similarity between the first entity and the second entity in the triplet.

In some embodiments, the feature value for indicating the degree of interest of the user of the triplet in the second entity in the triplet includes at least one of: a click rate of the second entity in the triplet; a click rate of a subject category to which the second entity belongs in a preset classification table; and a semantic similarity between the first entity and the second entity in the triplet.

In some embodiments, the feature value for indicating the degree of expectation of the user of the triplet for the second entity in the triplet includes at least one of: a familiarity of relationship of the user and/or the first entity to the second entity determined based on historical click data of the user in the triplet; a degree of surprise of the second entity relative to the user and/or the first entity in the triplet; and a click diversity of the first entity in the triplet.

In a second aspect, the embodiments of the present disclosure provides an apparatus for recommending entity, including: an acquisition unit, configured to acquire a candidate entity set associated with a to-be-searched entity, in response to receiving a user's search request for an entity; a rank unit, configured to input the candidate entity set into a pre-trained ranking model to obtain a candidate entity sequence; and a recommendation unit, configured to select a candidate entity from the candidate entity sequence and recommend the selected candidate entity to the user. The ranldng model ranks the candidate entity set based on at least one of: a degree of correlation between each candidate entity in the candidate entity set and the to-be-searched entity; a degree of interest of the user in the each candidate entity in the candidate entity set; and a degree of expectation of the user for the each candidate entity in the candidate entity set.

In some embodiments, when acquiring a candidate entity set associated with a to-be-searched entity, the acquisition unit is further configured to: add a candidate entity to the candidate entity set, in response to an existence of an association between the candidate entity and the to-be-searched entity in a preset knowledge graph.

In some embodiments, when acquiring a candidate entity set associated with a to-be-searched entity, the acquisition unit is further configured to: add a candidate entity to the candidate entity set, in response to a number of co-occurrences of the candidate entity and the to-be-searched entity in a search session history exceeding a preset first threshold.

In some embodiments, when acquiring a candidate entity set associated with a to-be-searched entity, the acquisition unit is further configured to: determine an entity having a co-occurrence relationship with the to-be-searched entity in a preset corpus as a co-occurrence candidate entity; and add a co-occurrence candidate entity having a degree of correlation with the to-be-searched entity exceeding a preset second threshold to the candidate entity set.

In some embodiments, the apparatus further includes a training unit, wherein the training unit is configured to train the ranking model. The training unit includes: a training sample generation module, configured to generate a training sample set, each training sample in the training sample set including a triplet and a click behavior tag, the triplet including a user identification, a first entity, and a second entity, and the click behavior tag being used to indicate whether the user clicked on the second entity in a search result obtained by searching the first entity; a feature vector generation module, configured to generate a feature vector of a training sample, for each training sample in the generated training sample set; an iteration training module, configured to input the training sample set and the generated feature vector into a pre-established gradient boosting decision tree model, and train the gradient boosting decision tree model based on a stochastic gradient descent algorithm; and a generation unit, configured to generate the ranking model, in response to a minimum cross-entropy loss function. The feature vector includes a feature value for indicating at least one of: a degree of correlation between the first entity and the second entity in the triplet; a degree of interest of the user of the triplet in the second entity in the triplet; and a degree of expectation of the user of the triplet for the second entity in the triplet.

In some embodiments, a component for indicating the degree of correlation between the first entity and the second entity in the triplet includes at least one of: a degree of correlation of the first entity and the second entity in the triplet in a preset knowledge graph; a degree of co-occurrence of the first entity and the second entity in the triplet in a search session history; a degree of co-occurrence of the first entity and the second entity in the triplet in a preset corpus; and a subject similarity between the first entity and the second entity in the triplet.

In some embodiments, the feature value for indicating the degree of interest of the user of the triplet in the second entity in the triplet includes at least one of: a click rate of the second entity in the triplet; a click rate of a subject category to which the second entity belongs in a preset classification table; and a semantic similarity between the first entity and the second entity in the triplet.

In some embodiments, the feature value for indicating the degree of expectation of the user of the triplet for the second entity in the triplet includes at least one of: a familiarity of relationship of the user and/or the first entity to the second entity determined based on historical click data of the user in the triplet; a degree of surprise of the second entity relative to the user and/or the first entity in the triplet; and a click diversity of the first entity in the triplet.

In a third aspect, the embodiments of the present disclosure further provides a device, including: one or more processors; and a storage apparatus, to store one or more programs, and when the one or more programs being executed by the one or more processors, cause the one or more processors to execute the method as provided in the first aspect.

In a fourth aspect, the embodiments of the present disclosure further provides a non-transitory computer-readable storage medium, storing a computer program thereon, the computer program, when executed by a processor, executes the method as provided in the first aspect.

The method and apparatus for recommending entity provided by the embodiments of the present disclosure acquire a candidate entity set associated with a to-be-searched entity in a preset entity set, in response to receiving a user's search request for an entity; then input the candidate entity set into a pre-trained ranking model to obtain a candidate entity sequence; and finally select a candidate entity from the candidate entity sequence and recommend the selected candidate entity to the user. In addition, since the ranking model ranks the candidate entity set based on at least one of the degree of correlation between each candidate entity in the candidate entity set and the to-be-searched entity, the degree of interest of the user in the each candidate entity in the candidate entity set, and the degree of expectation of the user for the each candidate entity in the candidate entity set, a more relevant, individualized, surprising, and diversified entity recommendation for the user and/or the to-be-searched entity is achieved.

In addition, in the method and apparatus for recommending entity of some of the embodiments of the present disclosure, since the candidate entity set includes the entity that has an association with the to-be-searched entity in the preset knowledge graph, the entity that has a number of co-occurrences with the to-be-searched entity in the search session history exceeding the preset first threshold and the entity that has the degree of correlation with the to-be-searched entity in the preset corpus exceeding the preset degree of correlation threshold, and the entities that are included in the candidate entity set are considered from three aspects of the degree of interest and the degree of expectation of the user, and the degree of correlation between the entities, it achieves the correlation between the various elements in the candidate entity set and the search request in different dimensions.

BRIEF DESCRIPTION OF THE DRAWINGS

After reading detailed descriptions of non-limiting embodiments with reference to the following accompanying drawings, other features, objectives and advantages of the present disclosure will be more apparent: <ul id="ul0001" list-style="none"><li><figref idref="f0001">Fig. 1</figref> is an exemplary system architecture diagram in which the present disclosure may be applied;</li><li><figref idref="f0002">Fig. 2</figref> is a flowchart of an embodiment of a method for recommending entity according to the present disclosure;</li><li><figref idref="f0003">Fig. 3</figref> is a schematic diagram of a knowledge graph;</li><li><figref idref="f0004">Fig. 4</figref> is a schematic diagram of an application scenario of the method for recommending entity according to the present disclosure;</li><li><figref idref="f0005">Fig. 5</figref> is a flowchart of another embodiment of the method for recommending entity according to the present disclosure;</li><li><figref idref="f0006">Fig. 6</figref> is a structural diagram of an embodiment of an apparatus for recommending entity according to the present disclosure; and</li><li><figref idref="f0006">Fig. 7</figref> is a schematic structural diagram of a computer system adapted to execute a server of embodiments of the present disclosure.</li></ul>

DETAILED DESCRIPTION OF EMBODIMENTS

The present application will be further described below in detail in combination with the accompanying drawings and the embodiments. It should be appreciated that the specific embodiments described herein are merely used for explaining the relevant disclosure, rather than limiting the disclosure. In addition, it should be noted that, for the ease of description, only the parts related to the relevant disclosure are shown in the accompanying drawings.

It should also be noted that the embodiments in the present application and the features in the embodiments may be combined with each other on a non-conflict basis. The present application will be described below in detail with reference to the accompanying drawings and in combination with the embodiments.

<figref idref="f0001">Fig. 1</figref> shows an illustrative architecture of a system 100 which may be used by a method for recommending entity or an apparatus for recommending entity according to the embodiments of the present application.

As shown in <figref idref="f0001">FIG. 1</figref>, the system architecture 100 may include terminal devices 101, 102 and 103, a network 104 and a server 105. The network 104 serves as a medium providing a communication link between the terminal devices 101, 102 and 103 and the server 105. The network 104 may include various types of connections, such as wired or wireless transmission links, or optical fibers.

The terminal devices 101, 102, 103 may be hardware or software. When the terminal devices 101, 102, 103 are hardware, they may be various electronic devices having displays and supporting search services, including but not limited to, smart phones, tablet computers, e-book readers, laptop portable computers, and desktop computers, etc. When the terminal devices 101, 102, 103 are software, they may be installed in the electronic devices listed above. The terminal devices may be executed as multiple software or software modules (e.g., multiple software or software modules used to provide distributed services), or as a single software or software module. The present disclosure does not impose any specific limitations thereof.

The server 105 may be a server that provides various services, such as a backend processing server that provides support for a search request sent by a user using the terminal devices 101, 102, 103. The backend processing server may perform analysis and other processing on the received data such as the search request, and feed back the processing result (for example, a search engine results page containing entity recommendation content) to the terminal device.

It needs to be noted that the method for recommending entity provided by the embodiments of the present disclosure is generally executed by the server 105. Accordingly, the apparatus for recommending entity is generally provided in the server 105.

It should be understood that the numbers of the terminal devices 101, 102, 103, the network 104 and the server 105 in <figref idref="f0001">Fig. 1</figref> are merely illustrative. Any number of terminal devices, networks and servers may be provided based on the actual requirements.

With further reference to <figref idref="f0002">Fig. 2</figref>, a flow 200 of an embodiment of the method for recommending entity according to the present disclosure is shown. The method for recommending entity includes the following steps:

Step 210, acquiring a candidate entity set associated with a to-be-searched entity, in response to receiving a user's search request for an entity.

In the present embodiment, the executive body of the method for recommending entity (e.g., the server 105 shown in <figref idref="f0005">Fig. 5</figref>) may acquire a candidate entity set associated with a to-be-searched entity, in response to receiving a user's search request for an entity.

Here, the user may use any electronic device (for example, the terminal devices 101, 102, and 103 shown in <figref idref="f0001">Fig. 1</figref>) capable of communicating with the executive body of the method for recommending entity in this embodiment via wired or wireless communication to send a search request to the executive body.

In addition, in the present embodiment, candidate entities in the candidate entity set may be entities having any feasible association with the to-be-searched entity. Here, the association may be a direct association between two entities (for example, an association in a knowledge graph), and/or an indirect association established between two entities by a search session history or a preset corpus. For example, two entities that have been searched in succession by the same user in a short period of time maybe candidate entities for each other. In the encyclopedia corpus, two entities that appear in the same article may also be candidate entities for each other. Taking a search session history as an example, if a user A searches for the entity eq and the entity ec in succession in a short period of time in the searching process, then, when another user B searches for the entity eq, it may be considered that the entity ec is a candidate entity of the entity eq. Therefore, ec may be determined as an element in the candidate entity set in these application scenarios.

Step 220, inputting the candidate entity set into a pre-trained ranking model to obtain a candidate entity sequence.

In the present embodiment, the ranking model may rank the candidate entity set based on at least one of the following: a degree of correlation between each candidate entity in the candidate entity set and the to-be-searched entity; a degree of interest of the user in the each candidate entity in the candidate entity set; and a degree of expectation of the user for the each candidate entity in the candidate entity set.

Here, the degree of correlation between each candidate entity and the to-be-searched entity may be understood as the degree of association between the candidate entity and the to-be-searched entity. The degree of correlation between the candidate entity and the to-be-searched entity may be the degree of similarity between the two entities in the aspects of specific content, subject abstraction, and the like, and/or may also be the degree of correlation of some indicators such as the association or co-occurrence of the two entities in the aspects of knowledge graph, search session history, preset corpus and the like.

The degree of interest of the user in the each candidate entity in the candidate entity set may be understood as the degree that used to characterize how the user initiating the search request is interested in the candidate entity. The most direct method is to analyze the historical behavior data of the user who initiates the search request, and measure the user's interest in the candidate entity by counting the click rate (clicks/presentations) to the candidate entity. It may also be possible to indirectly measure the degree of interest of the user in the candidate entity by generalizing the user's behavior of whether click to the semantic similarity calculation through a neural network model.

The degree of expectation of the user for the each candidate entity in the candidate entity set may be understood as the degree that used to characterize how the user initiating the search request expects for a certain candidate entity appearing in the search result. Alternatively, it may be obtained based on the subject similarity between the historical behavior data of the user who initiates the search request and the candidate entity. For example, for a candidate entity that the user often clicks on, it will be considered that the user is more familiar with this entity and has higher expectation for the entity.

Here, the pre-trained ranking model may score the priority of each candidate entity in the candidate entity set inputted therein through a series of calculations, and obtain a candidate entity sequence based on the determined priority ranking.

For example, the pre-trained ranking model may be any ranking model in the LTR (Learning to Rank) framework. The LTR framework may train labeled training data and features extracted from it, for a specific optimization objective and through a specific optimization method, so that the obtained ranking model after training may score the priority of the inputted candidate entities, and may further perform ranking.

In some application scenarios, the priority determined by the ranking model may be a qualitative description of the candidate entities in the candidate entity set. In these application scenarios, the ranking model may divide the candidate entities in the candidate entity set according to a priority ranking, thereby obtaining the candidate entity sequence.

For example, if the ranking model ranks the candidate entities in the candidate entity set based on the degree of correlation between each candidate entity in the candidate entity set and the to-be-searched entity, the ranking model may analyze various historical behavior data of each user for each candidate entity, to classify each candidate entity in the candidate entity set into classes such as a strong correlation, a medium-strong correlation, a medium correlation, a medium-weak correlation, a weak correlation, and no correlation according to the degree of correlation between each candidate entity and the to-be-searched entity.

Similarly, if the ranking model ranks the candidate entities in the candidate entity set based on the degree of interest of the user in the each candidate entity in the candidate entity set, the ranking model may analyze various historical click data of the user who initiates the search request, to classify each candidate entity in the candidate entity set into classes such as high interest, medium-high interest, medium interest, medium-low interest, low interest, and no interest according to the degree of interest of the user who initiates the search request.

Similarly, if the ranking model ranks the candidate entities in the candidate entity set based on the degree of correlation between each candidate entity in the candidate entity set and the to-be-searched entity and the degree of interest of the user in the each candidate entity in the candidate entity set at the same time, the ranking model may first respectively determine the degree of correlation between each candidate entity in the candidate entity set and the to-be-searched entity and the degree of interest of the user who initiates the search request in the each candidate entity in the candidate entity set, and then rank the degree of interest of the user who initiates the search request. For example, if it is desired to pay more attention to the degree of interest of the user who initiates the search request in the candidate entity rather than the degree of correlation between the candidate entity and the to-be-searched entity, then the candidate entity sequence after ranking by the ranking model may be ranked according to the following rank order: high interest and strong correlation, high interest and medium-strong correlation, high interest and medium correlation, high interest and weak correlation, high interest and no correlation, high-medium interest and strong correlation, high-medium interest and medium-strong correlation, high-medium interest and medium correlation, high-medium interest and weak correlation, high-medium interest and no correlation, medium interest and strong correlation, medium interest and medium-strong correlation, medium interest and medium correlation, medium interest and weak correlation, medium interest and no correlation, medium-low interest and strong correlation, medium-low interest and medium-strong correlation, medium-low interest and medium correlation, medium-low interest and weak correlation, medium-low interest and no correlation, low interest and strong correlation, low interest and medium-strong correlation, low interest and medium correlation, low interest and weak correlation, low interest and no correlation, no interest and strong correlation, no interest and medium-strong correlation, no interest and medium correlation, no interest and weak correlation, and no interest and no correlation.

In some other application scenarios, the priority determined by the ranking model may be a quantitative description of the candidate entities in the candidate entity set. In these application scenarios, the ranking model may quantify and score each candidate entity in the candidate entity set according to a certain algorithm, thereby obtaining the candidate entity sequence.

In these application scenarios, if the ranking model ranks the candidate entities in the candidate entity set based on the degree of correlation between each candidate entity in the candidate entity set and the to-be-searched entity, the ranking model may operate on various historical click data of the user for each candidate entity based on a preset algorithm, to calculate the degree of correlation score of each candidate entity in the candidate entity set.

Similarly, if the ranking model ranks the candidate entities in the candidate entity set based on the degree of interest of the user in the each candidate entity in the candidate entity set, the ranking model may operate on various historical click data of the user who initiates the search request based on a preset algorithm, to calculate the degree of interest score of each candidate entity in the candidate entity set.

Similarly, if the ranking model ranks the candidate entities in the candidate entity set simultaneously based on the degree of correlation between each candidate entity in the candidate entity set and the to-be-searched entity and the degree of interest of the user in the each candidate entity in the candidate entity set, the ranking model may perform a weighted sum on the degree of correlation score and the degree of interest score based on a preset weight (or a weight obtained by training), and rank the candidate entities in the candidate entity set according to the scores after the weighted sum to obtain the candidate entity sequence.

Step 230, selecting a candidate entity from the candidate entity sequence and recommending the selected candidate entity to the user.

In this step, it is possible to select a candidate entity to recommend it to the user according to the priority of each candidate entity in the candidate entity sequence output by the ranking model in step 220.

For example, in some application scenarios, the priority of each candidate entity determined by the ranking model is characterized by a qualitative ranking. In these application scenarios, for example, the candidate entity with the highest priority in the candidate entity sequence may be recommended to the user.

Alternatively, in some other application scenarios, the priority of each candidate entity determined by the ranking model is characterized by a quantitative value (e.g., a score). In these application scenarios, for example, a candidate entity with a score exceeding a predetermined threshold in the candidate entity sequence may be selected and recommended to the user. Alternatively, in these application scenarios, it may also be possible to select N (N is a preset positive integer) candidate entities with the highest scores in the candidate entity sequence to recommend them to the user.

The method for recommending entity provided by the present embodiment acquires a candidate entity set associated with a to-be-searched entity in a preset entity set, in response to receiving a user's search request for an entity; then inputs the candidate entity set into a pre-trained ranking model to obtain a candidate entity sequence; and finally selects a candidate entity from the candidate entity sequence and recommends the selected candidate entity to the user. In addition, since the ranking model may rank based on at least one of the degree of correlation between each candidate entity in the candidate entity set and the to-be-searched entity, the degree of interest of the user in the each candidate entity in the candidate entity set, and the degree of expectation of the user for the each candidate entity in the candidate entity set, a more relevant, individualized, surprising, and diversified entity recommendation for the user is achieved.

In some alternative implementations, the acquiring a candidate entity set associated with a to-be-searched entity in step 210 of the present embodiment may be executed through the following approach:

Step 211, adding a candidate entity to the candidate entity set, in response to an existence of an association between the candidate entity and the to-be-searched entity in a preset knowledge graph.

A knowledge graph (KG) may be understood as a centralized repository for storing an association between an entity and another entity associated with it.

Referring to <figref idref="f0003">Fig. 3</figref>, a schematic diagram of a knowledge graph of the entity "mammal" is shown.

In the knowledge graph shown in <figref idref="f0003">Fig. 3</figref>, "mammal" is one kind of "animal," and there is a connection between them in the knowledge graph shown in <figref idref="f0003">Fig. 3</figref> (for example, there is a connecting line between them), then, the entity "animal" may be determined as a candidate entity of "mammal."

In this way, when the user searches for the entity "mammal," the entities "animal," "cat," "whale," "bear," "spine," etc. appearing in the knowledge graph shown in <figref idref="f0003">Fig. 3</figref> may be determined as elements in the candidate entity set, while the entities "water," "fish," "hair," etc. are not determined as elements in the candidate entity set. The candidate entity set generated by step 211 may be denoted as, for example, K(eq), wherein eq represents the to-be-searched entity.

In some other alternative implementations, the acquiring a candidate entity set associated with a to-be-searched entity in step 210 of the present embodiment may also be executed through the following approach:

Step 212, adding a candidate entity to the candidate entity set, in response to a number of co-occurrences of the candidate entity and the to-be-searched entity in a search session history exceeding a preset first threshold.

In computer terminology, session refers to the process of communication of an end user with an interactive system (e.g., a server). For example, a session starts when the terminal accesses the server, and lasts until when the server is closed, or when the client is closed.

In some application scenarios, entities having more co-occurrence times with the to-be-searched entity eq in the search session history may be extracted to form the candidate entity set, which is denoted as S(eq).

In some other alternative implementations, the acquiring a candidate entity set associated with a to-be-searched entity in step 210 of the present embodiment may also be executed through the following approach:

Step 213, determining an entity having a co-occurrence relationship with the to-be-searched entity in a preset corpus as a co-occurrence candidate entity.

Here, entities appearing in the same web document in the preset corpus with the to-be-searched entity may be selected from the preset corpus as co-occurrence candidate entities, and a set Dr(eq) is formed.

And, step 214, adding a candidate entity having a degree of correlation with the to-be-searched entity exceeding a preset second threshold to the candidate entity set.

In some application scenarios, the degree of co-occurrence of the co-occurrence candidate entity in the set Dr(eq) and the to-be-searched entity may be calculated by the following formula (1): <maths id="math0001" num="(1)"><math display="block"><mrow><mi>P</mi><mfenced><msub><mi>e</mi><mi>c</mi></msub><mo>|</mo><msub><mi>e</mi><mi>q</mi></msub><mo>,</mo><mi>T</mi><mo>,</mo><mi>R</mi></mfenced><mo>≈</mo><mi>P</mi><mfenced><msub><mi>e</mi><mi>c</mi></msub><mo>|</mo><msub><mi>e</mi><mi>q</mi></msub></mfenced><mi mathvariant="normal">g</mi><mi>P</mi><mfenced><mi>R</mi><mo>|</mo><msub><mi>e</mi><mi>q</mi></msub><mo>,</mo><msub><mi>e</mi><mi>c</mi></msub></mfenced><mi mathvariant="normal">g</mi><mi>P</mi><mfenced><mi>T</mi><mo>|</mo><msub><mi>e</mi><mi>c</mi></msub></mfenced></mrow></math><img file="EP3554040A1_D0001.tif" /></maths>

In the above formula (1), T represents the set of entity categories of the to-be-searched entity eq, R represents the relationship between eq and ec described in the network document, in the preset word set for describing the relationship between the entities, P(ec|eq) is the content-independent degree of co-occurrence, and P(R|eq,ec) is the content-related degree of co-occurrence.

P(ec|eq) and P(R|eq,ec) may be calculated by the following formula (2) and formula (3), respectively. <maths id="math0002" num="(2)"><math display="block"><mrow><mi>P</mi><mfenced><msub><mi>e</mi><mi>c</mi></msub><mo>|</mo><msub><mi>e</mi><mi>q</mi></msub></mfenced><mo>=</mo><mfrac><mrow><mi mathvariant="italic">PMI</mi><mfenced separators=","><msub><mi>e</mi><mi>q</mi></msub><msub><mi>e</mi><mi>c</mi></msub></mfenced></mrow><mrow><mstyle displaystyle="false"><mrow><munder><mrow><mo>∑</mo></mrow><mrow><msubsup><mi>e</mi><mi>c</mi><mrow><mo>′</mo></mrow></msubsup><mo>∈</mo><msub><mi mathvariant="script">D</mi><mi>r</mi></msub><mfenced><msub><mi>e</mi><mi>q</mi></msub></mfenced></mrow></munder><mrow><mi mathvariant="italic">PMI</mi><mo>′</mo><mfenced separators=","><msub><mi>e</mi><mi>q</mi></msub><msub><mi>e</mi><mi>c</mi></msub></mfenced></mrow></mrow></mstyle></mrow></mfrac></mrow></math><img file="EP3554040A1_D0002.tif" /></maths><maths id="math0003" num="(3)"><math display="block"><mrow><mi>P</mi><mfenced><mi>R</mi><mo>|</mo><msub><mi>e</mi><mi>c</mi></msub><mo>,</mo><msub><mi>e</mi><mi>q</mi></msub></mfenced><mo>=</mo><mi>P</mi><mfenced><mi>R</mi><mo>|</mo><msub><mi>θ</mi><mi mathvariant="italic">qc</mi></msub></mfenced><mo>=</mo><mrow><mstyle displaystyle="true"><mrow><munder><mrow><mo>∏</mo></mrow><mrow><mi mathvariant="italic">t</mi><mi mathvariant="normal">ò</mi><mi mathvariant="italic">R</mi></mrow></munder></mrow></mstyle><mrow><mi>P</mi><mfenced><mi>t</mi><mo>|</mo><msup><mrow><msub><mi>θ</mi><mi mathvariant="italic">qc</mi></msub></mrow><mrow><mi>n</mi><mfenced separators=","><mi>t</mi><mi>R</mi></mfenced></mrow></msup></mfenced></mrow></mrow></mrow></math><img file="EP3554040A1_D0003.tif" /></maths>

Here, PMI(eq,ec) and PMI'(eq,ec) in the above formula (2) may be calculated by the following formula (4): <maths id="math0004" num="(4)"><math display="block"><mrow><mi mathvariant="italic">PMI</mi><mfenced separators=","><msub><mi>e</mi><mi>c</mi></msub><msub><mi>e</mi><mi>q</mi></msub></mfenced><mo>=</mo><mi>log</mi><mfrac><mrow><mi mathvariant="italic">cnt</mi><mfenced separators=","><msub><mi>e</mi><mi>c</mi></msub><msub><mi>e</mi><mi>q</mi></msub></mfenced></mrow><mrow><mi mathvariant="italic">cnt</mi><mfenced><msub><mi>e</mi><mi>c</mi></msub></mfenced><mi mathvariant="normal">g</mi><mi mathvariant="italic">cnt</mi><mfenced><msub><mi>e</mi><mi>q</mi></msub></mfenced></mrow></mfrac></mrow></math><img file="EP3554040A1_D0004.tif" /></maths>

Here, cnt(ec,eq) is the number of co-occurrences of ec and eq in the preset corpus, and cnt(ec) and cnt(eq) are the numbers of occurrences of ec and eq in the preset corpus, respectively.

θqc in the above formula (3) is the relation score between eq and ec output by a preset co-occurrence language model, and n(t,R) is the number of occurrences of t in R.

In addition, P(T|ec) in the above formula (1) is a relationship filter and may be obtained by the following formula (5): <maths id="math0005" num="(5)"><math display="block"><mrow><mi>P</mi><mfenced><mi>T</mi><mo>|</mo><msub><mi>e</mi><mi>c</mi></msub></mfenced><mo>=</mo><mrow><mo>{</mo><mtable><mtr><mtd><mn>1</mn></mtd><mtd columnalign="left"><mi mathvariant="italic">if cat</mi><mo>′</mo><mfenced><mi>T</mi></mfenced><mo>∩</mo><mi mathvariant="italic">cat</mi><mfenced><msub><mi>e</mi><mi>c</mi></msub></mfenced><mo>≠</mo><mi>∅</mi></mtd></mtr><mtr><mtd><mn>0</mn></mtd><mtd columnalign="left"><mi mathvariant="italic">others</mi></mtd></mtr></mtable></mrow></mrow></math><img file="EP3554040A1_D0005.tif" /></maths>

Here, cat(ec) is the mapping function that maps the entity ec to the category set of ec, and cat'(T) is a series of entity categories obtained by performing a category expansion operation on T.

In this way, by calculating the degree of co-occurrence of the co-occurrence candidate entities in the set Dr(eq) with the above formula (1), the co-occurrence candidate entities having the degree of co-occurrence exceeding the second preset threshold may be filtered out and the set D(eq) is formed.

It may be understood that when acquiring a candidate entity set associated with a to-be-searched entity in step 210 of the present embodiment, the candidate entity set K(eq), S(eq) or D(eq) may be obtained by using one of the above three alternative implementations. The candidate entity set may also be obtained by any combination of the above three alternative implementations. Specifically, if the candidate entity set is obtained by using the above step 211 and step 212, the candidate entity set ultimately generated may be K(eq) Us(eq). Similarly, if the candidate entity set is obtained by using the above step 211 and steps 213 to 214, the candidate entity set ultimately generated may be S(eq)UD(eq). Similarly, if the candidate entity set is obtained by using the above step 211, step 212, and steps 213 to 214, the candidate entity set ultimately generated may be K(eq)US(eq)UD(eq).

It may be understood that when the generated candidate entity set is K(eq)US(eq)UD(eq), since the candidate entity set includes not only the entity with an association with the to-be-searched entity in the preset knowledge graph (the candidate entity in K(eq)), the entity having the number of co-occurrences with the to-be-searched entity in a search session history exceeding the preset first threshold (the candidate entity in S(eq)), and the entity having the degree of correlation with the to-be-searched entity in the preset corpus exceeding the preset degree of correlation threshold (the candidate entity in D(eq)), the entities that are included in the candidate entity set are considered from three aspects of the user's degree of interest, degree of expectation, and degree of correlation between the entities. The correlation of each element in the candidate entity set and the search request in different dimensions is realized.

With reference to <figref idref="f0004">Fig. 4</figref>, a schematic diagram of an application scenario of the method for recommending entity of the present embodiment is shown.

In the application scenario shown in <figref idref="f0004">Fig. 4</figref> , the user 410 may send a search request for an entity to a search server through a terminal device (not shown in the figure) used by the user. After receiving the search request, the search server may acquire a candidate entity set associated with the to-be-searched entity from the database 402, as indicated by the reference numeral 401. Then, as indicated by the reference numeral 403, the search server may input the acquired candidate entity set into a pre-trained ranking model, thereby ranking each candidate entity in the candidate entity set to obtain the candidate entity sequence 404. In this way, top N of the candidate entities in the candidate entity sequence 404 may be recommended to the user.

With reference to <figref idref="f0005">Fig. 5</figref>, a schematic flowchart of another embodiment of the method for recommending entity according to the present disclosure is shown.

The method of the present embodiment includes the following steps: <ul id="ul0002" list-style="none"><li>Step 510, acquiring a candidate entity set associated with a to-be-searched entity, in response to receiving a user's search request for an entity.</li><li>Step 510 of the present embodiment may have an execution approach similar to step 210 in the embodiment shown in <figref idref="f0002">Fig. 2</figref>. In addition, in step 510 of this embodiment, an alternative implementation of acquiring a candidate entity set associated with a to-be-searched entity may also be obtained by referring to the approaches of the above step 211, step 212, step 213 to step 214, or any combination of the three approaches, and detailed description thereof will be omitted.</li><li>Step 520, inputting the candidate entity set into a pre-trained ranking model to obtain a candidate entity sequence.</li></ul>

In the method for recommending entity of the present embodiment, the ranking model may be obtained by training through the following approach:

Step 521, generating a training sample set, each training sample in the training sample set including a triplet and a click behavior tag, the triplet including a user identification, a first entity, and a second entity, and the click behavior tag being used to indicate whether the user clicked on the second entity in a search result obtained by searching the first entity.

Illustratively, each triplet may be expressed as, for example, <maths id="math0006"><math display="inline"><mrow><mfenced separators=",,"><msup><mi>u</mi><mi>i</mi></msup><msubsup><mi>e</mi><mi>q</mi><mi>j</mi></msubsup><msubsup><mi>e</mi><mi>c</mi><mi>k</mi></msubsup></mfenced><mn>.</mn></mrow></math><img file="EP3554040A1_D0006.tif" /></maths> Here, <i>uⁱ</i> may be understood as the identification of a user in a user collection, <maths id="math0007"><math display="inline"><mrow><msubsup><mi>e</mi><mi>q</mi><mi>j</mi></msubsup></mrow></math><img file="EP3554040A1_D0007.tif" /></maths> is a first entity (for example, an entity once searched by a user), and c is a second entity (for example, an entity presented on a search engine results page obtained by searching the first entity at a time.)

In addition, the value of the click behavior tag yijk may be determined by the following formula: <maths id="math0008" num="(6)"><math display="block"><mrow><msub><mi>y</mi><mi mathvariant="italic">ijk</mi></msub><mo>=</mo><mrow><mo>{</mo><mtable><mtr><mtd><mn>1</mn></mtd><mtd columnalign="left"><mi mathvariant="italic">if click</mi><mfenced separators=",,"><msup><mi>u</mi><mi>i</mi></msup><msubsup><mi>e</mi><mi>q</mi><mi>j</mi></msubsup><msubsup><mi>e</mi><mi>c</mi><mi>k</mi></msubsup></mfenced><mo>&gt;</mo><mn>0</mn></mtd></mtr><mtr><mtd><mn>0</mn></mtd><mtd columnalign="left"><mi mathvariant="italic">others</mi></mtd></mtr></mtable></mrow></mrow></math><img file="EP3554040A1_D0008.tif" /></maths>

In the above formula (6), <maths id="math0009"><math display="inline"><mrow><mi mathvariant="italic">click</mi><mfenced><msup><mi>u</mi><mi>i</mi></msup><mo>,</mo><msubsup><mi>e</mi><mi>q</mi><mi>j</mi></msubsup><msubsup><mrow><mo>,</mo><mi>e</mi></mrow><mi>c</mi><mi>k</mi></msubsup></mfenced></mrow></math><img file="EP3554040A1_D0009.tif" /></maths> is used to indicate that the user <i>uⁱ</i> has an aggregated click of the click behavior on the second entity <maths id="math0010"><math display="inline"><mrow><msubsup><mi>e</mi><mi>c</mi><mi>k</mi></msubsup></mrow></math><img file="EP3554040A1_D0010.tif" /></maths> in the search result obtained by searching the first entity <maths id="math0011"><math display="inline"><mrow><msubsup><mi>e</mi><mi>q</mi><mi>j</mi></msubsup><mn>.</mn></mrow></math><img file="EP3554040A1_D0011.tif" /></maths>If there is an aggregated click in the triplet <maths id="math0012"><math display="inline"><mrow><mfenced separators=",,"><msup><mi>u</mi><mi>i</mi></msup><msubsup><mi>e</mi><mi>q</mi><mi>j</mi></msubsup><msubsup><mi>e</mi><mi>c</mi><mi>k</mi></msubsup></mfenced><mo>,</mo></mrow></math><img file="EP3554040A1_D0012.tif" /></maths> then yijk=1 is marked for the triplet <maths id="math0013"><math display="inline"><mrow><mfenced separators=",,"><msup><mi>u</mi><mi>i</mi></msup><msubsup><mi>e</mi><mi>q</mi><mi>j</mi></msubsup><msubsup><mi>e</mi><mi>c</mi><mi>k</mi></msubsup></mfenced><mo>,</mo></mrow></math><img file="EP3554040A1_D0013.tif" /></maths> otherwise yijk=o is marked for the triplet <maths id="math0014"><math display="inline"><mrow><mfenced separators=",,"><msup><mi>u</mi><mi>i</mi></msup><msubsup><mi>e</mi><mi>q</mi><mi>j</mi></msubsup><msubsup><mi>e</mi><mi>c</mi><mi>k</mi></msubsup></mfenced><mn>.</mn></mrow></math><img file="EP3554040A1_D0014.tif" /></maths>

Step 522, generating a feature vector of a training sample, for each training sample in the generated training sample set.

Here, the feature vector includes a feature value for indicating at least one of the following: the degree of correlation between the first entity eq and the second entity ec in the triplet (<i>u</i>,<i>e_q</i>,<i>e_c</i>); the degree of interest of the user u of the triplet in the second entity ec in the triplet (<i>u</i>,<i>e_q</i>,<i>e_c</i>); and the degree of expectation of the user u of the triplet for the second entity ec in the triplet (<i>u</i>,<i>e_q</i>,<i>e_c</i>).

Here, the degree of correlation between the first entity eq and the second entity ec may be understood as the degree of association between the candidate entity and the to-be-searched entity. The degree of correlation between the candidate entity and the to-be-searched entity may be the degree of similarity between the two entities in the aspects of specific content, subject abstraction, and the like, and/or may also be the degree of correlation of some indicators such as the association or co-occurrence of the two entities in the aspects of knowledge graph, search session history, preset corpus and the like (for example, whether there is direct correlation between the two entities in the knowledge graph, or co-occurrence information in the search session history, etc.)

In some alternative implementations of the present embodiment, if the feature vector includes a feature value for indicating the degree of correlation between the first entity eq and the second entity ec, these feature values may include at least one of the following: the degree of correlation of the first entity eq and the second entity ec in the triplet (<i>u</i>,<i>e_q</i>,<i>e_c</i>) in a preset knowledge graph; the degree of co-occurrence of the first entity eq and the second entity ec in the triplet (<i>u</i>,<i>e_q</i>,<i>e_c</i>) in a search session history; the degree of co-occurrence of the first entity eq and the second entity ec in the triplet (<i>u</i>,<i>e_q</i>,<i>e_c</i>) in a preset corpus; and a subject similarity between the first entity eq and the second entity ec in the triplet (<i>u</i>,<i>e_q</i>,<i>e_c</i>).

In some application scenarios, the feature value of the degree of correlation of the first entity eq and the second entity ec in the triplet (<i>u</i>,<i>e_q</i>,<i>e_c</i>) in the preset knowledge graph may be determined by the following formula (7): <maths id="math0015" num="(7)"><math display="block"><mrow><mi>P</mi><mfenced><msub><mi>e</mi><mi>c</mi></msub><mo>|</mo><msub><mi>e</mi><mi>q</mi></msub></mfenced><mo>=</mo><mrow><mo>{</mo><mtable><mtr><mtd><mn>1</mn></mtd><mtd columnalign="left"><msub><mi mathvariant="italic">if there if a connection between e</mi><mi>c</mi></msub><msub><mrow><mspace width="1em" /><mi mathvariant="italic">and e</mi></mrow><mi>q</mi></msub><mspace width="1em" /><mi mathvariant="italic">in a preset knowledge graph</mi></mtd></mtr><mtr><mtd><mn>0</mn></mtd><mtd columnalign="left"><mi mathvariant="italic">others</mi></mtd></mtr></mtable></mrow></mrow></math><img file="EP3554040A1_D0015.tif" /></maths>

Here, there is a connection between the first entity eq and the second entity ec in the preset knowledge graph may be understood as, there is a connecting line between the first entity eq and the second entity ec in the preset knowledge graph. Still taking the knowledge graph as shown in <figref idref="f0003">Fig. 3</figref> as an example, there is a connecting line between the entity "mammal" and the entity "whale" in the knowledge graph. Therefore, if two entities correspond to the first entity eq and the second entity ec in the triplet (<i>u</i>,<i>e_q</i>,<i>e_c</i>) respectively, the feature value of the degree of correlation of the two entities may be determined as 1 according to the formula (7). In contrast, there is no connecting line between the entity "mammal" and the entity "fish" in the knowledge graph shown in <figref idref="f0003">Fig. 3</figref>. Therefore, if two entities correspond to the first entity eq and the second entity ec in the triplet respectively, the feature value of the degree of correlation of the two entities may be determined as o according to the formula (7).

In some application scenarios, the feature value of the degree of co-occurrence of the first entity eq and the second entity ec in the triplet (<i>u</i>,<i>e</i>_q,<i>e_c</i>) in the search session history may be determined by adopting the above formula (2). It may be understood that, when formula (2) is used to determine the degree of co-occurrence of the first entity eq and the second entity ec in the triplet (<i>u</i>,<i>e_q</i>,<i>e_c</i>) in the search session history, the set to which ec' in the formula (2) belongs should also correspond to the candidate entity set determined in step 510.

In some application scenarios, the feature value of the degree of co-occurrence of the first entity eq and the second entity ec in the triplet (<i>u</i>,<i>e_q</i>,<i>e_c</i>) in the preset corpus may be determined by the above formula (1).

In some application scenarios, the feature value of the subject similarity of the first entity eq and the second entity ec in the triplet (<i>u</i>,<i>e_q</i>,<i>e_c</i>) may be determined by the following formula (8). <maths id="math0016" num="(8)"><math display="block"><mrow><msub><mi mathvariant="italic">sim</mi><mi>c</mi></msub><mfenced separators=","><msub><mi>e</mi><mi>q</mi></msub><msub><mi>e</mi><mi>c</mi></msub></mfenced><mo>=</mo><mi>cos</mi><mfenced separators=","><msub><mi>v</mi><mrow><msub><mi>d</mi><mi mathvariant="italic">eq</mi></msub></mrow></msub><msub><mi>v</mi><mrow><msub><mi>d</mi><mi mathvariant="italic">ec</mi></msub></mrow></msub></mfenced><mo>=</mo><mfrac><mrow><msup><mfenced><msub><mi>v</mi><mrow><msub><mi>d</mi><mi mathvariant="italic">eq</mi></msub></mrow></msub></mfenced><mi>T</mi></msup><msub><mi>v</mi><mrow><msub><mi>d</mi><mi mathvariant="italic">ec</mi></msub></mrow></msub></mrow><mrow><mrow><mo>‖</mo><msub><mi>v</mi><mrow><msub><mi>d</mi><mi mathvariant="italic">eq</mi></msub></mrow></msub><mo>‖</mo></mrow><mrow><mo>‖</mo><msub><mi>v</mi><mrow><msub><mi>d</mi><mi mathvariant="italic">ec</mi></msub></mrow></msub><mo>‖</mo></mrow></mrow></mfrac></mrow></math><img file="EP3554040A1_D0016.tif" /></maths>

Here, <i>v_{d<sub2>eq</sub2>}</i> and <i>v_{d<sub2>ec</sub2>}</i> are respectively the subject feature vectors of the network document deq containing the first entity eq and the network document dec containing the second entity ec in a preset network document collection. In some application scenarios, latent dirichlet allocation (LDA) may be used to model network documents. For example, a LDA model may be pre-trained to characterize the subject feature vectors of the network documents in the network document collection. In this way, the cosine similarity between the subject feature vectors of the network document deq containing the first entity eq and the network document dec containing the second entity ec may be used as the feature value to measure the subject similarity between the first entity eq and the second entity ec in the triplet (<i>u</i>,<i>e_q</i>,<i>e_c</i>).

In some alternative implementations of the present embodiment, if the feature vector includes the feature value for indicating the degree of interest of the user u of the triplet in the second entity ec in the triplet (<i>u</i>,<i>e_q</i>,<i>e_c</i>), these feature values may include at least one of the following: a click rate of the second entity ec in the triplet (<i>u</i>,<i>e_q</i>,<i>e_c</i>); a click rate of a subject category to which the second entity ec belongs in a preset classification table; and a semantic similarity between the first entity eq and the second entity ec in the triplet (<i>u</i>,<i>e_q</i>,<i>e_c</i>).

In some application scenarios, the feature value of the click rate of the second entity ec in the triplet (<i>u</i>,<i>e_q</i>,<i>e_c</i>) may be determined by at least one of the following formula (9) to formula (11): <maths id="math0017" num="(9)"><math display="block"><mrow><mi mathvariant="italic">CTR</mi><mfenced separators=",,"><mi>u</mi><msub><mi>e</mi><mi>q</mi></msub><msub><mi>e</mi><mi>c</mi></msub></mfenced><mo>=</mo><mfrac><mrow><mi mathvariant="italic">click</mi><mfenced separators=",,"><mi>u</mi><msub><mi>e</mi><mi>q</mi></msub><msub><mi>e</mi><mi>c</mi></msub></mfenced><mo>+</mo><mi>α</mi></mrow><mrow><mi mathvariant="italic">impression</mi><mfenced separators=",,"><mi>u</mi><msub><mi>e</mi><mi>q</mi></msub><msub><mi>e</mi><mi>c</mi></msub></mfenced><mo>+</mo><mi>α</mi><mo>+</mo><mi>β</mi></mrow></mfrac></mrow></math><img file="EP3554040A1_D0017.tif" /></maths><maths id="math0018" num="(10)"><math display="block"><mrow><mi mathvariant="italic">CTR</mi><mfenced separators=","><msub><mi>e</mi><mi>q</mi></msub><msub><mi>e</mi><mi>c</mi></msub></mfenced><mo>=</mo><mfrac><mrow><mi mathvariant="italic">click</mi><mfenced separators=","><msub><mi>e</mi><mi>q</mi></msub><msub><mi>e</mi><mi>c</mi></msub></mfenced><mo>+</mo><mi>α</mi></mrow><mrow><mi mathvariant="italic">impression</mi><mfenced separators=","><msub><mi>e</mi><mi>q</mi></msub><msub><mi>e</mi><mi>c</mi></msub></mfenced><mo>+</mo><mi>α</mi><mo>+</mo><mi>β</mi></mrow></mfrac></mrow></math><img file="EP3554040A1_D0018.tif" /></maths><maths id="math0019" num="(11)"><math display="block"><mrow><mi mathvariant="italic">CTR</mi><mfenced><msub><mi>e</mi><mi>c</mi></msub></mfenced><mo>=</mo><mfrac><mrow><mi mathvariant="italic">click</mi><mfenced><msub><mi>e</mi><mi>c</mi></msub></mfenced><mo>+</mo><mi>α</mi></mrow><mrow><mi mathvariant="italic">impression</mi><mfenced><msub><mi>e</mi><mi>c</mi></msub></mfenced><mo>+</mo><mi>α</mi><mo>+</mo><mi>β</mi></mrow></mfrac></mrow></math><img file="EP3554040A1_D0019.tif" /></maths>

In the above formula (9) to formula (11), the click(•) function may be the number of clicks on the second entity ec in various cases. Specifically, <i>click</i>(<i>u</i>,<i>e_q</i>,<i>e_c</i>) may be the number of clicks on the second entity ec in the search engine results page obtained by the user u in searching the first entity eq; <i>click</i>(<i>e_q</i>,<i>e_c</i>) may be the number of clicks on the second entity ec in the search engine results page obtained by all users in searching the first entity eq; and <i>click</i>(<i>e_c</i>) may be the number of clicks on the second entity ec in the search engine results page obtained by all users in searching any entity.

The impression(•) function may be the number of times of presentation of the second entity ec in various cases. For example, the number of times the second entity ec being presented in the browser window of the search engine results page in various cases. <i>impression</i>(<i>u</i>,<i>e_q</i>,<i>e_c</i>) may be the number of times the second entity ec being presented in the search engine results page obtained by the user u in searching the first entity eq; <i>impression</i>(<i>e_q</i>,<i>e_c</i>) may be the number of times the second entity ec being presented in the search engine results page obtained by all users in searching the first entity eq; and <i>impression</i>(<i>e_c</i>) may be the number of times the second entity ec being presented in the search engine results page obtained by all users in searching any entity.

In addition, in the above formula (9) to formula (11), <i>α</i> and <i>β</i> may be preset constants to obtain smooth click rate data. By properly setting <i>α</i> and <i>β</i>, the second entity ec with few clicks and few presentation times may obtain a stable click rate value.

It may be understood that, in the search result obtained by searching the first entity eq in the triplet (<i>u</i>,<i>e_q</i>,<i>e_c</i>), if the feature value of the click rate of the second entity ec in the triplet (<i>u</i>,<i>e_q</i>,<i>e_c</i>) is determined by the above three formula (9) to formula (11), then, the feature vector of the sample ultimately obtained will have three feature values of the click rate calculated by the formula (9) to formula (11), respectively.

In some application scenarios, in the search result obtained by searching the first entity eq in the triplet (<i>u</i>,<i>e_q</i>,<i>e_c</i>), the feature value of the click rate of a subject category to which the second entity ec belongs in a preset classification table may be determined by at least one of the following formula (12) to formula (14): <maths id="math0020" num="(12)"><math display="block"><mrow><msub><mi mathvariant="italic">CTR</mi><mi>t</mi></msub><mfenced separators=",,"><mi>u</mi><msub><mi>e</mi><mi>q</mi></msub><msub><mi>e</mi><mi>c</mi></msub></mfenced><mo>=</mo><mfrac><mrow><mstyle displaystyle="true"><mrow><munderover><mrow><mo>∑</mo></mrow><mrow><msub><mi>T</mi><mi>q</mi></msub><mo>∈</mo><mi mathvariant="italic">cat</mi><mfenced><msub><mi>e</mi><mi>q</mi></msub></mfenced></mrow><mspace width="1em" /></munderover><munderover><mrow><mo>∑</mo></mrow><mrow><msub><mi>T</mi><mi>c</mi></msub><mo>∈</mo><mi mathvariant="italic">cat</mi><mfenced><msub><mi>e</mi><mi>c</mi></msub></mfenced></mrow><mspace width="1em" /></munderover></mrow></mstyle><mi mathvariant="italic">click</mi><mfenced separators=",,"><mi>u</mi><msub><mi>T</mi><mi>q</mi></msub><msub><mi>T</mi><mi>c</mi></msub></mfenced><mo>+</mo><mi>α</mi></mrow><mrow><mstyle displaystyle="true"><mrow><munderover><mrow><mo>∑</mo></mrow><mrow><msub><mi>T</mi><mi>q</mi></msub><mo>∈</mo><mi mathvariant="italic">cat</mi><mfenced><msub><mi>e</mi><mi>q</mi></msub></mfenced></mrow><mspace width="1em" /></munderover><munderover><mrow><mo>∑</mo></mrow><mrow><msub><mi>T</mi><mi>c</mi></msub><mo>∈</mo><mi mathvariant="italic">cat</mi><mfenced><msub><mi>e</mi><mi>c</mi></msub></mfenced></mrow><mspace width="1em" /></munderover></mrow></mstyle><msub><mi mathvariant="italic">impression</mi><mi>t</mi></msub><mfenced separators=",,"><mi>u</mi><msub><mi>T</mi><mi>q</mi></msub><msub><mi>T</mi><mi>c</mi></msub></mfenced><mo>+</mo><mi>α</mi><mo>+</mo><mi>β</mi></mrow></mfrac></mrow></math><img file="EP3554040A1_D0020.tif" /></maths><maths id="math0021" num="(13)"><math display="block"><mrow><msub><mi mathvariant="italic">CTR</mi><mi>t</mi></msub><mfenced separators=","><msub><mi>e</mi><mi>q</mi></msub><msub><mi>e</mi><mi>c</mi></msub></mfenced><mo>=</mo><mfrac><mrow><mstyle displaystyle="true"><mrow><munderover><mrow><mo>∑</mo></mrow><mrow><msub><mi>T</mi><mi>q</mi></msub><mo>∈</mo><mi mathvariant="italic">cat</mi><mfenced><msub><mi>e</mi><mi>q</mi></msub></mfenced></mrow><mspace width="1em" /></munderover><munderover><mrow><mo>∑</mo></mrow><mrow><msub><mi>T</mi><mi>c</mi></msub><mo>∈</mo><mi mathvariant="italic">cat</mi><mfenced><msub><mi>e</mi><mi>c</mi></msub></mfenced></mrow><mspace width="1em" /></munderover></mrow></mstyle><msub><mi mathvariant="italic">click</mi><mi>t</mi></msub><mfenced separators=","><msub><mi>T</mi><mi>q</mi></msub><msub><mi>T</mi><mi>c</mi></msub></mfenced><mo>+</mo><mi>α</mi></mrow><mrow><mstyle displaystyle="true"><mrow><munderover><mrow><mo>∑</mo></mrow><mrow><msub><mi>T</mi><mi>q</mi></msub><mo>∈</mo><mi mathvariant="italic">cat</mi><mfenced><msub><mi>e</mi><mi>q</mi></msub></mfenced></mrow><mspace width="1em" /></munderover><munderover><mrow><mo>∑</mo></mrow><mrow><msub><mi>T</mi><mi>c</mi></msub><mo>∈</mo><mi mathvariant="italic">cat</mi><mfenced><msub><mi>e</mi><mi>c</mi></msub></mfenced></mrow><mspace width="1em" /></munderover></mrow></mstyle><msub><mi mathvariant="italic">impression</mi><mi>t</mi></msub><mfenced separators=","><msub><mi>T</mi><mi>q</mi></msub><msub><mi>T</mi><mi>c</mi></msub></mfenced><mo>+</mo><mi>α</mi><mo>+</mo><mi>β</mi></mrow></mfrac></mrow></math><img file="EP3554040A1_D0021.tif" /></maths><maths id="math0022" num="(14)"><math display="block"><mrow><msub><mi mathvariant="italic">CTR</mi><mi>t</mi></msub><mfenced><msub><mi>e</mi><mi>c</mi></msub></mfenced><mo>=</mo><mfrac><mrow><mstyle displaystyle="true"><mrow><munderover><mrow><mo>∑</mo></mrow><mrow><msub><mi>T</mi><mi>q</mi></msub><mo>∈</mo><mi mathvariant="italic">cat</mi><mfenced><msub><mi>e</mi><mi>q</mi></msub></mfenced></mrow><mspace width="1em" /></munderover><munderover><mrow><mo>∑</mo></mrow><mrow><msub><mi>T</mi><mi>c</mi></msub><mo>∈</mo><mi mathvariant="italic">cat</mi><mfenced><msub><mi>e</mi><mi>c</mi></msub></mfenced></mrow><mspace width="1em" /></munderover></mrow></mstyle><msub><mi mathvariant="italic">click</mi><mi>t</mi></msub><mfenced><msub><mi>T</mi><mi>c</mi></msub></mfenced><mo>+</mo><mi>α</mi></mrow><mrow><mstyle displaystyle="true"><mrow><munderover><mrow><mo>∑</mo></mrow><mrow><msub><mi>T</mi><mi>q</mi></msub><mo>∈</mo><mi mathvariant="italic">cat</mi><mfenced><msub><mi>e</mi><mi>q</mi></msub></mfenced></mrow><mspace width="1em" /></munderover><munderover><mrow><mo>∑</mo></mrow><mrow><msub><mi>T</mi><mi>c</mi></msub><mo>∈</mo><mi mathvariant="italic">cat</mi><mfenced><msub><mi>e</mi><mi>c</mi></msub></mfenced></mrow><mspace width="1em" /></munderover></mrow></mstyle><msub><mi mathvariant="italic">impression</mi><mi>t</mi></msub><mfenced><msub><mi>T</mi><mi>c</mi></msub></mfenced><mo>+</mo><mi>α</mi><mo>+</mo><mi>β</mi></mrow></mfrac></mrow></math><img file="EP3554040A1_D0022.tif" /></maths>

Here, Tq is the subject collection to which the first entity eq belongs, and Tc is the subject collection to which the second entity ec belongs.

It may be understood that if the feature value of the click rate of the subject category to which the second entity ec belongs in the preset classification table is determined by the above three formula (12) to formula (14), the feature vector of the sample ultimately obtained will have three feature values of the click rate calculated by the formula (12) to formula (14), respectively.

In some application scenarios, the feature value of the semantic similarity of the first entity eq and the second entity ec in the triplet (<i>u</i>,<i>e_q</i>,<i>e_c</i>) may be determined by the following formula (15): <maths id="math0023" num="(15)"><math display="block"><mrow><msub><mi mathvariant="italic">sim</mi><mi>s</mi></msub><mfenced separators=","><msub><mi>e</mi><mi>q</mi></msub><msub><mi>e</mi><mi>c</mi></msub></mfenced><mo>=</mo><mi>cos</mi><mfenced><mi>v</mi><mfenced><msub><mi>s</mi><mi>q</mi></msub></mfenced><mo>,</mo><mi>v</mi><mfenced><msub><mi>s</mi><mi>c</mi></msub></mfenced></mfenced><mo>=</mo><mfrac><mrow><mi>v</mi><msup><mfenced><msub><mi>s</mi><mi>q</mi></msub></mfenced><mi>T</mi></msup><mi>v</mi><mfenced><msub><mi>s</mi><mi>c</mi></msub></mfenced></mrow><mrow><mrow><mo>‖</mo><mi>v</mi><mfenced><msub><mi>s</mi><mi>q</mi></msub></mfenced><mo>‖</mo></mrow><mo>+</mo><mrow><mo>‖</mo><mi>v</mi><mfenced><msub><mi>s</mi><mi>c</mi></msub></mfenced><mo>‖</mo></mrow></mrow></mfrac></mrow></math><img file="EP3554040A1_D0023.tif" /></maths>

In these application scenarios, each word in the description sentence s describing a entity eq may be first mapped to a word vector through a word embedding matrix. Then, the description sentence may be ultimately represented as a semantic vector through the convolutional neural network and a pooling operation. In this way, <i>v</i>(<i>s_q</i>) and <i>v</i>(<i>s_c</i>) in formula (15) above may be understood as the semantic vector of the first entity eq and the semantic vector of the second entity ec. Accordingly, the feature values of the semantic similarity of the first entity and the second entity may be understood as the cosine similarity between the semantic vector of the first entity eq and the semantic vector of the second entity ec.

In some alternative implementations of the present embodiment, if the feature vector contains the feature value for indicating the degree of expectation of the user of the triplet (<i>u</i>,<i>e_q</i>,<i>e_c</i>) for the second entity ec in the triplet (<i>u</i>,<i>e_q</i>,<i>e_c</i>), the feature values may include at least one of the following: a familiarity of relationship of the user and/or the first entity to the second entity determined based on historical click data of the user in the triplet (<i>u</i>,<i>e_q</i>,<i>e_c</i>); a degree of surprise of the second entity ec relative to the user u and/or the first entity eq in the triplet (<i>u</i>,<i>e_q</i>,<i>e_c</i>); and a click diversity of the first entity eq in the triplet (<i>u</i>,<i>e_q</i>,<i>e_c</i>)<i>.</i>

It may be understood that if a second entity ec has been found by the user u searching the first entity eq, then, when the user searches the first entity eq again, the familiarity of the user u to the second entity ec will be higher if the second entity ec is recommended to the user u. That is to say, the unpredictability of the user u to the second entity ec will be lower.

In some application scenarios, if the feature vector contains the feature value for indicating the familiarity of relationship of the user u and/or the first entity eq to the second entity ec determined based on the historical click data of the user in the triplet (<i>u</i>,<i>e_q</i>,<i>e_c</i>), the feature value may be determined by at least one of the following formula (16) to formula (17): <maths id="math0024" num="(16)"><math display="block"><mrow><msub><mi>R</mi><mi>a</mi></msub><mfenced separators=",,"><mi>u</mi><msub><mi>e</mi><mi>q</mi></msub><msub><mi>e</mi><mi>c</mi></msub></mfenced><mo>=</mo><mrow><mo>{</mo><mtable><mtr><mtd><mn>1</mn></mtd><mtd columnalign="left"><msub><mi mathvariant="italic">if e</mi><mi>c</mi></msub><mo>∈</mo><mi>ε</mi><mfenced separators=","><mi>u</mi><msub><mi>e</mi><mi>q</mi></msub></mfenced></mtd></mtr><mtr><mtd><mn>0</mn></mtd><mtd columnalign="left"><mi mathvariant="italic">others</mi></mtd></mtr></mtable></mrow></mrow></math><img file="EP3554040A1_D0024.tif" /></maths><maths id="math0025" num="(17)"><math display="block"><mrow><msub><mi>R</mi><mi>a</mi></msub><mfenced separators=","><msub><mi>e</mi><mi>q</mi></msub><msub><mi>e</mi><mi>c</mi></msub></mfenced><mo>=</mo><mrow><mo>{</mo><mtable><mtr><mtd><mn>1</mn></mtd><mtd columnalign="left"><msub><mi mathvariant="italic">if e</mi><mi>c</mi></msub><mo>∈</mo><msub><mi>ε</mi><mi>w</mi></msub><mfenced><msub><mi>e</mi><mi>q</mi></msub></mfenced></mtd></mtr><mtr><mtd><mn>0</mn></mtd><mtd columnalign="left"><mi mathvariant="italic">others</mi></mtd></mtr></mtable></mrow></mrow></math><img file="EP3554040A1_D0025.tif" /></maths>

Here, <i>ε</i>(<i>u</i>,<i>e_q</i>)=<i>ε_ct</i>(<i>u,e_q</i>)∪<i>ε_ce</i>(<i>u</i>,<i>e_q</i>), <i>ε_ct</i>(<i>u</i>,<i>e_q</i>) is all the entities in the titles of the web documents clicked by the user u obtained from a search click log, and <i>ε_ce</i>(<i>u</i>,<i>e_q</i>) is all entities clicked by the user u acquired from the entity click log.

In addition, in formula (17), <maths id="math0026"><math display="inline"><mrow><msub><mi>ε</mi><mi>w</mi></msub><mfenced><msub><mi>e</mi><mi>q</mi></msub></mfenced><mo>=</mo><mfenced open="{" close="}"><msub><mi>e</mi><mi>c</mi></msub><mo>∈</mo><mi mathvariant="script">R</mi><mfenced><msub><mi>e</mi><mi>q</mi></msub></mfenced><mo>:</mo><msub><mi mathvariant="italic">click</mi><mi>u</mi></msub><mfenced separators=","><msub><mi>e</mi><mi>q</mi></msub><msub><mi>e</mi><mi>c</mi></msub></mfenced><mo>≥</mo><msub><mi>N</mi><mi>u</mi></msub></mfenced><mn>.</mn></mrow></math><img file="EP3554040A1_D0026.tif" /></maths> Here, <i>click_u</i>(<i>e_q</i>,<i>e_c</i>) is the number of users who have clicked on the second entity ec presented on the search engine results page when searching the first entity eq; and Nu is the preset threshold used to characterize the familiarity of most users to the relationship between the first entity eq and the second entity ec.

It may be understood that, if the feature value of the familiarity of relationship determined based on the historical click data of the user in the triplet (<i>u</i>,<i>e_q</i>,<i>e_c</i>) is determined by the above formula (16) to formula (17), in the feature vector of the sample ultimately obtained, there are three feature values of the familiarity of relationship calculated from the formula (16) to formula (17), respectively.

In some alternative implementations of the present embodiment, if the feature vector includes the feature value for indicating the degree of surprise of the second entity ec relative to the user u and/or the first entity eq in the triplet (<i>u</i>,<i>e_q</i>,<i>e_c</i>), these feature vector may be determined by at least one of the following formula (18) to formula (21): <maths id="math0027" num="(18)"><math display="block"><mrow><mi mathvariant="italic">dis</mi><mfenced><msub><mi>e</mi><mi>c</mi></msub><mo>,</mo><mi>ε</mi><mfenced separators=","><mi>u</mi><msub><mi>e</mi><mi>q</mi></msub></mfenced></mfenced><mo>=</mo><munder><mi>min</mi><mrow><msub><mi>e</mi><mi>k</mi></msub><mo>∈</mo><mi>ε</mi><mfenced separators=","><mi>u</mi><msub><mi>e</mi><mi>q</mi></msub></mfenced></mrow></munder><mi>d</mi><mfenced separators=","><msub><mi>e</mi><mi>c</mi></msub><msub><mi>e</mi><mi>k</mi></msub></mfenced></mrow></math><img file="EP3554040A1_D0027.tif" /></maths><maths id="math0028" num="(19)"><math display="block"><mrow><msub><mi mathvariant="italic">dis</mi><mi>a</mi></msub><mfenced><msub><mi>e</mi><mi>c</mi></msub><mo>,</mo><mi>ε</mi><mfenced separators=","><mi>u</mi><msub><mi>e</mi><mi>q</mi></msub></mfenced></mfenced><mo>=</mo><mstyle displaystyle="true"><mrow><munderover><mrow><mo>∑</mo></mrow><mrow><msub><mi>e</mi><mi>j</mi></msub><mo>∈</mo><mi>ε</mi><mfenced separators=","><mi>u</mi><msub><mi>e</mi><mi>q</mi></msub></mfenced></mrow><mspace width="1em" /></munderover></mrow></mstyle><mi>C</mi><mover><mi>T</mi><mrow><mo>‾</mo></mrow></mover><mi>R</mi><mfenced separators=",,"><mi>u</mi><msub><mi>e</mi><mi>q</mi></msub><msub><mi>e</mi><mi>j</mi></msub></mfenced><mi mathvariant="normal">g</mi><mi>d</mi><mfenced separators=","><msub><mi>e</mi><mi>j</mi></msub><msub><mi>e</mi><mi>c</mi></msub></mfenced></mrow></math><img file="EP3554040A1_D0028.tif" /></maths><maths id="math0029" num="(20)"><math display="block"><mrow><mi>dis</mi><mfenced><msub><mi>e</mi><mi>c</mi></msub><mo>,</mo><msub><mi>ε</mi><mi>w</mi></msub><mfenced><msub><mi>e</mi><mi>q</mi></msub></mfenced></mfenced><mo>=</mo><munder><mi>min</mi><mrow><msub><mi>e</mi><mi>k</mi></msub><mo>∈</mo><msub><mi>ε</mi><mi>w</mi></msub><mfenced><msub><mi>e</mi><mi>q</mi></msub></mfenced></mrow></munder><mi>d</mi><mfenced separators=","><msub><mi>e</mi><mi>c</mi></msub><msub><mi>e</mi><mi>k</mi></msub></mfenced></mrow></math><img file="EP3554040A1_D0029.tif" /></maths><maths id="math0030" num="(21)"><math display="block"><mrow><msub><mi mathvariant="italic">dis</mi><mi>a</mi></msub><mfenced><msub><mi>e</mi><mi>c</mi></msub><mo>,</mo><msub><mi>ε</mi><mi>w</mi></msub><mfenced><msub><mi>e</mi><mi>q</mi></msub></mfenced></mfenced><mo>=</mo><mstyle displaystyle="true"><mrow><munderover><mrow><mo>∑</mo></mrow><mrow><msub><mi>e</mi><mi>j</mi></msub><mo>∈</mo><msub><mi>ε</mi><mi>w</mi></msub><mfenced><msub><mi>e</mi><mi>q</mi></msub></mfenced></mrow><mspace width="1em" /></munderover></mrow></mstyle><mi>C</mi><mover><mi>T</mi><mrow><mo>‾</mo></mrow></mover><mi>R</mi><mfenced separators=","><msub><mi>e</mi><mi>q</mi></msub><msub><mi>e</mi><mi>j</mi></msub></mfenced><mi mathvariant="normal">g</mi><mi>d</mi><mfenced separators=","><msub><mi>e</mi><mi>j</mi></msub><msub><mi>e</mi><mi>c</mi></msub></mfenced></mrow></math><img file="EP3554040A1_D0030.tif" /></maths>

Here, in the above formula (18), <i>ε_ct</i>(<i>u</i>,<i>e_q</i>) is a set of entities known to the user u in association with the first entity eq, d(•) may be a function for measuring the distance between the second entity ec and an element in the set <i>ε_ct</i>(<i>u</i>,<i>e_q</i>). Schematically, d(ec,ek)=1-simc(ec,ek), and simc(ec,ek) may be obtained by using the above formula (8). By obtaining the minimum value of the distance between the second entity ec and each element in the set, the degree of surprise of the second entity ec relative to the first entity eq may be measured.

However, measuring the degree of surprise of the second entity ec relative to the first entity eq only by formula (18) and/or formula (20) is likely to result in that the second entity ec is an entity completely uninterested to the user u and completely unrelated to the user u. To solve this problem, the degree of interest of the user u may be taken into account by the above formula (19) and/or formula (21).

Specifically, in formula (19), <i>C<o ostyle="single">T</o>R</i>(<i>u,e_q,e_j</i>) is the normalized <i>CTR</i>(<i>u</i>,<i>e_q</i>,<i>e_j</i>) and satisfies: <maths id="math0031"><math display="block"><mrow><mstyle displaystyle="true"><mrow><munderover><mrow><mo>∑</mo></mrow><mrow><msub><mi>e</mi><mi>j</mi></msub><mo>∈</mo><mi mathvariant="script">R</mi><mfenced><msub><mi>e</mi><mi>q</mi></msub></mfenced></mrow><mspace width="1em" /></munderover></mrow></mstyle><mi>C</mi><mover><mi>T</mi><mrow><mo>‾</mo></mrow></mover><mi>R</mi><mfenced separators=",,"><mi>u</mi><msub><mi>e</mi><mi>q</mi></msub><msub><mi>e</mi><mi>j</mi></msub></mfenced><mo>=</mo><mn>1</mn></mrow></math><img file="EP3554040A1_D0031.tif" /></maths>

<i>CTR</i>(<i>u</i>,<i>e_q</i>,<i>e_j</i>) may be calculated by referring to the above formula (9).

Further, <i>C<o ostyle="single">T</o>R</i>(<i>e_q</i>,<i>e_j</i>) in the above formula (21) is the normalized <i>CTR</i>(<i>e_q</i>,<i>e_j</i>) and satisfies: <maths id="math0032"><math display="block"><mrow><mstyle displaystyle="true"><mrow><munderover><mrow><mo>∑</mo></mrow><mrow><msub><mi>e</mi><mi>j</mi></msub><mo>∈</mo><mi mathvariant="script">R</mi><mfenced><msub><mi>e</mi><mi>q</mi></msub></mfenced></mrow><mspace width="1em" /></munderover></mrow></mstyle><mi>C</mi><mover><mi>T</mi><mrow><mo>‾</mo></mrow></mover><mi>R</mi><mfenced separators=","><msub><mi>e</mi><mi>q</mi></msub><msub><mi>e</mi><mi>j</mi></msub></mfenced><mo>=</mo><mn>1</mn></mrow></math><img file="EP3554040A1_D0032.tif" /></maths>

It may be understood that, if the feature value of the degree of surprise of the second entity ec relative to the user u and/or the first entity eq in the triplet (<i>u</i>,<i>e_q</i>,<i>e_c</i>) is determined respectively by the above formula (18) to formula (21), in the feature vector of the sample ultimately obtained, there are feature values of the degree of surprise of the second entity ec relative to the first entity eq determined by the formula (18) to formula (21), respectively.

In some alternative implementations of the present embodiment, if the feature vector includes the feature value for indicating the click diversity of the first entity eq in the triplet (<i>u</i>,<i>e_q</i>,<i>e_c</i>), the feature value may be determined by the following formula (22): <maths id="math0033" num="(22)"><math display="block"><mrow><mi>div</mi><mfenced><msub><mi>e</mi><mi>q</mi></msub></mfenced><mo>=</mo><mi mathvariant="italic">Clickentroy</mi><mfenced><msub><mi>e</mi><mi>q</mi></msub></mfenced><mo>=</mo><mstyle displaystyle="true"><mrow><munderover><mrow><mo>∑</mo></mrow><mrow><msub><mi>e</mi><mi>i</mi></msub><mo>∈</mo><mi>C</mi><mfenced><msub><mi>e</mi><mi>q</mi></msub></mfenced></mrow><mspace width="1em" /></munderover><mo>−</mo><mi>P</mi><mfenced><msub><mi>e</mi><mi>i</mi></msub><mo>|</mo><msub><mi>e</mi><mi>q</mi></msub></mfenced></mrow></mstyle><msub><mi>log</mi><mn>2</mn></msub><mi>P</mi><mfenced><msub><mi>e</mi><mi>i</mi></msub><mo>|</mo><msub><mi>e</mi><mi>q</mi></msub></mfenced></mrow></math><img file="EP3554040A1_D0033.tif" /></maths>

Here: <maths id="math0034"><math display="block"><mrow><mi>P</mi><mfenced><msub><mi>e</mi><mi>i</mi></msub><mo>|</mo><msub><mi>e</mi><mi>q</mi></msub></mfenced><mo>=</mo><mfrac><mrow><mi mathvariant="italic">click</mi><mfenced separators=","><msub><mi>e</mi><mi>q</mi></msub><msub><mi>e</mi><mi>i</mi></msub></mfenced></mrow><mrow><mstyle displaystyle="true"><mrow><munderover><mrow><mo>∑</mo></mrow><mrow><msub><mi>e</mi><mi>j</mi></msub><mo>∈</mo><mi>C</mi><mfenced><msub><mi>e</mi><mi>q</mi></msub></mfenced></mrow><mspace width="1em" /></munderover><mi mathvariant="italic">click</mi><mfenced separators=","><msub><mi>e</mi><mi>q</mi></msub><msub><mi>e</mi><mi>j</mi></msub></mfenced></mrow></mstyle></mrow></mfrac></mrow></math><img file="EP3554040A1_D0034.tif" /></maths>

C(eq) is a set of clicked entities in the search results obtained in searching the first entity eq.

The feature value of the click diversity determined by the above formula (22) may intuitively reflect the click diversity of the search result obtained in searching the first entity eq.

It may be understood that, in step 522, when the ranldng model obtained by training ranks, the more feature values are selected, the more the corresponding influencing factors affecting the ranking result, and the candidate entity sequence obtained by the ranking model will also meet the needs of the user such as the degree of interest, the degree of expectation and the degree of correlation between entities more appropriately.

Step 523, inputting the training sample set and the generated feature vector into a pre-established gradient boosting decision tree model, and training the gradient boosting decision tree model based on a stochastic gradient descent algorithm.

Here, the gradient boosting decision tree model may be, for example, a stochastic Gradient Boosting Decision Tree (stochastic GBDT) model. It should be noted that by adjusting parameters such as the number of trees, the number of nodes, the learning rate, and the sampling rate in the stochastic GBDT model, the trained model may achieve an optimal effect.

Step 524, generating the ranking model, in response to a minimum cross-entropy loss function.

Here, the cross-entropy loss function Loss(H) may have the following expression form of formula (23): <maths id="math0035" num="(23)"><math display="block"><mrow><mtable><mtr><mtd><mi mathvariant="italic">Loss</mi><mfenced><mi mathvariant="script">H</mi></mfenced></mtd><mtd columnalign="left"><mo>=</mo><mo>−</mo><mi>log</mi><mrow><mstyle displaystyle="true"><mrow><munder><mrow><mo>∏</mo></mrow><mrow><mfenced><mo>&lt;</mo><msup><mi>u</mi><mi>i</mi></msup><mo>,</mo><msubsup><mi>e</mi><mi>q</mi><mi>j</mi></msubsup><mo>,</mo><msubsup><mi>e</mi><mi>c</mi><mi>k</mi></msubsup><mo>&gt;</mo><msub><mi>y</mi><mi mathvariant="italic">ijk</mi></msub></mfenced><mo>∈</mo><mi mathvariant="script">H</mi></mrow></munder></mrow></mstyle><mi>f</mi><msup><mfenced separators=",,"><msup><mi>u</mi><mi>i</mi></msup><msubsup><mi>e</mi><mi>q</mi><mi>j</mi></msubsup><msubsup><mi>e</mi><mi>c</mi><mi>k</mi></msubsup></mfenced><mrow><msub><mi>y</mi><mi mathvariant="italic">ijk</mi></msub></mrow></msup><mi mathvariant="normal">g</mi><msup><mfenced><mn>1</mn><mo>−</mo><mi>f</mi><mfenced separators=",,"><msup><mi>u</mi><mi>i</mi></msup><msubsup><mi>e</mi><mi>q</mi><mi>j</mi></msubsup><msubsup><mi>e</mi><mi>c</mi><mi>k</mi></msubsup></mfenced></mfenced><mrow><mn>1</mn><msup><mrow><mo>−</mo></mrow><mrow><msub><mi>y</mi><mi mathvariant="italic">ijk</mi></msub></mrow></msup></mrow></msup></mrow></mtd></mtr><mtr><mtd><mspace width="1em" /></mtd><mtd columnalign="left"><mo>=</mo><mo>−</mo><mstyle displaystyle="true"><mrow><munder><mrow><mo>∏</mo></mrow><mrow><mfenced><mo>&lt;</mo><msup><mi>u</mi><mi>i</mi></msup><mo>,</mo><msubsup><mi>e</mi><mi>q</mi><mi>j</mi></msubsup><mo>,</mo><msubsup><mi>e</mi><mi>c</mi><mi>k</mi></msubsup><mo>&gt;</mo><msub><mi>y</mi><mi mathvariant="italic">ijk</mi></msub></mfenced><mo>∈</mo><mi mathvariant="script">H</mi></mrow></munder><msub><mi>y</mi><mi mathvariant="italic">ijk</mi></msub><mi>glog</mi><mspace width="1em" /><mi>f</mi><mfenced separators=",,"><msup><mi>u</mi><mi>i</mi></msup><msubsup><mi>e</mi><mi>q</mi><mi>j</mi></msubsup><msubsup><mi>e</mi><mi>c</mi><mi>k</mi></msubsup></mfenced><mo>+</mo><mfenced><mn>1</mn><mo>−</mo><msub><mi>y</mi><mi mathvariant="italic">ijk</mi></msub></mfenced><mi>glog</mi><mfenced><mn>1</mn><mo>−</mo><mi>f</mi><mfenced separators=",,"><msup><mi>u</mi><mi>i</mi></msup><msubsup><mi>e</mi><mi>q</mi><mi>j</mi></msubsup><msubsup><mi>e</mi><mi>c</mi><mi>k</mi></msubsup></mfenced></mfenced></mrow></mstyle></mtd></mtr></mtable></mrow></math><img file="EP3554040A1_D0035.tif" /></maths>

By training the stochastic gradient boosting decision tree model, the model corresponding to the minimum value of the cross entropy loss function Loss(H) may be determined as the ranking model ultimately obtained.

With further reference to <figref idref="f0006">Fig. 6</figref>, as an implementation to the method shown in the above figures, the present disclosure provides an embodiment of an apparatus for recommending entity. The apparatus embodiment corresponds to the method embodiment shown in <figref idref="f0002">Fig. 2</figref>, and the apparatus may specifically be applied to various electronic devices.

As shown in <figref idref="f0006">Fig. 6</figref>, the apparatus for recommending entity of the present embodiment may include an acquisition unit 610, a rank unit 620 and a recommendation unit 630.

The acquisition unit 610 may be configured to acquire a candidate entity set associated with a to-be-searched entity, in response to receiving a user's search request for an entity.

The rank unit 620 may be configured to input the candidate entity set into a pre-trained ranking model to obtain a candidate entity sequence.

The recommendation unit 630 may be configured to select a candidate entity from the candidate entity sequence and recommend the selected candidate entity to the user.

In the present embodiment, the ranking model may rank the candidate entity set based on at least one of: a degree of correlation between each candidate entity in the candidate entity set and the to-be-searched entity; a degree of interest of the user in the each candidate entity in the candidate entity set; and a degree of expectation of the user for the each candidate entity in the candidate entity set.

In some alternative implementations, when acquiring a candidate entity set associated with a to-be-searched entity, the acquisition unit 610 may be further configured to: add a candidate entity to the candidate entity set, in response to an existence of an association between the candidate entity and the to-be-searched entity in a preset knowledge graph.

In some alternative implementations, when acquiring a candidate entity set associated with a to-be-searched entity, the acquisition unit 610 may be further configured to: add a candidate entity to the candidate entity set, in response to a number of co-occurrences of the candidate entity and the to-be-searched entity in a search session history exceeding a preset first threshold.

In some alternative implementations, when acquiring a candidate entity set associated with a to-be-searched entity, the acquisition unit 610 may be further configured to: determine an entity having a co-occurrence relationship with the to-be-searched entity in a preset corpus as a co-occurrence candidate entity; and add a co-occurrence candidate entity having a degree of correlation with the to-be-searched entity exceeding a preset second threshold to the candidate entity set.

In some alternative implementations, the apparatus for recommending entity of the present embodiment may further include a training unit (not shown in the figures). The training unit may be configured to train the ranking model.

In these alternative implementations, the training unit may include: a training sample generation module, configured to generate a training sample set, each training sample in the training sample set including a triplet and a click behavior tag, the triplet including a user identification, a first entity, and a second entity, and the click behavior tag being used to indicate whether the user clicked on the second entity in a search result obtained by searching the first entity; a feature vector generation module, configured to generate a feature vector of a training sample, for each training sample in the generated training sample set; an iteration training module, configured to input the training sample set and the generated feature vector into a pre-established gradient boosting decision tree model, and train the gradient boosting decision tree model based on a stochastic gradient descent algorithm; and a generation unit, configured to generate the ranking model, in response to a minimum cross-entropy loss function. Here, the feature vector includes a feature value for indicating at least one of: a degree of correlation between the first entity and the second entity in the triplet; a degree of interest of the user of the triplet in the second entity in the triplet; and a degree of expectation of the user of the triplet for the second entity in the triplet.

In some alternative implementations, a component for indicating the degree of correlation between the first entity and the second entity in the triplet includes at least one of: a degree of correlation of the first entity and the second entity in the triplet in a preset knowledge graph; a degree of co-occurrence of the first entity and the second entity in the triplet in a search session history; a degree of co-occurrence of the first entity and the second entity in the triplet in a preset corpus; and a subject similarity between the first entity and the second entity in the triplet.

In some alternative implementations, the feature value for indicating the degree of interest of the user of the triplet in the second entity in the triplet includes at least one of: a click rate of the second entity in the triplet; a click rate of a subject category to which the second entity belongs in a preset classification table; and a semantic similarity between the first entity and the second entity in the triplet.

In some alternative implementations, the feature value for indicating the degree of expectation of the user of the triplet for the second entity in the triplet includes at least one of: a familiarity of relationship of the user and/or the first entity to the second entity determined based on historical click data of the user in the triplet; a degree of surprise of the second entity relative to the user and/or the first entity in the triplet; and a click diversity of the first entity in the triplet.

Referring to <figref idref="f0006">Fig. 7</figref>, a schematic structural diagram of a computer system 700 adapted to execute a server of the embodiments of the present application is shown. The server shown in <figref idref="f0006">Fig. 7</figref> is only an illustration, and does not limit the function and use of the embodiments of the present application.

As shown in <figref idref="f0006">Fig. 7</figref>, the computer system 700 includes a central processing unit (CPU) 701, which may execute various appropriate actions and processes in accordance with a program stored in a read-only memory (ROM) 702 or a program loaded into a random access memory (RAM) 703 from a storage portion 708. The RAM 703 also stores various programs and data required by operations of the system 700. The CPU 701, the ROM 702 and the RAM 703 are connected to each other through a bus 704. An input/output (I/O) interface 705 is also connected to the bus 704.

The following components are connected to the I/O interface 705: a storage portion 706 including a hard disk and the like; and a communication portion 707 including a network interface card, such as a LAN card and a modem. The communication portion 707 performs communication processes via a network, such as the Internet. A drive 708 is also connected to the I/O interface 705 as required. A removable medium 709, such as a magnetic disk, an optical disk, a magneto-optical disk, and a semiconductor memory, may be installed on the drive 708, to facilitate the retrieval of a computer program from the removable medium 709, and the installation thereof on the storage portion 706 as needed.

In particular, according to embodiments of the present disclosure, the process described above with reference to the flow chart may be executed in a computer software program. For example, an embodiment of the present disclosure includes a computer program product, which includes a computer program that is tangibly embedded in a machine-readable medium. The computer program includes program codes for executing the method as illustrated in the flow chart. In such an embodiment, the computer program may be downloaded and installed from a network via the communication portion 707, and/or may be installed from the removable media 709. The computer program, when executed by the central processing unit (CPU) 701, executes the above mentioned functionalities as defined by the methods of the present disclosure. It should be noted that the computer readable medium in the present disclosure may be computer readable storage medium. An example of the computer readable storage medium may include, but not limited to: semiconductor systems, apparatus, elements, or a combination any of the above. A more specific example of the computer readable storage medium may include but is not limited to: electrical connection with one or more wire, a portable computer disk, a hard disk, a random access memory (RAM), a read only memory (ROM), an erasable programmable read only memory (EPROM or flash memory), a fibre, a portable compact disk read only memory (CD-ROM), an optical memory, a magnet memory or any suitable combination of the above. In the present disclosure, the computer readable storage medium may be any physical medium containing or storing programs which can be used by a command execution system, apparatus or element or incorporated thereto. The computer readable medium may be any computer readable medium except for the computer readable storage medium. The computer readable medium is capable of transmitting, propagating or transferring programs for use by, or used in combination with, a command execution system, apparatus or element. The program codes contained on the computer readable medium may be transmitted with any suitable medium including but not limited to: wireless, wired, optical cable, RF medium etc., or any suitable combination of the above.

A computer program code for executing operations in the disclosure may be compiled using one or more programming languages or combinations thereof. The programming languages include object-oriented programming languages, such as Java, Smalltalk or C++, and also include conventional procedural programming languages, such as "C" language or similar programming languages. The program code may be completely executed on a user's computer, partially executed on a user's computer, executed as a separate software package, partially executed on a user's computer and partially executed on a remote computer, or completely executed on a remote computer or server. In the circumstance involving a remote computer, the remote computer may be connected to a user's computer through any network, including local area network (LAN) or wide area network (WAN), or may be connected to an external computer (for example, connected through Internet using an Internet service provider).

The flow charts and block diagrams in the accompanying drawings illustrate architectures, functions and operations that may be executed according to the systems, methods and computer program products of the various embodiments of the present disclosure. In this regard, each of the blocks in the flow charts or block diagrams may represent a module, a program segment, or a code portion, said module, program segment, or code portion including one or more executable instructions for executing specified logic functions. It should also be noted that, in some alternative implementations, the functions denoted by the blocks may occur in a sequence different from the sequences shown in the figures. For example, any two blocks presented in succession may be executed, substantially in parallel, or they may sometimes be in a reverse sequence, depending on the function involved. It should also be noted that each block in the block diagrams and/or flow charts as well as a combination of blocks may be executed using a dedicated hardware-based system executing specified functions or operations, or by a combination of a dedicated hardware and computer instructions.

The units or modules involved in the embodiments of the present application may be executed by means of software or hardware. The described units or modules may also be provided in a processor, for example, described as: a processor, including an acquisition unit, a rank unit and a recommendation unit, where the names of these units or modules do not in some cases constitute a limitation to such units or modules themselves. For example, the acquisition unit may also be described as "a unit for acquiring a candidate entity set associated with a to-be-searched entity, in response to receiving a user's search request for the entity."

In another aspect, the present application further provides a non-transitory computer-readable storage medium. The non-transitory computer-readable storage medium may be the non-transitory computer-readable storage medium included in the apparatus in the above described embodiments, or a stand-alone non-transitory computer-readable storage medium not assembled into the apparatus. The non-transitory computer-readable storage medium stores one or more programs. The one or more programs, when executed by a device, cause the device to: acquire a candidate entity set associated with a to-be-searched entity, in response to receiving a user's search request for the entity; input the candidate entity set into a pre-trained ranking model to obtain a candidate entity sequence; and select a candidate entity from the candidate entity sequence and recommend the selected candidate entity to the user, wherein, the ranking model ranks the candidate entity set based on at least one of: a degree of correlation between each candidate entity in the candidate entity set and the to-be-searched entity; a degree of interest of the user in the each candidate entity in the candidate entity set; and a degree of expectation of the user for the each candidate entity in the candidate entity set.

The above description only provides an explanation of the preferred embodiments of the present application and the technical principles used. It should be appreciated by those skilled in the art that the inventive scope of the present application is not limited to the technical solutions formed by the particular combinations of the above-described technical features. The inventive scope should also cover other technical solutions formed by any combinations of the above-described technical features or equivalent features thereof without departing from the concept of the disclosure. Technical schemes formed by the above-described features being interchanged with, but not limited to, technical features with similar functions disclosed in the present application are examples.