Using structured data for online research

Application No: 2008216397

WIPONo: WO08/100882 (22)

Date of Filing: 2008.02.12 (43) (44) (71)

Priority Data

Number

11/705,350

Publication Date: Accepted Journal Date:

Applicant(s)

Microsoft Corporation (32) Date

2007.02.12

2008.08.21

2012.01.19 (33) Country

US (72) Inventor(s)

Vonkoch, Walter;Truelove, Benjamin N.;Lyndersay, Sean;Pavlicic, Miladin;Kim, Jane (74) Agent / Attorney

Davies Collison Cave, 1 Nicholson Street, Melbourne, VIC, 3000 (56) Related Art

US 2006/0143568 A1 US 6546393 B1 US 6237030 B1 US 5935210 A US 2006/0069674 A1 (12) INTERNATIONAL APPLICATION PUBLISHED UNDER THE PATENT COOPERATION TREATY (PCT) (19) World Intellectual Property Organization

International Bureau (43) International Publication Date 21 August 2008 (21.08.2008)

<img file="AU2008216397B2_D0001.tif" />

PCT (10) International Publication Number

WO 2008/100882 Al (51) International Patent Classification:

G06Q 50/00 (2006.01) (21) International Application Number:

PCT/US2008/053643 (22) International Filing Date:

February 2008 (12.02.2008) (25) Filing Language: English (26) Publication Language: English (30) Priority Data:

11/705,350 12 February 2007 (12.02.2007) US (71) Applicant (for all designated States except US)·. MICROSOFT CORPORATION [US/US]; One Microsoft Way, Redmond, Washington 98052-6399 (US).

(72) Inventors: KIM, Jane; c/o Microsoft Corporation, International Patents, One Microsoft Way, Redmond, Washington 98052-6399 (US). LYNDERSAY, Sean; c/o Microsoft Corporation, International Patents, One Microsoft Way, Redmond, Washington 98052-6399 (US). PAVLICIC, Miladin; c/o Microsoft Corporation, International Patents, One Microsoft Way, Redmond, Washington 98052-6399 (US). VONKOCH, Walter; c/o Microsoft

Corporation, International Patents, One Microsoft Way, Redmond, Washington 98052-6399 (US). TRUELOVE, Benjamin, N.; c/o Microsoft Corporation, International Patents, One Microsoft Way, Redmond, Washington 98052-6399 (US).

(81) Designated States (unless otherwise indicated, for every kind of national protection available)·. AE, AG, AL, AM, AO, AT, AU, AZ, BA, BB, BG, BH, BR, BW, BY, BZ, CA,

CH, CN, CO, CR, CU, CZ, DE, DK, DM, DO, DZ, EC, EE, EG, ES, FI, GB, GD, GE, GH, GM, GT, HN, HR, HU, ID, IL, IN, IS, JP, KE, KG, KM, KN, KP, KR, KZ, LA, LC, LK, LR, LS, LT, LU, LY, MA, MD, ME, MG, MK, MN, MW, MX, MY, MZ, NA, NG, NI, NO, NZ, OM, PG, PH, PL, PT, RO, RS, RU, SC, SD, SE, SG, SK, SL, SM, SV, SY, TJ, TM, TN, TR, TT, TZ, UA, UG, US, UZ, VC, VN, ZA, ZM, ZW.

(84) Designated States (unless otherwise indicated, for every kind of regional protection available)·. ARIPO (BW, GH, GM, KE, LS, MW, MZ, NA, SD, SL, SZ, TZ, UG, ZM, ZW), Eurasian (AM, AZ, BY, KG, KZ, MD, RU, TJ, TM), European (AT, BE, BG, CH, CY, CZ, DE, DK, EE, ES, FI, FR, GB, GR, HR, HU, IE, IS, IT, LT, LU, LV, MC, MT, NL, NO, PL, PT, RO, SE, SI, SK, TR), OAPI (BF, BJ, CF, CG,

CI, CM, GA, GN, GQ, GW, ML, MR, NE, SN, TD, TG).

/ Continued on next page] (54) Title: USING STRUCTURED DATA FOR ONLINE RESEARCH wo 2008/100882 Ai lllllllllllllllllllllllllllllllllllllllllllll^

100102

<img file="AU2008216397B2_D0002.tif" />

Computing Device

104 —

Processor(s)

Computer-Readable Media -106

108 - _Λ

<td colspan="4"> ’ Application</td>

<td></td><td></td><td></td><td></td>

<td colspan="3"> 110 —,</td><td></td>

<td></td><td colspan="2"> Web Browser</td><td></td>

Web Browser

112

Collection Module

Fig. 1 (57) Abstract: Various embodiments utilize structured data contained within a resource, such as a web page, to enable a user to define collections of data. Individual constituent parts of a collection or links are collected within a collection. In one or more embodiments, a full page viewing experience can be provided which enables users to not only view more details for a given link, but to view multiple different links at a time. Other viewing options and collection interactions are provided.

WO 2008/100882 A1 IIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIIN

Declarations under Rule 4.17: Published:

— as to applicant’s entitlement to apply for and be granted a — with international search report patent (Rule 4.17(H)) — as to the applicant’s entitlement to claim the priority of the earlier application (Rule 4.17(iii))

WO 2008/100882

PCT/US2008/053643

USING STRUCTURED DATA FOR ONLINE RESEARCH

Background [0001] Some of the tasks that a user performs online involve researching and comparing various items that they find on the web using their web browser. For example, a user may be looking for a new apartment in a particular area of Seattle. Over the course of their research, they may visit four or five different real estate sites and find one or two apartments on each site that are of particular interest to them. Typically, to compare the various apartments, the user may have to physically print a copy and paste multiple apartment listings into a document or spreadsheet. Needless to say, this is a very manual process.

[0002] Alternately, the user may opt to save each apartment page in a favorites list.

This list is typically displayed in a control that is off to the side of the browser window.

Here, however, when the user wishes to review their selections, the user is still faced with the onerous task of manually accessing each link and reviewing, in a generally serial fashion, the various apartments associated with the various links.

Summary [0003] This Summary is provided to introduce a selection of concepts in a simplified form that are further described below in the Detailed Description. This Summary is not intended to identify key features or essential features of the claimed subject matter, nor is it intended to be used to limit the scope of the claimed subject matter.

[0004] Various embodiments utilize structured data contained within a resource, such as a web page, to enable a user to define collections of data. Individual constituent parts of a collection or “links” are collected within a collection. In one or more embodiments, a

2008216397 23 Dec 2011 full page viewing experience can be provided which enables users to not only view more details for a given link, but to view multiple different links at a time.

[0005] In one or more embodiments, the browser can provide multiple different selectable views that can be applied to the various collections. Accordingly, the user can define how data of the collection is presented to them. Further, in at least some embodiments, custom views can be defined and permit views of the collections to be flexibility and extensibly defined. · [0005A] In a first broad form the present invention seeks to provide a computerimplemented method including:

receiving a resource having structured data, the structured data described using one or more data types;

identifying structured data associated with the resource by examining a markup language associated with the resource for one or more descriptions of the structured data contained within the markup language;

rendering the resource having structured data; and presenting a visual indicator that indicates that a link associated with the structured data can be added to a collection, wherein the act of presenting a visual indicator includes displaying the visual indicator with the rendered resource. .

[0005B] Typically the resource includes a web page.

[0005C] Typically the examining a markup language includes examining HyperText

Markup Language (HTML) associated with the resource.

[0005D] Typically the method further includes:

ascertaining whether a user has opted to add the link to a collection; and responsive to the user opting to add the link to the collection, adding the link to the collection.

2008216397 23 Dec 2011

2A [0005E] Typically the visual indicator includes a button or tab, and the act of ascertaining is performed by ascertaining whether the user has clicked on the button or tab. [0005F] Typically displaying the visual indicator with the resource rendered includes automatically displaying the visual indicator when the resource is rendered.

[0005G] Typically displaying the visual indicator with the resource rendered includes selectively displaying the visual indicator when the user hovers their cursor over or near the structured data.

[0005H] Typically the method includes presenting the user with an option to view one or more collections in multiple different ways.

[00051] Typically the acts of receiving, identifying and presenting are performed by a web browser.

[0005J] In a second broad form the present invention seeks to provide a system including:

one or more processors;

one or more computer-readable storage media;

computer-readable instructions on the one or more computer-readable storage media which, when executed by the one or more processors, implement a web browser configured to:

provide one or more collections, wherein at least one of the collections includes a link that is associated with structured data that describes at least one data type of data associated with the link;

display a search box configured to enable a user to enter a search term;

receive a search term via the search box;

enable a search of the one or more collections based, at least in part, on the received search term;

2008216397 23 Dec 2011

2B enable display of information associated with one or more links from the one or more collections that match the received search term; and present the user with an option to view one or more collections in multiple different ways, wherein at least one of the ways that a collection can be viewed is a full page view that includes a summary of information from individual links, the summary of information including, for at least some links, a title, an image, and one or more properties associated with the link. · [0005K] Typically links in a collection can come from different types of sources.

[0005L] Typically the full page view is configured to enable a side-by-side comparison of items in a link. .

[0005M] Typically the web browser is configured to provide a collection that has links associated with structured data and links that are not associated with structured data.

[0005N] Typically one of the ways in which a collection can be viewed is through a title view.

[00050] Typically the web browser is configured to search both collections and sources other than collections and present results from both.

[0005P] Typically ways in which a collection can be viewed include a title view and a detailed view.

[0005Q] Typically the web browser is configured to enable a user to flag or comment on a particular link.

[0005R] Typically one of the ways in which a collection can be viewed is through a custom view that is based on a data type.

2008216397 23 Dec 2011

2C

Brief Description of the Drawings [0006] The same numbers are used throughout the drawings to reference like features.

[0007] Fig. 1 illustrates a system in which various principles described herein can be employed in accordance with one or more embodiments.

[0008] Fig. 2 illustrates an example web page that includes structured data in accordance with one or more embodiments.

[0009] Fig. 3 illustrates an example collection in accordance with one or more embodiments.

[0010] Fig. 4 illustrates a web page in accordance with one or more embodiments.

[0011] Fig. 5 is a flow diagram that describes steps in a method in accordance with one or more embodiments.

[0012] Fig. 6 illustrates an example full page view that presents a collection having links from various different sources in accordance with one or more embodiments.

[0013] Fig. 7 illustrates an example title view of a collection in accordance with one or more embodiments.

[0014] Fig. 8 illustrates a view that allows collections to be searched in accordance with one or more embodiments.

WO 2008/100882

PCT/US2008/053643 [0015] Fig. 9 is a flow diagram that describes steps in a method in accordance with one or more embodiments.

[0016] Fig. 10 illustrates an example system that can be used to implement one or more embodiments.

Detailed Description

Overview [0017] Various embodiments utilize structured data contained within a resource, such as a web page, to enable a user to define collections of data. Individual constituent parts of a collection or “links” are collected within a collection. In one or more embodiments, a full page viewing experience can be provided which enables users to not only view more details for a given link, but to view multiple different links at a time.

[0018] In one or more embodiments, the browser can provide multiple different selectable views that can be applied to the various collections. Accordingly, the user can define how data of the collection is presented to them. Further, in at least some embodiments, custom views can be defined and permit views of the collections to be flexibility and extensibly defined.

[0019] In the discussion that follows, a section entitled “Example System” is provided and describes one system that can be used to implement the embodiments described herein. Following this, a section entitled “Example Structured Data” is provided and introduces the notion of structured data. Following this, a section entitled “Example

Collection” is provided and describes features of a collection in accordance with one or more embodiments. A section entitled “Building A Collection” is then provided and describes how a user can build an example collection in accordance with one or more embodiments. Following this, a section entitled “Viewing or Operating on Collections” is

WO 2008/100882

PCT/US2008/053643 provided and describes, in various sub-sections, how a user can build or otherwise interact with collections in one or more embodiments.

Example System [0020] Fig. 1 illustrates a system in accordance with one or more embodiments, generally at 100. System 100 includes a computing device 102 having one or more processors 104, one or more computer-readable media 106 and one or more applications 108 that reside on the computer-readable media and which are executable by the processor(s). The computer-readable media can include, by way of example and not limitation, all forms of volatile and non-volatile memory and/or storage media that are typically associated with a computing device. Such media can include ROM, RAM, flash memory, hard disk, removable media and the like. In addition, computing device 102 includes an application in the form of a web browser 110. Any suitably configured web browser can be utilized, examples of which are commercially available from the assignee of this document and others. One specific example of a computing device is shown and described below in Fig. 10.

[0021] In one or more embodiments, the web browser includes or otherwise makes use of a collection module 112 which functions as described above and below. The collection module can comprise a native part of the browser, a plug-in which is subsequently added to the browser, and/or a standalone component that is used or otherwise leveraged by the browser.

[0022] Although computing device 102 is illustrated in the form of a desktop computer, it is to be appreciated and understood that other computing devices can be utilized without departing from the spirit and scope of the claimed subject matter. For example, other computing devices can include, by way of example and not limitation,

WO 2008/100882

PCT/US2008/053643 portable computers, handheld computers such as personal digital assistants (PDAs), cell phones and the like.

Example Structured Data [0023] In one or more embodiments, at least some of the data that is subject to the collection forming functionality is so-called structured data. Structured data refers to data that is in a format that can be utilized by the collection module 112. Structured data can be formatted in accordance with known or subsequently developed structured data standards, such as Extensible Markup Language (XML) or HyperText Markup Language (HTML). For example, the structured data can be described in a web page’s HTML in a manner that identifies the data’s particular data type. Specifically, in one or more embodiments,

HTML tags can be utilized to associate a data type with a particular instance of data. Alternately or additionally, structured data can be formatted using other standards, both public and private without departing from the spirit and scope of the claimed subject matter.

[0024] As an example, consider Fig. 2. There, a web page 200 includes an apartment listing 202. In this particular instance, the apartment listing is associated with fields having data types that include an apartment data type, address data type, rent data type, features data type and a picture data type. These fields are described in the page’s HTML 204 by, for example, suitable HTML tags such as the illustrated tags. Other methods and techniques can be used to associate data types with a web site’s data. For example, the data types can be described in header information or other metadata that is associated with the page.

[0025] In the example just above, the structured data was specifically described as structured data through the web page’s HTML. It is also possible, however, for data to not

WO 2008/100882

PCT/US2008/053643 be specifically described as structured data, but to be subsequently processed and utilized by the collection module 112 as will become apparent below.

[0026] In one or more embodiments, structured data can also come from locations other than web pages. For example, structured data can be sourced from various feeds, such as RSS feeds, from data that has been added to the client, e.g. to a suitable web store, and/or from various web applications. It is to be appreciated and understood that structured data can come from other locations as well, all of which are within the spirit and scope of the claimed subject matter.

[0027] Having discussed the general notion of structured data, consider now an example collection in accordance with one or more embodiments.

Example Collection [0028] In one or more embodiments, a collection can be considered to include a collection of links that a user has, with a browser or some other application, organized in some way, such as in a folder. A collection can hold many different types of information.

[0029] As an example, consider Fig. 3. There, a collection 300 can include links 302 having structured data, links 304 without structured data, other collections 306 to provide for nested collections, and/or structured data without links 308. Links without structured data can be considered as links whose data are not defined in a manner that enables the data’s data type(s) to be ascertained. Structured data without links can include content that resides locally that is expressed as structured data. A collection need not have all of the different types of information described above. For example, it is possible for a collection to contain only links having structured data.

[0030] Links of a collection can be associated with different data types. For example, an individual apartment link in collection 300, such as link 302, can include by way of

WO 2008/100882

PCT/US2008/053643 example and not limitation, data types that include apartment, address, rent, features and image data types. In view of the fact that collections can hold a wide variety of different types of information or links, a wide variety of other data types are possible. Other data types can include, by way of example and not limitation, calendar events, photos, products, videos and the like.

[0031] Having discussed the general notion of a collection, consider now how a user can build a collection in one or more embodiments.

Building a Collection [0032] In one or more embodiments, when a browser receives a resource such as a web page via the Internet, it parses the web page’s HTML to ascertain whether there is any structured data contained in the page. Identifying structured data can be performed in any suitable way. For example, if the structured data is specifically described in the web page’s HTML, as in the example above, identifying the structured data can be performed by examining the HTML itself. Alternately or additionally, if the resource is a web application, the structured data can be identified through the programmatic interaction between the browser and the application. Alternately or additionally, if the resource is a feed, such as an RSS feed, the structured data can be identified by parsing the RSS feed data.

[0033] Once structured data has been identified whether on a web page or some other resource, the browser can present a visual indicator to indicate the presence of structured data and that the structured data can be added to a collection. Any suitable visual indicator can be utilized and any suitable way of presenting the indicator can be used.

[0034] As an example, consider Fig. 4 which illustrates the Fig. 2 web page. Notice that along side apartment listing 202 a visual indicator 400 in the form of an “Add” button

WO 2008/100882

PCT/US2008/053643 or icon is displayed. This indicator informs the user that the apartment listing includes structured data that can be added to a collection. In one or more embodiments, the icon can be displayed automatically when the page is rendered. In one or more other embodiments, the icon can be selectively displayed when, for example, the user hovers their cursor over or near the structured data.

[0035] In one or more embodiments, if the user invokes an add operation on the structured data by, for example, clicking on the visual indicator, the browser can present further dialogs that permit the user to select a collection or create a new collection where the link is to be stored. Storing the link in a collection can include, by way of example and not limitation, storing actual items of the link and its structured data in the collection. Alternately, storing the link can include simply storing a reference to the link, along with any other information that might be stored.

[0036] Fig. 5 is a flow diagram that illustrates steps in a method in accordance with one embodiment. The method can be implemented in connection with any suitable hardware, software, firmware or combination thereof. In one or more embodiments, the method can be implemented by a suitably configured web browser, such as the one shown and described in Fig. 1.

[0037] Step 500 receives a resource having structured data. Any suitable resource can be received examples of which are given above. Step 502 identifies structured data associated with the resource. Examples of how this can be done are given above. Step 504 presents a visual indicator that indicates the presence of structured data and that a link associated with the data can be added to a collection. Any suitable type of visual indicator can be used an example of which is given above. Step 506 ascertains whether the user has opted to add the link to the collection. This step can be performed in any suitable way.

For example, if the visual indicator is in the form of a button or tab, the user can simply

WO 2008/100882

PCT/US2008/053643 click the button or tab. If, at step 506, the user opts to not add the link to a collection, the method ends at 508. If, on the other hand, the user opts to add the item to a collection, step 510 adds the link to a collection. This step can be performed in any suitable way, examples of which are provided above.

[0038] Having now discussed the notion of how a user can build a collection, consider now how a suitably configured application, such as a web browser, can enable a user to view their collections in one or more embodiments.

Viewing or Operating on Collections [0039] In the discussion that follows, various different embodiments are described that enable a user to view or otherwise operate upon collections in different ways. Individual embodiments are described under their own respective headings.

Full Page Collection View [0040] In one or more embodiments, an application such as a web browser can provide the ability to view collections in a full page view. Further, in one or more embodiments, this full page view can enable the user to view links associated with different sources or resources, such as various web pages, data from various feeds such as RSS feeds, data added by the client and various web applications and the like. Any suitable type of view can be provided.

[0041] As but one example, consider Fig. 6 which illustrates, generally at 600, a full page view that presents a collection having links from various different sources in accordance with one or more embodiments. The view that is presented is a generally uniform summary view that includes a summary of the information from the link. In this particular example, the summary view can include, for each link, a title, a thumbnail

WO 2008/100882

PCT/US2008/053643 image, and a few lines of properties associated with the link. The information contained in the summary view has been gleaned by the web browser from the HTML associated with the link. In addition, in one or more embodiments, a user interface component 601 in the form of a view drop down menu can be provided to enable the user to select from among different views, as will become apparent below.

[0042] In this example, full page view 600 includes four different links 602, 604, 606 and 608. Each individual link is represented by a title 602a, 604a, 606a and 608a respectively. In addition, each individual link includes a thumbnail image as shown. Further each individual link includes a few lines of properties located adjacent and to the right of its associated thumbnail image.

[0043] As noted above, the links in a collection can, but need not, come from different sources or different types of sources. In the present example, links 602, 604 have come from a web page; link 606 has come from a web application; and, link 608 has come from an RSS feed.

[0044] Having a full page summary view of the links in a collection provides the user with the ability to compare various items in a side-by-side fashion. The summary view provides enough information for the user to understand, at least preliminarily, some of the content associated with the link. In addition, in at least some embodiments, by clicking on or otherwise selecting a particular displayed link, the user’s browser can navigate to the web page associated with the structured data or open an associated file if there is no link to a web page.

[0045] In one or more embodiments, the summary view constitutes but one view that is available for the user, as will become apparent below.

WO 2008/100882

PCT/US2008/053643

Collection View with Structured and Unstructured Data [0046] In one or more embodiments, an application such as a web browser can provide the ability to both build collections and view collections that have links that are associated with structured data and links that do not have structured data. As an example, consider Fig. 7. There, a view 700 is shown and represents a so-called title view that displays, for a collection, individual titles of the links that make up the collection. In this example, view

700 includes links that are both associated with structured data—such as links 702, 704, and links that are not associated with structured data - such as links 706, 708. In this example, the titles associated with the structured data may include rich properties that allow them to be presented in a creative way, such as by having a unique font and/or icon associated with them. The links that are not associated with structured data may not have rich properties and may therefore be represented as simply textual titles. The representation of the links associated with the unstructured data can be considered as somewhat analogous to a list of a person’s favorites. However, by including links associated with structured data in the collection, the user can be exposed to a variety of rich viewing and interaction experiences.

Searching Collections [0047] In one or more embodiments, an application such as a browser can provide the user with the opportunity to search through a collection. In addition, in one or more embodiments, the application can provide the user with the ability search across multiple collections, as well as to pull in search results from sources other than collections. In one or more embodiments, the results can be based on those items with the same or similar data types. One example of such a source is the user’s history of web data. As an example, consider Fig. 8. There, a view 800 is shown. In this example, the application or

WO 2008/100882

PCT/US2008/053643 web browser renders a view that includes a search box 801 in which a user can type various search terms to search across one or more collections and/or other sources.

[0048] In this example, the user has an apartment collection that they are looking at in a summary view. In this example, the user has typed “Seattle” into the search box to search across their collection for apartment data types having text that matches “Seattle” in, for example, the data in the links’ address data type. Notice in this example that the results have pulled in two links associated with structured data which meet the criteria— links 802, 804. Further, in this example, the results have pulled in two links associated with the user’s history - here, links 806, 808. These history links have not been specifically marked by the user as comprising part of the collection. Yet, in one or more embodiments, the application or browser can build a result set that includes them. In situations like this, the user may have forgotten to add a particular browsed link to their collection but, nonetheless, would be interested in viewing it. In one or more embodiments, a user also has the option of selecting a link from their history and adding it to their collection. In the illustrated example, this can be performed by dragging and dropping the link from the history portion of the display to the collection portion of the display.

[0049] In addition, in one or more embodiments, a control box 810 can be provided and can enable the user to search across a collection or collections using various means such as properties and/or data types. In this particular example, the current search has pulled in two results out of the ten links that make up the user’s collection - hence the “Displaying 2/10” that appears in the figure. Here, the user has the option of sorting the search results in accordance with various parameters such as, by way of example and not limitation, title, date added, price and size—each of which can be a different data type associated with the link. In addition, the user can also filter on particular data types

WO 2008/100882

PCT/US2008/053643 associated with the links. Here, the links can be filtered on the data type “location” for values that correspond to those that are shown, i.e. “Capitol Hill” and “Downtown”.

[0050] Thus, the structured data and its manner of representing data as data types can provide a very powerful mechanism for enabling a user to not only build unique and robust collections, but to view and manipulate links of the collection as well.

Multiple Different Selectable Collection Views [0051] As alluded to above, in one or more embodiments, the application or web browser can provide multiple different types of views for a user to view links of their collection.

[0052] In one embodiment, three different types of views are provided—a title view, a summary view and a detailed view. The different views, as well as others, can be selected via any suitable type of user interface component, such as user interface component 601 in Fig. 8.

[0053] In one or more embodiments, when a web browser receives a web page, the web page is typically described by HTML that includes various descriptions and definitions. One of the things that HTML can include are a number of styles that can be applied to the structured data. A style defines, in some manner, how the data is going to look when it is rendered into a web page. To provide the user with a degree of flexibility in how they view their links, the title view and the summary view can be presented as text or text/image displays. That is, in these views, the various styles and other HTML can be stripped so that a more concise visual representation of the data can be presented. For example, Fig. 7 shows an example title view in which only the title of the link is displayed. Figs. 6 and 8, on the other hand, show an example summary view that includes not only

WO 2008/100882

PCT/US2008/053643 the title of the link, but some additional information including an image and a few lines of properties associated with the link.

[0054] The detailed view represents a more thorough display of the link. For example, the detailed view can show the actual HTML that was captured from the web page in the manner in which it was intended to be presented. In the apartment example, this can include providing, for any particular link, multiple views of the apartment along with a virtual tour of the apartment in which the user can “walk through” the apartment.

[0055] Having multiple different types of selectable views can enable the user to view links in their collection in a manner that is most convenient for them. For example, the user may be very familiar with the links in their collection so that the title view is all that they need to access the links for which they are looking. Alternately, the user may be in the preliminary stages of conducting online research so that the summary view provides just enough information to inform the user about a link, but is concise enough to allow a side-by-side presentation and comparison of various links. In this example, if the user finds a particular link of interest, they can simply select that link and change to a detailed view where they can see all of the details associated with that particular link.

Detecting Items that have Changed [0056] In one or more embodiments, if a particular item that is part of a collection has changed in some way, a visual cue can be presented to indicate such a change. For example, if an apartment price has changed, then the browser can detect this and provide a gleam or some other type of visual indication to bring this to the user’s attention.

WO 2008/100882

PCT/US2008/053643

Flagging or Commenting on Collection Items [0057] In one or more embodiments, an application or web browser can provide the user with the option to flag or comment on a particular link. If a user flags or comments on a link, the flag or comment then becomes a property of the link and can be associated with, but stored separately from the link. The user is then able to see the flag or comment within the collection view because the comment or flag effectively becomes part of the link when it is displayed.

Custom Collection Views Based on Data Type [0058] In one or more embodiments, an application or web browser can provide the ability to define one or more custom views for a collection. In at least one embodiment, a custom view can be defined by a data type. So, for example, a contact management experience can create a browser collection view for contacts, as well as other views based on data types. If a collection includes predominately contacts, then the browser can select the custom contact view as a default view of the collection. The user, of course, can change the views. In one or more embodiments, custom views can allow for user interaction. For example, custom views can allow a user to filter based on things such as data type and other parameters.

[0059] In one or more embodiments, third parties can design custom views that can be added to the browser. For example, in the apartment collection described above, a third party may design a map view which displays a map that has pin points that indicate the locations of the various apartments of the collection. The user would then be free to switch between the different views. So, for example, the user may search a particular collection for apartments in the Capitol Hill area of Seattle. When the Capitol Hill

WO 2008/100882

PCT/US2008/053643 apartments are displayed in a summary view, as in Fig. 8, the user may then select a custom-designed map view to see where these particular apartments appear on the map.

[0060] In one or more embodiments, the individual custom views can be designed to provide a view which is defined by a data type associated with a link. For example, in the apartment collection scenario mentioned just above, the map view can be provided as a viewing option when a user’s collection includes data of the type “apartment”. In these embodiments, the web browser can ascertain the data types associated with the particular collection, and then make an intelligent decision on which views to expose to the user.

Auto-converting Links into Collections with Data Types [0061] In one or more embodiments, if a user upgrades from a browser that does not support collections to one that does support collections, the new browser can automatically analyze the user’s saved links and auto-convert them into one or more collections. To do this, the browser can retrieve the web pages associated with the links and analyze the web pages for structured data that is available. If the web browser finds structured data that describes various data types associated with the web page, it can process the structured data and add the associated links into a collection. For example, if the user has bookmarked several links under a folder called “apartments”, then the browser can automatically set up a collection called “apartments”. The browser can then add the individual links as members of the collection. This can be done, in some embodiments, where some links are associated with structured data and where some links are not associated with structured data, as in the example above.

[0062] Fig. 9 is a flow diagram that describes steps in a method in accordance with one or more embodiments. The method can be implemented in any suitable hardware, software, firmware or combination thereof. In one or more embodiments, the method can

WO 2008/100882

PCT/US2008/053643 be implemented by a suitably configured web browser application, such as the one described above.

[0063] Step 900 provides one or more collections. This step can be performed in any suitable way. For example, in one or more embodiments, a web browser can provide user interface components that enable a user to discover and add particular links to a collection.

Examples of how this can be done are described above. Step 902 presents the user with an option to view one or more collections in multiple different ways. This step can be performed in any suitable way. For example, in at least some embodiments, when the user displays a collection, a user interface component in the browser can enable a user to see and then select from among a number of different views. One example of a user interface component is provided above. Any suitable type of view option can be presented to the user. For example, some view options can enable the user to see a full page view of their collection along with information that may be of interest to them, such as a title, images and/or a short list of properties associated with the link. In addition, in at least some embodiments, the links that are viewable can come from different sources such as, for example, web pages, web applications, feeds and the like. Alternately or additionally, in at least some embodiments, one or more viewing options provide the user with the ability to view both links that are associated with structured data and links that are not associated with structured data.

[0064] Further, in at least some embodiments, the viewing options that are presented to the user can include user interface instrumentalities that can enable the user to search a collection or collections. In at least some of the searching embodiments, in addition to searching across collections, the browser can provide the user with the ability to search across sources other than collections and have the results displayed along with the collection search results.

WO 2008/100882

PCT/US2008/053643 [0065] Continuing, in one or more embodiments, some of the other viewing options that can be presented to the user include, by way of example and not limitation, a title view, a summary view and a detailed view each of which is described above. Alternately or additionally, one of the viewing options can enable the user to flag or otherwise comment on a particular link. Alternately or additionally, another viewing option can enable the user to select from among one or more custom-designed views. These customdesigned views can, but need not, be based on various data types that are associated with the links.

[0066] Fig. 10 illustrates an example computing device 1000 that can implement the various embodiments described above. Computing device 1000 can be, for example, computing device 102 of Fig. 1 or any other suitable computing device.

[0067] Computing device 1000 includes one or more processors or processing units

1002, one or more memory and/or storage components 1004, one or more input/output (I/O) devices 1006, and a bus 1008 that allows the various components and devices to communicate with one another. Bus 1008 represents one or more of any of several types of bus structures, including a memory bus or memory controller, a peripheral bus, an accelerated graphics port, and a processor or local bus using any of a variety of bus architectures. Bus 1008 can include wired and/or wireless buses.

[0068] Memory/storage component 1004 represents one or more computer storage media. Component 1004 can include volatile media (such as random access memory (RAM)) and/or nonvolatile media (such as read only memory (ROM), Flash memory, optical disks, magnetic disks, and so forth). Component 1004 can include fixed media (e.g., RAM, ROM, a fixed hard drive, etc.) as well as removable media (e.g., a Flash memory drive, a removable hard drive, an optical disk, and so forth).

WO 2008/100882

PCT/US2008/053643 [0069] One or more input/output devices 1006 allow a user to enter commands and information to computing device 1000, and also allow information to be presented to the user and/or other components or devices. Examples of input devices include a keyboard, a cursor control device (e.g., a mouse), a microphone, a scanner, and so forth. Examples of output devices include a display device (e.g., a monitor or projector), speakers, a printer, a network card, and so forth.

[0070] Various techniques may be described herein in the general context of software or program modules. Generally, software includes routines, programs, objects, components, data structures, and so forth that perform particular tasks or implement particular abstract data types. An implementation of these modules and techniques may be stored on or transmitted across some form of computer readable media. Computer readable media can be any available medium or media that can be accessed by a computing device. By way of example, and not limitation, computer readable media may comprise “computer storage media” and “communications media.” [0071] “Computer storage media” include volatile and non-volatile, removable and non-removable media implemented in any method or technology for storage of information such as computer readable instructions, data structures, program modules, or other data. Computer storage media include, but are not limited to, RAM, ROM, EEPROM, flash memory or other memory technology, CD-ROM, digital versatile disks (DVD) or other optical storage, magnetic cassettes, magnetic tape, magnetic disk storage or other magnetic storage devices, or any other medium which can be used to store the desired information and which can be accessed by a computer.

[0072] ‘ ‘Communication media” typically embody computer readable instructions, data structures, program modules, or other data in a modulated data signal, such as carrier wave or other transport mechanism. Communication media also include any information

WO 2008/100882

PCT/US2008/053643 delivery media. The term “modulated data signal” means a signal that has one or more of its characteristics set or changed in such a manner as to encode information in the signal. By way of example, and not limitation, communication media include wired media such as a wired network or direct-wired connection, and wireless media such as acoustic, RF, infrared, and other wireless media. Combinations of any of the above are also included within the scope of computer readable media.

Conclusion [0073] Various embodiments utilize structured data contained within a resource, such as a web page, to enable a user to define collections of data. Individual constituent parts of a collection or “links” are collected within a collection. In one or more embodiments, a full page viewing experience can be provided which enables users to not only view more details for a given link, but to view multiple different links at a time.

[0074] In one or more embodiments, the browser can provide multiple different selectable views that can be applied to the various collections. Accordingly, the user can define how data of the collection is presented to them. Further, in at least some embodiments, custom views can be defined and permit views of the collections to be flexibility and extensibly defined.

[0075] Although the subject matter has been described in language specific to structural features and/or methodological acts, it is to be understood that the subject matter defined in the appended claims is not necessarily limited to the specific features or acts described above. Rather, the specific features and acts described above are disclosed as example forms of implementing the claims.

2008216397 23 Dec 2011

20A [0076] The reference in this specification to any prior publication (or information derived from it), or to any matter which is known, is not, and should not be taken as an acknowledgment or admission or any form of suggestion that the prior publication (or information derived from it) or known matter forms part of the common general knowledge in the field of endeavour to which this specification relates.

[0077] Throughout this specification and the claims which follow, unless the context requires otherwise, the word comprise, and variations such as comprises and comprising, will be understood to imply the inclusion of a stated integer or step or group of integers or steps but not the exclusion of any other integer or step or group of integers or steps.

2008216397 23 Dec 2011