Information sharing between images

BACKGROUND

0001Searching for images in a large database has in the past been very cumbersome. Content-based image retrieval, also known as query by image content and content-based visual information retrieval, is the application of computer vision to the image retrieval problem, that is, the problem of searching for digital images in large databases. “Content-based” means that the search makes use of the contents of the images themselves, rather than relying on metadata such as captions or keywords, which is typically input by humans.

0002There is growing interest in content-based image retrieval because of the limitations inherent in meta data-based systems. Textual information about images can be easily searched using existing technologies, but this type of a search requires humans to personally describe every image in the database. This is impractical for very large databases, or for images that are generated automatically, such as, for example, from surveillance cameras. It is also possible to miss images that use different synonyms in their descriptions.

0003The ideal content-based image retrieval system from a user's perspective involves semantic retrieval, where the user makes a request like “find pictures of a flower”. This type of open-ended task is very difficult for computers to perform—pictures of roses and lilies look very different. Current content-based information systems therefore generally make use of lower level features like texture, color, and shape in searching for images, although some systems take advantage of higher-level features.

0004Object instance (or known object) recognition is one type of content-based image retrieval. Object instance recognition is the task of recognizing a specific object in an image. Object instance recognition does not recognize categories of objects, but instead a particular object from a category. By way of example, these specific objects may include specific artwork (such as the Mona Lisa), a specific photograph, the front of a specific restaurant, or an object on a supermarket shelf.

0005Major search engines have yet to implement content based image retrieval and object instance recognition image retrieval to browse or search through their indexes of images, the largest of which contain links to billions of photographs and graphics. Still, research by both industry and academia has achieved some intriguing advances of late that sidestep the need for keywords—and address the challenge of analyzing the content of images in large databases.

SUMMARY

0006This Summary is provided to introduce a selection of concepts in a simplified form that are further described below in the Detailed Description. This Summary is not intended to identify key features or essential features of the claimed subject matter, nor is it intended to be used to limit the scope of the claimed subject matter.

0007In one embodiment of the present image information sharing technique photographs or images are supplied by a set of authors. The supplied images are associated with relevant information related to the photographs and/or objects in the photographs, such as, for example, comments and links to web pages. A user of the image information sharing technique acquires a picture, such as for example, by taking a picture of an object that interests them. Such an object could be, for example, a poster, a product, or a painting. The user uploads the picture to an image information sharing server (or servers). The image information sharing server then searches an image information sharing database which stores the authored images and matches the uploaded picture to an image in the database. Information regarding the image, or an object in the image, such as comments and web links associated with the matched photo, are subsequently sent to the user. The user can then optionally follow the links to obtain additional information about the image or an object in the image.

0008In one embodiment, the image information sharing technique uses a content-based image retrieval process to match the photograph or image uploaded by the user to an image in the image information sharing database. This allows a user to query a database using images vice keywords. In one embodiment, object instance recognition, a form of content-based image retrieval, is used to match an object in the image submitted by a user to an object in an image in the image information sharing database. For processing user queries the image information sharing technique can rely entirely on the content of the image sent by the user.

0009Obtaining additional information on objects in images submitted to the image information sharing server is a synchronous user experience, which is different from other two-part “email the image first, then wait for the response email” style systems. Since in one embodiment an image information sharing application is used to send the image to be used to query the image information sharing database, the image information sharing technique is independent of an email system and hence faster and more convenient in transmission and receipt of images and image information.

0010It is noted that while the foregoing limitations in existing database searching schemes described in the Background section can be resolved by a particular implementation of the present image information sharing technique, this is in no way limited to implementations that just solve any or all of the noted disadvantages. Rather, the present technique has a much wider application as will become evident from the descriptions to follow.

0011In the following description of embodiments of the present disclosure reference is made to the accompanying drawings which form a part hereof, and in which are shown, by way of illustration, specific embodiments in which the technique may be practiced. It is understood that other embodiments may be utilized and structural changes may be made without departing from the scope of the present disclosure.

DESCRIPTION OF THE DRAWINGS

0012The specific features, aspects, and advantages of the disclosure will become better understood with regard to the following description, appended claims, and accompanying drawings where:

0013<figref idref="DRAWINGS">FIG. 1</figref> is a diagram depicting a general purpose computing device constituting an exemplary system for a implementing a component of the present image information sharing technique.

0014<figref idref="DRAWINGS">FIG. 2</figref> is a diagram depicting the general concept employed in one embodiment of the present image information sharing technique.

0015<figref idref="DRAWINGS">FIG. 3</figref> is a diagram depicting a high level system architecture and operating environment employed in one embodiment of the present image information sharing technique.

0016<figref idref="DRAWINGS">FIG. 4</figref> is a flow diagram depicting one exemplary embodiment of a process employing the present image information sharing technique.

0017<figref idref="DRAWINGS">FIG. 5</figref> is a flow diagram depicting one exemplary embodiment of an image authoring process employed in the present image information sharing technique.

0018<figref idref="DRAWINGS">FIG. 6</figref> is a flow diagram depicting one exemplary process of uploading a query image to the image information sharing database using a camera phone.

0019<figref idref="DRAWINGS">FIG. 7</figref> is a flow diagram depicting one exemplary process of uploading a query image to the image information sharing database using a standard computing device.

0020<figref idref="DRAWINGS">FIG. 8</figref> is a flow diagram depicting one exemplary embodiment of a process for matching an uploaded image to an image in the database employed in the present Image information sharing.

0021<figref idref="DRAWINGS">FIG. 9</figref> is another flow diagram depicting one exemplary embodiment of a process for matching an uploaded image to an image in the database employed in the present Image information sharing.

DETAILED DESCRIPTION

1.0 The Computing Environment

0022Before providing a description of embodiments of the present image information sharing image information sharing technique, a brief, general description of a suitable computing environment in which portions thereof may be implemented will be described. The present technique is operational with numerous general purpose or special purpose computing system environments or configurations. Examples of well known computing systems, environments, and/or configurations that may be suitable include, but are not limited to, personal computers, server computers, hand-held or laptop devices, multiprocessor systems, microprocessor-based systems, set top boxes, programmable consumer electronics, network PCs, minicomputers, mainframe computers, distributed computing environments that include any of the above systems or devices, and the like.

0023<figref idref="DRAWINGS">FIG. 1</figref> illustrates an example of a suitable computing system environment. The computing system environment is only one example of a suitable computing environment and is not intended to suggest any limitation as to the scope of use or functionality of the present image information sharing technique. Neither should the computing environment be interpreted as having any dependency or requirement relating to any one or combination of components illustrated in the exemplary operating environment. With reference to <figref idref="DRAWINGS">FIG. 1</figref>, an exemplary system for implementing the present image information sharing technique includes a computing device, such as computing device <b>100</b>. In its most basic configuration, computing device <b>100</b> typically includes at least one processing unit <b>102</b> and memory <b>104</b>. Depending on the exact configuration and type of computing device, memory <b>104</b> may be volatile (such as RAM), nonvolatile (such as ROM, flash memory, etc.) or some combination of the two. This most basic configuration is illustrated in <figref idref="DRAWINGS">FIG. 1</figref> by dashed line <b>106</b>. Additionally, device <b>100</b> may also have additional features/functionality. For example, device <b>100</b> may also include additional storage (removable and/or non-removable) including, but not limited to, magnetic or optical disks or tape. Such additional storage is illustrated in <figref idref="DRAWINGS">FIG. 1</figref> by removable storage <b>108</b> and non-removable storage <b>110</b>. Computer storage media includes volatile and nonvolatile, removable and non-removable media implemented in any method or technology for storage of information such as computer readable instructions, data structures, program modules or other data. Memory <b>104</b>, removable storage <b>108</b> and non-removable storage <b>110</b> are all examples of computer storage media. Computer storage media includes, but is not limited to, RAM, ROM, EEPROM, flash memory or other memory technology, CD-ROM, digital versatile disks (DVD) or other optical storage, magnetic cassettes, magnetic tape, magnetic disk storage or other magnetic storage devices, or any other medium which can be used to store the desired information and which can accessed by device <b>100</b>. Any such computer storage media may be part of device <b>100</b>.

0024Device <b>100</b> may also contain communications connection(s) <b>112</b> that allow the device to communicate with other devices. Communications connection(s) <b>112</b> is an example of communication media. Communication media typically embodies computer readable instructions, data structures, program modules or other data in a modulated data signal such as a carrier wave or other transport mechanism and includes any information delivery media. The term “modulated data signal” means a signal that has one or more of its characteristics set or changed in such a manner as to encode information in the signal. By way of example, and not limitation, communication media includes wired media such as a wired network or direct-wired connection, and wireless media such as acoustic, RF, infrared and other wireless media. The term computer readable media as used herein includes both storage media and communication media.

0025Device <b>100</b> may have various input device(s) <b>114</b> such as keyboard, mouse, microphone, pen, voice input device, touch input device, and so on. Output device(s) <b>116</b> such as a display, speakers, a printer, and so on may also be included. All of these devices are well known in the art and need not be discussed at length here.

0026Device <b>100</b> can include a camera as an input device <b>114</b> (such as a digital/electronic still or video camera, or film/photographic scanner), which is capable of capturing an image or a sequence of images, as an input device. Further, multiple cameras could be included as input devices. The images from the one or more cameras can be input into the device <b>100</b> via an appropriate interface (not shown). However, it is noted that image data can also be input into the device <b>100</b> from any computer-readable media as well, without requiring the use of a camera.

0027The present image information sharing technique may be described in the general context of computer-executable instructions, such as program modules, being executed by a computing device. Generally, program modules include routines, programs, objects, components, data structures, and so on, that perform particular tasks or implement particular abstract data types. The present image information sharing technique may also be practiced in distributed computing environments where tasks are performed by remote processing devices that are linked through a communications network. In a distributed computing environment, program modules may be located in both local and remote computer storage media including memory storage devices.

0028The exemplary operating environment having now been discussed, the remaining parts of this description section will be devoted to a description of the program modules embodying the present image information sharing technique.

2.0 Image Information Sharing Technique

0029In a most general sense, the image information technique allows a user to obtain information about an object just using its image. As shown in <figref idref="DRAWINGS">FIG. 2</figref>, the user takes a picture of something they want more information about (box <b>202</b>). For example, they could take this picture with a camera phone. The user then sends the image via a network to a server entity (which could be one or more servers) (box <b>204</b>). The server entity then finds additional information about the object in the image (box <b>206</b>), or the image itself, and provides this to the user (box <b>208</b>).

0030More specifically, in one embodiment of the present image information sharing technique, digital images containing relevant comments and links to web pages are supplied by a set of authors. A user of the image information sharing technique takes a photograph or otherwise acquires an image of something that interests them, such as, for example, a poster, a product, a painting. This photo or image is then uploaded to an image information sharing server (or servers). The image information sharing technique then matches the photo or an object in the photo uploaded to the image information sharing server to an object in an image in an image information sharing database. If a match is found, the comments and web links associated with the matched photo in the image information sharing database are subsequently sent to the user.

0031The present image information sharing technique allows a user to query a database using images vice keywords. For processing user queries the image information sharing technique can rely entirely on the content of the image image sent by the user. This eliminates the need to annotate an image before querying the image information sharing database.

2.1 Architecture.

0032<figref idref="DRAWINGS">FIG. 3</figref> provides an exemplary architecture wherein the present interactive image information sharing technique can be practiced. In the most general terms, in one embodiment, the image information sharing architecture can include a standard computing device <b>302</b> (such as described with respect to <figref idref="DRAWINGS">FIG. 1</figref>) with an Image information sharing application <b>304</b>, a browser <b>306</b>, a connection to a network such as the Internet, and one or more input devices, such as a keyboard and/or a mouse, <b>320</b>. The standard computing device <b>302</b> could be in one of many configurations such as, for example, a desktop computer, a notebook computer, a Personal Data Assistant, or a Tablet PC, to name a few. The standard computing device <b>302</b> can also have a camera <b>322</b> or other means for capturing images <b>324</b>. A user can use the computing device <b>302</b> to author images such as, for example, by adding website links and comments to them. A user can also use the computing device <b>302</b> to manage any images that reside on it, for example, by editing, deleting or adding them.

0033In one embodiment of the present image information sharing technique, the computing device can also be a cellular telephone (for example, a Smartphone) <b>308</b> with a camera and network connectivity and an image information sharing application installed on it for sending images to, and receiving information from, the image information sharing server. In one embodiment a user can also use the phone <b>308</b> to capture images and to add comments to them. It should be noted that the computing device <b>302</b> and camera phone <b>308</b> are only exemplary in nature and that many other types and numbers of computing devices can be employed with the image information sharing technique.

0034Both the standard computing devices <b>302</b>, and any specialized computing devices such as the camera phone <b>308</b>, can be clients to an image information sharing server <b>312</b> which accesses an image information sharing database <b>316</b> of images. The clients communicate with the server (although several servers could be used) <b>312</b>, preferably via a network such as, for example, the Internet <b>310</b>. The image information sharing server has a content-based image retrieval image analyzer <b>314</b> which is used to match images in the image information sharing database <b>316</b> to any image sent to the image information sharing server <b>312</b> by a client. As discussed previously, the images in the image information sharing database <b>316</b> are preferably authored to contain additional information about the image, such as, for example, comments about objects in the image, search term keywords that can be associated with the object, location of the image or objects in the image and relevant website links for obtaining additional information about the image or objects in the image. In one embodiment of the present image information sharing technique, anyone that has an image information sharing application can author images by adding comments or website links to them prior to uploading them to the image information sharing database <b>216</b>. In another embodiment, image authoring can be limited to authors that are assigned a certain level of privilege. In yet another embodiment, querying the image information sharing database, as well as authoring and uploading images to the image information sharing server and database is limited to subscribers of an image information sharing service employing the architecture.

0035Either the standard computing device <b>302</b> or the camera phone <b>308</b> can send an image to one or more image information sharing servers <b>312</b> in an attempt to obtain more information about objects in the image from the image information sharing database <b>316</b>. The computing device <b>302</b> typically accesses the image information sharing server via an image information sharing website and a browser. Once the image information sharing server <b>312</b> obtains the image from a computing device <b>302</b> or camera phone <b>308</b> clients, it uses the content-based image retrieval analyzer <b>314</b> to determine if there is a match of an object in the image received from the client to one that exists in the image information sharing database <b>316</b>. If a match is found, the image information sharing server <b>312</b> extracts information (e.g., comments, location, website links) from the image in the image information sharing database <b>316</b>, and sends this back (in one embodiment along with a thumbnail of the image in the database) to the client that sent the image. Once the client (computing device <b>302</b>, smart phone <b>308</b>) receives the information it can be used for various purposes, such as linking to other sources of information.

0036In one embodiment, the image information sharing architecture includes a bulk content loader <b>318</b> which can connect to the image information sharing server via a network or directly. The bulk content loader <b>318</b> enables the mass import of searchable images into the image information sharing server <b>312</b>. The bulk loader permits many images to be loaded in a fast, convenient manner (an alternative would be to load them one-at-a-time via the web page). In one embodiment the loader pre-populates the database with certain images.

0037Obtaining additional information on objects in images submitted to the image information sharing server is a synchronous user experience, which is different from other two-part “email the image first, then wait for the response email” style systems. Since, in one embodiment, the image information sharing application is used to send the image to be used to query the image information sharing database the image information sharing technique is independent of an email system and hence faster and more convenient in transmission and receipt of images and image information. This is particularly true when the client is a cellular smart phone, as typing using the very small keyboard typical in such a device is often tedious and frustrating. In one embodiment a cellular phone is equipped with a button to activate the sending of an image on the phone to the Image information sharing server. In this embodiment a user merely needs to take a picture and press the send button to send a captured image to the server in order to query the Image information sharing database.

2.2 Overview of the Image Information Sharing Process.

0038<figref idref="DRAWINGS">FIG. 4</figref> provides an exemplary flow diagram of one embodiment of the present image information sharing technique. Images containing relevant information about an object in an image, such as, for example, comments and links to web pages are supplied by a set of authors (box <b>402</b>). A user of the image information sharing technique takes a digital picture of something that interests them, such as, for example, a poster, a product, a painting, or acquires it from another source, and uploads it to an image information sharing server (box <b>404</b>). The image information sharing technique then matches the user acquired image to an image in an image information sharing database using a content-based image retrieval technique (box <b>406</b>). The comments and web links associated with the matched photo are subsequently sent to the user (box <b>408</b>). This process of uploading images to obtain additional information about an object in the uploaded image can be repeated by this user and others (boxes <b>404</b>, <b>406</b>, <b>408</b>).

0039The following sections provide details of the above-described architecture and process.

2.2 Authoring Content.

0040Image information sharing authors supply content to the image information sharing database. In one embodiment, anyone in the general public, who has registered with an image information sharing service can be an author. An author supplies a digital image used for matching, along with information about the image. This image may be a digital photograph or one synthetically generated (such as, for example, by using an image editing or creating application). The information included with the image may include a web page relevant to the image or comments about the content of the image. The author may also choose whether other people can add comments and/or web page links to the image. More specifically, as shown in <figref idref="DRAWINGS">FIG. 5</figref>, an author captures an image or acquires it in some other manner (box <b>502</b>). The author then appends information about the image, such as relevant web site addresses or location. In addition the author can add permissions to the image, such as whether other people can append their information (box <b>504</b>). The author then attempts to upload the image to the image information sharing database (boxes <b>506</b>, <b>508</b>). If the authored image is already on the server, the process starts over (boxes <b>502</b> through <b>506</b>). If the image is not already authored, the authored image is uploaded to the server or servers (boxes <b>508</b>, <b>510</b>).

0041In one exemplary embodiment of the present technique, many images are loaded at once using a bulk loader, as discussed previously with respect to <figref idref="DRAWINGS">FIG. 3</figref>.

2.3 Uploading a Query.

0042The image information sharing technique can upload image to query the image information sharing database in a variety of ways. In one embodiment, the uploading is from an image information sharing application. In another embodiment it is from a web site. In regard to the image information sharing application the program runs in the background of the computing device such as a standard computing device or a camera phone. For example, in the context of a camera phone, the image sharing technique, the user downloads the image information sharing application onto their cellular phone and installs it (<figref idref="DRAWINGS">FIG. 6</figref>, box <b>602</b>). Once the image information sharing application is launched, the user captures or otherwise acquires a photograph of an object they are interested in (box <b>604</b>). Once captured, the user can optionally inspect the photo and if desired send it to the image information sharing server (box <b>606</b>, <b>608</b>, <b>610</b>). A captured photo may also be sent directly to the image information sharing server or servers, without inspection (box <b>610</b>). The uploaded photo is matched against image information sharing database (box <b>614</b>) and if no match is found, a message is sent to the user saying so (box <b>618</b>). If a match is found, information about the photo is sent back to the user (box <b>616</b>, <b>620</b>). On the user's cellular phone, comments about the photo as well as links to web pages associated with the photo are displayed. The user may follow the web link, read comments left by users, or if permission is given for that photo, the user can add their own comments and/or links (box <b>622</b>).

0043In regard to the website embodiment for content uploading, once a photo is captured it can be uploaded to the image information sharing server from an image information sharing website on the computing device.

0044More specifically, as shown in <figref idref="DRAWINGS">FIG. 7</figref>, in one embodiment of the image information sharing technique, the user accesses the image information sharing server via a website from their computing device (<figref idref="DRAWINGS">FIG. 7</figref>, box <b>702</b>). Once the image information sharing website is accessed, the user acquires a photograph of an object they are interested in (box <b>704</b>). Once acquired, the user can optionally inspect the photo and if desired send it to the image information sharing server (box <b>706</b>, <b>708</b>, <b>710</b>). The captured photo may also be sent directly to the image information sharing server, without inspection (box <b>710</b>). The uploaded photo is matched against image information sharing database (box <b>714</b>) and if no match is found, a message is sent to the user saying such (box <b>718</b>). If a match is found, information about the photo is sent back to the user (box <b>716</b>, <b>720</b>). On the user's computer display, comments about an object in the photo as well as web page links associated with an object in the photo are displayed. The user may follow the web links, read comments left by users, or if permission is given for that photo, the user can add their own comments and/or links (box <b>722</b>).

0045In one embodiment, additional processing can be done on the user's computing device so that the information used for matching, known as the image signature, is extracted from the image. The image signature, instead of the image, can then be sent to the image information sharing server or servers for matching. In this embodiment, computational resources of the server can be saved since the image processing is done on the user's computing device. Furthermore, it may be impossible to reconstruct the user's image from the image signature, increasing the user's privacy. This embodiment will be discussed in more detail later.

2.4 Matching an Uploaded Image to an Image in the Database.

0046The present image information sharing technique matches the user's uploaded image to an image in the image information sharing database. For example, in one embodiment the technique uses a content-based image retrieving technique described in a co-pending patent application entitled “OBJECT INSTANCE RECOGNITION USING FEATURE SYMBOL TRIPLETS”, filed on Jan. 27, 2006, and assigned Ser. No. 11/342,218. This object instant recognition image matching technique is called the feature symbol triplets object instance recognition method.

0047In general, the feature symbol triplets object instance recognition method finds an object in an image that is uploaded by a user to the image information sharing server by comparing portions of the object to images in the Image information sharing database. If the object in the uploaded query image matches one of the images in the database, the object is identified and information regarding the image is sent back to the user.

0048In particular, as shown in <figref idref="DRAWINGS">FIG. 8</figref>, the feature symbol triplets object instance recognition method begins by finding features in a query image (the image uploaded by the user), where the query image contains at least one object (box <b>802</b>). A group of three features are found in the query image and grouped into a feature triplet (box <b>804</b>). Next, an affine transformation is computed using neighboring feature positions (box <b>806</b>). In other words, for each of the three features in the feature triplet the affine transformation for that feature is computed using its neighboring other two features in the triplet.

0049The computed affine transformation is used to warp the feature triplet into a geometric shape in canonical space (box <b>808</b>). This geometric shape takes the form of a triangle. In a one embodiment, the geometric shape is an equilateral triangle. Next, each of the features in the warped feature triplet is matched with triplets of features in the images in the image information sharing database (box <b>810</b>). Comparing triplets of features, instead of individual features used by other search methods, enhances the likelihood of finding a match. The result of this matching is an identified object and any information associated with the object such as web site links and other information provided by the author of the image in the image information sharing database (box <b>812</b>).

0050In one embodiment, the extraction of triplet information (or if another method is used for matching the uploaded image to the database, the information used to determine a match) can be done on the image information sharing server or servers or on the user's computational device. If the image signature consisting of the triplet information is extracted on the user's computational device, only the image signature and not the original image needs to be sent to image information sharing server.

0051An exemplary embodiment employing the technique described in the paragraph above is shown in <figref idref="DRAWINGS">FIG. 9</figref>. The user accesses the image information sharing server via a website from their computing device (<figref idref="DRAWINGS">FIG. 9</figref>, box <b>902</b>). Once the image information sharing website is accessed, the user acquires a photograph of an object they are interested in (box <b>904</b>). Once acquired, the user can optionally inspect the photo and decide whether to send it to the image information sharing server or servers (boxes <b>906</b>, <b>908</b>, <b>910</b>). If the user decides they want more information on the image or an object in the image, an image signature (information used for matching) is extracted (block <b>912</b>) and the image signature or other information is sent to the image information sharing server (box <b>914</b>). The uploaded image signature or other information used for matching is matched against the image information sharing database (box <b>916</b>) and if no match is found, a message is sent to the user saying such (box <b>918</b>, <b>920</b>). If a match is found, information about the image or object in the image is sent back to the user (box <b>918</b>, <b>922</b>). On the user's computer display, comments about an object in the photo as well as web page links associated with the image or object in the image are displayed. The user may follow the web links, read comments left by users, or if permission is given for that photo, the user can add their own comments and/or links (box <b>924</b>, <b>926</b>).

0052It should be noted, however, that any content-based image retrieval technique, or object instance recognition technique, can be used for matching the user uploaded image to an image in the image information sharing database.

2.5 Exemplary Applications

0053The image information sharing technique can be used for many, many purposes. For example, it is possible for an image information sharing user to take a photo of a billboard, subway advertisement, magazine or newspaper advertisement and get more information about the product in the advertisement (for example, the user can be directed to a promotion-specific web site, or the corresponding television advertisement). This is significantly better for the advertiser than hoping the user will type in a website address on their phone.

0054Another exemplary application involves a user taking a photo of a consumer product box and receiving prices at various retail outlets or web sites to ensure that they are getting the best deal. Or a user can take a photo of a movie advertisement in the paper and see the trailer, get reviews, or be provided with local playing times.

0055Yet another application involves a user taking a photo of a restaurant card (or signage) and receiving a menu, reviews, or health department violations. Likewise, another application involves a user taking a photo of a concert or album promotion poster and receiving tickets or hearing a sample track.

0056Still another application involves a user taking a photo of bus number on printed timetable and receiving real-time information on the location of the bus, or just access to an online timetable. Or another application involves a user taking a photo of a beer mat and accessing bar jokes; or taking a photo of printed place mats and getting access to restaurant recipes.

0057Still another application involves a user taking a still image in a TV advertisement as a way to receive coupons. TV shows can do the same to give access to fun show facts or show related material. Or another application involves a user taking a photo of a resort in a travel brochure and receiving a multi-media virtual tour of the resort.

0058The above examples of how the present image information sharing technique can be employed are not meant to be exhaustive in nature. There are many other ways that the technique could be used.

0059It should also be noted that any or all of the aforementioned embodiments throughout the description may be used in any combination desired to form additional hybrid embodiments.