US9053616B2

Computing systems and methods for electronically indicating the acceptability of a product

Summary by NHIP

Product Label Acceptability Verification

The method captures product label images and determines monitor types to select specific analysis techniques. It compares active areas with color reference areas when monitors contain them, transmitting results to a host server for acceptability reports.

Claim Score by NHIP

Read claim 13, the broadest

Abstract

Computing systems and methods for electronically indicating the acceptability of a product. An image capture and communication device may analyze a product label that includes one or more monitors, authentication elements, and identification elements. The image capture and communication device may determine the type and features of the monitors, authentication elements, and identification elements and, based on the type of the monitors, authentication elements, and identification elements. The image capture and communication device may transmit data based on the type and features to a host server, which may transmit data associated with the host product to the image capture and communication device in, inter alia, the form of an acceptability report.

US9053616B2, drawing sheet 1 — Sheet 1 of 14

Term

5.2 yearsleft in the term

Expires 21 November 2031, including 580 days of term adjustment.

Parties

Owner: ZEBRA TECHNOLOGIES CORP
Assignee: TEMPTIME CORPORATION
Inventors and applicants: Frederick Robert Grabiner, Livingston, United States of America
Carl Michael Lentz, Cedar Knolls, United States of America
Emily Moore, Haddam Neck, United States of America
Thaddeus Prusik, Stroudsburg, United States of America
and 1 more inventorsShow fewer
Nicholas Puro, Briarcliff Manor, United States of America

Examination

Examiner: Kira Nguyen, art unit 3689
Agent: K&L Gates LLP
Filing to grant: 5.1 years
Office actions: Allowed after 2 non-final rejections, 1 final rejection and 1 RCE.⁠

Reach

Cited by: 22 later patents⁠
Cites: 72 earlier patents, 40 other works⁠
Family: 18 members in 7 offices⁠US8EP3CN2HK2DKJPWO

Classification

CPC: G07G1/0081G06Q30/018G16H10/20G06Q10/087G16H40/20G06Q10/0877
IPC: G06Q99 00G07G1 00G06Q10 08G06Q30 00

32 claims: 2 independent, 30 dependent

1
A method for determining the acceptability of a variety of host products having labels with different types of environmental monitors, the different types of environmental monitors having different types of features, each of the labels having one or more types of environmental monitor and one or more authentication elements or identification elements, the method comprising:(a) capturing an image with an image capture and communication device of a product label for a host product, the product label comprising one or more environmental monitors, the product label also comprising one or more authentication elements or one or more identification elements;(b) determining by the image capture and communication device a type for each of the one or more environmental monitors on the product label, wherein determining the type for at least one of the environmental monitors further includes determining whether the environmental monitor contains a color reference area;(c) based on the respective determined types of each of the one or more environmental monitors on the product label, analyzing image features of the one or more environmental monitors, the different types of environmental monitors having different image features which are analyzed using different image analysis techniques selected based on the respective type and features of the environmental monitor, wherein analyzing image features of the one or more environmental monitors includes, conditioned on the environmental monitor containing a color reference area, comparing an active area of the environmental monitor with the color reference area, and conditioned on the environmental monitor not containing a color reference area, analyzing the image of the environmental monitor to measure the active area without comparing it to a color reference area, (d) obtaining environmental monitoring data from each of the one or more environmental monitors on the product label using the respective image analysis techniques for the environmental monitors;(e) transmitting by the image capture and communication device to a host server the environmental monitoring data from the one or more environmental monitors and data based on the one or more authentication elements or one or more identification elements;(f) receiving by the image capture and communication device from the host server an acceptability report based on the environmental monitoring data and the data based on the one or more authentication elements or one or more identification elements;and (g) outputting by the image capture and communication device the acceptability report.
13
Broadest claimClaim Score 18, narrow(NHIP)An image capture and communication device comprising:(a) one or more memories each having at least one region for storing computer executable program code;and (b) a processor for executing the program code stored in the one or more memories, wherein the program code comprises: (b)(i) code to analyze a product label for a host product, the product label comprising one or more environmental monitors having different types of features, the product label further comprising one or more authentication elements or one or more identification elements;(b)(ii) code to determine a type for each of the one or more environmental monitors including code to determine whether an environmental monitor contains a color reference area;(b)(iii) code to analyze image features of each of the one or more environmental monitors based on their respective types, the code using different image analysis techniques selected based on the respective type and features of the one or more environmental monitors, the code to analyze image features including code that, conditioned on the environmental monitor containing a color reference area compares an active area of the environmental monitor with the color reference area, and conditioned on the environmental monitor not containing a color reference area, analyzes the environmental monitor by measure the active area without comparing it to a color reference area;(b)(iv) code to transmit to a host server the environmental monitoring data for the one or more environmental monitors and data based on and one or more authentication elements or one or more identification elements;(b)(v) code to receive from the host server an acceptability report based on the environmental monitoring data and data from the one or more authentication elements or one or more identification elements;and (b)(vi) code to output the acceptability report.

Independent claims2

120 paragraphs in 5 sections, as filed

FIELD OF THE INVENTION

0001The present invention relates to computing systems and methods for electronically indicating the acceptability of a product.

BACKGROUND OF THE INVENTION

0002Medical and health care products are usually marked with a “shelf life expiration” or “use by” date to enable medical practitioners, healthcare workers, patients and the public to determine whether or not to use a medical or healthcare product. The expiration date is generally marked prominently displayed on the product label. The label may also contain a variety of additional information, including product name, manufacturer name, location and date of manufactures, lot/batch number, and storage conditions. Meats, fish and other food products obtainable at a supermarket are usually marked with a “sell by” or “use by” date to help customers to consume or otherwise use the food products while it is still acceptably fresh. In the case of fresh or frozen meats and fish, the “sell by” or “use by” date is generally marked on a label which is prominently displayed on the product. The label can also contain a variety of additional information, including a product description, price information, weight information, and nutritional information. Other perishable products including various personal care products, and industrial products can also bear a “use by” date.

0003Monitors are devices used to track the exposure of a host product to one or more particular conditions, such as, temperature. Monitors, such as environmental monitors, may be calibrated to indicate the presence of certain environmental conditions, or when certain environmental conditions surpass pre-set limits. Some monitors provide a visual or electronic signal to make such indications.

0004Use of monitors in product labels can give consumers, patients or other end users some assurance that a given product is acceptable for use by providing some degree of protection against using products that may be ineffective or spoiled because of aging or adverse conditions.

0005Other factors can also detract from the acceptability of commercial products. For example, a product may be counterfeit and have little or no acceptability. Some measures taken to prevent or identify counterfeit products include various track-and-trace methods which can trace the movement of a product from its manufacturer or other legitimate source to a consumer or other user to assure authenticity. Radio-frequency identification (RFID) and barcodes are two technology methods which can be used to help implement traceability. RFID devices can be incorporated in packages, package labeling, or other product labeling.

0006Regulatory agencies in the United States and elsewhere have implemented—or are contemplating implementing—“pedigree” requirements for pharmaceutical products. A pedigree is, for example, a certified record that contains information about each distribution of a prescription drug which can be electronically embodied in what is known as an “epedigree”.

SUMMARY OF THE INVENTION

0007In certain embodiments, the present invention may provide a method comprising analyzing by an image capture and communication device a product label for a host product, the product label comprising at least two of one or more environmental monitors, one or more authentication elements, and one or more identification elements, determining by the image capture and communication device a type and one or more features based on the type for each of the at least two of the one or more environmental monitors, one or more authentication elements, and one or more identification elements, accessing by the image capture and communication device a host server, transmitting by the image capture and communication device to the host server data based on the type and features for each of the at least two of the one or more environmental monitors, one or more authentication elements, and one or more identification elements, receiving by the image capture and communication device from the host server an acceptability report based on the data for the at least two of the one or more environmental monitors, one or more authentication elements, and one or more identification elements, and outputting by the image capture and communication device the acceptability report.

0008In another embodiment, the present invention may provide a method comprising receiving by a host server one or more messages from one or more image capture and communication devices, the one or more messages including one or more acceptability for use data having authenticity, product identity, and current environmental data for one or more host products, determining by the host server whether the host server has access to at least one environmental history for each of the one or more host products, tabulating by the host server one or more second messages including one or more second acceptability for use data for the one or more host products, wherein the one or more second acceptability for use data is tabulated based on the acceptability for use data and, if the host server has access to at least one environmental history for each of the one or more host products, the at least one environmental history foe each of the one or more host products, and transmitting by the host server to the one or more image capture and communication devices the one or more second messages.

BRIEF DESCRIPTION OF THE DRAWINGS

0009Features and other aspects of embodiments of the present invention are explained in the following description taken in conjunction with the accompanying drawings, wherein:

0010<figref idref="DRAWINGS">FIG. 1</figref> illustrates a system according to one aspect of the present invention;

0011<figref idref="DRAWINGS">FIG. 2A</figref> illustrates a product label 100 according to one aspect of the present invention;

0012<figref idref="DRAWINGS">FIG. 2B</figref> illustrates a product label 100 according to another aspect of the present invention;

0013<figref idref="DRAWINGS">FIG. 3</figref> illustrates a method according to one aspect of the present invention;

0014<figref idref="DRAWINGS">FIG. 4</figref> illustrates a method according to another aspect of the present invention;

0015<figref idref="DRAWINGS">FIG. 5</figref> illustrates a method according to another aspect of the present invention;

0016<figref idref="DRAWINGS">FIG. 6A</figref> illustrates a method according to another aspect of the present invention;

0017<figref idref="DRAWINGS">FIG. 6B</figref> illustrates a method according to another aspect of the present invention;

0018<figref idref="DRAWINGS">FIG. 6C</figref> illustrates a method according to another aspect of the present invention;

0019<figref idref="DRAWINGS">FIG. 7A</figref> illustrates a method according to another aspect of the present invention;

0020<figref idref="DRAWINGS">FIG. 7B</figref> illustrates a method according to another aspect of the present invention; and

0021<figref idref="DRAWINGS">FIG. 7C</figref> illustrates a method according to another aspect of the present invention;

0022The drawings are exemplary, not limiting. It is intended for items that are labeled with the same number in multiple figures to refer to the same item throughout the figures.

DETAILED DESCRIPTION

0023Various embodiments of the present invention will now be described in greater detail with reference to the drawings.

0024As shown in <figref idref="DRAWINGS">FIG. 1</figref>, one aspect of the present invention may include one or more image capture and communication devices 170, 160 and 110 directly and indirectly connected to one or more host servers 190 through network 185 or cellular network 180. Host servers 190 may be directly or indirectly connected to one or more databases 195. Image capture and communication devices 170, 160, and 110 may receive data from one or more product labels 100.

0025In one aspect, an image capture and communication device may be any single or set of hardware equipment that is encoded and able to analyze product labels 100 and transmit data collected from the analysis through network 185 or cellular network 180 to host servers 190. The image capture and communication device may include one or more non-transitory data storage devices, such as harddrives, RAM, ROM, CD-ROM, DVD-ROM, floppy-disk drives, and/or solid-state memory drives; one or more input devices, such as a keyboard, touchpad, mouse, camera, video camera, image scanner, barcode scanner, densitometer, spectrometer, and/or RFID reader; one or more central processing units (CPUs); one or more output devices, such as a display, disc drive, and/or solid-state memory drive; one or more input/output (I/O) communications ports, such as an infrared port, universal serial bus port, serial port, ethernet port, celluar port, HDMI port, Display port, modem port, Bluetooth port, and/or wireless networking controller. The hardware may be in communication with one another by a shared data bus and/or by dedicated connections. The image capture and communication device may have one or more memory with at least one region for storing computer executable program code and one or more CPUs for executing the program code stored in the memory.

0026The executable program code may include instructions for reading authentication elements, monitors, and identification elements. The executable program code may include instructions to store data based on the image capture and communication device's review or communication with authentication elements, monitors, and identification elements. The executable program code may include instructions to communicate with a host server, transmit the data to the host server, receive data in response to that transmission, and generate and display a report based on the received data. The executable program code may include instructions to generate a report based on the data obtained from the image capture and communication device's review or communication with the authentication elements, monitors, and identification elements. The executable program code may include instructions to output an interrogation signal to an RFID and to receive and/or interpret the data from the RFID. The executable program code may include instructions to read a one-dimensional, two-dimensional, and/or three-dimensional barcode to receive and/or interpret data from the barcode. The executable program code may include instructions to find and recognize patterns in a particular image. For example, the executable program code may find a section of an image which is similar to a stored template, such as a template of a geometrical pattern, for instance, a circle. After the desired pattern is located, the pattern can be further analyzed, for example, to interpret the light and dark pixels of a bar code. Such instructions may include routines from a pattern recognition software library, for example, Matrox Imaging Library, which contains routines for image analysis and bar code reading.

0027In one aspect, the executable program code includes instructions to store-and-forward data. Such an aspect may include the image capture and communication device's temporarily storing of data in one or more memories for transmission at a later time, for example, when the host server becomes available, when a network or cellular network becomes available, and/or when transmission price rates decrease.

0028The executable program code may include instructions for capturing separate values for red, green, and blue (RGB) optical spectral ranges and converting the captured separate values into other color spaces for comparison. For example, grayscale, which is the average of RGB value; or cyan OD, which is the negative of the logarithm to the base 10 of the R value expressed as a fraction of its full-scale value.

0029In one aspect, the image capture and communication device 110 is a mobile phone with a built-in camera and/or video camera, such as Apple's iPhone® smartphones or Research in Motion Ltd.'s BLACKBERRY® smartphones. For example, Apple's iPhone® 3G or 3Gs or Research in Motion's BLACKBERRY® Bold 9700 or Curve™ 8300. In another aspect, the image capture and communication device 160 includes a computer 150 connected to a camera 120. In another aspect, the image capture and communication device 170 includes a computer 140 connected to a camera 130. Computers 140 and 150 may be a computer that generally includes one or more data storage devices, one or more CPUs, one or more input devices, one or more output devices, one or more I/O communications ports, and other hardware components that facilitate performance of the functions of computers 140 and 150. Computers 140 and 150 may be a tablet PC; alternatively, computers 140 and 150 may be a laptop computer. Cameras 120 and 130 may be any camera that is directly or indirectly connected to computer 150. For example, cameras 120 and 130 may be a digital camera connected via USB port or camera 120 and 130 may be a video camera connected to computers 140 and/or 150 by removing a solid-state memory card from cameras 120 and/or 130 and placing it in a solid state memory card reader that is connected to computers 140 and/or 150. Camera 120 and/or 130 may be built into or mounted on computers 140 and/or 150. In another aspect, an image capture and communication device may include a smart phone tethered to computers 140 and/or 150. Cameras 120 and/or 130 may be connected to a smart phone by removing a solid-state memory card from cameras 120 and/or 130 and placing it in a solid state memory card reader that is connected to the smart phone.

0030Network 185 may include any type of network infrastructure, such as client/server, peer-to-peer, or hybrid architectures. Network 185 may include the Internet. In one aspect, cellular network 180 is any cellular network. Cellular network 180 may operate under any mobile telephony standard such as 0G, 1G, 2G, 2G transitional, 3G, 3G transitional, and/or 4G. Cellular network 180 may be directly or indirectly connected to network 185 and/or host servers 190.

0031One or more host servers 190 may be one or more remote computer systems that are accessible over a remote or local network or the Internet, such as network 185, or through wireless network infrastructures, such as cellular network 180. Host servers 190 may have all of the hardware attributes of computers 140 and 150. Host servers 190 may be distributed over two or more physical locations. Host servers 190 may include—or be directly or indirectly connected to—one or more databases 195. One or more databases 195 may be any type of database, such as analytic, operational, hierarchical, network, or relational databases. For example, Microsoft SQL Server, MySQL, Oracle Database, Microsoft Access, Microsoft Excel file, and/or comma separated value or tab-delineated file. In another aspect, databases 195 may be—or include—any type of data structure, or nested data structures, such as tables, stacks, queues, lists, linked-lists, arrays, trees, and/or heaps.

0032Product label 100 may be any product or package label that has one or more monitors, authentication elements, and/or identification elements. Product label 100 may be associated with one or more host products. For example, product label 100 may be placed on—or part of—the product itself, the product's packaging, or the carton, box, crate, or pallet that houses multiple products for shipping, or be stand-a-lone. For example, in one aspect, the product label may travel with a truck driver and be associated with one or more host products on the truck.

0033Examples of host products include perishable health care products, for example vaccines, drugs, medicaments, pharmaceuticals, cosmeceuticals, nutricosmetics, nutraceuticals, and functional foods, medical devices and prophylactics; biological materials for industrial or therapeutic uses, for example cultures, organs and other human or animal body parts, blood and perishable blood products; diagnostic devices, kits and ingredients containing perishables; batteries and battery containing devices and appliances; foodstuffs including fresh or prepared fish, meats, dairy products, fruits, vegetables, baked goods, desserts and the like; food service products, including restaurant service foods; gourmet products; perishable animal foods; cut and uncut flowers; cosmetics, for example cosmetics containing biologics or other labile ingredients; beauty aids; perishable munitions and ordnance; perishable decontamination packs and products; and liquors, for example, wine, beer, champagne, port, whisky, cognac.

0034As shown in <figref idref="DRAWINGS">FIGS. 2A and 2B</figref> according to one aspect of the present invention, product label 100 may include one or more of monitors 210 and 225, authentication element 230, and/or identification elements 200 and 205.

0035The monitors may be environmental history monitors. An environmental history monitor may indicate one or more conditions of the environmental history of the host product which it is associated, for example, the environmental history monitor may indicate past exposure of the host product to one or more environmental conditions. The environmental history monitor's appearance may change with time to indicate the changing value of a monitored condition.

0036One example of an environmental condition which can be monitored by the environmental history monitor is heat exposure. The environmental history monitor can monitor heat exposure, either as an average cumulative temperature or as the occurrence of a temperature either above or below a specific temperature for a particular duration. Examples of such heat monitoring environmental history monitors may include cumulative time-temperature indicators, freeze indicators, thaw indicators and threshold indicators which can indicate a single event of past exposure to a temperature above ambient.

0037Other environmental conditions which environmental history monitors may monitor include humidity, mechanical shock, gas exposure, oxygen exposure, toxin exposure, chemical exposure, biological agent exposure, actinic radiation exposure, x-ray exposure, and/or microwave exposure.

0038Product label 100 may include multiple environmental monitors, each of which monitors a different environmental condition. For example, product label 100 may include two or more of a cumulative time-temperature indicator, a freeze indicator, and a threshold indicator. Product label 100 may include a cumulative time-temperature indicator, a freeze indicator, and a threshold indicator. Other environmental history monitors besides, or in addition to, one or more heat exposure indicators can be included, if desired.

0039A monitor may include a time-temperature indicator (TTI) composed of colorless diacetylene monomers which develop color as they polymerize. The progressive color development occurs at a rate that increases with temperature.

0040A monitor may include a multifunctional TTI which integrates two indicator types into a single device. For instance, it may include both a primary indicator, which can develop a color change as a result of cumulative time-temperature exposure, and a secondary indicator, which may be set to trigger at a predetermined temperature.

0041A monitor may include an activatable TTI system that includes a color-forming time-temperature indicator system that may be affixed to a product label so that the indicator composition is coextensive with a barcode. Upon expiration of the useful shelf life of a host product, the color density may reach a level which obscures the barcode sufficiently to register in market computer systems as a failed or unsafe product.

0042A monitor may include a combination RFID and environmental condition indicator tag. Information supplied by the RFID, for example, product ID and related data, may be machine read by interrogation of the RFID at an inspection station and the visual condition indication may be optically read by machine at the same station. The signals can be utilized locally at the inspection station or may be used at locations remote therefrom. Alternatively, the environmental condition indicator may have electrical properties that may be read by the RFID device. For example, such an indicator could be one based on the etching of an aluminum film by an acid.

0043The solid-state polymerization of diacetylene monomers and co-precipitated monomers to polymers are useful as TTIs. The monomers can be prepared as active agents on a substrate, or could be activated on demand by a number of methods including solvent evaporation, melt recrystallization, acid formation, metal formation, salt formation or the associated removal of the acid, metal or salt.

0044TTIs can include an immobilized enzyme which can react with the substrate to produce a color change in time and temperature dependent manner. Photo induced coloration by radiation of spiropyrans having a temperature dependent decoloration can be used as a TTI.

0045TTIs can include an upper layer carrying a first reactant and a base layer carrying a second reactant adapted to react with the first reactant upon triggering. TTIs can be formed from thermal paper and an activating film placed on the thermal paper. An indicator can be mixed with a portion of the food product and detects food spoilage directly, for example, pH change, through, for instance, detecting m-nitrophenol, p-nitrophenol and litmus changes from green to red/pink.

0046A TTI may have two surfaces that remain adhered when brought together: an acid-base indicator in one and an activator in the other. A TTI can be based on an azo coupling reaction between a capped diazonium component and a coupling component. An enzyme based TTI including urease to consume urea to generate ammonia and carbon dioxide, which may cause a pH change causing color change in a pH indicator.

0047TTIs can be prepared from a free radical-sensitive dye and peroxide on a carrier. TTIs can include a diffusion layer capable of transition above a defined temperature. An indicator film can be placed on one side of diffusion layer and be separated from a reactant material capable of producing a color change when in contact with the indicator film.

0048TTIs can be produced using vapor permeation techniques. Activatable TTI can include an oxygen-sensitive dye coating and a removable oxygen barrier over the coating.

0049TTIs having a colorless leuco base and a photoacid can be activated by UV light. TTI devices can include a substrate with organic silver salt oxidizing agent, reducing agent, and indicating indicia. TTIs can also contain a viscoelastic material, barrier material, and porous matrix.

0050In one aspect, the authentication element may establish or verify the authenticity of the host product with which the monitor is associated. The authentication element may be readable by a human. For example, the authentication element can include an area printed with a special ink, a symbol, or an object which is difficult to reproduce and which, in other aspects, may also visually change with time. The authentication element may be incorporated into the identification element and/or monitor. The identification element may include information referencing the authentication element. If such information, for example, fails to verify the authentication element, label 100 may indicate that the host product is not authentic.

0051In one aspect, the identification element indicates the identity of the host product. For example, an identification element may include a one-dimensional barcode, a two-dimensional barcode, a three dimensional barcode, or an RFID device. The identification element can be printed and be visible to a human and/or machine-readable. For example, the identification element can be printed with an ink that reflects primarily in the near-infrared and can be read with a charge-coupled device (CCD) camera that is sensitive to near infrared light. The identification element can be accompanied by a human readable equivalent of the identification element, for example a string of text, icons, pictographs or other human-recognizable graphics or symbols.

0052The identification element may be unique and identifies the host product with which it is associated. The identification element may include an item identifier that indicates the identity of a specific individual host product for example a stock-keeping unit.

0053In one aspect, the identification element may include a serial global trade identifier number (SGTIN). For example, a “SGTIN-96” tag. A SGTIN-96 tag data specification provides six fields that are to be set for each tag and the combination of all six fields ensures each tag's uniqueness. The six fields are as follows: a header comprising 8 bits; a filter, comprising three bits which can specify if the tagged object is an item, case or pallet; a partition, which is three bits and indicates how the subsequent fields are divided to get the correct data for each; a company prefix, which comprises 20-40 bits (depending on the partition); an item reference, comprising 24-4 bits (depending on the partition) which can comprise the item's global trade identification number “GTIN”; and a serial number, which is 38 bits and contains the item's unique serial number.

0054The identification element may be compatible with an e-pedigree code used for pharmaceutical tracking. In one aspect where the identification element includes an RFID or other electronic device, the identification element may include an electrical or optical device to read the other elements of product label 100, such as one or more monitors 210 and 225 and/or authentication element 230. Monitors, such as environmental history monitors, may generate both electrical and visual signals indicating exposure to one or more environmental conditions. Such electrical signals may be output to an associated RFID that otherwise acts as a identification element.

0055The information from monitors 210 and 225, authentication element 230, and identification elements 200 and 205 of product label 100 may be accessible by photocapture, scanning, pattern recognition, image comparison, such as by using image capture and communication devices 110, 160 and 170, or by human recognition.

0056As shown in <figref idref="DRAWINGS">FIG. 2A</figref> according to one aspect of the present invention, product label 100 may be configured for attachment to a case containing one or more sales units of a pharmaceutical product. Product label 100 may be self-adhesive or otherwise attachable to the case. Product label 100 may be printable in a single pass or in multiple passes. The entire label 100 may be printable. One or more monitors, authentication elements, and/or identification elements may be separately fabricated and then attached or applied to label 100. It is noted that product label 100 may include one or more monitors, authentication elements, and/or identification element that are not physically embedded or otherwise located on the same surface or housing; however, in such an aspect, the monitors, authentication elements, and/or identification elements would be associated with the same one or more host products.

0057As shown in <figref idref="DRAWINGS">FIG. 2A</figref> according to one aspect of the present invention, label 100 may include in a header row at the top of the label, identification element 200, a two-dimensional barcode 205, and monitor 210. Beneath the header row, the label has the drug name and strength, prominently displayed. Beneath the drug name appear additional data, such as, a product or list number, for example, 1 55Z5555 555 555; a batch or a lot number, for example, F 66666; an expiry date for the drug or other host product; a notation as to the case contents, for example, 10 units per case; a sales unit description, for example, 2 syringes per carton; a date of manufacture of the drug; storage conditions such as a permissible range of temperature variation and a storage type, for example, refrigerated storage; the name of the supplier; the location of the manufacturing plant; and the date and time of dispatch and a case number, for example, 72/1000. Identification element 200 may include a product number which may be the same as or different from the product/list number. The identification element 200 may be the same as or different from the product expiration date and a batch or lot number. Some or all of the information in identification element 200 may be encoded into identification element 205.

0058Identification element 205 can include one or more authentication elements, for example, a serial number or a code correlated with other information on label 100, which uniquely identifies the host product unit, for example, a case, and hinders counterfeiting. Authentication element 230 may include one or more identification elements. In another aspect, monitors 210 and/or 225 may include one or more identification and/or authentication elements.

0059In one aspect, monitor 210 is an environmental history monitor that operates as a TTI. Monitor 210 may include two color zones: an active zone 220 and a reference zone 215. Active zone 220 can change color. For example, active zone 220's color may darken in response to cumulative temperature exposure over time outside of acceptable limits for the host product. If active zone 220 appears as dark or darker than reference zone 215, monitor 220 is indicating by visual signal that the host product with which it is associated is no longer acceptable for use. In other aspects, active zone 220's color may lighten in response to cumulative temperature exposure over time outside of acceptable limits for the host product. In such an aspect, if active zone 220 appears lighter than reference zone 215, monitor 220 is indicating by visual signal that the host product with which it is associated is no longer acceptable for use. In another aspect, any suitable color value, or combination of color values, detectable in active zone 220 and reference zone 215 may be compared, for example, grayscale reflectivity, grayscale density, color optical density, RGB values, Lab values, brightness, hue and/or color intensity.

0060As shown in <figref idref="DRAWINGS">FIG. 3</figref> at step 300, in one aspect of the present invention, an image capture and communication device may analyze a product label 100 (as shown in <figref idref="DRAWINGS">FIGS. 1</figref>, 2A, and 2B) for a host product. Based on its analysis, for example, by scanning for visual or electronic signals indicative of one or more authentication elements, monitors, and/or identification elements present on product label 100, the image capture and communication device determines a type and one or more features for each of the one or more authentication elements, monitors, and/or identification elements, as shown at step 305.

0061In one aspect, the type of an authentication element, monitor, or identification elements indicates to the image capture and communication device how the image capture and communication device may retrieve data from the authentication element, monitor, or identification element. For example, the type of an identification element may be a one-dimensional barcode, which may indicate to the image capture and communication device to scan the barcode and interpret the barcode data. In another example, the type of a monitor may be an environmental monitor with an active zone and a reference zone, which may indicate to the image capture and communication device to capture an image of the two zones for comparison. In another example, the type of an authentication element may be RFID, which may indicate to the image capture and communication device to send an interrogation signal and retrieve the data from the RFID.

0062The one or more features for each of the one or more authentication elements, monitors, and/or identification elements are features associated with the type of authentication element, monitor, and identification element that are used to provide data stored in the authentication element, monitor, and identification element. For example, if the type of identification element is a one-dimensional barcode, the features may be the lines and/or numbers associated with the barcode. In another example, if the type of monitor is an environmental monitor that includes an active zone and a reference zone, the features of the monitor may be the color of the active zone and the color of the reference zone. In another example, if the type of authentication element is RFID, the features of the authentication element may be the data stored in the RFID.

0063As further shown in <figref idref="DRAWINGS">FIG. 3</figref> at step 310 according to one aspect of the present invention, the image capture and communication device may access the one or more host servers 190 (as shown in <figref idref="DRAWINGS">FIG. 1</figref>). The image capture and communication device may accomplish such access by connecting to host servers 190 through network 185 (as shown in <figref idref="DRAWINGS">FIG. 1</figref>) and/or cellular network 180 (as shown in <figref idref="DRAWINGS">FIG. 1</figref>). In other aspects, the image capture and communication device may connect to host servers 190 through a direct satellite link. Once the image capture and communication device is either directly or indirectly connected to the host server, the image capture and communication device may transmit the type and features for each of one or more authentication elements, monitors, and/or identification elements present on product label 100, as shown at step 315. The image capture and communication device may transmit the type and features to the host servers 190 (as shown in <figref idref="DRAWINGS">FIG. 1</figref>) via short message service (SMS) text message, TCP/IP messaging, email, FTP, PIN email, and/or instant message. The image capture and communication device may receive an acceptability report from host servers 190 (as shown in <figref idref="DRAWINGS">FIG. 1</figref>) based on the type and features for each of one or more authentication elements, monitors, and/or identification elements present on product label 100, as shown at step 320. The image capture and communication device may receive the acceptability report from host servers 190 (as shown in <figref idref="DRAWINGS">FIG. 1</figref>) via SMS text message, TCP/IP messaging, email, FTP, PIN email, and/or instant message. In further aspects, the image capture and communication device may receive the acceptability report from the host servers 190 (as shown in <figref idref="DRAWINGS">FIG. 1</figref>) by the host servers 190 providing a uniform resource locator (URL) to a website for the image capture and communication device to access through cellular network 180 (as shown in <figref idref="DRAWINGS">FIG. 1</figref>) or network 185 (as shown in <figref idref="DRAWINGS">FIG. 1</figref>). In such aspects, host servers 190 (as shown in <figref idref="DRAWINGS">FIG. 1</figref>) post the acceptability report to the website available at the URL.

0064As further shown in <figref idref="DRAWINGS">FIG. 3</figref> at step 325 according to one aspect of the present invention, the image capture and communication device may display the acceptability report. For example, image capture and communication devices 170, 160, and/or 110 may output a text-based and/or graphical-based acceptability report on display devices such as a liquid crystal display (LCD), light emitting diode (LED) display, or cathode ray tube (CRT) display.

0065The acceptability report may include text, symbols, and/or graphics indicating any of the following: whether the host product is acceptable to use, whether the host product is authentic; product identification data; product history data, including the environmental history of the host product; instructions on how the user should proceed based on the host product's acceptability; pedigree detail, such as, a SGTIN and/or pedigree verification; and whether a new expiration or use-by date is provided based on the environmental exposure. If the host product is a pharmaceutical product, a link to download a patient information sheet may be included. In addition, late breaking warnings as to possible adverse reactions, product recall information, directions, or requests, or a link to such information, may also be included in the report. The acceptability report may include a link for the holder of the host product to re-order or return the host product. Such information may be triggered by data received from the one or more authentication elements, monitors, and/or identification elements.

0066The acceptability report may be output audibly by the image capture and communication device. For example, the image capture and communication device may use text-to-speech routines or speech libraries located on either the host servers or image capture and communication device. Such aspects may help vision-impaired users understand whether a host product is acceptable to use.

0067As shown in <figref idref="DRAWINGS">FIG. 4</figref> at step 400, according to one aspect of the present invention, one or more image capture and communication devices 170, 160, and 110 (as shown in <figref idref="DRAWINGS">FIG. 1</figref>) may analyze a monitor with a type and one or more features based on the type for a host product. The one or more image capture and communication devices may take a still picture or image of the monitor. At step 405, the one or more image capture and communications devices may determine the type of monitor and the one or more features based on the type. At step 410, the one or more image capture and communication devices may determine whether the one or more features and/or type indicate that the monitor contains a color reference zone, which has a reference area and an active area, such as are included in monitor 210 (as shown in <figref idref="DRAWINGS">FIG. 2A</figref>).

0068If the features and/or type indicate that the monitor contains a color reference zone, at step 415, the one or more image capture and communication devices may measure one or more first pixel locations of the reference area and one or more second pixel locations of the active area. In one aspect, the measuring at step 415 is done through executing pattern recognition routines. At step 420, the one or more image capture and communication devices may derive a first RGB value of the reference area based on the one or more first pixel locations and a second RGB value of the active area based on the one or more second pixel locations. At step 425, the one or more image capture and communication devices may convert the first RGB value to a first color space value and the second RGB value to a second color space value. At step 430, the one or more image capture and communication devices may compare the first color space value to the second color space value. For example, color space values may be grayscale, which is obtained by calculating the average of the RGB values. Another color space value example may be cyan OD, which is obtained by calculating the negative of the logarithm to the base 10 of the R value expressed as a fraction of its full-scale value.

0069At step 435, the one or more image capture and communication devices may determine whether, for example, the still image or picture contains sufficient color resolution for the one or more image capture and communication devices or the one or more host servers 190 (as shown in <figref idref="DRAWINGS">FIG. 1</figref>) to derive color space values accurate enough to provide all available product information from the monitor. For instance, it is possible that if the lighting conditions are poor and the an image capture or communication device may not have created enough light, the image capture and communication device may still have retrieved sufficient data to determine whether the active zone is darker or lighter than the reference zone, but not sufficient data to accurately determine the degree of darkness and lightness necessary to derive more data from the comparison. If the one or more image capture and communication devices determine that the still image or picture does not contain sufficient color resolution, at step 440, the one or more image capture and communication devices may determine whether, based on that comparison (at step 430), the host product is acceptable for use. In further aspects, because of the lack of sufficient color, any acceptability data generated downstream may indicate whether the host product is acceptable, but may not accurately indicate the degree of acceptability, for example, the degree of exposure to a particular condition. In such an aspect, the degrees of acceptability may be omitted from acceptability reports.

0070If the one or more image capture and communication devices determine that the still image or picture does contain sufficient color resolution, at step 445, the one or more image capture and communication devices may determine whether, based on that comparison (at step 430), the host product is acceptable for use and may indicate the degree of acceptability of use in any acceptability report generated downstream. In one aspect if the active zone's color may darken in response to cumulative temperature exposure over time outside of acceptable limits for the host product. If the active zone's color is as dark or darker than reference zone, the monitor may be indicating by visual signal that the host product with which it is associated is no longer acceptable for use. In another aspect, the active zone's color may lighten in response to cumulative temperature exposure over time outside of acceptable limits for the host product. In such aspects, if the active zone's color is lighter than reference zone's color, the monitor may be indicating by visual signal that the host product with which it is associated is no longer acceptable for use.

0071If, at step 410, the one or more image capture and communication devices determines that the features and/or type indicate that the monitor does not contain a color reference zone, at step 460, the one or more image capture and communication devices may measure one or more first pixel locations of the active area. In one aspect, the measuring at step 460 is done through executing pattern recognition routines. At step 465, the one or more image capture and communication devices determines, based on the type and/or features of the monitor, whether the monitor provides information, such as environmental condition, by color. If the monitor provides information by color, at step 470, the one or more image capture and communication devices may derive a first RGB value of the active area based on the one or more first pixel locations. At step 475, the one or more image capture and communication devices may convert the first RGB value to a first color space value. At step 480, the one or more image capture and communication devices may compare the first color space value to a set of values based on the type and/or features of the monitor in order to determine if the color space value is less than, equal to, or greater than the set of values. Based on the comparison (at step 480), the one or more image capture and communication devices, at step 481, may determine whether the host product is acceptable for use.

0072If the monitor does not provide information by color, at step 485, the one or more image capture and communication devices determines whether information is provided by determining a particular visual pattern on the monitor. For example, in one aspect, if certain environmental conditions are present, a symbol may appear in the active area, such as a check mark as shown in monitor 225 in <figref idref="DRAWINGS">FIG. 2A</figref>. At step 486, if the visual pattern is present on the monitor, the one or more image capture and communication devices may determine, based on the visual pattern, whether the host product is acceptable for use. Depending on the type and features of the monitor, the existence of a visual pattern may indicate that a host product is or is not acceptable for use; or, the visual pattern may need to be interpreted in light of other data, such as other data from other monitors, authentication elements, and/or identity elements, in order for the image capture and communication device and/or host servers to determine whether the host product is acceptable for use.

0073At step 450, the one or more image capture and communication devices determines whether the image capture and communication device is directly or indirectly connected to one or more host servers 190 (as shown in <figref idref="DRAWINGS">FIG. 1</figref>) through network 185 (as shown in <figref idref="DRAWINGS">FIG. 1</figref>). If the one or more image capture and communication devices determines that it is connected to one or more host servers through network 185, the image capture and communication device may, at step 490, transmit data including the type, features, comparison results (at steps 430 and/or 480), and/or determination results (at steps 435, 440, 481, and/or 486) to the one or more host servers. At step 492, the image capture and communication device may receive data from the host server that is associated with the one or more host product that is associated with the monitor and output the data in the form of an acceptability report (as described in step 325 in <figref idref="DRAWINGS">FIG. 3</figref>). Such data may include the host product's name, strength, presentation (for example, pre-filled syringe, vial, ampoule, etc.), quantity, product identification number, serialized numeric identifier (SNI), SGTIN, numeric drug code (NDC), lot number, expiration date, location of manufacture, date of manufacture, storage conditions, date/time and condition of unit from each reading including identification, authentication and monitor, site of reading or GPS information, identity of reading device or person or entity making the reading, product specific information (for example, specifications, package insert, use instructions, etc.), recall status, warranty information, product coupons for discounts, notice of product status change (for example, if the product is subject to a recall or other action, notice could be automatically sent to the last entity reading the acceptability device), notice to reorder product, information and emergency call or e-mail addresses.

0074If the one or more image capture and communication devices determine that it is not connected to one or more host servers through network 185, at step 451, the one or more image capture and communication devices determine whether they can transmit a message, such as SMS, through cellular network 180 to the one or more host servers. If the one or more image capture and communication devices determine that they can transmit a message, at step 495, the one or more image capture and communication devices may receive data from the host server that is associated with the one or more host products that are associated with the monitor. In one aspect, the data may be in the form of a link, such as a URL, that references a webpage that hosts an acceptability report that the one or more host servers have generated (as described in step 325 in <figref idref="DRAWINGS">FIG. 3</figref>).

0075If the one or more image capture and communication devices determine that they cannot transmit a message, at step 455, the one or more image capture and communication devices may output to the user an acceptability report based on the results of the comparisons and determinations at steps 430, 435, 440, 480, 481, and/or 486. The output may be in the form of a visual display and/or audible display.

0076As shown in <figref idref="DRAWINGS">FIG. 5</figref> at step 500, in one aspect of the present invention, one or more host servers 190 (as shown in <figref idref="DRAWINGS">FIG. 1</figref>) may receive a message or other data from one or more image capture and communication devices 170, 160, and 110 (as shown in <figref idref="DRAWINGS">FIG. 1</figref>) including the type and features of each of the one or more authentication elements, monitors, and/or identification elements present on the product label that the image capture and communication device 170, 160, and 110 analyzes. In further aspects, message or data is received via SMS text message, TCP/IP messaging, email, FTP, PIN email, and/or instant message.

0077As further shown in <figref idref="DRAWINGS">FIG. 5</figref> at step 505, based on the message or data, the host servers 190 (as shown in <figref idref="DRAWINGS">FIG. 1</figref>) retrieve information about the host product from one or more databases 195 (as shown in <figref idref="DRAWINGS">FIG. 1</figref>) and store the message or data that was received from the image capture and communication device 170, 160, and 110 (as shown in <figref idref="DRAWINGS">FIG. 1</figref>) in databases 195. Information about the host product may include the host product's name, strength, presentation (for example, pre-filled syringe, vial, ampoule, etc.), quantity, product identification number, SNI, SGTIN, NDC, lot number, expiration date, location of manufacture, date of manufacture, storage conditions, date/time and condition of unit from each reading including identification, authentication and monitor, site of reading or GPS information, identity of reading device or person or entity making the reading, product specific information (for example, specifications, package insert, use instructions, etc.), recall status, warranty information, product coupons for discounts, notice of product status change (for example, if the product is subject to a recall or other action, notice could be automatically sent to the last entity reading the acceptability device), notice to reorder product, information and emergency call or e-mail addresses.

0078In further aspects, at step 510, based on the message or data, the host server 190 (as shown in <figref idref="DRAWINGS">FIG. 1</figref>) may determine, for example, whether the host product is authentic and/or whether the host product was exposed to environmental conditions outside or inside set limits for the host product. At step 515 one or more host servers 190 (as shown in <figref idref="DRAWINGS">FIG. 1</figref>) may store information referencing the determination (made at step 510) in the one or more databases 195 (as shown in <figref idref="DRAWINGS">FIG. 1</figref>) 515. At step 520, host servers 190 (as shown in <figref idref="DRAWINGS">FIG. 1</figref>) may generate an acceptability report based on the determination (made at step 510). In one aspect, generating an acceptability report (generated at step 520) may include generating an HTML-based webpage and a URL pointing to the webpage. At step 525, the host servers 190 (as shown in <figref idref="DRAWINGS">FIG. 1</figref>) may transmit a message or data including the URL to the image capture and communication device via cellular network 180 (as shown in <figref idref="DRAWINGS">FIG. 1</figref>) or network 185 (as shown in <figref idref="DRAWINGS">FIG. 1</figref>).

0079In another aspect, generating an acceptability report (generated at step 520) may include tabulating data based on the determination (made at step 510) and/or other attributes of the host product. In such an aspect, at step 525, one or more host servers 190 (as shown in <figref idref="DRAWINGS">FIG. 1</figref>) may transmit the acceptability report in the form of such tabulated data to the image capture and communication device 170, 160, and/or 110 (as shown in <figref idref="DRAWINGS">FIG. 1</figref>) via SMS text message, TCP/IP messaging, email, FTP, PIN email, and/or instant message.

0080As shown in <figref idref="DRAWINGS">FIGS. 6A</figref>, 6B, and 6C, according to one aspect of the present invention a manufacturer of a host product may use systems and methods of the present invention to track the acceptability of the host product throughout the steps of clinical trials of the host product. For example, at step 600, the manufacturer may associate one or more host products with a product label 100 (as shown in <figref idref="DRAWINGS">FIGS. 1</figref>, 2A, and 2B) including at least two of one or more monitors, product identification elements, and authentication elements. During the association (at step 600), the manufacturer may set the limits or other data for each of the one or more monitors, product identification elements, and/or authentication elements; or, the manufacturer may use one or more monitors, product identification elements, and/or authentication elements with pre-set limits and/or data as appropriate for the particular host product.

0081At step 604, before the manufacturer is ready to release the product for use at a clinical trial, an image capture and communication device may analyze a product label 100 (as shown in <figref idref="DRAWINGS">FIGS. 1</figref>, 2A, and 2B) for a host product at the host product's site of manufacture. Based on its analysis, for example, by scanning for visual or electronic signals indicative of one or more authentication elements, monitors, and/or identification elements present on product label 100, the image capture and communication device determines a type and one or more features for each of the one or more authentication elements, monitors, and/or identification elements, as shown at step 605.

0082At step 610, the image capture and communication device may access the one or more host servers 190 (as shown in <figref idref="DRAWINGS">FIG. 1</figref>). The image capture and communication device may accomplish such access by connecting to host servers 190 through network 185 (as shown in <figref idref="DRAWINGS">FIG. 1</figref>) and/or cellular network 180 (as shown in <figref idref="DRAWINGS">FIG. 1</figref>). In other aspects, the image capture and communication device may connect to host servers 190 through a direct satellite link. Once the image capture and communication device is either directly or indirectly connected to the host server, the image capture and communication device may transmit the type and features for each of one or more authentication elements, monitors, and/or identification elements present on product label 100, as shown at step 615. The image capture and communication device may transmit the type and features to the host servers 190 (as shown in <figref idref="DRAWINGS">FIG. 1</figref>) via short message service (SMS) text message, TCP/IP messaging, email, FTP, PIN email, and/or instant message. The image capture and communication device may receive an acceptability report from host servers 190 (as shown in <figref idref="DRAWINGS">FIG. 1</figref>) based on the type and features for each of one or more authentication elements, monitors, and/or identification elements present on product label 100, as shown at step 620. The image capture and communication device may receive the acceptability report from host servers 190 (as shown in <figref idref="DRAWINGS">FIG. 1</figref>) via SMS text message, TCP/IP messaging, email, FTP, PIN email, and/or instant message. In further aspects, the image capture and communication device may receive the acceptability report from the host servers 190 (as shown in <figref idref="DRAWINGS">FIG. 1</figref>) by the host servers 190 providing a uniform resource locator (URL) to a website for the image capture and communication device to access through cellular network 180 (as shown in <figref idref="DRAWINGS">FIG. 1</figref>) or network 185 (as shown in <figref idref="DRAWINGS">FIG. 1</figref>). In such aspects, host servers 190 (as shown in <figref idref="DRAWINGS">FIG. 1</figref>) post the acceptability report to the website available at the URL.

0083At step 625 according to one aspect of the present invention, the image capture and communication device may output the acceptability report. For example, image capture and communication devices 170, 160, and/or 110 may output a text-based and/or graphical-based acceptability report on display devices such as a LCD display, LED display, or CRT display. In addition, an audible report may be output in lieu of—or in addition to—the graphically displayed report. At step 630, based on the outputted acceptability report, either the user of the image capture and communication device—or the device itself—may determine whether the host product is acceptable for use. For example, the acceptability report may actually state “it is not acceptable for use” or “it is acceptable use” or provide certain data for interpretation by its user or the device/host servers itself/themselves. At step 634, if the host product is not acceptable for use, it may not be shipped out. In a further aspect, the acceptability report may include instructions transmitted or generated by the manufacturer about what the user should do with an unacceptable product. If the product is acceptable for use, at step 635, the host product is released to a clinic, such as a hospital.

0084At step 640, the clinic and/or delivery driver may analyze the inbound product label 100 (as shown in <figref idref="DRAWINGS">FIGS. 1</figref>, 2A, and 2B) of the host product at the clinic. Based on its analysis, the image capture and communication device determines a type and one or more features for each of the one or more authentication elements, monitors, and/or identification elements, as shown at step 645.

0085At step 650, the image capture and communication device may access the one or more host servers 190 (as shown in <figref idref="DRAWINGS">FIG. 1</figref>). Once the image capture and communication device is either directly or indirectly connected to the host server, the image capture and communication device may transmit the type and features for each of one or more authentication elements, monitors, and/or identification elements present on product label 100, as shown at step 655. The image capture and communication device may receive an acceptability report from host servers 190 (as shown in <figref idref="DRAWINGS">FIG. 1</figref>) based on the type and features for each of one or more authentication elements, monitors, and/or identification elements present on product label 100, as shown at step 660. In addition, the acceptability report may also take into account historical information about the host product, including the data collected at the site of manufacture. The image capture and communication device may receive the acceptability report from host servers 190 (as shown in <figref idref="DRAWINGS">FIG. 1</figref>) via SMS text message, TCP/IP messaging, email, FTP, PIN email, and/or instant message. In further aspects, the image capture and communication device may receive the acceptability report from the host servers 190 (as shown in <figref idref="DRAWINGS">FIG. 1</figref>) by the host servers 190 providing a uniform resource locator (URL) to a website for the image capture and communication device to access through cellular network 180 (as shown in <figref idref="DRAWINGS">FIG. 1</figref>) or network 185 (as shown in <figref idref="DRAWINGS">FIG. 1</figref>). In such aspects, host servers 190 (as shown in <figref idref="DRAWINGS">FIG. 1</figref>) post the acceptability report to the website available at the URL.

0086At step 665, the image capture and communication device may output the acceptability report. At step 670, based on the outputted acceptability report, either the user of the image capture and communication device—or the device itself—may determine whether the host product is acceptable for use. At step 671, if the host product is not acceptable for use, it may not be shipped out and returned to the manufacturer. In a further aspect, the acceptability report may include instructions transmitted or generated by the manufacturer about what the clinic should do with an unacceptable product. If the product is acceptable for use, at step 675, the host product may be stored until such time as the clinic decides to release the host product to a patient or practitioner.

0087At step 680, the clinic may analyze the product label 100 (as shown in <figref idref="DRAWINGS">FIGS. 1</figref>, 2A, and 2B) of the stored host product at the clinic. Based on its analysis, the image capture and communication device determines a type and one or more features for each of the one or more authentication elements, monitors, and/or identification elements, as shown at step 685.

0088At step 690, the image capture and communication device may access the one or more host servers 190 (as shown in <figref idref="DRAWINGS">FIG. 1</figref>). Once the image capture and communication device is either directly or indirectly connected to the host server, the image capture and communication device may transmit the type and features for each of one or more authentication elements, monitors, and/or identification elements present on product label 100, as shown at step 695. The image capture and communication device may receive an acceptability report from host servers 190 (as shown in <figref idref="DRAWINGS">FIG. 1</figref>) based on the type and features for each of one or more authentication elements, monitors, and/or identification elements present on product label 100, as shown at step 700. In addition, the acceptability report may also take into account historical information about the host product, including the data collected at the site of manufacture and inbound at the clinic. The image capture and communication device may receive the acceptability report from host servers 190 (as shown in <figref idref="DRAWINGS">FIG. 1</figref>) via SMS text message, TCP/IP messaging, email, FTP, PIN email, and/or instant message. In further aspects, the image capture and communication device may receive the acceptability report from the host servers 190 (as shown in <figref idref="DRAWINGS">FIG. 1</figref>) by the host servers 190 providing a uniform resource locator (URL) to a website for the image capture and communication device to access through cellular network 180 (as shown in <figref idref="DRAWINGS">FIG. 1</figref>) or network 185 (as shown in <figref idref="DRAWINGS">FIG. 1</figref>). In such aspects, host servers 190 (as shown in <figref idref="DRAWINGS">FIG. 1</figref>) post the acceptability report to the website available at the URL.

0089At step 705, the image capture and communication device may output the acceptability report. At step 710, based on the outputted acceptability report, either the user of the image capture and communication device—or the device itself—may determine whether the host product is acceptable for use. At step 711, if the host product is not acceptable for use, it may not be distributed to a patient or practitioner for use in the trial and is returned to the manufacturer. In a further aspect, the acceptability report may include instructions transmitted or generated by the manufacturer about what the clinic should do with an unacceptable product. If the product is acceptable for use, at step 715, the host product may be distributed to a patient or practitioner.

0090At step 720, the patient or practitioner may analyze the product label 100 (as shown in <figref idref="DRAWINGS">FIGS. 1</figref>, 2A, and 2B) of the host product at the practitioner's office, patient's home, or other place where the host product is administered to the patient. Based on its analysis, the image capture and communication device determines a type and one or more features for each of the one or more authentication elements, monitors, and/or identification elements, as shown at step 725.

0091At step 730, the image capture and communication device may access the one or more host servers 190 (as shown in <figref idref="DRAWINGS">FIG. 1</figref>). Once the image capture and communication device is either directly or indirectly connected to the host server, the image capture and communication device may transmit the type and features for each of one or more authentication elements, monitors, and/or identification elements present on product label 100, as shown at step 735. The image capture and communication device may receive an acceptability report from host servers 190 (as shown in <figref idref="DRAWINGS">FIG. 1</figref>) based on the type and features for each of one or more authentication elements, monitors, and/or identification elements present on product label 100, as shown at step 740. In addition, the acceptability report may also take into account historical information about the host product, including the data collected at the site of manufacture and inbound and outbound at the clinic. The image capture and communication device may receive the acceptability report from host servers 190 (as shown in <figref idref="DRAWINGS">FIG. 1</figref>) via SMS text message, TCP/IP messaging, email, FTP, PIN email, and/or instant message. In further aspects, the image capture and communication device may receive the acceptability report from the host servers 190 (as shown in <figref idref="DRAWINGS">FIG. 1</figref>) by the host servers 190 providing a uniform resource locator (URL) to a website for the image capture and communication device to access through cellular network 180 (as shown in <figref idref="DRAWINGS">FIG. 1</figref>) or network 185 (as shown in <figref idref="DRAWINGS">FIG. 1</figref>). In such aspects, host servers 190 (as shown in <figref idref="DRAWINGS">FIG. 1</figref>) post the acceptability report to the website available at the URL.

0092At step 745, the image capture and communication device may output the acceptability report. At step 750, based on the outputted acceptability report, either the user of the image capture and communication device—or the device itself—may determine whether the host product is acceptable for use. At step 751, if the host product is not acceptable for use, it may not be used or caused to be used by a patient or practitioner in the trial and is returned to the manufacturer. In a further aspect, the acceptability report may include instructions transmitted or generated by the manufacturer about what the clinic should do with an unacceptable product. If the product is acceptable for use, at step 755, the host product may be used—or caused to be used—by a patient or practitioner.

0093At step 760, the patient or practitioner may withdraw from the clinical trial and return the host product to the clinic. On the host product's return, the clinic may analyze the product label 100 (as shown in <figref idref="DRAWINGS">FIGS. 1</figref>, 2A, and 2B) of the host product. Based on its analysis, the image capture and communication device determines a type and one or more features for each of the one or more authentication elements, monitors, and/or identification elements, as shown at step 765.

0094At step 770, the image capture and communication device may access the one or more host servers 190 (as shown in <figref idref="DRAWINGS">FIG. 1</figref>). Once the image capture and communication device is either directly or indirectly connected to the host server, the image capture and communication device may transmit the type and features for each of one or more authentication elements, monitors, and/or identification elements present on product label 100, as shown at step 775. The image capture and communication device may receive an acceptability report from host servers 190 (as shown in <figref idref="DRAWINGS">FIG. 1</figref>) based on the type and features for each of one or more authentication elements, monitors, and/or identification elements present on product label 100, as shown at step 780. In addition, the acceptability report may also take into account historical information about the host product, including the data collected at the site of manufacture, inbound and outbound at the clinic, and at the practitioner's office, patient's home, and/or other place the host product was administered to the patient. In a further aspect, any data collected by any image capture and communication devices from product label 100 may be taken into account as historical information for the product acceptability report. The image capture and communication device may receive the acceptability report from host servers 190 (as shown in <figref idref="DRAWINGS">FIG. 1</figref>) via SMS text message, TCP/IP messaging, email, FTP, PIN email, and/or instant message. In further aspects, the image capture and communication device may receive the acceptability report from the host servers 190 (as shown in <figref idref="DRAWINGS">FIG. 1</figref>) by the host servers 190 providing a uniform resource locator (URL) to a website for the image capture and communication device to access through cellular network 180 (as shown in <figref idref="DRAWINGS">FIG. 1</figref>) or network 185 (as shown in <figref idref="DRAWINGS">FIG. 1</figref>). In such aspects, host servers 190 (as shown in <figref idref="DRAWINGS">FIG. 1</figref>) post the acceptability report to the website available at the URL.

0095At step 785, the image capture and communication device may output the acceptability report. At step 795, based on the outputted acceptability report, either the user of the image capture and communication device—or the device itself—may determine whether the host product is acceptable for use. At step 796, if the host product is not acceptable for use, it may not be re-used and thus cannot be redistributed by the clinic or manufacturer and may be returned to the manufacturer for destruction. In a further aspect, the acceptability report may include instructions transmitted or generated by the manufacturer about what the clinic should do with an unacceptable product. If the product is acceptable for use, at step 800, the host product may be returned to the manufacturer for restocking and/or repackaging. In a further aspect, the acceptability report may include instructions transmitted or generated by the manufacturer about what the clinic should do with an acceptable product.

0096At step 805, on the host product's return, the manufacturer may analyze the product label 100 (as shown in <figref idref="DRAWINGS">FIGS. 1</figref>, 2A, and 2B) of the host product. Based on its analysis, the image capture and communication device determines a type and one or more features for each of the one or more authentication elements, monitors, and/or identification elements, as shown at step 810.

0097At step 815, the image capture and communication device may access the one or more host servers 190 (as shown in <figref idref="DRAWINGS">FIG. 1</figref>). Once the image capture and communication device is either directly or indirectly connected to the host server, the image capture and communication device may transmit the type and features for each of one or more authentication elements, monitors, and/or identification elements present on product label 100, as shown at step 820. The image capture and communication device may receive an acceptability report from host servers 190 (as shown in <figref idref="DRAWINGS">FIG. 1</figref>) based on the type and features for each of one or more authentication elements, monitors, and/or identification elements present on product label 100, as shown at step 825. In addition, the acceptability report may also take into account historical information about the host product, including the data collected at the site of manufacture, inbound and outbound at the clinic, and at the practitioner's office, patient's home, and/or other place the host product was administered to the patient. In a further aspect, any data collected by any image capture and communication devices from product label 100 may be taken into account as historical information for the product acceptability report. The image capture and communication device may receive the acceptability report from host servers 190 (as shown in <figref idref="DRAWINGS">FIG. 1</figref>) via SMS text message, TCP/IP messaging, email, FTP, PIN email, and/or instant message. In further aspects, the image capture and communication device may receive the acceptability report from the host servers 190 (as shown in <figref idref="DRAWINGS">FIG. 1</figref>) by the host servers 190 providing a uniform resource locator (URL) to a website for the image capture and communication device to access through cellular network 180 (as shown in <figref idref="DRAWINGS">FIG. 1</figref>) or network 185 (as shown in <figref idref="DRAWINGS">FIG. 1</figref>). In such aspects, host servers 190 (as shown in <figref idref="DRAWINGS">FIG. 1</figref>) post the acceptability report to the website available at the URL.

0098At step 830, the image capture and communication device may output the acceptability report. At step 835, based on the outputted acceptability report, either the user of the image capture and communication device—or the device itself—may determine whether the host product is acceptable for use. At step 836, if the host product is not acceptable for use, it may not be re-stocked or repackaged and may be sent for destruction. In a further aspect, the acceptability report may include instructions transmitted or generated by the manufacturer about what the manufacturer should do with an unacceptable product. If the product is acceptable for use, at step 840, the host product may be restocked, repackaged, and/or re-issued to a clinic and/or patient or practitioner

0099In steps 600-840, the one or more image capture and communication devices may be the same image capture and communication devices, different image capture and communication devices, or the same device for some steps and different devices for other steps.

0100As shown in <figref idref="DRAWINGS">FIGS. 7A</figref>, 7B, and 7C, according to one aspect of the present invention a manufacturer of a host product may use systems and methods of the present invention to track the acceptability of the host product throughout the steps of its supply or distribution chain for the host product. For example, at step 900, the manufacturer may associate one or more host products with a product label 100 (as shown in <figref idref="DRAWINGS">FIGS. 1</figref>, 2A, and 2B) including at least two of one or more monitors, product identification elements, and authentication elements. During the association (at step 900), the manufacturer may set the limits or other data for each of the one or more monitors, product identification elements, and/or authentication elements; or, the manufacturer may use one or more monitors, product identification elements, and/or authentication elements with pre-set limits and/or data as appropriate for the particular host product.

0101At step 904, before the manufacturer is ready to release the product for distribution through its supply chain, an image capture and communication device may analyze a product label 100 (as shown in <figref idref="DRAWINGS">FIGS. 1</figref>, 2A, and 2B) of a host product at the host product's site of manufacture. Based on its analysis, for example, by scanning for visual or electronic signals indicative of one or more authentication elements, monitors, and/or identification elements present on product label 100, the image capture and communication device determines a type and one or more features for each of the one or more authentication elements, monitors, and/or identification elements, as shown at step 905.

0102At step 910, the image capture and communication device may access the one or more host servers 190 (as shown in <figref idref="DRAWINGS">FIG. 1</figref>). The image capture and communication device may accomplish such access by connecting to host servers 190 through network 185 (as shown in <figref idref="DRAWINGS">FIG. 1</figref>) and/or cellular network 180 (as shown in <figref idref="DRAWINGS">FIG. 1</figref>). In other aspects, the image capture and communication device may connect to host servers 190 through a direct satellite link. Once the image capture and communication device is either directly or indirectly connected to the host server, the image capture and communication device may transmit the type and features for each of one or more authentication elements, monitors, and/or identification elements present on product label 100, as shown at step 915. The image capture and communication device may transmit the type and features to the host servers 190 (as shown in <figref idref="DRAWINGS">FIG. 1</figref>) via short message service (SMS) text message, TCP/IP messaging, email, FTP, PIN email, and/or instant message. The image capture and communication device may receive an acceptability report from host servers 190 (as shown in <figref idref="DRAWINGS">FIG. 1</figref>) based on the type and features for each of one or more authentication elements, monitors, and/or identification elements present on product label 100, as shown at step 920. The image capture and communication device may receive the acceptability report from host servers 190 (as shown in <figref idref="DRAWINGS">FIG. 1</figref>) via SMS text message, TCP/IP messaging, email, FTP, PIN email, and/or instant message. In further aspects, the image capture and communication device may receive the acceptability report from the host servers 190 (as shown in <figref idref="DRAWINGS">FIG. 1</figref>) by the host servers 190 providing a uniform resource locator (URL) to a website for the image capture and communication device to access through cellular network 180 (as shown in <figref idref="DRAWINGS">FIG. 1</figref>) or network 185 (as shown in <figref idref="DRAWINGS">FIG. 1</figref>). In such aspects, host servers 190 (as shown in <figref idref="DRAWINGS">FIG. 1</figref>) post the acceptability report to the website available at the URL.

0103At step 925, according to one aspect of the present invention, the image capture and communication device may output the acceptability report. For example, image capture and communication devices 170, 160, and/or 110 may output a text-based and/or graphical-based acceptability report on display devices such as a LCD display, LED display, or CRT display. In addition, an audible report may be output in lieu of—or in addition to—the graphically displayed report. At step 930, based on the outputted acceptability report, either the user of the image capture and communication device—or the device itself—may determine whether the host product is acceptable for use. For example, the acceptability report may actually state “it is not acceptable for distribution” or “it is acceptable distribution” or provide certain data for interpretation by its user or the device/host servers itself/themselves. At step 931, if the host product is not acceptable for use, it may not be shipped out. In a further aspect, the acceptability report may include instructions transmitted or generated by the manufacturer about what the user should do with an unacceptable product. If the product is acceptable for use, at step 935, the host product is released to a supply chain intermediary user, such as a distributor or wholesaler.

0104At step 940, the clinic and/or delivery driver may analyze the inbound product label 100 (as shown in <figref idref="DRAWINGS">FIGS. 1</figref>, 2A, and 2B) of the host product at the clinic. Based on its analysis, the image capture and communication device determines a type and one or more features for each of the one or more authentication elements, monitors, and/or identification elements, as shown at step 945.

0105At step 950, the image capture and communication device may access the one or more host servers 190 (as shown in <figref idref="DRAWINGS">FIG. 1</figref>). Once the image capture and communication device is either directly or indirectly connected to the host server, the image capture and communication device may transmit the type and features for each of one or more authentication elements, monitors, and/or identification elements present on product label 100, as shown at step 955. The image capture and communication device may receive an acceptability report from host servers 190 (as shown in <figref idref="DRAWINGS">FIG. 1</figref>) based on the type and features for each of one or more authentication elements, monitors, and/or identification elements present on product label 100, as shown at step 960. In addition, the acceptability report may also take into account historical information about the host product, including the data collected at the site of manufacture. The image capture and communication device may receive the acceptability report from host servers 190 (as shown in <figref idref="DRAWINGS">FIG. 1</figref>) via SMS text message, TCP/IP messaging, email, FTP, PIN email, and/or instant message. In further aspects, the image capture and communication device may receive the acceptability report from the host servers 190 (as shown in <figref idref="DRAWINGS">FIG. 1</figref>) by the host servers 190 providing a uniform resource locator (URL) to a website for the image capture and communication device to access through cellular network 180 (as shown in <figref idref="DRAWINGS">FIG. 1</figref>) or network 185 (as shown in <figref idref="DRAWINGS">FIG. 1</figref>). In such aspects, host servers 190 (as shown in <figref idref="DRAWINGS">FIG. 1</figref>) post the acceptability report to the website available at the URL.

0106At step 965, the image capture and communication device may output the acceptability report. At step 970, based on the outputted acceptability report, either the user of the image capture and communication device—or the device itself—may determine whether the host product is acceptable for use. At step 971, if the host product is not acceptable for use, it may cease the supply chain process (for example, not further distribute the host product) and return it to the manufacturer. In a further aspect, the acceptability report may include instructions transmitted or generated by the manufacturer about what the supply chain intermediary user should do with an unacceptable product. If the product is acceptable for use, at step 975, the host product may be stored until such time as the supply chain intermediary user decides to release the host product to an end-user.

0107At step 980, the supply chain intermediary user may analyze the product label 100 (as shown in <figref idref="DRAWINGS">FIGS. 1</figref>, 2A, and 2B) of the stored host product. Based on its analysis, the image capture and communication device determines a type and one or more features for each of the one or more authentication elements, monitors, and/or identification elements, as shown at step 985.

0108At step 990, the image capture and communication device may access the one or more host servers 190 (as shown in <figref idref="DRAWINGS">FIG. 1</figref>). Once the image capture and communication device is either directly or indirectly connected to the host server, the image capture and communication device may transmit the type and features for each of one or more authentication elements, monitors, and/or identification elements present on product label 100, as shown at step 995. The image capture and communication device may receive an acceptability report from host servers 190 (as shown in <figref idref="DRAWINGS">FIG. 1</figref>) based on the type and features for each of one or more authentication elements, monitors, and/or identification elements present on product label 100, as shown at step 1000. In addition, the acceptability report may also take into account historical information about the host product, including the data collected at the site of manufacture and inbound at the supply chain intermediary user. The image capture and communication device may receive the acceptability report from host servers 190 (as shown in <figref idref="DRAWINGS">FIG. 1</figref>) via SMS text message, TCP/IP messaging, email, FTP, PIN email, and/or instant message. In further aspects, the image capture and communication device may receive the acceptability report from the host servers 190 (as shown in <figref idref="DRAWINGS">FIG. 1</figref>) by the host servers 190 providing a uniform resource locator (URL) to a website for the image capture and communication device to access through cellular network 180 (as shown in <figref idref="DRAWINGS">FIG. 1</figref>) or network 185 (as shown in <figref idref="DRAWINGS">FIG. 1</figref>). In such aspects, host servers 190 (as shown in <figref idref="DRAWINGS">FIG. 1</figref>) post the acceptability report to the website available at the URL.

0109At step 1005, the image capture and communication device may output the acceptability report. At step 1010, based on the outputted acceptability report, either the user of the image capture and communication device—or the device itself—may determine whether the host product is acceptable for use. At step 1011, if the host product is not acceptable for use, it may not be distributed to an end-user and is returned to the manufacturer. In a further aspect, the acceptability report may include instructions transmitted or generated by the manufacturer about what the supply chain intermediary user should do with an unacceptable product. If the product is acceptable for use, at step 1015, the host product may be distributed to an end-user.

0110At step 1020, the end-user may analyze the product label 100 (as shown in <figref idref="DRAWINGS">FIGS. 1</figref>, 2A, and 2B) of the host product. Based on its analysis, the image capture and communication device determines a type and one or more features for each of the one or more authentication elements, monitors, and/or identification elements, as shown at step 1025.

0111At step 1030, the image capture and communication device may access the one or more host servers 190 (as shown in <figref idref="DRAWINGS">FIG. 1</figref>). Once the image capture and communication device is either directly or indirectly connected to the host server, the image capture and communication device may transmit the type and features for each of one or more authentication elements, monitors, and/or identification elements present on product label 100, as shown at step 1035. The image capture and communication device may receive an acceptability report from host servers 190 (as shown in <figref idref="DRAWINGS">FIG. 1</figref>) based on the type and features for each of one or more authentication elements, monitors, and/or identification elements present on product label 100, as shown at step 1040. In addition, the acceptability report may also take into account historical information about the host product, including the data collected at the site of manufacture and inbound and outbound at the supply chain intermediary user's location. The image capture and communication device may receive the acceptability report from host servers 190 (as shown in <figref idref="DRAWINGS">FIG. 1</figref>) via SMS text message, TCP/IP messaging, email, FTP, PIN email, and/or instant message. In further aspects, the image capture and communication device may receive the acceptability report from the host servers 190 (as shown in <figref idref="DRAWINGS">FIG. 1</figref>) by the host servers 190 providing a uniform resource locator (URL) to a website for the image capture and communication device to access through cellular network 180 (as shown in <figref idref="DRAWINGS">FIG. 1</figref>) or network 185 (as shown in <figref idref="DRAWINGS">FIG. 1</figref>). In such aspects, host servers 190 (as shown in <figref idref="DRAWINGS">FIG. 1</figref>) post the acceptability report to the website available at the URL.

0112At step 1045, the image capture and communication device may output the acceptability report. At step 1050, based on the outputted acceptability report, either the user of the image capture and communication device—or the device itself—may determine whether the host product is acceptable for use. At step 1051, if the host product is not acceptable for use, it may not be used or caused to be used by the end-user and is returned to the manufacturer directly or indirectly through the supply chain intermediary user. In a further aspect, the acceptability report may include instructions transmitted or generated by the manufacturer about what the end-user should do with an unacceptable product. If the product is acceptable for use, at step 1055, the host product may be used—or caused to be used—by the end-user.

0113At step 1060, the end-user may decide to return the host product to the supply chain intermediary user or the manufacturer. On the host products return to the supply chain intermediary user, the supply chain intermediary user may analyze the product label 100 (as shown in <figref idref="DRAWINGS">FIGS. 1</figref>, 2A, and 2B) of the host product. Based on its analysis, the image capture and communication device determines a type and one or more features for each of the one or more authentication elements, monitors, and/or identification elements, as shown at step 1065.

0114At step 1070, the image capture and communication device may access the one or more host servers 190 (as shown in <figref idref="DRAWINGS">FIG. 1</figref>). Once the image capture and communication device is either directly or indirectly connected to the host server, the image capture and communication device may transmit the type and features for each of one or more authentication elements, monitors, and/or identification elements present on product label 100, as shown at step 1075. The image capture and communication device may receive an acceptability report from host servers 190 (as shown in <figref idref="DRAWINGS">FIG. 1</figref>) based on the type and features for each of one or more authentication elements, monitors, and/or identification elements present on product label 100, as shown at step 1080. In addition, the acceptability report may also take into account historical information about the host product, including the data collected at the site of manufacture, inbound and outbound at the supply chain intermediary user's location, and at the end-user's location or place it used the host product. In a further aspect, any data collected by any image capture and communication devices from product label 100 may be taken into account as historical information for the product acceptability report. The image capture and communication device may receive the acceptability report from host servers 190 (as shown in <figref idref="DRAWINGS">FIG. 1</figref>) via SMS text message, TCP/IP messaging, email, FTP, PIN email, and/or instant message. In further aspects, the image capture and communication device may receive the acceptability report from the host servers 190 (as shown in <figref idref="DRAWINGS">FIG. 1</figref>) by the host servers 190 providing a uniform resource locator (URL) to a website for the image capture and communication device to access through cellular network 180 (as shown in <figref idref="DRAWINGS">FIG. 1</figref>) or network 185 (as shown in <figref idref="DRAWINGS">FIG. 1</figref>). In such aspects, host servers 190 (as shown in <figref idref="DRAWINGS">FIG. 1</figref>) post the acceptability report to the website available at the URL.

0115At step 1085, the image capture and communication device may output the acceptability report. At step 1090, based on the outputted acceptability report, either the user of the image capture and communication device—or the device itself—may determine whether the host product is acceptable for use. At step 1091, if the host product is not acceptable for use, it may not be re-used and thus cannot be redistributed by the clinic or manufacturer and may be returned to the manufacturer for destruction. In a further aspect, the acceptability report may include instructions transmitted or generated by the manufacturer about what the supply chain intermediary user should do with an unacceptable product. If the product is acceptable for use, at step 1095, the host product may be returned to the manufacturer for restocking and/or repackaging. In a further aspect, the acceptability report may include instructions transmitted or generated by the manufacturer about what the supply chain intermediary user should do with an acceptable product.

0116At step 1100, on the host product's return, the manufacturer may analyze the product label 100 (as shown in <figref idref="DRAWINGS">FIGS. 1</figref>, 2A, and 2B) of the host product. Based on its analysis, the image capture and communication device determines a type and one or more features for each of the one or more authentication elements, monitors, and/or identification elements, as shown at step 1105.

0117At step 1110, the image capture and communication device may access the one or more host servers 190 (as shown in <figref idref="DRAWINGS">FIG. 1</figref>). Once the image capture and communication device is either directly or indirectly connected to the host server, the image capture and communication device may transmit the type and features for each of one or more authentication elements, monitors, and/or identification elements present on product label 100, as shown at step 1115. The image capture and communication device may receive an acceptability report from host servers 190 (as shown in <figref idref="DRAWINGS">FIG. 1</figref>) based on the type and features for each of one or more authentication elements, monitors, and/or identification elements present on product label 100, as shown at step 1120. In addition, the acceptability report may also take into account historical information about the host product, including the data collected at the site of manufacture, inbound and outbound at the supply chain intermediary user's location, and at the end-user location or place the end-user used the host product. In a further aspect, any data collected by any image capture and communication devices from product label 100 may be taken into account as historical information for the product acceptability report. The image capture and communication device may receive the acceptability report from host servers 190 (as shown in <figref idref="DRAWINGS">FIG. 1</figref>) via SMS text message, TCP/IP messaging, email, FTP, PIN email, and/or instant message. In further aspects, the image capture and communication device may receive the acceptability report from the host servers 190 (as shown in <figref idref="DRAWINGS">FIG. 1</figref>) by the host servers 190 providing a uniform resource locator (URL) to a website for the image capture and communication device to access through cellular network 180 (as shown in <figref idref="DRAWINGS">FIG. 1</figref>) or network 185 (as shown in <figref idref="DRAWINGS">FIG. 1</figref>). In such aspects, host servers 190 (as shown in <figref idref="DRAWINGS">FIG. 1</figref>) post the acceptability report to the website available at the URL.

0118At step 1125, the image capture and communication device may output the acceptability report. At step 1130, based on the outputted acceptability report, either the user of the image capture and communication device—or the device itself—may determine whether the host product is acceptable for use. At step 1131, if the host product is not acceptable for use, it may not be re-stocked or repackaged and may be sent for destruction. In a further aspect, the acceptability report may include instructions transmitted or generated by the manufacturer about what the manufacturer should do with an unacceptable product. If the product is acceptable for use, at step 1135, the host product may be restocked, repackaged, and/or re-issued to a supply chain intermediary user and/or end-user.

0119In steps 900-1135, the one or more image capture and communication devices may be the same image capture and communication devices, different image capture and communication devices, or the same device for some steps and different devices for other steps.

0120Although illustrative embodiments have been shown and described herein in detail, it should be noted and will be appreciated by those skilled in the art that there may be numerous variations and other embodiments that may be equivalent to those explicitly shown and described. For example, the scope of the present invention is not necessarily limited in all cases to execution of the aforementioned steps in the order discussed. Unless otherwise specifically stated, terms and expressions have been used herein as terms of description, not of limitation. Accordingly, the invention is not to be limited by the specific illustrated and described embodiments (or the terms or expressions used to describe them) but only by the scope of claims.

Contents5

Every citation, both ways

Citations
Document	Relation	Office	Cited during
US10412347B2	Cited by	United States of America	Applicant
US2014121810A1	Cited by	United States of America	Search report
US11935223B2	Cited by	United States of America	Applicant
US11763448B2	Cited by	United States of America	Applicant
US10554937B2	Cited by	United States of America	Applicant
US11838690B2	Cited by	United States of America	Applicant
US2025259230A1	Cited by	United States of America	Search report
US11216933B2	Cited by	United States of America	Applicant
US11532085B2	Cited by	United States of America	Applicant
US2014121810A1	Cited by	United States of America	Search report
US11516443B2	Cited by	United States of America	Applicant
US2014121810A1	Cited by	United States of America	Pre-grant
US10853938B2	Cited by	United States of America	Applicant
US10395207B2	Cited by	United States of America	Applicant
US10679342B2	Cited by	United States of America	Applicant
US9930297B2	Cited by	United States of America	Applicant
US12283042B2	Cited by	United States of America	Applicant
US12417481B2	Cited by	United States of America	Search report
US12315156B2	Cited by	United States of America	Applicant
US11341641B2	Cited by	United States of America	Applicant
US10692207B2	Cited by	United States of America	Applicant
US11568537B2	Cited by	United States of America	Applicant
EP0117390A2	Cites	European Patent Office (EPO)	Applicant
US2003165602A1	Cites	United States of America	Applicant
US2003216969A1	Cites	United States of America	Applicant
US2005011957A1	Cites	United States of America	Search report
US2005198095A1	Cites	United States of America	Search report
US2006034602A1	Cites	United States of America	Applicant
US2006157559A1	Cites	United States of America	Applicant
US2006200480A1	Cites	United States of America	Search report
US2007012784A1	Cites	United States of America	Applicant
WO2007114976A2	Cites	World Intellectual Property Organization (WIPO)	Applicant
US2007160814A1	Cites	United States of America	Search report
US2007235528A1	Cites	United States of America	Applicant
US2007274561A1	Cites	United States of America	Applicant
US2008156876A1	Cites	United States of America	Applicant
US2008253648A1	Cites	United States of America	Search report
US2008298472A1	Cites	United States of America	Applicant
US2009063307A1	Cites	United States of America	Applicant
US2009207881A1	Cites	United States of America	Search report
US2009327258A1	Cites	United States of America	Search report
US2010051707A1	Cites	United States of America	Search report
US2010119158A1	Cites	United States of America	Applicant
US2010219235A1	Cites	United States of America	Search report
US2010293106A1	Cites	United States of America	Applicant
US2010327051A1	Cites	United States of America	Applicant
US2011006109A1	Cites	United States of America	Applicant
US2011006115A1	Cites	United States of America	Applicant
US2011007151A1	Cites	United States of America	Search report
US2011050872A1	Cites	United States of America	Applicant
WO2011057695A1	Cites	World Intellectual Property Organization (WIPO)	Applicant
US2011258130A1	Cites	United States of America	Applicant
US4917503A	Cites	United States of America	Applicant
US5057434A	Cites	United States of America	Applicant
US6119932A	Cites	United States of America	Applicant
US6544925B1	Cites	United States of America	Applicant
US7209042B2	Cites	United States of America	Applicant
US7430588B2	Cites	United States of America	Search report
US7490575B2	Cites	United States of America	Applicant
US7562811B2	Cites	United States of America	Applicant
US7571695B2	Cites	United States of America	Applicant
US7809152B2	Cites	United States of America	Applicant
US8091776B2	Cites	United States of America	Applicant
US8196821B2	Cites	United States of America	Applicant
US20030165602A1	Cites	United States of America	Applicant
US20030216969A1	Cites	United States of America	Applicant
US20050011957A1	Cites	United States of America	Search report
US20050198095A1	Cites	United States of America	Search report
US20060034602A1	Cites	United States of America	Applicant
US20060157559A1	Cites	United States of America	Applicant
US20060200480A1	Cites	United States of America	Search report
US20070012784A1	Cites	United States of America	Applicant
US20070160814A1	Cites	United States of America	Search report
US20070235528A1	Cites	United States of America	Applicant
US20070274561A1	Cites	United States of America	Applicant
US20080156876A1	Cites	United States of America	Applicant
US20080253648A1	Cites	United States of America	Search report
US20080298472A1	Cites	United States of America	Applicant
US20090063307A1	Cites	United States of America	Applicant
US20090207881A1	Cites	United States of America	Search report
US20090327258A1	Cites	United States of America	Search report
US20100051707A1	Cites	United States of America	Search report
US20100119158A1	Cites	United States of America	Applicant
US20100219235A1	Cites	United States of America	Search report
US20100293106A1	Cites	United States of America	Applicant
US20100327051A1	Cites	United States of America	Applicant
US20110006109A1	Cites	United States of America	Applicant
US20110006115A1	Cites	United States of America	Applicant
US20110007151A1	Cites	United States of America	Search report
US20110050872A1	Cites	United States of America	Applicant
US20110258130A1	Cites	United States of America	Applicant
EP117390	Cites	European Patent Office (EPO)	Applicant
WO2007114976	Cites	World Intellectual Property Organization (WIPO)	Applicant
WO2011057695	Cites	World Intellectual Property Organization (WIPO)	Applicant
Teskey, M., “Turning RFID Data into Information”, 2008, downloaded Feb. 23, 2010.	Non-patent	–	Applicant
Apple—iPhone—Technical Specifications, downloaded on Mar. 31, 2010.	Non-patent	–	Applicant
“Will Serialization Make Authentication Obsolete?”, 5th Global Forum on Pharmaceutical AntiCounterfeiting, Feb. 2010, Miami, Florida, presented by Jim Rittenburg.	Non-patent	–	Applicant
“Barcode”, downloaded from Wikipedia on Feb. 22, 2010.	Non-patent	–	Applicant
Van Arnum, P., “Epedigree in the Pharmaceutical Supply Chain”, 2008, downloaded on Feb. 23, 2010.	Non-patent	–	Applicant
iPhone User Guide, for iPhone OS 3.1 Software. Apple, Inc. (2009).	Non-patent	–	Applicant

Showing 100 of 134

18 members in 7 offices; this record represents the family

This recordMember, by publication date

Members18

Family members, oldest first
Document	Office	Kind
US2011258130A1	United States of America	A1	2011-10-20
US2012175412A1	United States of America	A1	2012-07-12
WO2013058991A1	World Intellectual Property Organization (WIPO)	A1	2013-04-25
EP2769359A1	European Patent Office (EPO)	A1	2014-08-27
CN104115185A	China	A	2014-10-22
HK1196172A	Hong Kong, China	A	2014-12-05
HK1196172A1	Hong Kong, China	A1	2014-12-05
JP2015503138A	Japan	A	2015-01-29
US9053616B2This record	United States of America	B2	2015-06-09
EP2769359A4	European Patent Office (EPO)	A4	2015-06-10
US2015269589A1	United States of America	A1	2015-09-24
US9224120B2	United States of America	B2	2015-12-29
US2016154939A1	United States of America	A1	2016-06-02
EP2769359B1	European Patent Office (EPO)	B1	2017-01-04
DK2769359T3	Denmark	T3	2017-04-10
CN104115185B	China	B	2017-06-23
US9811632B2	United States of America	B2	2017-11-07
US2018114597A1	United States of America	A1	2018-04-26

89 transactions on the USPTO file

Allowed after 2 non-final rejections, 1 final rejection and 1 RCE.

Non-final rejections: 2
Final rejections: 1
RCEs: 1
Appeals: 0

Over time

Point at a mark for the transaction

Transactions

Prosecution transactions, newest first
	Event	Code
2022-11-23	Payment of Maintenance Fee, 8th Year, Large EntityM1552	M1552
2020-01-21	Correspondence Address ChangeC.ADB	C.ADB
2018-11-22	Payment of Maintenance Fee, 4th Year, Large EntityM1551	M1551
2015-06-09	Recordation of Patent Grant MailedPGM/	PGM/
2015-06-09	Patent Issue Date Used in PTA CalculationAllowedPTAC	PTAC
2015-05-21	Email NotificationEML_NTR	EML_NTR
2015-05-20	Issue Notification MailedAllowedWPIR	WPIR
2015-05-12	Dispatch to FDCD1935	D1935
2015-05-08	Application Is Considered Ready for IssuePILS	PILS
2015-05-07	Issue Fee Payment VerifiedN084	N084
2015-05-07	Entity Status Set To Undiscounted (Initial Default Setting or Status Change)BIG.	BIG.
2015-05-07	Issue Fee Payment ReceivedIFEE	IFEE
2015-03-12	Email NotificationEML_NTR	EML_NTR
2015-03-12	Printer Rush- No mailingTCPB	TCPB
2015-03-12	Mail Miscellaneous Communication to ApplicantMM327	MM327
2015-03-09	Miscellaneous Communication to Applicant - No Action CountM327	M327
2015-03-03	Pubs Case Remand to TCPUBTC	PUBTC
2015-02-12	Electronic ReviewELC_RVW	ELC_RVW
2015-02-12	Email NotificationEML_NTF	EML_NTF
2015-02-12	Mail Notice of AllowanceAllowedMN/=.	MN/=.
2015-02-09	Notice of Allowance Data Verification CompletedAllowedN/=.	N/=.
2014-10-24	Date Forwarded to ExaminerFWDX	FWDX
2014-10-14	Information Disclosure Statement consideredIDSC	IDSC
2014-10-14	Response after Non-Final ActionA...	A...
2014-10-14	Request for Extension of Time - GrantedXT/G	XT/G
2014-10-14	Reference capture on IDSRCAP	RCAP
2014-10-14	Electronic Information Disclosure StatementEIDS.	EIDS.
2014-10-14	Information Disclosure Statement (IDS) FiledWIDS	WIDS
2014-05-14	Electronic ReviewELC_RVW	ELC_RVW
2014-05-14	Email NotificationEML_NTF	EML_NTF
2014-05-14	Mail Non-Final RejectionNon-final rejectionMCTNF	MCTNF
2014-05-04	Non-Final RejectionNon-final rejectionCTNF	CTNF
2013-07-23	Date Forwarded to ExaminerFWDX	FWDX
2013-07-23	Disposal for a RCE / CPA / R129AbandonedABN9	ABN9
2013-07-22	Request for Continued Examination (RCE)RCEX	RCEX
2013-07-22	Request for Extension of Time - GrantedXT/G	XT/G
2013-07-22	Workflow - Request for RCE - BeginBRCE	BRCE
2013-02-08	Information Disclosure Statement consideredIDSC	IDSC
2013-02-08	Reference capture on IDSRCAP	RCAP
2013-02-08	Information Disclosure Statement (IDS) FiledM844	M844
2013-02-08	Information Disclosure Statement (IDS) FiledWIDS	WIDS
2013-01-31	Electronic ReviewELC_RVW	ELC_RVW
2013-01-31	Email NotificationEML_NTF	EML_NTF
2013-01-31	Mail Final Rejection (PTOL - 326)Final rejectionMCTFR	MCTFR
2013-01-25	Final RejectionFinal rejectionCTFR	CTFR
2012-11-07	Date Forwarded to ExaminerFWDX	FWDX
2012-11-05	Response after Non-Final ActionA...	A...
2012-08-03	Electronic ReviewELC_RVW	ELC_RVW
2012-08-03	Email NotificationEML_NTF	EML_NTF
2012-08-03	Mail Non-Final RejectionNon-final rejectionMCTNF	MCTNF
2012-07-31	Information Disclosure Statement consideredIDSC	IDSC
2012-07-31	Reference capture on IDSRCAP	RCAP
2012-07-31	Information Disclosure Statement (IDS) FiledM844	M844
2012-07-31	Information Disclosure Statement (IDS) FiledWIDS	WIDS
2012-07-27	Non-Final RejectionNon-final rejectionCTNF	CTNF
2012-07-10	Date Forwarded to ExaminerFWDX	FWDX
2012-07-09	Response to Election / Restriction FiledELC.	ELC.
2012-06-18	Electronic ReviewELC_RVW	ELC_RVW
2012-06-18	Email NotificationEML_NTF	EML_NTF
2012-06-18	Mail Restriction RequirementMCTRS	MCTRS
2012-06-11	Restriction/Election RequirementCTRS	CTRS
2012-03-09	Case Docketed to Examiner in GAUDOCK	DOCK
2012-03-08	Case Docketed to Examiner in GAUDOCK	DOCK
2012-02-29	Case Docketed to Examiner in GAUDOCK	DOCK
2012-02-03	Information Disclosure Statement consideredIDSC	IDSC
2012-02-03	Reference capture on IDSRCAP	RCAP
2012-02-03	Information Disclosure Statement (IDS) FiledM844	M844
2012-02-03	Information Disclosure Statement (IDS) FiledWIDS	WIDS
2011-10-21	Email NotificationEML_NTR	EML_NTR
2011-10-20	PG-Pub Issue NotificationPG-ISSUE	PG-ISSUE
2011-08-18	Email NotificationEML_NTR	EML_NTR
2011-08-18	Change in Power of Attorney (May Include Associate POA)PA..	PA..
2011-08-15	Correspondence Address ChangeC.AD	C.AD
2011-07-05	Information Disclosure Statement consideredIDSC	IDSC
2011-07-05	Information Disclosure Statement (IDS) FiledM844	M844
2011-07-05	Reference capture on IDSRCAP	RCAP
2011-07-05	Information Disclosure Statement (IDS) FiledWIDS	WIDS
2010-07-08	Application Dispatched from OIPEOIPE	OIPE
2010-06-11	Application Is Now CompleteCOMP	COMP
2010-06-11	Change in Power of Attorney (May Include Associate POA)PA..	PA..
2010-06-11	Sent to Classification ContractorPGPC	PGPC
2010-06-11	Filing Receipt - UpdatedFLRCPT.U	FLRCPT.U
2010-05-24	Additional Application Filing FeesADDFLFEE	ADDFLFEE
2010-05-24	A statement by one or more inventors satisfying the requirement under 35 USC 115, Oath of the ApplicOATHDECL	OATHDECL
2010-05-10	Notice Mailed--Application Incomplete--Filing Date AssignedINCD	INCD
2010-05-10	Filing ReceiptFLRCPT.O	FLRCPT.O
2010-05-03	Cleared by OIPE CSRL194	L194
2010-04-29	IFW Scan & PACR Auto Security ReviewSCAN	SCAN
2010-04-22	Initial Exam Team nnIEXX	IEXX

16 legal events, as the office reported them to INPADOC

Over the term

Point at a mark for the event

Events

Legal events, newest first
	Event	Code
2025-05-29	AssignmentAS	AS
2022-11-23	Maintenance fee paymentMAFP	MAFP
2021-03-05	AssignmentAS	AS
2021-03-05	AssignmentAS	AS
2021-03-05	AssignmentAS	AS
2020-09-01	AssignmentAS	AS
2019-04-25	AssignmentAS	AS
2019-04-25	AssignmentAS	AS
2018-11-22	Maintenance fee paymentMAFP	MAFP
2015-05-20	Information on status: patent grantGrantedPATENTED CASESTCF	STCF
2013-09-13	AssignmentAS	AS
2010-05-24	AssignmentAS	AS
2010-05-24	AssignmentAS	AS
2010-05-24	AssignmentAS	AS
2010-05-24	AssignmentAS	AS
2010-05-24	AssignmentAS	AS