Annotating imaged data product
Abstract
The annotating product adapted for use with an information system and with an exhibit having a plurality of objects has an imager ( 11 ) which is signal connected to the information system ( 91 ) and has codes ( 31 ) representing ( 33 ) objects ( 81 ) from the plurality of objects, the imager detecting light ( 32 ) from several codes together and sending an indicate signal ( 12 ) which represents at least one of the several objects to the information system which then sends an annotate signal ( 22 ) to cause a display ( 21 ) to output data about objects represented by the indicate signal.

Term
Term ended
Expired 15 August 2021, 5.1 years ago.
- Priority
- Filed
- Granted
- Expired
- Today
14 claims: 6 independent, 8 dependent
- 1An annotating system used with an information system (91) and with a plurality of objects (81), the annotating system comprising:an imager (11), the imager having a field of view, the field of view extending along each of three orthogonal axes, a plurality of coded data sources (31), several coded data sources from the plurality of coded data sources being spatially separated in the field of view, light (32) from the several coded data sources being together detected by the imager;a first object from the several objects;a first coded data source from the several coded data sources, light from the first coded data source representing the first object;a first indicate signal (12), the first indicate signal being related to light from the first coded data source selected at the imager, wherein the first coded data source or the imager includes personal data that is added to the indicate signal;the first indicate signal representing the first object, the imager being able to output the first indicate signal, the information system being able to receive the first indicate signal, first annotate data being associated with the first object, the first annotate data being available to the information system;the information system being able to output a first annotate signal (22), in response to the first indicate signal, the first annotate signal having a first personal component, the first annotate signal with the first personal component representing first annotate data relevant specifically to a first person;and a display (21), the display being able to receive the first annotate signal and the display being able to output in response to the first annotate signal the first annotate data.
- 9An annotating system as claimed in any preceding claim wherein the indicate signal (12) has a first query component which solicits first reply data about the first object and wherein the first annotate data has a first reply component which represents the first reply data.
- 11An annotating system as claimed in any preceding claim wherein the imager (11) is a first private imager, and comprising:a second private imager (11), the second private imager having a field of view, the second field of view extending along each of three orthogonal axes, several coded data sources from the plurality of coded data sources;(31) being spatially separated in the second field of view, second light (32) from the several coded data sources being together detected by the second private imager;a second object from the several objects;a second coded data source from the several coded data sources;light from the second coded data source representing the second object;a second indicate signal (12), the second indicate signal being related to light from the second coded data source selected at the second private imager, wherein the second coded data source or the second private imager includes second personal data that is added to the indicate signal the second indicate signal representing the second object, the second private imager being able to output the second indicate signal, the information system being able to receive the second indicate signal;second annotate data associated with the second object, the second annotate data being available to the information system;the information system being able to output a second annotate signal (22), in response to the second indicate signal, the second annotate signal having a second personal component, the second annotate signal with the second personal component representing second annotate data relevant specifically to a second person;and the display (21) being able to receive the second annotate signal and the display being able to output in response to the second annotate signal the second annotate data.
- 13An annotating system as claimed in any preceding claim wherein the display (21) is a private display.
Independent claims6
36 paragraphs, as filed
0001The annotating product - which is used with an information system and with objects -provides data about an object when the object is indicated via an imager which detects light from several coded data sources together.
0002The objects can be in various planned and unplanned arrangements such as exhibits of objects in a store window, in a store, in a gallery, and in a museum and such as everyday objects in private homes and in public places. <patcit id="pcit0001" dnum="FR2694827"><text>FR 2 694 827</text></patcit> discloses a system having an optical bar code reader which reads bar-codes on products to be identified. The data is sent either between an interface unit and a terminal or to a remote system operating via infra-red, electro-magnetic or optical systems to a central computer which is controlled by a central server. The server is used to compile the alphanumeric data in the computer into a series of visual, musical or voice audio messages which will be sent to monitors or terminals in contact with the final user. The invention is set forth in claim 1.
0003<figref idref="f0001">FIG. <b>1</b></figref> schematically depicts the product.
0004<figref idref="f0001">FIG. <b>2</b></figref> depicts an example of light from a coded data source.
0005The annotating product is adapted for use with an information system and with a plurality of objects. The product comprises an imager <b>11</b> which is signal connected to the information system <b>91;</b> comprises coded data sources <b>31</b> representing objects from the plurality of objects <b>81,</b> with light <b>32</b> from the plurality of coded data sources being detected by the imager; comprises an indicate signal <b>12</b> which indicates via the imager to the information system objects from the plurality of objects; and comprises an annotate signal <b>22</b> from the information system which causes annotate data about the indicated objects to be made available to a person via a display <b>21.</b>
0006"Person" here, and throughout, can not only mean a natural person, but also can mean various entities which can be animate and inanimate and which can be self-acting and can be externally motivated.
0007The imager <b>11</b> has a field of view extending along each of three orthogonal axes. Several coded data sources - members of <b>31</b> - from the plurality of coded data sources are spatially separated in the field of view. The imager detects light-members of <b>32</b> - from the several coded data sources together.
0008"Detects light" here and throughout means not only detecting the presence of light but also means detecting the specific properties of the light - such as the color bands <b>43 -</b> which encode data so that the imager can output an indicate signal which represents the data. Detecting light from several data sources together distinguishes the imager from a bar code reader which can not detect light from several spatially separated bar codes together.
0009Light - <b>41</b> for example - from a first coded data source - a member of <b>31</b> - from the plurality of coded data sources represents a first object - a member of <b>81</b> - from the several objects. A first indicate signal - a component of <b>12</b> - is caused by the imager when light from the first coded data source is selected by the imager. The first indicate signal represents the first object. The first indicate signal is output by the imager and is input to the information system. A person can cause light from the first coded data source to be selected by the imager.
0010First annotate data associated with the first object is available to the information system. The first indicate signal causes the information system to output a first annotate signal - a component of <b>22 -</b> which represents the first annotate data. The first annotate signal is input to a display <b>21.</b> The first annotate signal causes the display to output the first annotate data. The display can be visible to a person.
0011The imager can be a private imager. A plurality of object coded data sources can member-by-member correspond to object members from the plurality of coded data sources as indicated by <b>33.</b> The first coded data source is a first object coded data source from the plurality of object coded data sources. Light from the first object coded data source is caused to be selected by data input to the private imager to select a representation of the first object coded data source output by the private imager.
0012The private imager can be part of a device such as a cell phone and a computer which can be signal connected to the information system. When the private imager detects light from the first object coded data source, the private imager can output a representation of the first object coded data source. This representation can then be selected by the person by any of various data input means such as key stroking, screen tapping, and computer mouse clicking.
0013The imager can be a public imager. A plurality of person coded data sources can member-by-member correspond to person members from the plurality of coded data sources. A first person coded data source from the plurality of person coded data sources is the first coded data source. The first person coded data source is selected by the imager when a first alignment - a component of <b>33 -</b> of the first person coded data source is held for a set time.
0014In this public imager case the first person coded data source - <b>41</b> for example - can have a first axis <b>45 -</b> defined for example by bands <b>42</b> and <b>44.</b> The first alignment can be achieved by manipulating the first person coded data source so that the first axis intersects the first object. The first alignment represents the first object by intersecting the first object.
0015In the public imager case a plurality of object coded data sources can also member-by-member correspond to object members from the plurality of coded data sources. The plurality of object coded data sources member-by-member separately represent - components of <b>33 -</b> each object from the plurality of objects.
0016In this case the public imager can also detect light from several object coded data sources representing the several objects. The indicate signal can have an object component which represents the objects. Thus, even if objects have been moved - by forces which can be internal, external, and combinations thereof - the information system will have data about the first object when it is indicated by the first alignment.
0017In this case the first alignment can also be achieved by manipulating the first person coded data source to indicate the first object coded data source representing the first object. The first object coded data source can be selected - for example - by obscuring at least part of at least one of the first person coded data source color bands <b>43.</b>
0018The information system can be adapted so that more than one of these alignment means can be used. The information system can be adapted so that the alignment means can be caused by various combinations of all of these alignment means.
0019In the private imager case many persons can be manipulating private imagers. For example a first person can manipulate a first private imager and cause a first indicate signal representing a first object while a second person can manipulate a second private imager and cause a second indicate signal representing a second object. The first person and the second person can cause a first indicate signal and a second indicate signal which represents the same object which can be the first object and can be the second object.
0020The first indicate signal from the first private imager has a first person component which represents the first private imager and the second indicate signal from the second private imager has a second person component which represents the second private imager. The first person component and the second person component cause the first annotate signal and the second annotate signal here to have a first personal component representing first annotate data relevant specifically to the first person, and the second annotate signal to have a second personal component representing annotate data relevant specifically to the second person.
0021In the public imager case many persons can be manipulating many person coded data sources. A first person coded data source being aligned by a first person can have a portion - <b>43</b> for example - which represents the first person, and a second person coded data source being aligned by a second person can have a similar, but distinct, portion which represents the second person.
0022The first indicate signal from the public imager has a first person component which represents the first person and the second indicate signal from the public imager has a second person component which represents the second person. The first person component and the second person component cause the first annotate signal and the second annotate signal to have a first personal component representing first annotate data relevant specifically to the first person, and the second annotate signal to have a second personal component representing annotate data relevant specifically to the second person.
0023The display can have any of various forms which can be signal connected to the information system. The display can be a private display in the private imager case and in the public imager case. A private display can be any of various devices such as a cell phone and a computer. The display can be a public display in the public imager case and in the private imager case. A public display can be a large display which can be perceived by many persons. A large display can show annotate data intended for each of many persons. A public display can be projected to a location close to a person so that this display can be perceived by the person and only also by other persons close to the person.
0024The display can be various combinations of two and more of these. The display form can be tailored to the needs and wants of various persons indicating objects.
0025The display can be any data output means which can be perceived by a person such as visual, audible, and tactile means. The display can be combinations of these means. The display can be achieved by motions of a robot. The data output means can be tailored to the needs and wants of various persons indicating objects.
0026The indicate signal can have a query component. A query component can be caused by a person. Many query components can be caused by many persons together. A query component can request various specific reply data about the indicated object such the query "what colors are available?" relevant to merchandise and such as queries relevant to other exhibits of objects. The first annotate data can have a reply component which represents the first reply data.
0027A query component can be caused by a person manipulating a private imager to detect light from object coded data source. When light from the object coded data source is detected, the imager can give the person the opportunity to cause a query component by any of various data input means.
0028A query component can be caused by a person manipulating a person coded data source so that light from the person coded data source is detected by a public imager. The person coded data source can have a form like that depicted in <figref idref="f0001">FIG. 2</figref> with color bands. Thus the query component can be caused for example by obscuring at least part of at least one of the person coded data source color bands.
0029The information system can be adapted so that more than one of these means can be used. The information system can be adapted so that the query component, and any second query component, can be caused by various combinations of these means.
0030When a person code has a component which identifies a person, a query can be answered with annotate data about the object particularly relevant to the person.
0031The imager can be the dual mode imager of patent application <patcit id="pcit0002" dnum="US0113742W"><text>PCTUS/01/13742 filed 30 April 2001</text></patcit>. The coded data source depicted in <figref idref="f0001">FIG. 2</figref> is a form which works well with the dual mode imager. The bands 42 and 44 retro reflect infra red light. The locate mode of the dual mode imager detects these bands. The react mode of the dual mode imager detects light from the region 43 over other light from the field of view. Band 44 is wider than band 41 defining a direction. Other imagers and other forms of coded data sources can be used.
0032The imager - dual mode and otherwise - can have components separated in space. This can enlarge the field of view. This can facilitate determining the spatial positions of coded data sources. The imager can have several elements which selectively detect portions of a range of values of a physical property of light from a coded data source, with the several portions detected by the several imager elements being combined to detect the full range of the physical property of light without forming an image of the coded data source.
0033Light from a coded data source can have various sources such as light reflected from ambient sources; a coded data source light source; light emitted after energizing by suitable radiation; light emitted after energizing by suitable radiation with a characteristic decay time; a light source adjacent to the imager illuminating the coded data source; and combinations of two and more of these.
0034Light is not limited to visible light. For example, infrared can be used, and millimeter and longer wavelengths can be used. Light can be radiating energy from any portion of the electromagnetic spectrum which can provide the functions required here. Other forms of radiating energy - such as acoustic energy - which can provide the functions required here are included in the meaning of "light" here.
0035A "signal" from a first product part to a second product part and a first product part being "signal connected" with a second product part here, and throughout, mean that a first physical state of the first product part causes a second physical state of the second product part. This can occur by various direct causal means and can occur by any of various transmission means. Transmitted signals can be any of various point-to-point and broadcast forms of energy transmission such as wireless and via wires, cables, and fibers. Parts of transmitted signals can reside with one form of the transmitted signal, parts can reside with a second form of transmitted signal, and parts can reside with various combinations of transmitted signals.
0036The several causes here can act via any of various processing modes. The processing can utilize configured processing elements such as fixed circuits, can utilize configurable processing elements such as field programmable gate arrays and neural networks, can utilize instructions in a data-bearing medium, and can utilize combinations of these. The processing be stand alone, can act via a local information system, can act via a networked information system, and can act via combinations of these. The processing - in part at least - can be a part of the imager.
1 sheet
Sheet 1
Every citation, both ways
| Document | Relation | Office |
|---|---|---|
| EP0840248A | Cites | European Patent Office (EPO) |
| WO8707106A | Cites | World Intellectual Property Organization (WIPO) |
| WO9966441A | Cites | World Intellectual Property Organization (WIPO) |
| FR2694827A | Cites | France |
| US5537211A | Cites | United States of America |
| US5852823A | Cites | United States of America |
| US6048117A | Cites | United States of America |
70 members in 9 offices
Priority claims7
| Document | Office | Kind | Date |
|---|---|---|---|
| 226183P | United States of America | – | |
| 22618300 | United States of America | P | |
| 238952P | United States of America | – | |
| 23895200 | United States of America | P | |
| 256086P | United States of America | – | |
| 25608600 | United States of America | P | |
| 0125500 | United States of America | W |
Members70
| Document | Office | Kind | |
|---|---|---|---|
| WO0184475A1 | World Intellectual Property Organization (WIPO) | A1 | |
| AU6107301A | Australia | A | |
| WO0217037A2 | World Intellectual Property Organization (WIPO) | A2 | |
| WO0217291A1 | World Intellectual Property Organization (WIPO) | A1 | |
| WO0217293A1 | World Intellectual Property Organization (WIPO) | A1 | |
| AU7705000A | Australia | A | |
| AU8337501A | Australia | A | |
| AU8491501A | Australia | A | |
| WO0217037A3 | World Intellectual Property Organization (WIPO) | A3 | |
| WO0248947A1 | World Intellectual Property Organization (WIPO) | A1 | |
| WO0249340A1 | World Intellectual Property Organization (WIPO) | A1 | |
| WO0249344A1 | World Intellectual Property Organization (WIPO) | A1 | |
| AU2895002A | Australia | A | |
| AU3519102A | Australia | A | |
| AU3959402A | Australia | A | |
| KR20030005311A | Republic of Korea | A | |
| KR20030027041A | Republic of Korea | A | |
| EP1301892A1 | European Patent Office (EPO) | A1 | |
| KR20030040407A | Republic of Korea | A | |
| CN1427978A | China | A | |
| EP1325397A2 | European Patent Office (EPO) | A2 | |
| EP1325491A1 | European Patent Office (EPO) | A1 | |
| CN1447961A | China | A | |
| EP1350217A1 | European Patent Office (EPO) | A1 | |
| EP1350385A1 | European Patent Office (EPO) | A1 | |
| EP1354471A1 | European Patent Office (EPO) | A1 | |
| JP2003532239A | Japan | A | |
| CN1454378A | China | A | |
| US2003222145A1 | United States of America | A1 | |
| US2004027455A1 | United States of America | A1 | |
| US2004041027A1 | United States of America | A1 | |
| JP2004507811A | Japan | A | |
| US6708885B2 | United States of America | B2 | |
| JP2004512548A | Japan | A | |
| JP2004516555A | Japan | A | |
| JP2004516564A | Japan | A | |
| US2004125224A1 | United States of America | A1 | |
| US2004135766A1 | United States of America | A1 | |
| JP2004527147A | Japan | A | |
| US2004188525A1 | United States of America | A1 | |
| EP1301892A4 | European Patent Office (EPO) | A4 | |
| EP1325397A4 | European Patent Office (EPO) | A4 | |
| EP1350217A4 | European Patent Office (EPO) | A4 | |
| EP1350385A4 | European Patent Office (EPO) | A4 | |
| CN1190752C | China | C | |
| US2005102332A1 | United States of America | A1 | |
| US6945460B2 | United States of America | B2 | |
| EP1325491A4 | European Patent Office (EPO) | A4 | |
| EP1354471A4 | European Patent Office (EPO) | A4 | |
| US7000840B2 | United States of America | B2 | |
| US7034803B1 | United States of America | B1 | |
| CN1269100C | China | C | |
| US7099070B2 | United States of America | B2 | |
| US2006291797A1 | United States of America | A1 | |
| US7161581B2 | United States of America | B2 | |
| US7184075B2 | United States of America | B2 | |
| KR100786898B1 | Republic of Korea | B1 | |
| JP4081373B2 | Japan | B2 | |
| JP2008135072A | Japan | A | |
| JP4103592B2 | Japan | B2 | |
| CN100397469C | China | C | |
| EP1325397B1This record | European Patent Office (EPO) | B1 | |
| AT400840T | Austria | T | |
| ATE400840T1 | Austria | T1 | |
| EP1301892B1 | European Patent Office (EPO) | B1 | |
| AT403908T | Austria | T | |
| ATE403908T1 | Austria | T1 | |
| DE60134759D1 | Germany | D1 | |
| DE60135227D1 | Germany | D1 | |
| JP4294319B2 | Japan | B2 |
48 legal events, as 6 offices reported them to INPADOC
Over the term
Point at a mark for the eventEvents
| Event | Code | Office | |
|---|---|---|---|
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| Application deemed withdrawn, or ip right lapsed, due to non-payment of renewal feeWithdrawnR119 | R119 | DE | |
| Gb: european patent ceased through non-payment of renewal feeCeasedGBPC | GBPC | EP | |
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| Notification of lapseLapsedST | ST | FR | |
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| Annual fee paid to national office [announced via postgrant information from national office to epo]GrantedPGFP | PGFP | EP | |
| Annual fee paid to national office [announced via postgrant information from national office to epo]GrantedPGFP | PGFP | EP | |
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| No opposition filedOpposition26N | 26N | EP | |
| No opposition filed within time limitOppositionORIGINAL CODE: 0009261PLBE | PLBE | EP | |
| Information on the status of an ep patent application or granted ep patentGrantedSTATUS: NO OPPOSITION FILED WITHIN TIME LIMITSTAA | STAA | EP | |
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| Annual fee paid to national office [announced via postgrant information from national office to epo]GrantedPGFP | PGFP | EP | |
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| Patent ceasedCeasedPL | PL | CH | |
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| Lapsed in a contracting state [announced via postgrant information from national office to epo]LapsedPG25 | PG25 | EP | |
| Nl: lapsed or annulled due to failure to fulfill the requirements of art. 29p and 29m of the patents actLapsedNLV1 | NLV1 | EP | |
| European patents granted designating irelandGrantedFG4D | FG4D | IE | |
| Corresponds to:REF | REF | EP | |
| European patent takes effect as a national patent in ch/liEP | EP | CH | |
| Designated contracting statesAK | AK | EP | |
| European patent grantedGrantedFG4D | FG4D | GB | |
| (expected) grantORIGINAL CODE: 0009210GRAA | GRAA | EP | |
| Grant fee paidORIGINAL CODE: EPIDOSNIGR3GRAS | GRAS | EP | |
| Despatch of communication of intention to grant a patentORIGINAL CODE: EPIDOSNIGR1GRAP | GRAP | EP | |
| First examination report despatched17Q | 17Q | EP | |
| First examination report despatched17Q | 17Q | EP | |
| Supplementary search report drawn up and despatchedA4 | A4 | EP | |
| Information provided on ipc code assigned before grantRIC1 | RIC1 | EP | |
| Information provided on ipc code assigned before grantRIC1 | RIC1 | EP | |
| Request for examination filed17P | 17P | EP | |
| Designated contracting statesAK | AK | EP | |
| Request for extension of the european patentAX | AX | EP | |
| Public reference made under article 153(3) epc to a published international application that has entered the european phaseORIGINAL CODE: 0009012PUAI | PUAI | EP |
Numbers
- Publication
- 1325397
- Application
- 19621762
Titles3
- German
- ANMERKUNGS-ABBILDUNGS-DATENPRODUKT
- English
- ANNOTATING IMAGED DATA PRODUCT
- French
- PRODUIT D'ANNOTATION DE DONNEES IMAGEES
Classification
- CPC, 13
- G06K19/06018
- G06Q50/10
- G06F21/36
- G06K7/10079
- G06K7/10861
- G06K2019/06225
- H04N1/00127
- H04N1/00244
- H04N1/00326
- H04N1/00334
- H04N2201/0084
- H04N2201/0089
- G06Q30/06
- IPC, 8
- G06F1 00
- G06K17 00
- G06F3 033
- G06F3 042
- G06F21 00
- G06K7 10
- G06K19 06
- H04N1 00
Designated states20
- Contracting states, 20
- Austria
- Belgium
- Switzerland
- Cyprus
- Germany
- Denmark
- Spain
- Finland
- France
- United Kingdom
- Greece
- Ireland
- Italy
- Liechtenstein
- Luxembourg
- Monaco
- Netherlands (Kingdom of the)
- Portugal
- Sweden
- Türkiye