Interactive multi-sensory reading system electronic teaching/learning device.

(54) Title: ELECTRONIC DEVICE FOR TEACHING / LEARNING AN INTERACTIVE MULTISENSORY READING SYSTEM.

(54) Title: INTERACTIVE MULTI-SENSORY READING SYSTEM ELECTRONIC TEACHING / LEARNING DEVICE.

(57) Summary

An electronic teaching / learning device (100) operates with and without a Printed sheet element (20) that has a content configuration that can be selected by means of a group of user-sensitive sensors (142) below a surface ( 130) configured to receive the item; the group of sensors is formed by cross points of two sets of transverse conductor lines (246, 248), one set being conducted sequentially with a radio frequency square wave and the other set is sampled sequentially, through a connection high-amplifier amplifier with an asynchronous detection circuit; Where more than one cross-point location is activated by the user, the algorithms (Figures 12a and 12b) are used to identify a location of the cross-point sensor as the selection activated by the user.

(57) Abstract

An electronlc learnlng / teachlng devlce (100) operates with and without a prlnted sheet element (20) having an arrangement of selectable content by means of a user responslve sensor array (142) beneath a surface (130) configured to recelve the element. The sensor array ¡s formed by cross-polnts of two sets of Crossing conductlve Unes (246, 248), one set being drlven sequentially with a radio frequeney square wave and the other set being sampled sequentially though a high ¡mpedance ampllfler connectlon with an asynchronous detectlon clrcult. Where more than one cross-polnt locatlon s user actlvated, algorithms (Fig. 12) are used to dentlfy one cross-polnt sensor locatlon as the user actlvated selectlon.

(12) INTERNATIONAL APPLICATION PUBLISHED UNDER THE PATENT COOPERATION TREATY (PCT)

<img file="MXPA04012018A_D0001.tif" />

PCT

WO 03/102895 Al (19) World Intellectual Property Organization

Internalional Bureau (43) International Publication Date 11 December 2003 (11.12.2003) (10) International Publication Number (51) International Patent Classification⁷: G09B 5/00 (21) International Application Number: PCT / US03 / 17013 (22) International Filing Date: May 30, 2003 (May 30, 2003) (25) Filing Language: English (26) Publication Language: English (30) Priority Data:

60 / 385,159 May 30, 2002 (May 30, 2002) US (71) A pplicant: MATTEL, INC. (US / US); 333 Continental Boulevard, El Segundo, CA 90245-5012 (US).

(72) Inventors: ERNST, Stephen, M .; 13750 Holmes Road, Colorado Springs, CO 80908 (US). TAYLOR, John, W .; PO Box 464, Elma, NY 14059 (US). GALARNEAU, Dagan; 2721D Street, Sacramento, CA 95816 (US). HOPPY, Joseph, E .; 141 Colony Courl, East Aurora, NY 14052 (US). BISHOP, James, A., Jr .; 3745 Moyer Road, North Tonawanda, NY 14120 (US). PYRCE, Philip, R .; 1325 DodgeRoad, Getzville, NY 14068 (US). MEADE, James, P .; 5525 Coachmans Lañe, Hamburg, NY 14075 (US).

(74) Agents: JAM1ESON, John, Jr. el al .; Akin Gump Strauss Hauer &amp; Feld, LLP, One Commerce Square, Suite 2200, 2005 Market Street, Philadelphia, PA 19103-7086 (US).

(81) Designated States (national): AE, AG, AL, AM, AT, AU, AZ, BA, BB, BG, BR, BY, BZ, CA, CH, CN, CO, CR, CU, CZ, DE , DK, DM, DZ, EC, EE, ES, FI, GB, GD, GE, GH, GM, HR, HU, ID, IL, IN, IS, JP, KE, KG, KP, KR, KZ, LC , LK, LR, LS, LT, LU, LV, MA, MD, MG, MK, MN, MW, MX, MZ, NI, NO, NZ, OM, PH, PL, PT, RO, RU, SC, SD , SE, SG, SK, SL, TJ, TM, TN, TR, TT, TZ, UA, UG, UZ, VC, VN, YU, ZA, ZM, ZW.

(84) Designated States (regional): ARIPO patent (GH, GM, KE, LS, MW, MZ, SD, SL, SZ, TZ, UG, ZM, ZW), Eurasian patent (AM, AZ, BY, KG, KZ, MD, RU, TJ, TM), European patent (AT, BE, BG, CH, CY, CZ, DE, DK, EE, ES, Fl, FR, GB, GR, HU, IE, IT, LU, MC, NL, PT, RO, SE, SI, SK, TR), OAPI patent (BF, BJ, CF, CG, Cl, CM, GA, GN, GQ, GW, ML, MR, NE, SN, TD, TG).

Published:

- with internalional search report

For two-letter codes and other abbreviations, refer to the Guidance Notes on Codes and Abbrevialions appearing at the beginning of each regular issue of the PCT Gazette.

(54) Title: INTERACTIVE MULT1-SENSORY READING SYSTEM ELECTRONIC TEACH1NG / LEARNING DEVICE

<img file="MXPA04012018A_D0002.tif" />

(57) Abstract: An electronic leaming / teaching device (100) operates with and without a printed sheet elemenl (20) having an arrangement of selectable content by means of a nser responsive sensor array (142) beneath a surface (130) configured to receive the element. The sensor array is formed by cross-points of two sets of Crossing conductive Unes (246,248), one set being driven sequenlially with a radio frequeney square wave and the other set being sampled sequentially though a high impedance amplifier connection with an asynchronous delection circuit. Where more than one cross-point location is user activated, algorithms (Fig. 12) are used to i den tify one cross-point sensor location as the user activated selection.

ELECTRONIC DEVICE FOR TEACHING / LEARNING A

INTERACTIVE MULTI-SENSORY READING SYSTEM

BACKGROUND OF THE INVENTION

The present invention relates generally to electronic teaching / learning devices for an interactive multi-sensory teaching / learning system. More particularly, the present invention relates to electronic teaching / learning devices that allow a child or another student to activate an electronic speech and sound, selecting words or images on the device or at least on the pages of multi-page books or other printed sheet elements that can be inserted so that they can be removed within an intermediate area of ​​the device.

The above interactive electronic learning devices are well known and have been used for many years as teaching and entertainment aids. Many of the early "reader" devices used individual cards with words and / or graphics printed on each card. The readers used microcontrollers with software that maps the contents of each card individually. The words or graphics printed on the card were associated with stored sounds and localized sound effects in memory. The selection of a word or graphic printed on the card made by the user, would generate the associated audio sound from the reader. The typical association might be for the reader to audibly pronounce the selected printed word or letter printed on the card.

Most of the above learning card reading devices employed a panel group of Membrane Switches. These were formed by a flexible membrane sheet with printed electrical contacts lying on a substrate with separate electrical contacts and some kind of thin open separator to keep the substrate membrane separate until the spots on the membrane were depressed. The membrane switches were arranged to match the content of the cards. The cards were placed in the reader and a method of identifying the cards was employed in such a way that the reader recognized which card was in the reading device. Card identification methods ranged from a sensitive optical card to manual data entry. A common method of card or page identification is to select the card or page placed in the reader by pressing a spot located on the card that is unique to the card. Selecting a printed word, letter or graphic on the card was accomplished by forcing down on the selected word, letter or graphic to close the contacts of the Membrane Switch located below the card. The microprocessor could then produce the associated audio through an audible output device (eg, a speaker) in the housing of the book reading device. Many devices have been developed that utilize this basic printed word, letter, or graphic technique in association with stored audio sound files.

In some cases, the Individual cards were used separately or joined together to make small books that were placed on the reading device. For use with a membrane switch device, printed cards or book pages need to be very thin and flexible in order to allow the force of pressure on the card or book page to be transferred to the placed membrane switches. under the book.

In order to overcome this disadvantage, the new reading devices were developed using a stylus, a manual electronic pointing pen that injects an electronic signal into said receiver sensor group placed under the book. This allowed the use of thinner books with thinner pages. However, a disadvantage of pen devices is that the user, usually very young children, must be trained to use the pen, while the finger selection method used by membrane switch designs is more intuitive. for the target audience.

It is considered that a user-friendly device designed to more easily use the electronic reader device, and more particularly, for the precise selection of finger-based content, will significantly increase the value of conventional electronic reading aids and , through fun and play, help in a way that a child or student can enjoy more to develop their reading and writing skills.

BRIEF DESCRIPTION OF THE INVENTION

In one aspect, the present invention is a method of operating an interactive electronic teaching / learning device, configured to receive a printed sheet product having a predetermined orientation on the device and selectable content, wherein the device it comprises a housing including a platform configured to receive the printed sheet product when the printed sheet product is in the predetermined orientation; an electronic user interface in the housing includes a user sensitive position sensor that has an active range on the platform and includes a plurality of individual sensors arranged in a group on the platform; and control electronics in the housing that includes a memory that has in it, instructions associated with the content that can be selected from the printed sheet product and a controller in electrical communication with the electronic user interface, where the controller is configured to carry out at least the operation steps, according to the instructions in the memory, to determine a selected position within the active scale of the position sensor, recognizing a selection of content that can be selected by the selector, and sending a signal associated with the selection to the electronic user interface; a method of operating the device, wherein the determining step comprises the steps of: identifying a plurality of possible sensor positions selected by the user; and selecting only one of the plurality of possible sensor positions selected by the user as the selection.

In another aspect, the present invention is an interactive electronic teaching / learning device, having a platform with a first generally flat user contact surface lying on a first generally flat sensor, wherein the first sensor includes a plurality of at least mutually attached, touch sensitive sensors arranged in a two-dimensional group, where a group is formed separately, and a first and second separate sets of individual lines which are generally parallel transversely crossed with each other, below an upper surface of the platform, characterized in that: a radio frequency oscillation signal generator is cyclically coupled to individual lines of the first set; and a synchronous detection circuit operatively coupled to the generator and to individual lead lines of the second set to identify individual user-activated cross points of the first and second sets of lines in the group.

BRIEF DESCRIPTION OF THE DRAWINGS

The foregoing summary, as well as the following detailed description of the preferred embodiments of the present invention, will be better understood when read in conjunction with the accompanying drawings. For the purpose of illustrating the present invention, the embodiments that are currently preferred are shown in the drawings. It should be understood, however, that the present invention is not limited to the precise configurations and mediations shown.

In the drawings:

Figure 1 is a top perspective view of a preferred embodiment of the present invention showing a teaching / learning device in the closed position;

Figure 2 is a perspective top view of device 15 of Figure 1, partially covered with an open book in a two-page configuration;

Figure 3 is a top plan view of the device of Figures 1 - 2, in the open position without a book;

Figure 4 is a schematic of the electronics of the device position sensor in Figures 1 to 3;

Figure 5 is a schematic of the electronics for the device of Figures 1 to 3;

Figure 6 is a fragmentary view of part of a corner of the device of Figures 1 to 3, illustrating the construction of one of the transverse point sensor groups;

Figure 7 is a top plan view of a schematic of the transverse point group (or grid) for the position sensor of the device in Figures 1 to 3;

Figure 8 is a schematic view of the portion of a part that is covered by a book of a position sensor in the device of Figures 1 to 3;

Figures 9 to 11 are diagrammatic sectional views of a sensor and the signals exiting the sensor for non-human contact, nominally maximum human contact, and nominally minimum human contact, respectively;

Figures 12a to 12b are a flow chart of the touch identification procedure;

Figure 13 is a detailed schematic of a currently preferred oscillator;

Figure 14 is a detailed schematic of a currently preferred column selector circuit;

Figures 15a-15b are detailed diagrams of the suggested connections of the cross-point sensor groups to the other components of the sensor circuitry shown in the other figures;

Figure 16 is a detailed schematic of a currently preferred column selector circuit;

Figure 17 is a detailed schematic of a currently preferred column sensor circuit;

Figures 18a-18b are a detailed schematic of a currently preferred synchronous detector multiplexer and filter circuit; and

Figures 19a-19b are a detailed schematic of a currently preferred sensor controller.

DETAILED DESCRIPTION OF THE INVENTION

An electronic teaching / learning system Includes an Interactive electronic teaching / learning toy device, software and one or more removable printed books or other flat items, such as sheets, cards, individual templates, etc. The software may be stored in one or more auxiliary processing cartridges, which accompany the printed item (s), or in a memory within device 100 or both. When provided together, the cartridge and the Printed item are a matching pair and are used in the device simultaneously. '

Referring to Figures 1 to 3, a currently preferred embodiment of an interactive teaching / learning toy electronic device 100 generally designed in accordance with the present invention is shown. The electronic learning device

100 It is configured to be used without assistance, as well as to receive a book 10 or other printed flat item (s) that can be removed.

Device 100 can be configured, in particular, as an interactive book reader having a sensor that can sense the position of a finger when placed on a book 10 within an area of ​​the active finger sensor of device 100. The active sensor area is preferably coincident with the size of the book (s) or other printed sheet element (s) that could be placed on the device 100. The preferred sensor of device 100 can sense the presence of a finger at a distance of at least 0.635 centimeters from the flat surface of the sensor. This resolution z (height) will allow the sensor to detect the presence of a finger through a book that is up to at least 0.635 cm thick. The sensor, preferably has a resolution x and y, in planes parallel to the plane of the sensor that is fine enough to select each word or other graphic cues or icons that are printed in book 10. Resolution is based on the number of transverse points of the sensor, and how they correspond in position to words and graphics on the surface on the sensor or the print on the book or on another flat item that can be removed, such as a sheet printed or stencil that can be used with device 100.

The software within an auxiliary processing cartridge 146 or within the device 100, itself, contains information to produce the sound effects (including music and speech) or actions associated with graphics and words printed within the book or other item that can be removed printed or with respect to letters, words or other graphics Printed on the upper surface of the sensor. The x and y coordinates of words or graphics and their corresponding sound effects or actions are mapped into memory located in the auxiliary processing cartridge 146 or in the device 100 itself. Selecting any text or graphic by simply touching it will produce at least one audio output associated with the specifically selected text or graphic. This information is preferably organized in a page-by-page architecture. The user of device 100 either interacts with the sensor directly using any of the graphics that may be printed on this surface, or places a book 10 or other printed sheet on the surface of the sensor and inserts the auxiliary processing cartridge 146 (if required) for that book in an auxiliary slot 144 of device 100 interacts through printed object 10 and sensor. Device 100 can then produce a suitable audio output in response to a finger touch on any word or graphic. This open architecture allows an infinite number of books and software to be used on the generic device 100.

Referring to Figures 1 to 3, device 100 has a housing assembly or simply "housing" 110 configured in particular to receive book 10 when the book is in the predetermined orientation with the top, bottom, left, and right next to the top, bottom, left, and right sides of device 100. Housing 110 comprises two generally flat platforms, a base 112 and a cover 114 hinged 180, 182, as well as a book mounting assembly 118, a clamping member 220, and a handle 148. The first platform, the base 112, has a first intermediate base 128 with a first flat intermediate surface 130. The intermediate base 128 is joined by an intermediate edge 132 and a first, second and third intermediate boundary side walls 134, 136, 138. Below the surface 130 is the user-sensitive position sensor in the form of a matrix of conductive lines separated, but cross-sectional, constituting a first group of cross-point sensor 142 like the one discussed above. A cartridge slot 144 can be provided on top of base 112 to receive a cartridge

Removable ROM 146, such as will be intended for use with book 10 or other removable flat printed item (eg, sheet or card or template) used with the device. The second platform, deck 114, has a second, intermediate deck 156 with a second intermediate flat surface 158. The intermediate deck 156 is joined by an intermediate edge 160 and a first, second and third intermediate side walls 162, 164, 166. Beneath the second contact surface of the cover 158 is a second sensor in the form of an array of separate but transverse conductor lines constituting a second cross-point sensor group 170 like the one discussed below. A horn retention device 176 supports a horn 178. Hinges 180 and 182 are hollow and configured to provide a passage (not shown) through each hinge to connect electrical conductors (not shown) with electronics at base 112 with electronics at cover 114.

Referring to Figure 2, a preferred book 10 has a plurality of pages 16 connected by a binding 17. Any contiguous pair of the plurality of pages, such as the first and second pages 16a, 16b can be opened in a two-configuration open pages 20. The configuration of two open pages 20 has opposite side edges 24a, 24b, distal to binding 17. Book 10 is designed to fit closely on device 100 with minimal movement. In particular, the housing 110 has a book magazine 208 formed by the combination of the intermediate base 128 and the intermediate cover 156. Reservoir 208 is configured to closely receive book 10, when book 10 is in the predetermined upright orientation, the top, bottom, left, and right of book 10 proximate the top, bottom, left, and right sides, respectively, of the tank 208 and in particular, to have an adjustment of free space between the tank and the book 10 or the configuration on two separate pages 20.

Referring to Figure 4, the components of the electronics 240 of the device 100 are shown in general terms. The electronics 240 includes a user interface 230 which additionally comprises the position of the sensor 232 and the horn 178, a generator assembly of visible signal 238, which controls, for example, LEDs 150. Other user interfaces may be provided. Other illustrated electronics and circuits of device 100 are the main controller or microcontroller 288, coupled with each of the components of interface 230, as well as memory 290 and a speech synthesizer 292. Memory 290 can contain a non-volatile group of instructions 290a, as well as a non-volatile group of data 290b, including, for example, a map of book magazine 208 to identify the locations of the touch sensor of various icons such as the letters 274, 276 that can be provided on the intermediate surfaces 130, 158 that cover the sensor elements. An external electrical connector 144 is provided for use with a suitably structured cartridge 146. Such a cartridge could contain at least one accessible memory 296. Preferably, for the described system 100, the indicated cartridge 146 includes its own cartridge controller 294 and the cartridge memory 296, which includes both firmware instructions 296a to run on the microcontroller 294, and using the device driver 288 as a slave to driver cartridge 294, as well as data 296b that specifically relates to a book or other printed item, which is used with cartridge 146 and device 100. Also a part of the electronics, although not described in Figure 5, is the power supply (battery and / or AC converter), the On / Off switch 234 and volume control switch 236.

Figure 5 illustrates on a block diagram the shape of the electronics of the position sensor 250 of Figure 4. The electronics of sensor 250 are preferably controlled by a dedicated sensor controller 264, for example, a Sunplus SPL130A microprocessor, which is connected to and controls a column of driver circuit 254, a pair of sensor circuits 256a, 256b, a through selector row circuit 258, a synchronous detector, a multiplexer and filter circuit 260, which processes the signals from the natural sensor and the processed signals pass to an analog-to-digital converter 262 for dlgltallization. Alternatively, the functions of the sensor microcontroller 264 can be performed by the device microcontroller 288. The position sensor 232 in the device 100 further comprises the cross-point matrices or sensor groups 142, 170 and a signal oscillator 252, which energizes the groups 142,170 and controls the detector 260.

The arrangement of the sensors 142,170 in each housing element 112,113 is indicated diagrammatically in Figure 6, which illustrates the components of the position sensor in the base 112. Sensor group 142 is located directly below of a plastic spacer 515 that forms the intermediate surface 130. The space below the sensor or matrix group 142 is an electrically conductive metal plate 510.

Referring to Figure 7, each of the matrices 142, 170 has two sets of generally parallel separate and separate individual conductor lines arranged as a plurality of separate column lines or vertical conductors (also referred to as vertical grid lines) 248 and a plurality of spaced row lines or horizontal conductors or signals ( also referred to as horizontal grid lines) 246 transverse and preferably perpendicular to the plurality of column leader lines 248. Referring to line sets 246, 248, as "rows" or "columns" for convenience, "rows" have an east-west / left-right path, while "columns" are perpendicular (or otherwise transverse) ) for which said “rows” have a north-south / top-bottom trajectory, although the nomenclature could be inverted. Column conductor line set 248 and row conductor line set 246 are separated by an electrically insulating spacer, for example, a Mylar plastic sheet. The row and column conductor lines 246, 248 are Suggestedly Printed in conductive inks at opposite ends of the Mylar sheet to provide electrical insulation between the assemblies and form the matrix 170. Figure 7 shows matrix 142 in accordance with an exemplary embodiment of the present invention. Matrix 170 is suggested as a mirror image although it could be a different configuration or structure. Each matrix 142,170 suggestedly includes sixteen rows 246 and sixteen columns 248 of conductive lines or tracks, however both different line numbers or both may be used. Each point where a line in a row 246 intersects and column 248 creates a unique individual "cross-point" sensor. Accordingly, groups of sixteen by sixteen lines create two hundred and fifty-six individual cross-point sensors arranged in a rectangular group at gap 128,156 of each half of housing 112,114.

Figure 8 schematically illustrates part of a book 10 placed in part of a sensor group 142 of device 100, and as a shadow, the hand of a user who is selecting the word "BALL" with an extended pointing finger. The operation of the interactive book reading device 100 allows a user to select any active area on the book page 10 by touching or simply pointing the selected area of ​​the page from close enough with a finger. Upon selection of this active area, the speaker 178 of the interactive book reading device 100 emits a message that can be heard sensitive to this selection. As an example, when your finger touches the word "BALL", the interactive book reading device 100 may produce a spoken audio broadcast of "BALL from horn 178. The message that can be heard is generated in direct response to the touch of the user of the word “BALL”. The different messages that can be heard could be generated if the user touched other areas of the page, for example, touching the word "blue" could generate a message that can be heard saying "blue". Touching the ball graph on the page may produce a sound of a bouncing ball. Tapping any areas of the book page that have no text or graphics that could generate a generic sound of a single bell sound meaning there is no audio associated with this area, a generic spoken audio broadcast such as "try again" or the entry of the selection could simply be ignored. The interactive book reading device 100 can therefore be used to read the book, create sound effects associated with graphics in the book, or any other activity programmed to be responsive to a touch of a finger. It can easily be seen from Figure 8, that each word and Image can be mapped for one or more pairs of x and y coordinates of any group 142, 170. For example, the word “BALL is located in R5, C4 and R5, C5 of the groups. This location map is stored in memory along with the associated audible message, which is played when any location of the cross-point sensor is selected.

Figures 9 to 11 show examples of the three cross sections of device 100 without and with book 10. The cross section drawings shown in Figures 9 to 11, device 100 without book or printed item that can be removed or the presence of the user, and a finger 505 with pages 16 of a book 10 (in different thicknesses). Each of Figures 9 to 11 further illustrates a plastic spacer 515, a plurality of the separate (vertical) column tracks 248, the non-conductive sheet (eg Mylar) 525 and one of the separate (horizontal) row tracks 246 transverse to the plurality of tracks in column 248.

The non-conductive sheet 525 supports and separates the column tracks 248 from the row tracks 246 and forms with them the groups of tracks 142, 170. The sensor preferably includes a conductive plane 510 in the form of a connected metal plate. to a ground system and parallel to and separated from the groups 142,170.

The plastic spacer 515, which forms the top surface

130, 158 of any intermediate 128, 156, is approximately 0.2032 cm thick and is placed on top of any group 142, 170 to act as an insulator, such that the contact surface of the sensor is separated from the matrix 142, 170 using at least this amount. Spacer 515 can be a styrene or ABS with a dielectric constant of between about 2 and 3 although the thickness and dielectric constant can be adjusted to achieve the desired sensitivity. The function of the spacer 515 is to provide a stable response of the matrix 142, 170. By removing spacer 515, the group cross-point sensors could be made to be much more sensitive, with pages 16 being highly sensitive, the output of groups 142, 170 could be dramatically changed. The effect of adding pages is relatively significant (e.g. 15-20 millivolt) with spacer 515 in place, although it could be more than an order of magnitude larger without the spacer. By separating pages 16 of book 10 from die 142, 170 by the thickness of plastic spacer 515, the effect on die 140, 162 is greatly reduced. As previously stated, the width and thickness of column tracks 248 (vertical columns) and row tracks 246 (horizontal rows) should be kept to a minimum at cross points to reduce the capacitive effect at each of the cross points of the transverse points, although they are preferably increased between the transverse points and around the transverse points, for example, by widening the individual row and column tracks into four-point stars or diagonal squares or the like, around and between the locations of the cross-point.

Conductive plane 510 is suggested spacing with approximately one-quarter inch (5 mm) below dies 142,

170. The conductive plane provides a covering for matrices 142, 170 and as a result, affects the perceived area around each cross point in matrices 142, 170. The spacing of the plane 510 perpendicular to the plane groups 142, 170 can be adjusted to fit the size of the sensitive or perception area (i.e., selected by the user) around each transverse point, such that the perception areas that adjoin the transverse points, do not overlap.

Referring to Figure 7, the individual tracks 246, 248 are extended toward the side and bottom edges of the sheet 525 supporting the tracks. Preferably, the shorter tracks 530 and 535 are extended from the side and bottom edges, respectively, of the sheet 525, a shorter track 530 or 535, on either side of each track of the sensor 246 or 248, respectively. The shorter tracks 530 and 535 are all connected to the ground system through or with the conductor plane 510. Horizontal tracks 530 extend inward from the vertical edge to just below, where row tracks 246 widen. to form the terminals and, with a uniform length, provide some impedance control. Vertical tracks 535 extend from the bottom edge to a point where vertical tracks 248 begin to move in parallel, just below where those tracks glow and within approximately one-half inch (12 mm) of the lower cross points. Tracks 535 prevent cross coupling between column tracks 248 when the columns are triggered by the oscillator

252.

Generally speaking, the signal values ​​generated by matrices 142, 170 are read and stored without human interaction with the groups to obtain a reference value for each cross point. The reference value of each cross point sensor is individually determined and updated. Preferably, each is an average "offset of successful scan values ​​(eg, approximately sixteen) for the cross point. Successful scans are compared with reference values ​​to determine the proximity of a human finger or other limb. In accordance with a preferred embodiment of the present invention, data is accumulated starting at zero when device 100 is turned on. A side effect of this is that if the user has their finger on the matrices 142, 170, when this procedure occurs, the reference values ​​for the touched points are lower than they should be without the touch.

The operation of sensor 232 is as follows. Although not required, sensor 232 is preferably read by reading the individual touch sensors in a row at the time of alternating groups 142, 170 for each row 256. The firmware associated with the microcontroller 264 directs the column driver circuit 254 to pass the RF drive signal, for example, a 3300 millivolt square, 250 kHz wave signal from oscillator 252 to column tracks 248 of the two groups 142, 170, preferably in sequence, leading the same column positioned in each group 142, 170 together. The firmware also directs the selected column circuit 258 to generate the appropriate control signals sent to the sensor circuits (column) 256a, 256b to alternatively connect the same row track placed 246 in each group 142, 170 to the synchronous detector. , multiplexer and filter circuit 260 as column tracks 248 are sequentially routed through each group 142, 170. Controller 264 additionally controls data transfer from circuit 260, which generates a DC level analog voltage signal, through an A / D converter 262. Corresponding rows 246 are sampled in each group 142,170 before that the successive row is sampled, all with the same leading column in each group. Accordingly, the firmware cycles for the fastest 142, 170 groups, fastest 246 second rows, and slowest 248 columns. Preferably, but not necessarily, rows 246 are scanned from bottom to top, while columns are led from the innermost to the outermost part (from right to left for 170, from left to right to 142).

After the initial values ​​for groups 142, 170 are stored, groups 142, 170 are scanned cyclically and continuously, and the results for each cross-point sensor are compared to the stored reference values, which are, by themselves, updated cyclically and continuously. If any individual cross-point sensor value has a difference from its reference value that is greater than a predetermined or threshold amount (“threshold”), controller 264 will mark the point as “touched” or “selected” . A fixed threshold is established for device 100 characterizing device 100 during manufacturing. For the described circuitry, materials and structure, it has been found that with a 250 square kHz, 3300 millivolt wave signal, the individual cross-point sensors of groups 142, 170, the output signals of approximately 2200 millivolts ± 400 millivolts without User Interaction.

Signal deviation (i.e., a drop in detected signal strength) at each location of the cross-point sensor for user contact is within range between those of, a direct form of a large adult touching the intermediate cover surface up to a young child touching the top of a closed book 10 on top of said surface, it is within the range of approximately 1600 millivolts in the first case to only approximately 200,000 millivolts in the second case. The threshold should be adjusted as close as possible to the smallest expected user-generated offset.

In this device 100 being described, the threshold is suggested setting for less than 200 millivolts, preferably approximately 190-200 millivolts, for each cross-point sensor. If the measured voltage value for the cross point being perceived is less than the reference value in memory by an amount equal to or greater than the threshold amount, the point is considered as touched and is "marked" as such. by sensor controller 264. If the difference is less than the threshold, the reference value is updated every 64 millisecond period (full scan time), resulting in an installation of the reference values ​​after approximately one second. After the matrices 142, 170 are scanned, the cross points that have been "marked" as touched by two scan cycles are considered valid and selected for further processing by a "best candidate" algorithm as will be described later.

For the described device 100, every 250 microseconds, two (2) cross points (identically located cross points associated with each group 142, 170) are preferably scanned and the associated data is recorded with a clock within the sensor controller 264 For each sensor scan, each cross-point data value is preferably initially compared to a "high limit" value. If the data value exceeds this high limit value, this is 10 ignored as a candidate for that scan and ignored to update the reference value for that sensor. The purpose of the high limit value is to prevent highly abnormal data values ​​from causing a cross-point sensor to appear permanently depressed. To understand the above mechanism, an understanding of the concepts described below is required. Consequently, the function of the high limit will be described later in this section.

As noted, for each scan group, each time the data value associated with a cross-point sensor is read, it is compared to the reference value, which may be considered and referred to in the present description as an "average displacement ”associated with that cross-point sensor (see below). If the data value is less than the displacement average minus the threshold, the cross-point sensor is considered "touched" for that scan. The threshold is the aforementioned fixed data value (i.e., 190 to 200 millivolts), which represents the minimum deviation, which is expected to indicate that a cross-point sensor is considered to be touched.

If the data value does not indicate that the cross-point sensor is considered to be touched (that is, data value &lt;[displacement average - threshold]), then the data value is used to update the displacement average. From the increase in power of the system, the displacement average for each point is adjusted to zero. Whenever the data value for a cross point sensor is not greater than the high limit, and is not low enough to indicate that the cross point sensor is touched, the data value is used to update the displacement average by that point. The formula used to calculate the new displacement average is as follows:

New displacement average = displacement average + (data value - displacement average) / 16. Therefore, the preferred "displacement average" is not really an average, but a convergence algorithm.

With the above knowledge, the function of the high limit algorithm can now be explained. The reference value / average displacement algorithm can be altered by situations where there are high levels of interference and the cross-point sensor readings rise significantly. Without the high limit cutoff, abnormally high data values ​​(due to a continuous noise source) could eventually result in an abnormally high displacement average for a given cross-point sensor. So when the scanned data values ​​return to their nominal value range, if the scanned data values ​​are low enough, such that the data values ​​are greater than the abnormally high displacement average minus the threshold , the cross point sensor will be considered as touched. This will result in recently scanned data values, which have never been used in the calculation of the displacement average, and therefore will not allow the displacement value to be decreased to its normal level, causing the cross-point sensor to appear touched permanently for the duration of use of device 100. Consequently, the single sensor data, which is used or stored, is that data, which is less than the high limit. For device 100, as described above, a high limit value of 3,100 millivolts (approximately fifty percent greater than the nominal voltage) is suggested.

In the preferred embodiment, device 100 further includes a "fast recovery" algorithm. This compares the last reading from a cross point to the reference value or displacement average. If the last reading, if it is greater than the rapid recovery threshold, the reference value will be set equal to the last reading. This algorithm accounts for a situation where the user is "hovering" a finger on a point for an extended period of time, which artificially forces the reference value. A quick release and touch of the same point in this situation, may cause the system to not correspond, due to the difference between the reference value and the last reading is not greater than the touch threshold value (threshold). Figures 12a - 12b summarize the steps followed in the identification of the “touched” sensors and during the updating of the reference values ​​/ displacement averages.

The previous section described in detail how each of the 512 (170 X 16X2) cross-point sensor groups 142, 170 are determined to be activated (ie, "touched" or "selected") or not. Scanning the entire group of cross points on one occasion takes approximately 64 milliseconds (16 X 16 X 250 microseconds). During each scan, each cross-point sensor is considered to be activated / touched or not.

After each scan, the points touched are processed to identify a "best candidate". Generally speaking, the best candidate is the cross-point sensor selected by the sensor microprocessor as being the point most likely to have been selected by the user during sensor touch. Generally speaking, this is the touched point, which is the highest (furthest to the north / top) or the highest and furthest to the left (i.e. the one furthest to the northwest / top right) if two potential candidates of equal height are activated in a given sensor group

142, 170. For convenience, these will be collectively referred to simply as the "most northwest" point. Also, the transverse 5-point sensor should preferably be "touched" during two consecutive 64-millisecond scans to be considered as the new northwestmost point of the sensor. The procedure is also illustrated in Figures 12a-12b.

Sensor controller 264 first identifies a set of touched sensors. Next, identify those, which have been touched for at least two consecutive 64-millisecond cycles. These are the newest northwest-facing candidate sensors. Preferably, the left side group 140 is processed for the new, most northwesterly, new candidates before the left side group 172 is processed and the left side group takes precedence over the right side group on each scan. This means that if a new northwest most candidate point / identified sensor in the Left side group is less than a new highest northwestern candidate point / identified sensor in the right group, the candidate in the left group will still be selected as the new northwest / sensor point to process the best candidate. Once the best candidate has been chosen, their identification / location is communicated from the sensor controller 264 to the base unit microcontroller 288.

The priority of the left side group over the right side group, described above, only takes effect when one cross-point sensor in each group is first touched within a single 64 millisecond scan. However, it can be extended to two "preference treatment" scans (128 milliseconds) for the Left side group if desired. Both scenarios are described in the following examples:

If a relatively Lower cross point sensor in the right side group 142 and a relatively higher cross point sensor in the right side group 170 are touched during the same 64 millisecond scan, the cross point sensor over the group of the left side sensor 142 is chosen as the potential most northwestward point, if the same cross section point of the left side sensor group is still being touched during the next scan.

If a relatively higher cross-point sensor in the right sensor group 170 is touched and chosen as the new northwestmost candidate during a 64-millisecond scan cycle and if a relatively lower cross-point sensor in the group of the left side 142 is touched during the next 64 millisecond scan cycle and is the new northwest most point candidate for that group, then the new northwest most point sensor (the lowest cross point sensor) in the left side group 142 is chosen as the new northwest most point candidate, if that left group point is still touched during the next scan and is processed accordingly.

Once a new point to the northwest (transverse 5-point sensor) has been chosen, preferably the algorithm of "stop to the south" has effect for that group 142 or 170. The south stop algorithm causes any point in the same group touched on subsequent scans below the new northwest most point to be ignored until the previous expiration of one second, although the new northwest most point remains selected, or the most to the new northwest it is released. After arrest, all cross-sectional points in the group become candidates for the new point further north-west. This algorithm covers the situation where the user rests the wrist of the pointing hand on the group after the finger touches the group.

The south stop, when used, preferably only has effect for a group 142,170 over which the new / sensor northwesterly most point resides. That is, the following scenario may occur. The new northwest / sensor point is selected from the right group. The rest of the cross-point sensors in that particular group, which are south of the new northwest most point / sensor are "stopped" for one second or until the new northwest most point / sensor is released. During that one-second period, a cross-point sensor in the left group, which is the candidate for the most north-west sensor touched in that group, can be selected as the new most north-western point of the two groups. , if it is touched during two consecutive scans. This is a result for arbitrarily giving the left sensor group 142, priority between the two groups 142,170.

Preferably, a "peak search" algorithm is employed after the new northwestmost point of the sensor (two groups 142, 170) is identified. The deviation of the transverse point sensors immediately east (right), south (below), and southeast (bottom right) of the point sensor further to the new northwest is examined for touch and the relative deviations of any touched sensor from all four compared to each other. That sensor from that group of four sensors that have the largest deviation (that is, they change the reference value / displacement average) is selected as the “best candidate and its identity / location / position is transferred to the main microcontroller (base unit ) 288.

Each time a best candidate is selected, their position is transferred by the sensor control circuit to the main control circuit (base unit) 288. Because it only takes two 64-millilone second scans to determine a best candidate and it is possible to find a Best potential new candidate in each group consecutively, it is possible that a new best candidate may be sent to the main controller 288 in consecutive scans. The main controller 288 could then decide how to use this Information (interrupted current activity or not, use a neighboring cross-point sensor instead of the best candidate, etc.).

Device 100 will also search to see if there are 5 other hands placed on book 10 because the user inadvertently placed more than one hand on the book. In the event that the book reader sensor observes two hands placed on the sensor, it will search to see if any data entry is a clearly defined point further north. IF so, this data entry will be selected as the best candidate. Rather than having generated an audio output to guide the user to use "one finger at a time" or any other statement when device 10 cannot reasonably determine probable data input, the present invention can select a "best candidate ”based on the algorithm mentioned above.

Figure 13 is a schematic of a preferred signal oscillator circuit 252. Signal oscillator circuit 252 generates and supplies a square wave signal having a frequency of approximately 250 kHz at 3.3 V for the conductor circuit of column 254. The The same signal is passed via line 253 to the synchronous detector, multiplexer, and filter circuit 260 for synchronous detection of the group coupled oscillating signal.

Figure 14 is a schematic of a currently preferred column conductor circuit 254. Column conductor circuit 254 sequentially excites the column lines of matrices 142, 170, a pair of corresponding lines at once under the control of the circuit 264. Preferably, four multiplexers 254a-254d are used to drive the thirty-two column tracks 248 in two groups 142,170.

Figures 15a-15b are a schematic diagram of the currently preferred connections of the two cross-point sensor groups 142 with the circuit elements sensing the conductive column and row. Group 170 is, in a suggested way, a mirror image.

Figure 16 schematically shows a currently preferred construction of row selection circuit 258, which is also primarily formed by four multiplexers 258a-158d.

Figure 17 illustrates a currently preferred construction of one of two preferably Identical sensor circuits, sensor circuit "B" (256b of Figure 5), which detects signals from row tracks 246 of right sensor group 142 shown in Figures 15a and 15b and sends the detected signal output ("PANEL_R") to the multiplexer and filter circuit, synchronous detector 260 under the control of row selection circuit 258. These sensor circuits 256a, 256b inflict a high impedance load on the coupled row tracks 246 through the use of the individual transistor / Q1-Q16 amps in the illustrated circuit 256B. The outputs (SENSE_R1 through SENSE_R16) are held up normally by row selector circuit 258 and are discarded for individual transistors Q1-Q16 by that circuit when row 246 is being "sensed".

Figures 18a-18b are a schematic of a currently preferred construction of the multiplexer and filter circuit, synchronous detector 206, showing the group outputs 142, 170 (PANEL_L, PANELR), the analog output (ANALOG POINT) of circuit 260 and the timer input (CONTROL_8) from sensor controller 264. Circuit element "U10" is a multi-switch microprocessor that couples the output of left sensor group 140 with a synchronous detector / differential amplifier 260a consisting of capacitors C24 and C25 and amplifiers U11A and U11B with a related circuitry . The output of that detector / amplifier pair is passed to a filter 260b formed by the amplifier U12A and the related circuit system and returned to the Z0 pin to be multiplexed by the U10 microprocessor for the converter

A / D 262. The parallel circuit connected to pins YO, Y1 and Z1, operates on the signals of the other group 172. Circuit 260 operates on the 250 kHz scale of the output signal of oscillator circuit 252 on line 253.

Figures 19a-19b show a currently preferred construction of the sensor controller or control circuit 264. Control circuit 264 preferably includes a general-purpose microprocessor, such as Sunplus ™ Part No. SPLI30A, or the like. The A / D converter can be an external MicroChip MCP 3001 A / D converter.

The power supply (not shown) of device 100 provides power to sensor circuit 232.

Those skilled in the art will appreciate that changes can be made to the modalities described above without departing from the broad inventive concept thereof. It should be appreciated that the present invention can be used directly, for example, without a book or card or sheet, but with the indicia formed or printed on an upper surface on the circuit with the software sensitive to the designation of different locations on the surface. touching or almost touching the location on the surface. In this regard, the present invention could be used in place of conventional touch-sensitive displays in other book reading devices, as well as in other educational or entertainment devices. It should be understood, therefore, that the present invention is not limited to the particular embodiments described, although they are intended to encompass modifications within the spirit and scope of the present invention as defined by the appended Claims.