An optical reader having a color imager

The present invention generally relates to an optical reader, and more particularly to an optical reader using a color image pickup device.

Optical marking readers provided for reading one-dimensional or two-dimensional barcode symbols are technically known. Many optical character recognition systems are also on the market. In addition, many financial institutions use computer-based signature capture systems today. Many of these systems use monochrome imaging devices because monochrome imaging devices are very suitable for reading graphical symbols such as barcodes, OCR symbols, or signatures.

On the other hand, it is very attractive to be able to provide an image capture function as well as a mark reading in one device. At present, the optical reader having an image capture function uses a monochrome image pickup device that provides a grayscale image. While such devices are useful, grayscale images are less desirable than color images for visual purposes. The world has come to expect color imaging. Further, monochrome images are often less clear and less informative than color images.

Unfortunately, there are problems associated with reading graphical symbols using color imaging systems. The first problem concerns the difficulty of distinguishing binary markings in color images. Color imaging data is often confusing to graphical symbol marking readers because color imaging devices provide more information than can be used by binary marking readers. One way to solve this problem is to convert the color imaging data to grayscale data. However, commercially available methods for converting color images to grayscale are too slow for mass scanning. Therefore, an optical reader using a color imager equipped with a grayscale converter will be slower and more expensive than an optical reader using a monochrome imager because of the additional processing required.

Therefore, there is a need for an inexpensive optical reader capable of taking color photographs and determining graphical symbols. This optical reader can automatically determine whether the image contains graphical symbols or only color photographic images, and must process the color imaging data acquired based on that determination. There is also a need for an optical reader capable of associating the acquired color image with any subsequently acquired color image.

<p> The present invention addresses the above needs. The present invention relates to low cost optical readers configured to take color photographs or determine graphical symbols. The optical reader of the present invention automatically or manually determines whether the captured image is a color photographic image or a color image containing graphical symbols. Subsequently, the optical reader of the present invention processes the acquired imaging data according to the determination. The optical reader of the present invention operates to capture a plurality of images and associate the captured images with each other.</p><p> One aspect of the present invention is an optical reader. The optical reader comprises a color imaging assembly that acquires an image of an object and generates imaging data corresponding to the image. An image analysis circuit is connected to the color imaging assembly. The image analysis circuit is configured to determine whether or not the color imaging data contains at least one graphical symbol. The image is categorized as a graphical symbol, or if the color imaging data does not contain at least one graphical symbol, the image is categorized as a color photograph. The processing circuit is connected to the image analysis circuit. The processing circuit operates to process the imaged data based on the determination.</p><p> On the other side, the invention comprises an optical reader that captures an image of an object. The optical reader comprises a color imaging assembly that transforms the image of the object into color digital data corresponding to the image.</p><p> An automatic mode selection circuit is connected to the color imaging assembly. The mode selection circuit uses at least a portion of the color digital data to select one of a plurality of operating modes of the optical reader. The operating mode includes at least one graphical symbol mode and a color photographic mode. The processing circuit is connected to the mode selection circuit. The processing circuit is configured to process the color digital data based on the selected operating mode.</p><p> On the other side, the invention comprises an optical reader that captures an image of an object. The optical reader comprises a color imaging assembly that captures the image as color imaging data. Since the categorization circuit is connected to the color imaging assembly and the categorization circuit is configured to process at least a portion of the color imaging data to select one of a plurality of categorizations, the image is in color. It is categorized as a photographic image or as an image containing at least one graphical symbol. The automatic mode selector is connected to the classification circuit, and the automatic mode selector is configured to select the optical reader mode according to the selected classification. The processor is connected to the categorization circuit and is programmed to process the color imaging data according to the optical reader mode selected by the automatic mode selector.</p><p> On the other side, the invention comprises an optical reader that captures an image of an object. The optical reader comprises a color imaging assembly that captures the image as color imaging data. A user mode selector is connected to the color imaging assembly and can be switched between at least one automatic user mode or a manual user mode for manually selecting one of the plurality of imaging modes of the optical reader. As such, the plurality of imaging modes include at least one graphical symbol mode and color photography mode. The automatic imaging mode selector is connected to the user mode selector and the color imaging assembly, and operates to automatically select one of the plurality of imaging modes when in the automatic user mode. A processing circuit is connected to the user mode selector and the automatic mode selector, and is programmed to process the color imaging data based on the selected one of the plurality of operating modes.</p><p> On the other side, the present invention has a method of acquiring an image of an object with an optical reader. The method includes a step of acquiring first color imaging data representing the image and analyzing the color imaging data to provide an image classification so that the image is categorized as a color photograph or at least one graphical. It has a step of being classified as including a symbol and a step of processing the color imaging data according to the image classification.</p><p> In another aspect, the present invention provides an image classification by analyzing the color imaging data and providing an image classification with a step of acquiring color imaging data, so that the image is classified as a color photograph or the image is at least one. A computer-readable medium having computer-executable instructions for performing a method having a step categorized as including a graphical symbol and a step of processing the color imaging data according to the image categorization.</p><p> In another aspect, the present invention comprises a color imaging assembly for acquiring color imaging data and an optical reader having a graphical user interface including a display and a selection device. In the optical reader, a method of selecting at least one optical reader operating mode includes a step of displaying at least one icon corresponding to the at least one optical reading device operating mode on the graphical user interface. Based on the step of selecting the at least one optical reader operating mode corresponding to the selected at least one icon by clicking the at least one icon on the selection device and the at least one selected icon. By processing the color imaging data, the color imaging data is processed as a color photographic image or an image including at least one graphical icon.</p><p> On the other side, the present invention comprises a color imaging assembly for acquiring color imaging data and an optical reader having a graphical user interface including a display and a selection device. In the optical reader, a method of providing and selecting a menu on the display searches for a set of menu items for the menu, each of which represents at least one mode of operation of the optical reader. Steps, a step of displaying the set of menu items on the display, a step of selecting a menu item, a step of issuing a menu selection signal indicating the selected operation mode, and the selected menu item. Based on this, by processing the captured data, the captured data is processed as a color photographic image or an image containing at least one graphical symbol.</p><p> On the other side, the present invention has a method of acquiring an image of an object with an optical reader. The method follows the steps of providing a color imaging assembly, converting the image into color imaging data, classifying the image as a color photograph or a color image containing at least one graphical symbol, and the classification steps. It has a step of processing the color imaging data.</p><p> On the other side, the present invention has a method of acquiring an image of an object with an optical reader. The optical reader has a plurality of imaging modes including at least one graphical symbol mode and a color photographic mode. The method includes a step of capturing the image by acquiring color imaging data and analyzing at least a part of the color imaging data to provide an image classification, wherein the image classification is at least one graphical symbol classification and color. A step including photo categorization, a step of automatically selecting one of a plurality of image processing modes based on the image categorization provided in the analysis step, and said selection of the plurality of image processing modes. It has a step of processing the color imaging data based on one.</p><p> On the other side, the present invention has a method of acquiring an image of an object with an optical reader. The optical reader has at least one graphical symbol mode and a plurality of imaging modes including a color photographic mode. The method includes a step of capturing the image by acquiring color imaging data, a step of automatically selecting one of the plurality of imaging modes based on the analysis of the color imaging data, and the plurality of steps. It has a step of processing the color imaging data according to a selected one of the imaging modes of.</p><p> On the other side, the present invention has a system for processing at least one image. The system has at least one network element. The system includes an optical reader with a color imager and a processor. The color imaging device is configured to capture the at least one image by generating color imaging data corresponding to the at least one image. The processor is configured to provide an classification of the color imaging data based on whether the color imaging data contains at least one graphical symbol. The processor is programmed to process the color imaging data according to the classification. Since the network is connected to the color optical reader and the at least one network element, the processed image data is transmitted between the network and the at least one network element.</p><p> Further features and advantages of the present invention are set forth in the detailed description that follows, some of which are readily apparent to those skilled in the art, or that follow the detailed description, claims, and attachments. It will be understood by practicing the invention as described herein, including the drawings.</p><p> It is understood that both the above summary description and the following detailed description are merely examples of the present invention and are intended to provide a summary or framework for understanding the essence and features of the claimed invention. Should be. The accompanying drawings are provided for a better understanding of the present invention and are incorporated into a portion of the specification to constitute a portion of the specification. The drawings show various examples of the present invention, and serve to explain the principles and operations of the present invention together with explanations.</p>

Hereinafter, the present embodiment as an example of the present invention will be described in detail, examples of which are shown in the accompanying drawings. Wherever possible, the same reference numbers are used throughout the drawing to point to the same or similar parts. An exemplary embodiment of the optical reader of the present invention is shown in FIG. 1 and is typically indicated by reference numeral 10 throughout.

According to the present invention, the present invention for an optical reader comprises a color imaging assembly that acquires color imaging data. The image analysis circuit determines whether the acquired image contains at least one graphical symbol. The processing circuit processes the imaging data based on the determination of whether the image contains at least one graphical symbol. The present invention allows a user to use a color imager to read graphical symbols such as barcodes, texts, OCR characters and signatures. The color optical reader of the present invention is configured to automatically determine whether a color image contains graphical symbols or is only a color photographic image. The optical reader of the present invention also operates to associate one acquired image with at least one subsequent acquired image.

A perspective view of an optical reader according to various embodiments of the present invention is disclosed as performed herein and shown in FIGS. 1A-1D. FIG. 1A shows the lower surface of the handheld wireless optical reader 10. FIG. 1B shows the top surface of the optical reader shown in FIG. 1A. The optical reader 10 has a housing 100, an antenna 102, a window 104, and a trigger 12. The window 104 houses the irradiation assembly 20 and the imaging assembly 30. As shown in FIG. 1B, the top surface of the reader 10 comprises a function key 14, an alphanumeric keypad 16 and a display 60. In one embodiment, the function key 14 has an enter key and an up / down cursor key. FIG. 1C is also a handheld wireless optical reader 10. The reading device 10 includes a function key 14, an alphanumeric keypad 16, a writing stylus 18, a display 60, and a signature block 62. The stylus 18 is used by the user to write a signature on signature block 62. FIG. 1D shows yet another embodiment of the optical reader 10 of the present invention. In this embodiment, the reader 10 has a gun-shaped housing 100. The display 60 and the keypad 16 are arranged on the upper surface portion of the gun-shaped housing 100, and the trigger 12 is arranged on the lower surface portion of the upper surface portion of the housing 100. The housing 100 also comprises a window 104 that houses the irradiation assembly 20 and the imaging assembly 30. The wire 106 is arranged at the tip of the handle of the housing 100. The wire 106 provides the optical reader 10 with a hard-wired communication link for an external device such as a host processor or other data acquisition device.

A block diagram of the electro-optical assembly of the optical reader 10 of the present invention is disclosed as performed herein and shown in FIG. The optical reader 10 includes an irradiation assembly 20 and a color imaging assembly 30 connected to a processor 40. The irradiation assembly 20 has an irradiation optical component 22 connected to a light source 24. The light source 24 is connected to an ASIC / FPGA 44. The ASIC / FPGA 44 is programmed to drive the light source 24. The imaging assembly 30 includes an imaging optical component 32 and a color imaging device 34. The imaging optical component 32 converges the irradiation light reflected by the target T on the color imaging device 34. The color imaging device 34 provides color imaging data to the ASIC / FPGA 44. The color imager 34 performs several functions. The color image pickup apparatus 34 uses the image pickup array color filter to generate an analog color image signal. The array color filter pattern is a Bayer pattern. Analog color imaging data is converted to digital format using an internal analog / digital converter that also functions as a quantizer. An 8-bit system provides 256 luminance levels and a 12-bit converter provides over 4,000 luminance levels. The digital color imaging data is transmitted from the imaging device 34 to the ASIC / FPGA 44 and the processor 42.

The optical reader 10 also has a processor 40. In the embodiment shown in FIG. 2, processor 40 comprises microprocessor 42 and ASIC44. The system bus 52 connects the microprocessor 40, RAM46, EROM48, I / O circuit 50, and display 60.

The irradiation optics 22 may be of any suitable type, but an example shows a lens system that directs light from the light source 24 towards the subject T. It will be apparent to those skilled in the art in the art that modifications and modifications can be made to the irradiation optics 22 of the present invention depending on the complexity of the target irradiation. For example, the irradiation optics 22 can include one or more lenses, diffusers, wedges, reflectors or a combination of these elements. In one embodiment, the irradiation optics 22 creates an aiming pattern on the target T.

The light source 24 may be of any suitable type, but a plurality of white light emitting diodes are shown as an example. It will be apparent to those skilled in the art in the art that modifications and modifications can be made to the light source 24 of the present invention depending on the application. For example, the irradiation assembly 20 may be removed altogether if it is certain that the ambient light level is high enough to obtain a high quality color image. In other embodiments, a red light emitting diode is used in place of the white light emitting diode.

The color imager 34 may be of any suitable type, but a CMOS color imager having a resolution of 640 x 480 pixels is shown as an example. It will be apparent to those skilled in the art in the art that modifications and modifications can be made to the color imager 34 of the present invention, depending on the cost and resolution required by the optical reader 10. In another embodiment, the color imager 34 has 800 x 600 pixels. A typical VGA resolution of 640 x 480 pixels is suitable for displaying color images on a liquid crystal display or computer monitor. In one megapixel embodiment, the color imager 34 has 1156 x 864 pixels (approximately one million pixels). In yet another embodiment, the color imager 34 has 1536 x 1024 pixels. Those skilled in the art will appreciate that the higher the resolution of the imager 34, the higher the cost. In another embodiment, the color imager 34 is achieved by scanning a linear CCD array. In another embodiment, the color imager 34 is implemented using an area CCD solid state image sensor.

Processor 40 may be of any suitable type, but as an example a processor with microprocessor 42 and ASIC 44 connected to system bus 52 is shown. In one embodiment, the microprocessor 42 and ASIC are programmable controls that receive, process, and output data according to an embedded program stored in the EROM 48. As mentioned above, microprocessor 42 and ASIC44 are connected to system bus 52 and include addresses, data and control lines.

In the embodiment shown in FIG. 2, the microprocessor 42 is a standard VLSI integrated circuit (IC) microprocessor. The microprocessor 42 is assigned to control the entire electro-optic component shown in FIG. The processor 42 controls menu operations, commands and data received from the I / O circuit 50, data written to the display 60, and operating system functions. The I / O circuit 50 controls the information received from the keypad 14 and the keypad 16. The microprocessor 42 also serves to process and decode the imaging data stored in the RAM 46 according to the programming instructions stored in the EROM 48. Therefore, the microprocessor 42 performs barcode decoding, optical character recognition, signature verification, and color image processing.

In the embodiment shown in FIG. 2, the ASIC44 is implemented using a programmable logic array (PLA) device. In a similar embodiment, ASIC44 is implemented using a field programmable gate array (FPGA) device. The ASIC44 plays a role of controlling the image acquisition process and the storage of image data. As part of the image acquisition process, the ASIC 44 performs various timing adjustments and performs control functions including control of the light source 24, control of the color image pickup device 34, and control of the external interface 56. It will be apparent to those skilled in the art that modifications and changes can be made to the processor 40 of the present invention depending on the cost, availability and performance of the standard microprocessor and the type of color imaging device used. In one embodiment, microprocessor 42 and ASIC44 are replaced by single microprocessor 40. In one embodiment, the microprocessor 40 is implemented using a single RISC processor. In yet another embodiment, the microprocessor 40 is implemented using RISC and DSP hybrid processors.

It will be apparent to those skilled in the art in the art that modifications and changes may be made to the memory configurations of the present invention in consideration of cost and adaptability. For example, in one embodiment EROM48 is implemented using EPROM or E2PROM. In yet another embodiment, flash memory is used. The RAM 46 typically comprises at least one volatile memory element, and some embodiments have one or more long-term non-volatile memory elements.

It will be apparent to those skilled in the art of related art that the I / O apparatus 50 of the present invention may be modified or modified depending on the application and working environment. Examples of the I / O device 50 include an RS-232 interface, a LAN interface, a PAN interface, a serial bus such as USB, an Internet interface, and a wireless interface.

The external interface 56 is used to transmit discrete signals to control peripheral devices. Peripherals are usually external illuminators. An external illuminator is used in place of the light source 24.

It will be apparent to those skilled in the art in the art that modifications and changes may be made to the operating system used in the optical reader 10 depending on the application and the desired operating environment. In one embodiment, the Windows CE® operating system is used. In other embodiments, the LINUX® or Palm0S® operating system is used. As a non-limiting example, application programs can be written using C, C ++, Visual Basic® or Visual C ++®. Other languages can be used, depending on the application program. In another embodiment, the optical reader 10 does not use an operating system. For example, the simple reader shown in Figure 1D does not require a complex operating system.

An example of a graphical user interface according to the invention is disclosed as performed herein and shown in FIG. The display 60 provides a plurality of application program icons displayed in a graphical user interface (GUI) 650. Select by the user with arrow 652. For example, the GUI 650 allows the user to select an automatic image capture mode by clicking the automatic mode icon 654. The GUI 650 also has a semi-automatic image capture icon 656, a barcode scanning icon 658, an OCR / text capture icon 660, a signature capture mode icon 662, a color photo mode icon 664, an association mode icon 668, and an additional application program icon 666. The application program icon 666 will allow the user to collect other biometric information such as fingerprints and voiceprints. In a Windows CE® environment, the start button icon 670 and toolbar will also appear on the GUI 650. The GUI650 also displays the current application program data 672.

In the automatic imaging mode, the processor 40 is programmed to analyze the color imaging data to determine if the acquired image contains graphical symbols or is only a color photographic image. If the processor determines that the color image contains a graphical symbol, the processor further analyzes the acquired image and categorizes it as a barcode, OCR symbol, text or signature. Based on that classification, the optical reader 10 jumps to the appropriate routine in the EROM 48. The same applies to the semi-automatic mode. Therefore, in automatic or semi-automatic mode, the barcode scanning mode, OCR / text mode, signature capture mode, color photo mode and association mode are controlled by the application program, not by the user.

However, the user can manually select any of the modes listed above. When the user clicks the barcode scanning icon 658, the barcode scanning application program will be activated. In this application program, the user can select between 1D barcode mode, 2D barcode mode and automatic identification mode. In addition, the user can manually select and deselect the barcode type, and the optical reader 10 can read the barcode or not.

The user can also click the OCR / text icon 660. Clicking icon 660 provides the user with check collation mode, text scanning mode, or binary image capture mode. Check collation mode runs with network services.

Clicking icon 662 provides the user with a signature capture mode. In one embodiment, this mode includes a signature collation program, allowing the user to choose between static collation or dynamic collation. In static mode, the user captures an image of the signature. The captured image is compared with the collation image stored in the remote database. In dynamic mode, the optical reader 10 uses a stylus and signature block to capture the signature. In this mode, the signature block 62 measures specific dynamic parameters such as pressure applied, direction and timing of movement, or a combination of these parameters. Those skilled in the art will appreciate that the ones listed above do not contain all, but rather are typical examples. The captured dynamic parameters are compared with the collation data stored in the remote database.

The user selects the color photo mode by clicking the icon 664. This mode allows the user to select either an automatic imaging mode in which the optical reader 10 adjusts the imaging (eg, exposure) or a manual mode in which the user can arbitrarily adjust the settings of the imaging device.

In another embodiment, the display 60 provides the user with a menu listing the main modes of the optical reader 10. The user uses the keypad 16 to select the desired mode. Use the cursor keys to highlight one of the modes listed above. When the enter key is pressed, the processor 40 jumps to the appropriate routine stored in the EROM 48. As described above, the user can select between automatic imaging mode, semi-automatic imaging mode, barcode scanning mode, OCR / text mode, signature capture mode, color photography mode or association mode.

As shown in FIG. 4, which is carried out in the present specification, a flowchart showing a processing flow of the automatic imaging mode according to another embodiment of the present invention is disclosed. After the user pulls the trigger in step 400, the processor reads the selected mode. In this case, the user has selected automatic mode. The processor initializes the hardware of the optical reader 10, determines the image data memory space, and initializes the software mode setting. In step 408, the optical reader 10 captures an image by acquiring color imaging data. In some embodiments, the processor 40 can display the image acquired on the display 60 during this step. At step 410, processor 40 determines whether the captured image contains graphical symbols. In one embodiment, the processor 40 uses only a portion of the color imaging data to make this determination. Since the bayer pattern has more green pixels than red or blue pixels, the processor 40 uses the green pixels to search for high-energy regions in the acquired image. For example, high energies such as black and white transitions are good indicators for looking for the presence of graphical symbols such as barcode symbols. A black and white binary image will consist of green pixels in one of two possible value regions. One narrow value area represents the white part of the image and the other narrow value area represents the black part of the image.

In another embodiment, step 410 takes into account all pixel values. However, the determination of the pixel value is adjusted based on whether it is a red pixel, a green pixel, or a blue pixel.<u style="single">In another embodiment, processor 40 sums three sets of values, red, blue, and green, to form a superpixel.</u>In another embodiment, processor 40 creates a grayscale image and determines if the image contains graphical symbols.<u style="single">In another embodiment, step 410 is performed by converting the color imaging data. Also here, an optical reader consisting of: is set: a color imaging assembly for acquiring an image of interest, the color imaging assembly producing color imaging data corresponding to the image; said color. An image analysis circuit coupled to the imaging data, the image analysis circuit, is configured to determine whether the color imaging data contains at least one graphical symbol, whereby the image is if the color imaging data is contained. If at least one graphical symbol is included, it is categorized as a graphical symbol image, or if the color imaging data does not contain at least one graphical symbol, it is categorized as a color photograph; and in the image analysis circuit. The combined processing circuit, the processing circuit, operates to process the color imaging data based on the classification of the image, where the classification circuit selects one of a plurality of classifications. In the process, the values of the red, blue, and green triplets are collected to form a superpixel. Also, an optical reader consisting of: is set up: a color imaging assembly for acquiring an image of interest, the color imaging assembly producing color imaging data corresponding to the image; to the color imaging data. The combined image analysis circuit, the image analysis circuit, is configured to determine whether the color imaging data contains at least one graphical symbol, whereby the image will have at least one color imaging data. If a graphical symbol is included, it is categorized as a graphical symbol image, or if the color imaging data does not contain at least one graphical symbol, it is categorized as a color photograph;</u>

If in step 410 the processor 40 determines that there are no graphical symbols in the image, then in step 432 the user is asked if he wants to store the image. If desired, the color photographic image is stored in memory in step 434. If the processor 40 determines that the image contains a graphical symbol, the processing flow moves to step 418. In this step, the processor 40 draws a scan line and searches for the barcode symbol identifier. If processor 40 determines that the graphical symbol is a bar code symbol, it attempts to decode the symbol in step 436. If the decryption is successful, the symbol will be a menu symbol or a data symbol. If it is a data symbol, the decoded value of the barcode symbol is output to the display. If it is a menu symbol, the menu routine is executed. This menu symbol will be described in more detail below.

If processor 40 does not find the barcode symbol, go to step 420 and look for the OCR-A or OCR-B character. If the processor finds these characters, it performs optical character recognition in step 422. If it cannot be found, the processor determines if there is text in the image. If the text is found, at steps 428 and 430, the image is cropped and the text is compressed and stored. If the image does not contain text, processor 40 determines if the image has a signature. If the signature is present, at steps 428 and 430, the image is cropped and the data is compressed and stored. In another embodiment, the optical reader 10 is connected to a network and the processor 40 communicates with a remote network resource to provide a signature verification service. If the processor 40 cannot detect the barcode symbol, OCR symbol, text or signature, in step 432 the user is asked if he wants to store the image. If desired, the color photographic image is stored in memory in step 434.

A flowchart showing the processing flow of the semi-automatic mode, which is carried out in the present specification and is shown in FIG. 5, is disclosed. After the user pulls the trigger in step 500, the processor reads the selected mode, initializes the hardware of the optical reader 10, determines the image data memory space, and initializes the software mode settings. At step 508, the optical reader 10 captures and displays the image.

At step 510, processor 40 determines if the captured image contains graphical symbols. Step 510 in the semi-automatic mode is the same as step 410 in the automatic mode. If processor 40 determines that the captured image does not contain graphical symbols, processor 40 asks the user if he or she wishes to store a color image. If desired, the color image is stored in step 514. At step 516, the prompt asks the user if he wants to associate the color image with another image. This step is not done in automatic mode. If the user gives a positive answer in step 518, the association is made and the processing flow returns to step 508.

At steps 520, 522, 526, and 532, the user is given the opportunity to select the type of graphical imaging to be performed. The methods for OCR, text capture, signature capture and / or collation are described above in the description of automatic mode, but there is one difference. In semi-automatic mode, in step 538 the user is asked if he wants to associate the processed image with subsequent captured images. If desired, the processing flow is returned to step 508, where other images are captured and displayed. This association feature can be used several times to associate multiple images.

If the user indicates that it is a barcode, an attempt is made to decrypt the symbol in step 540. Looking back at step 540, if the decryption attempt is successful, at step 544 processor 40 determines if this symbol is a menu symbol. If it is not a menu symbol, the processor 40 displays the decrypted barcode information on the display 60. If it is a menu symbol, in step 546 processor 40 executes the appropriate menu routine. In steps 552 to 564, if the trigger is subsequently pulled, processor 40 can continue to capture the image. At step 562, the user is asked if he wants to associate the decryption barcode with another image. If desired, the program flow is returned to step 508, where other images are captured and displayed. Processor 40 associates this image with the decrypted barcode information.

As shown in FIGS. 6A-6C implemented herein, the graphical representation of the menu symbols used in the barcode processing flow shown in FIGS. 4 and 5 is disclosed. The decrypted menu symbol includes a menu word 600 having the format shown in FIG. 6A. The menu word 600 has a 1-byte manufacturing ID code 600-1 to identify the type and model of the optical reader. Field 600-2 of word 600 specifies the OP code. The OP code is shown in Figure 6C. OP code 0 refers to the vector processing operation listed as A1-A4 in Figure 6C. Vector processing allows users to download valid codes, parameter tables, or current software to external devices. OP code 1-7 allows the user to modify certain parts of the parameter table. These OP codes are used with offset fields 600-3 and data fields 600-4 to 600-7. Offset field 600-3 is an index on the base address of the parameter table in memory that identifies the exact location in the parameter table. Data fields 600-4 to 600-7 are used to specify a bitmask that indicates which bits should be modified. Figure 6B shows the second important group of options. For example, the operating mode of the reader is included in F1-F6. These options are the same as the icons displayed on the GUI650 in Figure 3. Offset fields 600-3 correspond to other optical reader 10 options as shown.

A flowchart showing a method of reading a barcode according to still another embodiment of the present invention is disclosed as performed herein and shown in FIG. At step 700, processor 40 refers to the parameter table stored in EROM48. Specifically, processor 40 determines if the parameter table is programmed to perform one-dimensional decoding. If the parameter table enables 1D processing, 1D automatic identification is performed. The parameter table specifies the values of the parameters that determine the operating mode of the reader. Examples of these parameters include the size and frame rate of the color imager, the code that is valid when decoding the barcode, the I / O communication protocol, and the OCR option. If the one-dimensional decoding is successful, the decrypted data is stored or displayed according to the settings in the parameter table. If the 1D code is invalid or the 1D decryption is unsuccessful, the processor moves to step 708. In this step, the processor 40 determines if there is a valid 2D code. If the parameter table disables all of the 2D code, processor 40 terminates the barcode decoding routine. If the 2D code is enabled, 2D automatic identification is performed in step 710. If the decoding is successful, the decrypted data is stored or output according to the parameters stored in the parameter table. If the decryption is unsuccessful, the processor terminates this routine.

A flowchart showing a method for performing one-dimensional automatic identification in step 702 of FIG. 7 is disclosed as performed herein and shown in FIG. At step 800, processor 40 calculates the activity of the selected image data element. Activity is defined as a measure of the rate of change of image data in a small two-dimensional portion of the area surrounding the selected data element. In one embodiment, activity is calculated along two arbitrarily selected directions orthogonal to each other. The directions that are orthogonal to each other are used because the orientation of the symbol is unknown. In step 802, processor 40 looks for a "high activity" area. These high activity areas are called candidate symbol areas (CSR). The high activity region indicates a transition from the black region to the white region, or vice versa, from the white region to the black region. If you have more than one CSR, it probably indicates that you have more than one barcode symbol. At step 804, processor 40 selects the maximum CSR. In step 806, processor 40 calculates the mass center of maximum CSR. Next, the processor 40 finds the direction of the highest activity of the maximum CSR. For one-dimensional barcodes, this would be perpendicular to the direction of the bar. In steps 810 and 812, the processor defines the first scanline (SC = 0) as the scanline that bisects the mass center of the barcode. The processor calculates the brightness value of the sampling point along the first scan line. In step 816, these luminance values are converted into digital data. In decoding step 818, processor 40 applies one-dimensional decoding programs one after another. If the decryption is unsuccessful, processor 40 checks to see if the entire CSR has been scanned. If the entire CSR has not been scanned, a new scanline is established and the decryption process is repeated. If the entire CSR has been scanned in step 822 and there are no CSRs left to decrypt, processor 40 will be in this position. -End the chin. If the one-dimensional decoding is successful in step 820, the processor 40 determines whether or not this symbol is a one-dimensional stack type symbol. If this symbol is a one-dimensional stack symbol, processor 40 scans and decodes the remaining CSR as a stack symbol. If it is not a stack symbol, the decoded one-dimensional data is stored or output to the display 60 in step 830. At step 838, processor 40 determines if there is an uninspected area. If there are uninspected areas, the decoding step is repeated. If there are no unchecked areas, processor 40 terminates this routine.

As implemented herein and shown in FIG. 9, a flowchart showing a method for two-dimensional automatic identification is disclosed. In step 900, processor 40 converts the image data into a binary format in two states. At step 902, processor 40 searches for all 2D finder patterns and identifies them by type. Examples of the pattern type include a bulls-eye type pattern, a waistband type pattern, and a peripheral pattern. If the number of finder patterns is 0, processor 40 terminates this routine. If there is a finder pattern, the processor 40 searches for the finder pattern closest to the center of the field of view in certain embodiments of the present invention. The option of choosing the one closest to the center is advantageous in that the image located in the center is probably a symbol. At step 908, processor 40 attempts to decode the symbol according to the finder type. For example, the Aztec 2D matrix symbol uses the Bullseye Finder pattern. DataMatrix symbols use peripheral finder patterns. If the decryption is successful, the decrypted data is stored or displayed. At step 914, processor 40 determines if there are other unused finder patterns. If there are unused finder patterns, the symbols corresponding to these unused patterns are decoded and the steps described above are repeated. If there are no unused patterns, processor 40 terminates this routine.

A flowchart is disclosed showing how to read the text according to still other embodiments of the invention, as performed herein and shown in FIG. This routine can be accessed in many ways as described above. At step 1000, a bitmap image of the page is created. In step 1002, this bitmap image is sampled. In one embodiment, this is done by analyzing every Nth scanline of the bitmap image. The value of this integer N depends on the resolution of the image being scanned. In one embodiment, the image is sampled every 1/40 inch. This provides sufficient resolution to search and categorize different areas of the page. Sampling every 1 / 40th inch instead of every scanline significantly reduces the processing and memory requirements of reader 10. At step 1004, processor 40 identifies the features of the page. Processor 40 analyzes the page and divides it into blank and non-blank areas. Non-blank areas are analyzed to distinguish between text areas and non-text areas. After checking the layout of the page, processor 40 uses the transition between black and white to determine the degree of distortion. At step 1008, a horizontal white space is identified to separate the lines of text. In step 1010, separate individual words and letters by identifying vertical white spaces within each text line . At step 1014, a character recognition algorithm is used in an attempt to recognize each individual character. Finally, in step 1016, processor 40 formats the restored text before storing it in memory.

A flowchart is disclosed showing how to perform OCR according to still other embodiments of the invention, as performed herein and shown in FIG. At step 1100, the reader 10 generates a pit map image of the page. The processor 40 then finds the lines of text in the image, searches for white space in each line, and separates the characters. At step 1108, processor 40 performs OCR-A or OCR-B character recognition as desired. The decrypted characters are stored in the memory.

A flowchart showing a method of associating continuous images taken with the color optical reader of the present invention, as performed herein and shown in FIG. 12, is disclosed. This method corresponds to the icon 668 displayed on GUI650 in Figure 3. If icon 668 is not clicked, processor 40 assumes that reader 10 is not operating in association mode. Therefore, processor 40 will process a single image. When the reader 10 is in the association mode, the processor 40 initializes the counter CNTR. At step 1206, processor 40 processes the first captured image. In step 1208, if CNTR is 2 or less, processor 40 processes image N and associates image N with the first image. At step 1216, CNTR is incremented by one. If the CNTR is greater than 2 (step 1208), that is, if at least two images are already associated, processor 40 asks the user if he wants to associate other images. If desired, the processing flow returns to step 1212. If not desired, processor 40 terminates this routine.

As performed herein and shown in FIG. 13, an example of image association according to the present invention is disclosed. Those skilled in the art will understand that the associated image 1300 can be placed on paper, displayed electronically on the display 60, or displayed electronically using other electronic means such as a computer monitor. Will. In this example, the captured first image is a color photo 1302 showing a damaged parcel. The second image captured is the barcode 1304 affixed to the side of the damaged parcel. The processor 40 decodes the barcode 1304 and associates the decoded barcode data 1306 with the color photograph 1302. In this example, the user chose to associate a third image, signature 1308. Therefore, according to record 1300 seen by staff, it is reasonable that the damaged parcel was delivered to company XYZ and the person who signed the parcel delivery was named John W. Smith. Can be judged.

A perspective view of a wireless color optical reader network 1400 according to another embodiment of the present invention is disclosed as performed herein and shown in FIG. Network 1400 includes an N-cordless optical scanner 10 connected to base terminal 202 by wireless link 18. The base terminal 202 is connected to the host computer 206 by a communication link 204. The cordless optical reader 10 is of the type described above. It has an antenna 102, keypads 14 and 16 and a display 60. The wireless control device is included in both the optical scanner 10 and the base terminal 202. It will be apparent to those skilled in the art in the art that the radio controller may be of any suitable type, but as an example, the radio controller 30 has a frequency hopping spread spectrum between the scanner 10 and the base terminal 202. Provides spread (FHSS) communication. FHSS is a type of spread spectrum radio transmission that produces narrowband signals that hopping between multiple frequencies in a predetermined pattern. FHSS is often used in commercial environments because it minimizes errors due to interference and interference. However, those skilled in the art will appreciate that the optical scanner 10 and the base terminal 202 can communicate using other radio schemes and other modulation formats based on user requirements and environmental factors. The base terminal 202 has an antenna 208 and is used to send and receive messages from the optical scanner 10. Antenna 208 is connected to a radio controller located within terminal 202. The base terminal 202 also has an I / O card, a base terminal processor, and a base terminal memory. The I / O card of the base terminal 202 is connected to the wireless controller and the communication link 204.

A flowchart showing a method of transmitting packetized data from a color optical reader to a base station, as performed herein and shown in FIG. 15, is disclosed. At steps 1500 and 1502, the optical reader 10 captures an image and processes the image as described above. At step 1504, the processed images, whether color images, decryption barcodes, text files, or signature matching information, are combined into packets. In steps 1506 and 1508, loops are created and packets are sent one by one to the base terminal until all packets have been sent.

Graphical representations of packet formats according to the invention are disclosed as performed herein and shown in FIGS. 16A and 16B. In one embodiment of the invention, each packet can contain approximately 200 bytes of decrypted data in a 256-byte packet. Those skilled in the art will appreciate that this is merely a representative example and the scope of the invention should not be limited to data packets of a particular size or format. FIG. 16A shows a data packet 1600 used to transmit decoded data from the optical reader to the base terminal when only one data packet is required. Packet 1600 includes an optical reader address field, a serial number field, a packet length field, an image type field, image data, and an error check field. The optical reader address identifies an individual optical reader. Each packet contains a serial number placed in the second field. The next field contains the length of the image data field. After this, the packet contains a field that identifies the type of image processed. The image data payload of the packet is inserted after the image type. Finally, packet 200 contains an error check field.

FIG. 16B shows a header packet 1602 and a data bucket 1604 used to transmit decoded data from an optical scanner to a base terminal when two or more data packets are required. If more than one packet is required, the reader 10 first transmits the header packet 1602. After the base terminal 202 responds that it can process the remaining packets, the reader 10 transmits the remaining packets 1604. If the base terminal 202 cannot handle the remaining packets 1604 or has other problems, the base terminal 202 will transmit the application packet to the scanner 10 to indicate an error. The definitions of the scanner address field, serial number field, symbol type, length, symbol data, and error check field have been described above and will not be repeated. The header packet 1602 also has a header identification field, which identifies this packet as a header packet. In the next field, packet 1602 has a full length field, which contains the full length of the data contained in the decryption symbol. The next field contains the total number of packets in the message. The penultimate field is the packet number. In this header packet, this number is shown as packet number "1". The remaining packet 1604 also has a packet number field, which is incremented from 2 to N depending on the total number of packets transmitted in the message.

Packets 1600, 1602, and 1604 as described above may be of any suitable type, and these are representative examples representing an embodiment of the present invention. Those skilled in the art will appreciate that packets may be implemented in a variety of ways.

A flowchart showing a method of performing signature verification is disclosed, which is carried out in the present specification and shown in FIG. At step 1700, the optical reader 10 captures an image of the document to generate a bitmap of the image. Those skilled in the art will appreciate that in automatic or semi-automatic mode, the processor 40 will determine that the image object is a graphical symbol in subsequent steps. Step 1202 is the same as steps 1002 and 1004 in FIG. The image is sampled by analyzing every Nth scanline of the bitmap image. As mentioned above, the image must be scanned in such a way as to locate the various areas on the document and provide sufficient resolution to categorize the areas. For checks, the positions of the various columns on the certificate are relatively standardized. Check dimensions may vary somewhat, but check numbers, bank codes, account numbers, dates, signature blocks, etc. are in the same relationship position for each check. At step 1704, document data such as name, check number, bank code, account number, date, etc. is extracted from the document using any OCR program and stored in memory. At step 1706, a handwritten image of the signature block is captured.

Steps 1708 and 1710 are performed using the wireless system 1400 described above. In other embodiments, these steps are performed by a wired system. For example, in one embodiment, the optical reader 10 is connected to a host computer via an RS-232 or USB link. In another embodiment, the optical reader 10 is connected to the host computer via a LAN. Those skilled in the art will appreciate that the present invention should not be construed as being limited by these examples.

At steps 1712 and 1714, processor 40 initializes the counter and begins waiting for a response from the host computer. At step 1714-1718, if the response is not received within the time limit TL, the counter CNTR is incremented and the message is retransmitted. After several attempts, if CNTR&gt; N (N is an integer), processor 40 prints a fault message. If the response message is received within the time limit TL, the processor determines the response in step 1722. If the extracted data and signature match the information stored in the database accessible by the host computer, an authorization message is displayed. If the extracted data and signature do not match the information stored in the database accessible by the host computer, a disapproval message will be displayed. The example of dynamic signature collation is the same as the static example described immediately before. In the dynamic one, the user provides a signature using a stylus 18 and a signature block 62 as shown in FIG. 1C. The signature block 62 provides the processor 40 with dynamic parameters recorded at the time of signing. The dynamic parameters are transmitted to the host computer as described above.

An example of a color optical reader network 1800 according to the present invention is disclosed as performed herein and shown in FIG. The network 1800 has a wireless system 1400, a personal computer 1802, an optical reader 10, a LAN 1820, a network service center 1830, and a personal area network (PAN), all of which are connected via the network 1810.

Those skilled in the art will understand that the network 1810 can be of any suitable type depending on the application, but the Internet is taken as an example. However, the present invention should not be construed as being limited to this example. In another embodiment, network 1810 is a private network. Those skilled in the art will also appreciate that network 1810 is a wired network in one embodiment and a wireless network in another. The network 1810 can include a circuit switching network, an IP network, or both.

The LAN 1820 includes a server 1822, a computer 1824, a database 1826, and a plurality of optical readers 10. Database 1826 is used to store the associated image along with other data fields. For example, it would be quite useful to store additional information along with the associated image shown in Figure 13. Some may want to correlate delivery methods, routes, drivers and other relevant information for subsequent analysis. Network 1810 allows reader 10, PAN1850 and wireless system 1400 a way to store such data in database 1826. Systems analysts can access this information via personal computer 1802 connected to network 1810. In one embodiment, LAN 1820 includes an internet website. In this embodiment, the user is authenticated before gaining access to database 1826.

The network service center 1830 is connected to the network 1810 via interface 1844. Center 1830 also has server 1832, computer 1834, database 1836, signature verification module 1838, and authentication module 1840, all connected via LAN. Center 1830 accommodates any number of useful application programs 1842.

The PAN1850 has at least one color optical reader 10 connected to a point of sale (POS) terminal 1854. POS terminal 1854 is connected to network 1810 via interface 182. POS terminal 1854 has a credit card reader and a signature capture block. In the scenario shown in FIG. 18, the vendor user at POS terminal 1854 transmits the associated customer credit card number, signature, and, in one embodiment, the customer's color image to center 1830. The authentication module 1840 is used to authenticate credit cards, and the signature verification module is used to authenticate signatures. In another embodiment, database 1836 is used to store a customer's image, credit card number, and matching signature.

It will be apparent to those skilled in the art that various modifications and modifications can be made to the present invention without departing from the spirit and scope of the present invention. Therefore, the present invention is intended to extend to the modifications and modifications of the present invention if the modifications and modifications are made within the scope of the appended claims and equivalents.

<figref num="1A">It is a perspective view of various examples of the optical reader of this invention.</figref><figref num="1B">It is a perspective view of various examples of the optical reader of this invention.</figref><figref num="1C">It is a perspective view of various examples of the optical reader of this invention.</figref><figref num="1D">It is a perspective view of various examples of the optical reader of this invention.</figref><figref num="2">It is a block diagram of the electro-optic assembly of the optical reader of this invention.</figref><figref num="3">This is an example of a graphical user interface display according to the present invention.</figref><figref num="4">It is a flowchart which shows the processing flow of the automatic mode by another Example of this invention.</figref><figref num="5">It is a flowchart which shows the processing flow of the semi-automatic mode by another Example of this invention.</figref><figref num="6A">It is an illustration of the menu symbol used in the barcode processing flow shown in FIGS. 4 and 5.</figref><figref num="6B">It is an illustration of the menu symbol used in the barcode processing flow shown in FIGS. 4 and 5.</figref><figref num="6C">It is an illustration of the menu symbol used in the barcode processing flow shown in FIGS. 4 and 5.</figref><figref num="7">It is a flowchart which shows the method of reading the bar code by still another Example of this invention.</figref><figref num="8">It is a flowchart which shows the method of one-dimensional automatic identification by the method shown in FIG.</figref><figref num="9">It is a flowchart which shows the method of 2D automatic identification by the method shown in FIG.</figref><figref num="10">It is a flowchart which shows the method of reading the text by still another Example of this invention.</figref><figref num="11">It is a flowchart which shows the method for performing OCR by still another Example of this invention.</figref><figref num="12">It is a flowchart which shows the method of associating the continuous image taken by the color optical reader of this invention.</figref><figref num="13">This is an example of image association according to the present invention.</figref><figref num="14">It is a perspective view of the wireless color optical reader according to still another embodiment of this invention.</figref><figref num="15">It is a flowchart which shows the method of transmitting the packetized data from a color optical reader to a base station.</figref><figref num="16A">It is an illustration of a packet format according to still another embodiment of the present invention.</figref><figref num="16B">It is an illustration of a packet format according to still another embodiment of the present invention.</figref><figref num="17">It is a flowchart which shows the method of performing the signature collation by still another Example of this invention.</figref><figref num="18">FIG. 5 is a diagram of a color optical reader network application according to the present invention.</figref>