Hand-held computers incorporating reduced area imaging devices
Claim Score by NHIP
Abstract
A reduced area-imaging device is provided for use with a miniature hand-held computer referred to in the industry as a PDA. In one configuration of the imaging device, the image sensor is placed remote from the remaining image processing circuitry. In a second configuration, all of the image processing circuitry to include the image sensor is placed in a stacked fashion near the same location. In the first configuration, the entire imaging device can be placed at the distal end of a camera module. In a second configuration, the image sensor is remote from the remaining image processing circuitry wherein available space within the PDA is used to house the remaining circuitry. In any of the configurations, the image sensor may be placed alone on a first circuit board, or timing and control circuits may be included on the first circuit board containing the image sensor. One or more video processing boards can be stacked in a longitudinal fashion with respect to the first board, or the video processing boards may be placed within the housing of the communication device. The PDA includes a miniature LCD-type video view screen which is capable of viewing not only the images taken by the camera module, but also can show incoming video images received from a personal computer connected to a global communications network. The camera module is of such small size that it can be easily stored within the housing of the PDA. In a first embodiment, the camera module communicates with the housing of the PDA by a wired connection utilizing a small retractable cable. In a second embodiment, the camera module communicates wirelessly with the PDA. In either embodiment, the camera module may be pointed at any desired object within sight of the user, and without having to actually point or move the phone housing in order to take an image. In the wireless embodiment, a user has total freedom to manipulate the positioning of the camera module without adjusting the position of the video telephone since there is not even a cable to contend with. Any acceptable wireless standard may be used for communication between the camera module and the video telephone. One particularly advantageous standard includes bluetooth.

Term
Term ended
Projected expiry passed 2 October 2019, 7 years ago.
- Priority
- Filed
- Published
- Projected expiry
- Today
87 claims: 21 independent, 66 dependent
- 1In a PDA having capability to transmit and receive data in a communications network, the improvement comprising:a video system integral with said PDA for receiving and transmitting video images, and for viewing said video images, said video system comprising;a camera module housing an image sensor therein, said image sensor lying in a first plane and including an array of pixels for receiving images thereon, said image sensor further including circuitry means on said first plane and coupled to said array of pixels for timing and control of said array of pixels, said image sensor producing a pre-video signal, a first circuit board mounted in said camera module and electrically coupled to said image sensor, said first circuit board including circuitry means for converting said pre-video signal to a desired video format, said camera module further including a transceiver radio element mounted therein and electrically communicating with said first circuit board to transmit the converted pre-video signal;a transceiver radio module mounted in said PDA for wirelessly communicating with said transceiver element in said camera module to receive said converted pre-video signal;a video view screen attached to said PDA for viewing said video images, said video view screen communicating with said transceiver radio module for displaying video images processed by said first circuit board.
- 18In a PDA having capability to transmit and receive data in a communications network the improvement comprising:a video system integral with said PDA for receiving and transmitting video images, and for viewing said video images, said video system comprising;a camera module housing an image sensor therein, said image sensor lying in a first plane and including an array of pixels for receiving images thereon, said image sensor further including circuitry means on said first plane and coupled to said array of pixels for timing and control of said array of pixels, said image sensor producing a pre-video signal, said camera module further including a transceiver radio element mounted therein and electrically communicating with said circuitry means to transmit the pre-video signal to the PDA;a transceiver radio module mounted in said PDA for wirelessly communicating with said transceiver element in said camera module to receive said pre-video signal;a first circuit board mounted in said PDA and electrically communicating with said transceiver radio module for converting said pre-video signal into a desired video format;a video view screen attached to said PDA for viewing said video images, said video view screen communicating with said first circuit board for displaying video images processed by said first circuit board.
- 22In a PDA having capability to transmit and receive data in a communications network, the PDA having a housing, and a video view screen for viewing the data which includes video signals, the improvement comprising:a camera module for taking video images, said camera module communicating with circuitry within said PDA enabling viewing on said video view screen and enabling video signals to be transmitted from said camera module to said computer, said camera module including an image sensor housed therein, said image sensor lying in a first plane and including an array of pixels for receiving images thereon, said image sensor further including circuitry means on said first plane and coupled to said array of said pixels for timing and control of said array of pixels, said image sensor producing a pre-video signal, a first circuit board electrically connected to said image sensor, said first circuit board including circuitry means for converting said pre-video signal to a desired video format;a transceiver radio element housed within said camera module and electrically coupled to said first circuit board for transmitting said converted pre-video signal;and a transceiver radio module housed in the PDA and wirelessly communicating with said transceiver radio element for receiving said converted pre-video signal, and said transceiver radio element being electrically coupled to the video view screen of the PDA enabling viewing of the converted pre-video signals.
- 27In a PDA having capability to transmit data between a computer connected to a global communications network, the PDA having a housing, and a video view screen for viewing the data which includes video signals, the improvement comprising:a camera module for taking video images, said camera module communicating with circuitry within said PDA enabling viewing on said video view screen and enabling video signals to be transmitted from said camera module to said computer, said camera module including an image sensor housed therein, said image sensor lying in a first plane and including an array of pixels for receiving images thereon, said image sensor further including circuitry means on said first plane and coupled to said array of said pixels for timing and control of said array of pixels, said image sensor producing a pre-video signal;a transceiver radio element housed within said camera module and electrically coupled to said image sensor for transmitting said pre-video signal;a transceiver radio module housed in the PDA and wirelessly communicating with said transceiver radio element for receiving said pre-video signal;and a first circuit board housed within the PDA and electrically coupled to said transceiver radio module for taking said pre video signal and conditioning it to be a post video signal in a desired format, and said transceiver radio element being electrically coupled to the video view screen of the PDA enabling viewing of the converted pre-video signals.
- 32A PDA having capability to transmit and receive data in a communications network, said PDA comprising:an image sensor lying in a first plane, and an array of pixels for receiving images thereon, said image sensor further including circuitry means on said first plane and coupled to said array of pixels for timing and control of said array of pixels, said image sensor producing a pre-video signal;a first circuit board electrically communicating with said image sensor, said first circuit board including circuitry means for converting said pre-video signal to a desired video format;a camera module housing said image sensor and said first circuit board;a transceiver radio element mounted in said camera module communicating with said first circuit board for wirelessly transmitting the converted pre-video signal;a transceiver radio module communicating wirelessly with said transceiver radio element for receiving the converted pre-video signal;a transceiver/amplifier section electrically coupled to said transceiver radio module for amplifying and further transmitting the converted pre-video signal, and for receiving, and amplifying video and audio signals transmitted by another party;a digital signal processor electrically coupled to said transceiver radio module and said transceiver/amplifier section, said digital signal processor further conditioning said converted pre-video signal, and also for conditioning video and audio signals received by said transceiver/amplifier section from the other party;a microphone electrically communicating with said digital signal processor for recording sound and converting the sound to audio signals;a speaker electrically communicating with said digital signal processor for broadcasting the audio signals;a video view screen attached to said PDA, said video view screen for selectively displaying images from said imaging device, and for selectively displaying video images received by said transceiver/amplifier section from the other party;a video switch communicating with said first circuit board and said digital signal processor for switching video images to be viewed on said video view screen;and a PDA power supply mounted in said PDA for providing power thereto.
- 37A PDA having capability to transmit and receive data in a communications network, said PDA comprising:an image sensor lying in a first plane, and an array of pixels for receiving images thereon, said image sensor further including circuitry means on said first plane and coupled to said array of pixels for timing and control of said array of pixels, said image sensor producing a pre-video signal;a camera module housing said image sensor;a transceiver radio element mounted in said camera module communicating with said image sensor for wirelessly transmitting the pre-video signal;a transceiver radio module communicating wirelessly with said transceiver radio element for receiving the pre-video signal;a first circuit board electrically communicating with said transceiver radio module, said first circuit board including circuitry means for converting said pre-video signal to a desired video format;a transceiver/amplifier section electrically coupled to said transceiver radio module for amplifying and further transmitting the converted pre-video signal, and for receiving, and amplifying video and audio signals transmitted by another party;a digital signal processor electrically coupled to said transceiver radio module and said transceiver/amplifier section, said digital signal processor further conditioning said converted pre-video signal, and also for conditioning video and audio signals received by said transceiver/amplifier section from the other party;a microphone electrically communicating with said digital signal processor for recording sound and converting the sound to audio signals;a speaker electrically communicating with said digital signal processor for broadcasting the audio signals;a video view screen attached to said PDA, said video view screen for selectively displaying images from said imaging device, and for selectively displaying video images received by said transceiver/amplifier section from the other party;a video switch communicating with said first circuit board and said digital signal processor for switching video images to be viewed on said video view screen;and a PDA power supply mounted in said PDA for providing power thereto.
- 42In a PDA having capability to transmit and receive data in a communications network, the improvement comprising:a video system integral with said PDA for receiving and transmitting video images, and for viewing said images, said video system comprising: a camera module housing an image sensor therein, said image sensor lying in a first plane and including an array of pixels for receiving images thereon, said image sensor producing a pre-video signal, a first circuit board lying in a second plane and electrically coupled to said image sensor, said first circuit board including circuitry means for timing and control of said array of pixels and circuitry means for processing and converting said pre-video signal to a desired video format, a transceiver radio element communicating with said firs circuit board for transmitting said converted pre-video signal;a transceiver radio module mounted in said PDA for wirelessly receiving said converted pre-video signal;and a video view screen attached to said PDA for viewing said video images, said video view screen communicating with said transceiver radio module, and displaying video images processed by said first circuit board.
- 46In a PDA having capability to transmit and receive data in a communications network the improvement comprising:a video system integral with said PDA for receiving and transmitting video images, and for viewing said images, said video system comprising: a camera module housing an image sensor therein, said image sensor including an array of pixels for receiving images thereon, said image sensor producing a pre-video signal, a transceiver radio element communicating with said image sensor for transmitting said pre-video signal;a transceiver radio module mounted in said PDA for wirelessly receiving said pre-video signal;a first circuit board electrically coupled to said transceiver radio module, said first circuit board including circuitry means for timing and control of said array of pixels and circuitry means for processing and converting said pre-video signal to a desired video format, and a video view screen attached to said PDA for viewing said video images, said video view screen communicating with said transceiver radio module, and displaying video images processed by said first circuit board.
- 50In a PDA having capability to transmit and receive data in a communications network the PDA including a video view screen for viewing video images, the improvement comprising:a camera module for taking video images, said camera module wirelessly communicating with circuitry within said PDA enabling viewing on said video view screen and enabling video signals to be transmitted from said camera module to the personal computer, said camera module including an image sensor housed therein, said image sensor lying in a first plane and including an array of pixels for receiving images thereon, said image sensor producing a pre-video signal, a first circuit board lying in a second plane and electrically connected to said image sensor, said first circuit board including circuitry means for timing and control of said array of pixels and circuitry means for processing and converting said pre-video signal to a desired video format, and a transceiver radio element housed in the camera module for wirelessly transmitting the converted pre-video signal to the PDA.
- 54In a PDA having capability to transmit and receive data in a communications network, the PDA including a video view screen for viewing video images, the improvement comprising:a camera module for taking video images, said camera module wirelessly communicating with circuitry within said PDA enabling viewing on said video view screen and enabling video signals to be transmitted from said camera module to the personal computer, said camera module including an image sensor housed therein, said image sensor including an array of pixels for receiving images thereon, said image sensor producing a pre-video signal, and a transceiver radio element housed in the camera module for wirelessly transmitting the pre-video signal to the PDA.
- 58In a PDA having capability to transmit and receive data in a communications network, the PDA including a video view screen for viewing the video images, the improvement comprising:a camera module for taking video images, said camera module communicating with circuitry within said PDA enabling viewing of said video images on said PDA and enabling video signals to be transmitted from said camera module to the personal computer, said camera module including an image sensor housed therein, said image sensor lying in a first plane and including an array of pixels for receiving images thereon, said image sensor further including circuitry means electrically coupled to said array of said pixels for timing and control of said array of pixels, said circuitry means for timing and control placed remote from said array of pixels on a second plane, said image sensor producing a pre-video signal, a first circuit board electrically connected to said image sensor and lying in a third plane, said first circuit board including circuitry means for processing and converting said pre-video signal to a desired video format, and a radio transceiver element communicating with said first circuit board for wirelessly transmitting said converted pre-video signal.
- 62In a PDA having capability to transmit and receive data in a communications network, the PDA including a video view screen for viewing the video images, the improvement comprising:a camera module for taking video images, said camera module communicating with circuitry within said PDA enabling viewing of said video images on said PDA and enabling video signals to be transmitted from said camera module to the personal computer, said camera module including an image sensor housed therein, said image sensor lying in a first plane and including an array of pixels for receiving images thereon, said image sensor further including circuitry means electrically coupled to said array of said pixels for timing and control of said array of pixels, said circuitry means for timing and control placed remote from said array of pixels on a second plane, said image sensor producing a pre-video signal, and a radio transceiver element communicating with said image sensor for wirelessly transmitting said pre-video signal.
- 66A PDA having capability to transmit and receive data in a communications network said PDA comprising:an image sensor lying in a first plane including an array of pixels for receiving images thereon, said image sensor producing a pre-video signal;a first circuit board electrically communicating with said image sensor, said first circuit board including circuitry means for timing and control of said array of pixels and circuitry means for processing and converting said pre-video signal to a desired video format;a radio transceiver element communicating with said first circuit board for wirelessly transmitting said converted pre-video signal;a camera module housing said image sensor, said first circuit board, and said transceiver radio element therein;a radio transceiver module housed within the PDA for wirelessly communicating with said radio transceiver element and receiving said converted pre-video signal;a transceiver/amplifier section electrically coupled to said transceiver radio module for amplifying and further transmitting the converted pre-video signal, and for receiving, and amplifying video and audio signals transmitted by another party;a digital signal processor electrically coupled to said transceiver radio module and said transceiver/amplifier section, said digital signal processor further conditioning said pre-video signal which is first conditioned by said first circuit board, and also for conditioning video and audio signals received by said transceiver/amplifier section from the other party;a microphone electrically communicating with said digital signal processor for receiving sound and converting the sound to audio signals;a speaker electrically communicating with said digital signal processor for broadcasting audio signals;a video view screen attached to said PDA, said video view screen for selectively displaying images from said imaging device, and for selectively displaying video images received by said transceiver/amplifier section;and a video switch communicating with said first circuit board and said digital signal processor for switching video images to be viewed on said video view screen;and a power supply mounted to said PDA for providing power thereto.
- 70A PDA having capability to transmit and receive data in a communications network, said PDA comprising:an image sensor lying in a first plane including an array of pixels for receiving images thereon, said image sensor producing a pre-video signal;a first circuit board electrically communicating with said image sensor, said first circuit board including circuitry means for timing and control of said array of pixels;a radio transceiver element communicating with said first circuit board for wirelessly transmitting said pre-video signal;a camera module housing said image sensor, said first circuit board, and said transceiver radio element therein;a radio transceiver module housed within the PDA for wirelessly communicating with said radio transceiver element and receiving said pre-video signal;a second circuit board electronically communicating with said radio transceiver module, said second circuit board including circuitry means for converting said pre-video signal to a desired video format;a transceiver/amplifier section electrically coupled to said transceiver radio module for amplifying and further transmitting the converted pre-video signal, and for receiving, and amplifying video and audio signals transmitted by another party;a digital signal processor electrically coupled to said transceiver radio module and said transceiver/amplifier section, said digital signal processor further conditioning said pre-video signal which is first conditioned by said first circuit board, and also for conditioning video and audio signals received by said transceiver/amplifier section from the other party;a microphone electrically communicating with said digital signal processor for receiving sound and converting the sound to audio signals;a speaker electrically communicating with said digital signal processor for broadcasting audio signals;a video view screen attached to said PDA, said video view screen for selectively displaying images from said imaging device, and for selectively displaying video images received by said transceiver/amplifier section;a video switch communicating with said first circuit board and said digital signal processor for switching video images to be viewed on said video view screen;and a power supply mounted to said PDA for providing power thereto.
- 74A PDA having capability to transmit and receive data in a communications network, said PDA comprising:an image sensor lying in a first plane, and an array of pixels for receiving images thereon, said image sensor further including circuitry means electrically coupled to said array of pixels for timing and control of said array of pixels, said circuitry means for timing and control being placed remote from said array of pixels on a second plane, said image sensor producing a pre-video signal;a first circuit board electrically coupled with said image sensor and lying in a third plane, said first circuit board including circuitry means for processing and converting said pre-video signal to a desired video format;a transceiver radio element communicating with said first circuit board to wirelessly transmit the converted pre-video signal;a camera module housing said image sensor, said first circuit board and said transceiver radio element;a transceiver/amplifier section electrically coupled to said transceiver radio module for amplifying and further transmitting said converted pre-video signal and for receiving and amplifying video and audio signals transmitted by another party;a digital signal processor electrically coupled to said transceiver radio module and said transceiver/amplifier section, said digital signal processor further conditioning said converted pre-video signal which is first conditioned by said first circuit board, and also for conditioning video and audio signals received by said transceiver/amplifier section from the other party;a microphone electrically communicating with said digital signal processor for receiving sound and converting the sound to audio signals;a speaker electrically communicating with said digital signal processor for broadcasting audio signals;a video view screen attached to said PDA, said video view screen for selectively displaying selectively displaying video images from said image device, and for selectively displaying video images received by said transceiver/amplifier section from the other party;and a video switch communicating with said first circuit board and said digital signal processor for switching video images to be viewed on said video view screen;and a power supply mounted to said PDA for providing power thereto.
- 78In a method for conducting video conferencing communications through a global communications network, the improvement comprising the steps of:providing a camera module having an image sensor housed therein;removing the camera module from connection with the PDA;pointing the camera module at a targeted object and taking video images of the targeted object;wirelessly transmitting the video images taken by image sensor to the PDA;processing the video images transmitted by the camera module;and selectively viewing the video images on the PDA and selectively transmitting the video images to another party.
- 80In a PDA having capability to transmit and receive data communications network, the improvement comprising:a camera module housing an image sensor therein, said camera module for producing video images of a targeted object;means for wirelessly interconnecting said camera module to said PDA, said means for wirelessly interconnecting enabling said camera module to be selectively displaced at a location remote from said PDA;and a video view screen attached to said PDA for selectively viewing video images taken by said camera module, and for selectively viewing incoming video images received from the personal computer connected to the global communications network.
- 82Broadest claimClaim Score 80, broad(NHIP)In a PDA having a housing and a video view screen for viewing video images, the improvement comprising:a camera module housing an image sensor therein, said camera module for producing video images of a targeted object;and means for wirelessly interconnecting said camera module to said PDA, said means for wirelessly interconnecting enabling said camera module to be selectively displaced at a location remote from said PDA.
- 84In a PDA, the improvement comprising:a camera module housing an image sensor therein;first circuitry means coupled to said image sensor for timing and control of said image sensor;second circuitry means for processing images taken by said image sensor to create video signals of a desired video format;and means for wirelessly interconnecting said camera module to a housing of said PDA, said means for wirelessly interconnecting enabling said camera module to be selectively displaced from said housing by the user for pointing the camera module at a targeted object without having to manipulating the PDA.
- 86In a PDA having the capability to transmit data between a personal computer connected to a global communications network, the improvement comprising:a camera module housing an image sensor therein;a camera module battery housed within said camera module for providing power to said camera module;a camera battery charge circuit housed within the PDA;a PDA battery housed within the PDA for providing power to said camera battery charge circuit;and wherein the camera module is received in the PDA so said camera module battery electrically communicates with said camera battery charge circuit to selectively charge said camera module battery.
- 87A method of powering and recharging a camera module for use with a PDA, said method comprising the steps of:providing a PDA housing a camera battery charge circuit therein;providing a camera module housing an image sensor therein for taking video images, and a camera module battery housed within said camera module for selectively powering said camera module;removing said camera module from seated engagement with the PDA resulting in activation of said camera module battery for powering said camera module;and returning said camera module to its seated position with said PDA and in electrical communication with the battery charge circuit to charge said camera module battery.
Independent claims21
92 paragraphs in 5 sections, as filed
P-0001[0001] This application is a continuation-in-part of U.S. Ser. No. 09/638,976 filed on Aug. 15, 2000, entitled “Hand Held Computers Incorporating Reduced Area Imaging Devices”, which is a continuation-in-part of U.S. Ser. No. 09/496,312, filed Feb. 1, 2000, and entitled “Reduced Area Imaging Devices”, which is a continuation application of U.S. Ser. No. 09/175,685, filed Oct. 20, 1998 and entitled “Reduced Area Imaging Devices”, now U.S. Pat. No. 6,043,839, which is a continuation-in-part of U.S. Ser. No. 08/944,322, filed Oct. 6, 1997 and entitled “Reduced Area Imaging Devices Incorporated Within Surgical Instruments”, now U.S. Pat. No. 5,929,901.
TECHNICAL FIELD
P-0002[0002] This invention relates to solid state image sensors and associated electronics, and more particularly, to solid state image sensors which are configured to be of a minimum size and used within miniature computer systems known as palm top computers, personal digital assistants (PDA), or hand-held computers/organizers.
BACKGROUND ART
P-0003[0003] The three most common solid state image sensors include charged-coupled devices (CCD) charge injection devices (CID) and photo diode arrays. In the mid-1980s, complementary metal oxide semiconductors (CMOS) were developed for industrial use. CMOS imaging devices offer improved functionality and simplified system interfacing. Furthermore, many CMOS imagers can be manufactured at a fraction of the cost of other solid state imaging technologies.
P-0004[0004] The CCD device is still the preferred type of imager used in scientific applications. Only recently have CMOS-type devices been improved such that the quality of imaging compares to that of CCD devices. However, there are enormous drawbacks with CCD devices. Two major drawbacks are that CCD devices have immense power requirements, and the amount of processing circuitry required for a CCD imager always requires the use of a remote processing circuitry module which can process the image signal produced by the CCD imager. Also, because of the type of chip architecture used with CCD devices, on-chip processing is impossible. Therefore, even timing and control circuitry must be remoted from the CCD imager plane. Therefore, CCD technology is the antithesis of “camera on a chip” technology discussed below.
P-0005[0005] One particular advance in CMOS technology has been in the active pixel-type CMOS imagers which consist of randomly accessible pixels with an amplifier at each pixel site. One advantage of active pixel-type imagers is that the amplifier placement results in lower noise levels. Another major advantage is that these CMOS imagers can be mass-produced on standard semiconductor production lines. One particularly notable advance in the area of CMOS imagers including active pixel-type arrays is the CMOS imager described in U.S. Pat. No. 5,471,515 to Fossum, et al. This CMOS imager can incorporate a number of other different electronic controls that are usually found on multiple circuit boards of much larger size. For example, timing circuits, and special functions such as zoom and anti-jitter controls can be placed on the same circuit board containing the CMOS pixel array without significantly increasing the overall size of the host circuit board. Furthermore, this particular CMOS imager requires 100 times less power than a CCD-type imager does. In short, the CMOS imager disclosed in Fossum, et al. has enabled the development of a “camera on a chip.”
P-0006[0006] Passive pixel-type CMOS imagers have also been improved so that they too can be used in an imaging device, which qualifies as a “camera on a chip.” In short, the major difference between passive and active CMOS pixel arrays is that a passive pixel-type imager does not perform signal amplification at each pixel site. One example of a manufacturer which has developed a passive pixel array with performance nearly equal to known active pixel devices and compatible with the read out circuitry disclosed in the U.S. Pat. No. 5,471,515 is VLSI Vision, Ltd., 1190 Saratoga Avenue, Suite 180, San Jose, Calif. 95129. A further description of this passive pixel device may be found in the applicant's patent entitled “Reduced Area Imaging Devices Incorporated Within Surgical Instruments,” now U.S. Pat. No. 5,986,693, and is hereby incorporated by reference.
P-0007[0007] In addition to the active pixel-type CMOS imager which is disclosed in U.S. Pat. No. 5,471,515, there have been developments in the industry for other solid state imagers which have resulted in the ability to have a “camera on a chip.” For example, Suni Microsystems, Inc. of Mountain View, Calif., has developed a CCD/CMOS hybrid which combines the high quality image processing of CCDs with standard CMOS circuitry construction. In short, Suni Microsystems, Inc. has modified the standard CMOS and CCD manufacturing processes to create a hybrid process providing CCD components with their own substrate which is separate from the P well and N well substrates used by the CMOS components. Accordingly, the CCD and CMOS components of the hybrid may reside on different regions of the same chip or wafer. Additionally, this hybrid is able to run on a low power source (5 volts) which is normally not possible on standard CCD imagers which require 10 to 30 volt power supplies. A brief explanation of this CCD/CMOS hybrid can be found in the article entitled “Startup Suni Bets on Integrated Process” found in <i>Electronic News</i>, Jan. 20, 1997 issue. This reference is hereby incorporated by reference for purposes of explaining this particular type of imaging processor.
P-0008[0008] Another example of a recent development in solid state imaging is the development of a CMOS imaging sensor which is able to achieve analog to digital conversion on each of the pixels within the pixel array. This type of improved CMOS imager includes transistors at every pixel to provide digital instead of analog output that enables the delivery of decoders and sense amplifiers much like standard memory chips. With this new technology, it may, therefore, be possible to manufacture a true digital “camera on a chip.” This CMOS imager has been developed by a Stanford University joint project and is headed by Professor Abbas el-Gamal.
P-0009[0009] A second approach to creating a CMOS-based digital imaging device includes the use of an over-sample converter at each pixel with a one bit comparator placed at the edge of the pixel array instead of performing all of the analog to digital functions on the pixel. This new design technology has been called MOSAD (multiplexed over sample analog to digital) conversion. The result of this new process is low power usage, along with the capability to achieve enhanced dynamic range, possibly up to 20 bits. This process has been developed by Amain Electronics of Simi Valley, Calif. A brief description of both of the processes developed by Stanford University and Amain Electronics can be found in an article entitled “A/D Conversion Revolution for CMOS Sensor?,” September 1998 issue of <i>Advanced Imaging</i>. This article is also hereby incorporated by reference for purposes of explaining these particular types of imaging processors.
P-0010[0010] Yet another example of a recent development with respect to solid state imaging is an imaging device developed by ShellCase, of Jerusalem, Israel. In an article entitled “A CSP Optoelectronic Package for Imaging and Light Detection Applications” (A. Badihi), ShellCase introduces a die-sized, ultrathin optoelectronic package which is completely packaged at the wafer level using semiconductor processing. In short, ShellCase provides a chip scale package (CSP) process for accepting digital image sensors which may be used, for example, in miniature cameras. The die-sized, ultrathin package is produced through a wafer level process which utilizes optically clear materials and completely encases the imager die. This packaging method, ideally suited for optoelectronic devices, results in superior optical performance and form factor not available by traditional image sensors. This article is also incorporated by reference for purposes of explaining ShellCase's chip scale package process.
P-0011[0011] Yet another example of a recent development with respect to solid state imaging is shown in U.S. Pat. No. 6,020,581 entitled “Solid State CMOS Imager Using Silicon on Insulator or Bulk Silicon.” This patent discloses an image sensor incorporating a plurality of detector cells arranged in an array wherein each detector cell as a MOSFET with a floating body and operable as a lateral bipolar transistor to amplify charge collected by the floating body. This invention overcomes problems of insufficient charge being collected in detector cells formed on silicon on insulator (SOI) substrates due to silicon thickness and will also work in bulk silicon embodiments.
P-0012[0012] The above-mentioned developments in solid state imaging technology have shown that “camera on a chip” devices will continue to be enhanced not only in terms of the quality of imaging which may be achieved, but also in the specific construction of the devices which may be manufactured by new breakthrough processes.
P-0013[0013] Although the “camera on a chip” concept is one which has great merit for application in many industrial areas, a need still exists for a reduced area imaging device which can be used in even the smallest type of industrial application. Recently, devices known as palm top computers, PDA(s), or hand-held computers have become very popular items. Essentially, these PDAs are miniature computers, small enough to be held in the hand, which have various software programs available to a user including word processing, e-mail, and organization software for addresses/phone books, etc.
P-0014[0014] One example of a U.S. patent disclosing a type of a PDA includes U.S. Pat. No. 5,900,875. This patent is incorporated herein by reference for purposes of illustrating an example of a PDA including basic functionality for such a device. In a recent article entitled “Palm, Inc. Gets Ready for New Hands” appearing in the <i>Wallstreet Journal</i>, a number of soon to be commercially available PDAs are disclosed. One such device disclosed in this article is known as the “Hand Spring Visor Deluxe.” This device will soon be available which allows a user to accommodate pagers, MP3 players, still digital cameras and other devices.
P-0015[0015] It is one general object of this invention to provide a video system in combination with a standard PDA enabling a user to take video images by a very small camera module incorporated within the PDA, view the video images taken on a video view screen incorporated within the PDA, and to have the capability to store video images, download the video images, and send the video images electronically through a communications network.
P-0016[0016] Another object of this invention is to provide a PDA with the ability to not only transmit video images taken by the camera module, but also to receive video images sent from a remote location via the communications network, and to view such received video images on the video view screen of the PDA. Accordingly, the invention is ideally suited for video teleconferencing.
P-0017[0017] It is another object of this invention to provide a reduced area imaging device incorporated within a PDA which takes advantage of “camera on a chip” technology, but to rearrange the video processing circuitry in a selective stacked relationship so that the camera module has a minimum profile.
P-0018[0018] It is yet another object of this invention to provide imaging capability for a PDA wherein the video camera used is of such small size that it can be stored in the PDA when not in use. The camera module is attached to the PDA by a retractable cord which enables the imaging device to be used to image anything at which the camera module is pointed by the user without having to also move the PDA away from the view of the user.
P-0019[0019] It is yet another object of the invention to provide a video camera with a PDA wherein the camera communicates with a PDA by a wireless link such as a RF radio link so that the camera does not have to be physically connected to the PDA. This wireless connection further enhances the capability to use the camera to shoot video without having to move the PDA or otherwise manipulate the PDA in a manner which detracts from shooting the video.
P-0020[0020] In all applications, to include use of the imaging device of this invention with a PDA, “camera on a chip” technology can be improved with respect to reducing its profile area, and incorporating such a reduced area imaging device within a PDA such that minimal size and weight is added to the PDA, and further that the imaging device can be used to image selected targets by the user.
DISCLOSURE OF THE INVENTION
P-0021[0021] In accordance with the present invention, reduced area imaging devices are provided in combination with a hand-held computer or PDA. The term “imaging device” as used herein describes the imaging elements and processing circuitry which is used to produce a video signal which may be accepted by both a standard video device such as a television or video monitor accompanying a personal computer, and a small LCD screen which is incorporated within the PDA. The term “image sensor” as used herein describes the components of a solid state imaging device which captures images and stores them within the structure of each of the pixels in the array of pixels found in the imaging device. As further discussed below, the timing and control circuits can be placed either on the same planar structure as the pixel array, in which case the image sensor can also be defined as an integrated circuit, or the timing and control circuitry can be placed remote from the pixel array. The terms “video signal” or “image signal” as used herein, and unless otherwise more specifically defined, refer to an image which at some point during its processing by the imaging device, is found in the form of electrons which have been placed in a specific format or domain. The term “processing circuitry” as used herein refers to the electronic components within the imaging device which receive the image signal from the image sensor and ultimately place the image signal in a usable format. The terms “timing and control circuits” or “timing and control circuitry” as used herein refer to the electronic components which control the release of the image signal from the pixel array.
P-0022[0022] In a first embodiment of the PDA, the imaging device connects to the PDA by a cable or cord that may retract within the housing of the PDA. Thus in this embodiment, the camera is tethered to the PDA. In a second embodiment, the imaging device does not have to be physically connected to the PDA; rather, a wireless RF link or other acceptable wireless technology is used so that video signals produced by the imaging device may be transmitted to and received by the PDA. One particularly advantageous wireless technology usable with the PDA of this invention is known as “Bluetooth”. Another recent wireless technology which is usable with the invention is a wireless protocol known as “IEEE 802.15.3”. This wireless standard is developing under the joint efforts of Kodak, Motorola, Cisco and the International Electronic and Electrical Engineers Standards Association (IEEE) Wireless Personal Area Network Working Group (WPAN). Bluetooth technology provides a universal radio interface in the 2.4 GHz frequency band that enables portable electronic devices to connect and communicate wirelessly via short-range ad hoc networks. Bluetooth radios operate in an unlicensed Instrumentation, Scientific, Medical (ISM) band at 2.4 GHz. Bluetooth is a combination of circuit and packet switching. Slots can be reserved for synchronous packets. Each packet is transmitted in a different hop frequency. A packet nominally covers a single slot, but can be extended to cover up to five slots. Bluetooth can support an asynchronous data channel, up to three simultaneous synchronous voice channels, or a channel that simultaneously supports asynchronous data and synchronous voice. Spectrum spreading is used to facilitate optional operation at power levels up to 100 mW worldwide. Spectrum spreading is accomplished by frequency hopping in 79 hops displaced by 1 MHz, starting at 2.402 GHz and stopping at 2.480 GHz. The maximum frequency-hopping rate is 1600 hops per second. The nominal link range is 10 centimeters to 10 meters, but can be extended to more than 100 meters by increasing the transmit power. A shaped, binary FM modulation is applied to minimize transceiver complexity. The gross data rate is 1 Mb/second. A time division duplex scheme is used for full-duplex transmission. Additional technical information describing the Bluetooth global specification is found on the world wide web at www.bluetooth.com. Additional information regarding the technical specification for the IEEE 802.15.3 standard may be found at http://www.ieee802.org/15, under the link for Task Force Three (TG3).
P-0023[0023] In a first arrangement of the imaging device, the image sensor, with or without the timing and control circuitry, may be placed at the distal tip of a very small video camera module which communicates with the PDA by a wireless RF link or is attached by a cable or cord to the PDA, or the camera module communicates with the PDA by a wireless RF link while the remaining processing circuitry may be placed within the housing of the PDA.
P-0024[0024] In a second arrangement of the imaging device, the image sensor and the processing circuitry may all be placed in a stacked arrangement of miniature circuit boards and positioned at the distal tip of the video camera module. In this second arrangement, the pixel array of the image sensor may be placed by itself on its own circuit board while the timing and control circuitry and processing circuitry are placed on one or more other circuit boards, or the circuitry for timing and control may be placed with the pixel array on one circuit board, while the remaining processing circuitry can be placed on one or more of the other circuit boards.
P-0025[0025] In yet another alternative arrangement of the imaging device, the pixel array, timing and control circuits, and some of the processing circuitry can be placed near the distal end of the video camera module with the remaining part of the processing circuitry being placed in the housing of the PDA.
P-0026[0026] For the arrangement or configuration of the imaging device that calls for the array of pixels and the timing and control circuitry to be placed on the same circuit board, only one conductor is required in order to transmit the image signal to the video processing circuitry. When the timing and control circuits are incorporated onto other circuit boards, a plurality of connections are required in order to connect the timing and control circuitry to the pixel array, and then the one conductor is also required to transmit the image signal back to the video processing circuitry.
P-0027[0027] As mentioned above, the invention disclosed herein can be considered an improvement to a PDA wherein the improvement comprises a video system. The video system would include the video view screen or monitor attached to the PDA, the camera module, as well as supporting video processing circuitry for the imaging device. In yet another aspect, the invention disclosed herein can also be considered an improvement to a PDA wherein the improvement comprises a novel imaging device, preferably of CMOS construction. For this improvement comprising the imaging device, the imaging device includes the array of pixels, and the supporting video processing circuitry for providing a video ready signal.
P-0028[0028] In yet another aspect, the invention disclosed herein can also be considered an improvement to a PDA wherein the improvement comprises an imaging device which utilizes a wireless standard in order to transmit video images to the PDA.
P-0029[0029] This video ready signal may be formatted by the video processing circuitry for viewing on a NTSC/PAL compatible device such as television, or for viewing on a VGA compatible device such as a monitor of a personal computer. Of course, the video ready signal is formatted for viewing the video images on the video view screen incorporated within the PDA.
P-0030[0030] In yet another aspect, the invention disclosed herein can also be considered an improvement to a PDA wherein the improvement comprises a combination of a video system, and wireless telephone communication means for transmitting and receiving both audio and video signals. In this aspect, the invention has functionality for transmitting and receiving audio and video signals via the communications network. One example of a U.S. patent disclosing wireless remote communications between a personal computer and a PDA or miniature hand held computer is U.S. Pat. No. 6,034,621. This patent is hereby incorporated by reference in its entirety for purposes of disclosing means by which data can be exchanged between the hand held computer and a personal computer, to include video and audio signals. The specific example in this patent which readily lends itself to the communication network incorporated within this invention is found at FIG. 4 of this '621 patent. The discussion further below outlines this particular communication network.
P-0031[0031] In yet another aspect, the invention disclosed herein can also be considered an improvement to a PDA wherein the improvement comprises a video system, and a standard wireless telephone communication means for transmitting and receiving audio signals. In this aspect, the PDA simply includes a standard wireless/cellular phone connected externally on the PDA which enables the user to conduct well-known wireless/telephone communications. This wireless/cellular communication means can be in addition to the wireless telephone communication means for transmitting and receiving both audio and video signals discussed immediately above with respect to the U.S. Pat. No. 6,034,621.
P-0032[0032] Another example of a U.S. patent disclosing basic mobile phone technology including a discussion of basic phone circuitry is U.S. Pat. No. 6,018,670. This patent is hereby incorporated by reference in its entirety for purposes of disclosing standard or basic mobile phone technology and supporting circuitry.
P-0033[0033] Accordingly, the invention disclosed herein has utility with respect to an overall combination of elements, as well as various sub-combinations of elements.
BRIEF DESCRIPTION OF THE DRAWINGS
P-0034[0034]FIG. 1 is an enlarged fragmentary partially exploded perspective view of the distal end of the camera module which is used in conjunction with the PDA, specifically illustrating the arrangement of the image sensor with respect to the other elements of the camera module;
P-0035[0035]FIG. 1<i>a </i>is an enlarged exploded perspective view illustrating another configuration of the image sensor wherein video processing circuitry is placed behind and in longitudinal alignment with the image sensor;
P-0036[0036]FIG. 2 is a perspective view of the PDA in a first embodiment incorporating the reduced area imaging device of this invention;
P-0037[0037]FIG. 3 illustrates the PDA of FIG. 2 wherein the camera module is in the retracted position;
P-0038[0038]FIG. 4 is an overall schematic diagram of the functional electronic components in the first embodiment which make up both the PDA and the reduced area imaging device wherein communications are achieved by wireless/cellular technology for video teleconferencing via the world wide web which is well-known as a global communications network;
P-0039[0039]FIG. 5 is a schematic diagram illustrating an example communications network which can be used for data transfer of text, audio, and visual signals between the PDA and a personal computer which is in communication with the world wide web;
P-0040[0040]FIG. 6<i>a </i>is a perspective view of the PDA in the first embodiment illustrated in combination with an externally attached wireless/cellular phone;
P-0041[0041]FIG. 6<i>b </i>is another perspective view of the combination of FIG. 6<i>a </i>illustrating the combination opened to expose the PDA;
P-0042[0042]FIG. 7 is a perspective view of the PDA in a second embodiment wherein the camera module utilizes a wireless technology, thus the camera module may be physically separated from the PDA during operation, but can still be housed within the PDA for storage and for recharge of the battery of the camera module;
P-0043[0043]FIG. 8 is an overall schematic diagram, similar to FIG. 4, of the functional components which make up the PDA and a simplified cross sectional view of the camera module in the second preferred embodiment wherein the camera module communicates with the PDA via a wireless link;
P-0044[0044]FIG. 8<i>a </i>is an enlarged view of some of the components of the camera module, specifically, the components used in the wireless link with the PDA;
P-0045[0045]FIG. 9 is a more detailed schematic diagram of the functional electronic components, which make up the imaging device;
P-0046[0046]FIG. 9<i>a </i>is an enlarged schematic diagram of a circuit board/planar structure, which may include the array of pixels and the timing and control circuitry;
P-0047[0047]FIG. 9<i>b </i>is an enlarged schematic diagram of a video processing board/planar structure having placed thereon the processing circuitry which processes the pre-video signal generated by the array of pixels and which converts the pre-video signal to a post-video signal which may be accepted by an NTSC/PAL compatible video device; and
P-0048[0048]FIGS. 10<i>a</i>-<b>10</b><i>e </i>are schematic diagrams that illustrate an example of specific circuitry which may be used to make the video processing circuitry of the imaging device.
BEST MODE FOR CARRYING OUT THE INVENTION
P-0049[0049] In accordance with the invention, as shown in FIG. 1, a camera module <b>10</b> is provided which incorporates a reduced area imaging device <b>11</b>. As further discussed below, the elements of the imaging device <b>11</b> may all be found near one location, or the elements may be separated from one another and interconnected by the appropriate wired connections. The array of pixels making up the image sensor captures images and stores them in the form of electrical energy by conversion of light photons to electrons. This conversion takes place by the photo diodes in each pixel which communicate with one or more capacitors which store the electrons. Specifically, the camera module <b>10</b> includes an outer tube/sheath <b>14</b> which houses the components of the imaging device. The camera module is shown as being cylindrical in shape having a window <b>16</b> sealed at the distal end of the camera module. A retractable cable <b>12</b> extends from the proximal end of the camera module <b>10</b>. A shielded cable <b>21</b> is used to house the conductors which communicate with the imaging device <b>11</b>. The shielded cable <b>21</b> is then housed within the retractable cable <b>12</b>. A lens group <b>18</b> is positioned at the distal end of the camera module to enable an image to be appropriately conditioned prior to the image impinging upon the imaging device <b>11</b>. Also shown is a focusing ring <b>20</b> which enables the lens group <b>18</b> to be displaced distally or proximally to best focus an image on the imaging device <b>11</b>.
P-0050[0050] Now referring to FIGS. 2 and 3, a PDA <b>22</b> in a first embodiment is shown which incorporates the camera module <b>10</b>. In basic terms, the PDA <b>22</b> is a miniature hand-held computer incorporating a video system enabling video to be taken by the camera module, and viewed on the video view screen <b>26</b>, as well as enabling images to be stored and downloaded on a miniature computer disc (not shown) used with the PDA. Also discussed further below is the ability to transmit and receive audio and video signals.
P-0051[0051] Beginning first with a description of the basic components of the PDA <b>22</b>, it includes a housing <b>24</b> which hold the components of the PDA and the video system. Cable <b>12</b> is housed within the housing <b>24</b> when in the retracted position. A spring biased spool (not shown) or some other known retracting device is mounted within the housing <b>24</b> enabling the cable <b>12</b> to be extended or retracted. A plurality of controls is provided enabling the user to manipulate the functions of the PDA. These are shown as buttons <b>34</b> on the housing <b>24</b>. The video view screen <b>26</b> is used for displaying video images taken by the camera module <b>10</b>, or for viewing incoming video signals received from a remote location. A command screen <b>28</b> is provided which allows a user to select programs with a stylus (not shown). A video capture button <b>30</b> is provided which allows a user to capture a still video image taken by the camera module <b>10</b>. A video store button <b>32</b> is also provided which enables a captured video image to be stored within the digital memory of the PDA, as further discussed below. An opening or cavity <b>35</b> is provided which allows the camera module <b>10</b> to be stored, along with cable <b>12</b> within the housing <b>24</b>. As shown in FIG. 3, the camera module <b>10</b> is in the stored or retracted position. The antenna <b>36</b> allows for enhanced transmission and reception of incoming or transmitted/outgoing audio and video signals. A video select switch <b>37</b> is provided enabling a user to view either video images taken by the camera module <b>10</b>, or for viewing incoming video images. The video view screen <b>26</b> may be a liquid crystal display (LCD) type, or any other well-known display device of high resolution which has low power requirements, and has minimum size requirements as well.
P-0052[0052] An example of a manufacture of such a miniature LCD monitor includes DISPLAYTECH of Longmont, Colo. DISPLAYTECH manufactures a miniature reflective display that consists of ferroelectric liquid crystal (FLC) applied to a CMOS integrated circuit. The reflective display is a VGA display panel having low voltage digital operation, low power requirements, and full color operation. One of their specific products includes the LightCaster™ VGA Display Panel, Model LDP-0307-MV1. This is but one example of a LCD monitor that is available and usable within the invention herein described.
P-0053[0053] A camera on/off switch <b>66</b> is provided enabling the user to turn the video system on or off. Also shown in FIGS. 2 and 3 is a speaker <b>76</b> and a microphone <b>78</b> which are used for sending and receiving audio signals in the conventional manner as with a wireless/cellular telephone. A further description of speaker <b>76</b> and microphone <b>78</b> is found below.
P-0054[0054] Referring back to FIGS. 1 and 1<i>a</i>, the imaging device <b>11</b> includes an image sensor <b>40</b>. FIG. 1 illustrates that the image sensor <b>40</b> can be a planar and square shaped member, or alternatively, planar and circular shaped to better fit within outer tube <b>14</b>. In the configuration of the imaging device in FIGS. 1 and 1<i>a</i>, there are only three conductors which are necessary for providing power to the image sensor <b>40</b>, and for transmitting an image from the image sensor <b>40</b> back to the processing circuitry found within the phone housing <b>24</b>. Specifically, there is a power conductor <b>44</b>, a grounding conductor <b>46</b>, and an image signal conductor <b>48</b>, each of which are hardwired to the image sensor <b>40</b>. Thus, shielded cable <b>21</b> may simply be a three conductor, 50 ohm type cable.
P-0055[0055] Image sensor <b>40</b> can be as small as 1 mm in its largest dimension. However, a more preferable size for most PDA applications would be between 4 mm to 8 mm in the image sensor's largest dimension (height or width). The image signal transmitted from the image sensor <b>40</b> through conductor <b>48</b> is also herein referred to as a pre-video signal. Once the pre-video signal has been transmitted from image sensor <b>40</b> by means of conductor <b>48</b>, it is received by video processing board <b>50</b>, as shown in FIG. 6<i>b</i>. Video processing board <b>50</b> then carries out all the necessary conditioning of the pre-video signal and places it in a form, also referred to herein as a video ready signal, so that it may be viewed directly on a remote video device such as a television or standard computer video monitor. In order for the pre-video signal to be viewed on the video view screen/monitor <b>26</b>, the pre-video signal is further conditioned by a digital signal processor <b>72</b>, as further discussed below. The video signal produced by the video processing board <b>50</b> can be viewed by an NTSC/PAL compatible video device (such as a television) which connects to the PDA through a remote jack. This video signal produced by board <b>50</b> can be further defined as a post-video signal.
P-0056[0056]FIG. 1 illustrates an arrangement wherein the image sensor <b>40</b> is placed by itself adjacent the distal end of the camera module <b>10</b>. Alternatively, some or all of the video processing circuitry may be placed in adjacent circuit boards directly behind the image sensor <b>40</b>. Accordingly, la illustrates video processor board <b>50</b> aligned directly behind the image sensor <b>40</b>. A plurality of pin connectors <b>52</b> can be used to interconnect image sensor <b>40</b> to video processor board <b>50</b>. Depending upon the specific configuration of image sensor <b>40</b>, pin connectors <b>52</b> may be provided for structural support only, and/or to provide a means by which image signals are transmitted between image sensor <b>40</b> and board <b>50</b>. Additionally, digital signal processor <b>72</b> could also be placed behind image sensor <b>40</b> and behind video processing board <b>50</b>. Accordingly, the image sensor, and all supporting video processing circuitry could be placed at the distal end of the camera module <b>10</b>. However, because of the ample space within housing <b>24</b>, it may be preferable to place at least some of the video processing circuitry within housing <b>24</b>. In the case of FIG. 1<i>a</i>, the conductor <b>49</b> represents the conductor which may carry the post-video signal for direct connection with a remote video device <b>60</b> such as a television or computer monitor. As also discussed further below with respect to the first embodiment, placement of the digital signal processor <b>72</b> at the distal tip of the camera module behind the video processing board <b>50</b> would also enable yet another conductor (not shown) to connect directly to the video monitor <b>26</b> for transmitting a video signal to the video monitor <b>26</b>.
P-0057[0057] Again referring to FIGS. 1 and 1<i>a</i>, the area which is occupied by image sensor <b>40</b> may be defined as the profile area of the imaging device and which determines its critical dimensions. If it is desired to place video processing circuitry adjacent the image sensor <b>40</b> at the distal end of the camera module <b>10</b>, such circuitry must be able to be placed on one or more circuit boards that are longitudinally aligned with image sensor <b>40</b> along longitudinal axis XX. If it is not important to limit the size of the profile area, then any circuitry placed behind image sensor <b>40</b> can be aligned in an offset manner, or may simply be larger than the profile area of image sensor <b>40</b>. In the configuration shown in FIG. 1<i>a</i>, it is desirable that elements <b>40</b> and <b>50</b> be approximately the same size so that they may uniformly fit within the distal end of outer tube <b>14</b>.
P-0058[0058] Now referring to the first embodiment of FIG. 4, a further explanation is provided of the basic electronic components of the PDA <b>22</b>. The PDA <b>22</b> of this invention includes functionality normally found in multiple devices. Specifically, the PDA <b>22</b> includes the computing capability of a PDA, a mobile/wireless phone, communication means for connection to a computer network such as the worldwide web, and a video system. The PDA <b>22</b> may be separated into two major groups, namely, a video and communication system <b>61</b>, and a computer processing and memory unit <b>82</b>. Both of these are discussed in further detail below.
P-0059[0059] As shown in FIG. 4, a conventional lithium ion battery <b>62</b> is provided which communicates with power supply board <b>64</b>. Power supply board <b>64</b> conditions various power outputs to the components of the device, to include power to the video components. In the preferred imaging device of this invention, the power to the imaging device may simply be direct current of between about 1.5 to 12 volts, depending upon the power requirements of the imaging device. A camera on/off switch <b>66</b> must be set to the “on” position in order to activate the camera module <b>10</b>. The video processor board <b>50</b> then transfers power to supplies the camera module <b>10</b>, and also receives the analog pre-video signal back from the camera module, as further discussed below. After processing of the pre-video signal at the video processor board <b>50</b>, the video signal is video ready, meaning that it may then be directly viewed on a remote compatible video device <b>60</b>, such as a television or computer monitor. A video port <b>54</b> can be provided on the housing <b>24</b> enabling a user to take a standard video jack (not shown) and interconnect the PDA with the video port of the remote video device. The video format for such remote video devices includes NTSC/PAL and VGA; thus, the video signal processed by video processor board <b>50</b> creates the video ready signals for use with these remote video devices. For purposes of viewing images on the monitor <b>26</b>, the pre-video signal is farther processed into a digital format within video processor board <b>50</b>, preferably an 8 bit component video signal format that is commonly referred to as “YUV 4:2:2.” This video format easily lends itself to video compression. This 8-bit digital video signal is then sent to the digital signal processor <b>72</b> which performs two functions relevant to the video signal. The digital signal processor <b>72</b> further converts the signal into a format that is compatible with the driver circuitry of the video monitor <b>26</b>. Secondly, the digital signal processor <b>72</b> compresses the YUV signal using a common video compression format, preferably JPEG. The JPEG encoded video signal is then mixed with the audio signal created by microphone <b>78</b> and amplifier <b>74</b>, and the resulting high frequency carrier signal may then be passed onto the transceiver/amplifier section <b>70</b> for transmission. It is to be understood that the transceiver/amplifier <b>70</b> is intended for communication with well-known wide area wireless communication networks. It is also contemplated within the spirit and scope of this invention that the PDA <b>22</b> be capable of communication with computer networks to include the worldwide web. Accordingly, the invention is well adapted for conducting video teleconferencing that is normally conducted with desktop computers and supplemental video equipment. The transceiver/amplifier section also modulates the carrier signal prior to transmission. Depending upon the position of video switch <b>37</b>, the video signal from digital signal processor <b>72</b> is either sent to the monitor <b>26</b>, or is sent to the transceiver/amplifier section <b>70</b> for transmission. As also shown, the antenna <b>36</b> is used for enhancement of reception and transmission of transmitted and received carrier signals.
P-0060[0060] The transceiver/amplifier section <b>70</b> also serves as a receiver that receives an incoming carrier signal. This incoming signal is then demodulated within section <b>70</b>, the video and audio components of the incoming signal are separated, and then these separated signals are then sent to the digital signal processor <b>72</b> which performs video decompression. Then, the decompressed video signal is sent to the monitor <b>26</b> for viewing (if the video switch <b>37</b> is placed in that selected mode). The decompressed audio signal is sent to the amplifier <b>74</b>, and then to the speaker <b>76</b>.
P-0061[0061]FIG. 4 shows the transceiver/amplifier section <b>70</b> as being a cellular digital packet data system (CDPD) type transceiver. This particular transceiver/amplifier <b>70</b> could be the same as that disclosed in the U.S. Pat. No. 6,034,621. A cellular digital packet system is a wireless standard providing two-way, 19.2 KBPS packet data transmission over existing cellular telephone channels.
P-0062[0062] The video switch <b>37</b> may simply be a momentary, spring loaded, push button-type switch. When the video switch <b>37</b> is not depressed, incoming video, which is received via the antenna <b>36</b>, is processed as discussed above in the transceiver/amplifier section <b>70</b> and digital signal processor <b>72</b>, and then sent to the monitor <b>26</b>. When the video switch <b>37</b> is depressed and held, the video signal produced from the camera module <b>10</b> is processed as discussed above, and ultimately sent to the monitor <b>26</b> for viewing by the user. An operator can cycle the switch <b>37</b> between the two positions in order to selectively choose whether to view incoming or outgoing video.
P-0063[0063]FIG. 5 illustrates a communications network that can be used by the invention. A communications network of this type is disclosed in the U.S. Pat. No. 6,034,621, and is discussed specifically therein at FIGS. 3 and 4 of that patent. FIG. 5 illustrates a CDPD base station <b>182</b> with a remote computer <b>188</b> utilizing a direct connection to the CDPD base station <b>182</b> via a modem <b>186</b> with a dial-up connection to the public switch telephone network (PSTN) <b>184</b>. The CDPD base station <b>182</b> includes an antenna <b>181</b>. The remote computer <b>188</b> can be a personal computer, a server, or any other well-known stand-alone computer.
P-0064[0064] Referring back to FIG. 4, the computer processing and memory unit <b>82</b> which allows the PDA <b>22</b> to achieve basic word processing, etc., includes a microprocessor <b>83</b>, RAM <b>84</b>, ROM <b>86</b>, and digital storage <b>88</b>. Digital storage <b>88</b> is provided for storing the formatted images taken by the camera module <b>10</b>. The RAM <b>84</b>, microprocessor <b>83</b>, and ROM <b>86</b> are conventional or standard components as found in existing PDAs. An input/output bus <b>89</b> is provided which allows video signals to be stored or otherwise manipulated within the computer processing and memory unit <b>82</b>. Accordingly, video taken by camera module <b>10</b> can be downloaded to digital storage <b>88</b>. Also, existing image data stored in digital storage <b>88</b> could be viewed on video monitor <b>26</b>.
P-0065[0065]FIGS. 6<i>a </i>and <b>6</b><i>b </i>illustrate another combination of the invention wherein the PDA <b>22</b> is simply combined with an externally mounted cellular telephone <b>190</b>. The cellular phone <b>190</b> is a commercially available cellular/wireless telephone. As shown, the telephone includes the standard keypad <b>194</b>, visual display <b>196</b>, and antennae <b>198</b>. The phone <b>190</b> is secured to the PDA <b>22</b> as by mounting means <b>192</b>, which is shown in the preferred embodiment as a piano-type hinge. Thus, the PDA is altered very simply by providing means by which a cellular telephone can be attached to the PDA. This enables the user to hold both the PDA and cellular telephone in one hand while manipulating the PDA or phone <b>190</b> as desired with the other hand. All of the telephone circuitry for phone <b>190</b> is housed within the phone itself, and there is no circuitry within the PDA which is used within the phone <b>190</b>.
P-0066[0066] The actual size of the phone <b>190</b> is smaller than the PDA <b>22</b>. However, in order to create a uniform edged combination, the phone <b>190</b> is housed in a larger housing <b>200</b> which essentially matches the dimensions of housing <b>24</b>. Additionally, a peripheral flange could be provided on the inner surface of housing <b>200</b> which comes into contact with housing <b>24</b> in the closed position of FIG. 6<i>a </i>which would prevent inadvertent activation of the control buttons on the PDA <b>22</b>.
P-0067[0067] Now referring to FIGS. 7 and 8, the second embodiment of the PDA is illustrated that utilizes a wireless camera module <b>10</b>′. As with the first embodiment, the camera module <b>10</b>′ is cylindrical shaped and can be stored within hole or orifice <b>35</b>. Thus, exteriorly, the PDA <b>22</b> appears the same, along with camera module <b>10</b>′ with the exception that there is no cable or cord interconnecting the camera module <b>10</b>′ to the PDA device <b>22</b>. Now also referring to FIGS. 8 and 8<i>a</i>, in lieu of a wired connection, the camera module <b>10</b>′ communicates with the PDA <b>22</b> by a transceiver radio element <b>91</b> which is mounted in the proximal end of the module <b>10</b>′. Similarly, the PDA <b>22</b> also includes its own transceiver radio module <b>85</b> which allows video signals transmitted by transceiver <b>91</b> to be received and then passed on to the video processor board <b>50</b> for further video signal processing, as necessary. Antennae <b>93</b> communicates with transceiver module <b>85</b> for enhancing reception of incoming video signals from the camera module <b>10</b>′. The camera module <b>10</b>′ also has its own antennae <b>81</b> which enhances reception for authenticating signals which may be transmitted by transceiver <b>91</b>. As understood by those skilled in the art, Bluetooth and other RF standards involve two-way communications whereby transmissions are authenticated and synchronized. Thus the transceiver module <b>85</b> whose main function is to receive a signal from the camera module <b>10</b>′, also transmits some signals to the camera module <b>10</b>′. Accordingly, the camera module also acts as a receiver to authenticate and receive such signals. The proximal end of the camera module <b>10</b>′ also includes a rechargeable battery <b>79</b> which is recharged when the module <b>10</b>′ is seated within the opening <b>35</b> of the PDA <b>22</b>. The battery <b>79</b> can be a common rechargeable nickel-cadmium or lithium-ion type battery. The battery <b>79</b> has a contact <b>77</b> protruding from the proximal tip of the camera module <b>10</b>′. The deepest portion of chamber/opening <b>35</b> also has a contact <b>87</b> (shown schematically in FIG. 8) which makes contact with contact <b>77</b> when the camera module <b>10</b>′ is placed in the chamber. Contact <b>87</b> electrically couples with camera battery charging circuit <b>95</b> which provides an electrical charge for recharging the battery <b>79</b>. When the camera module <b>10</b>′ is placed in the chamber <b>35</b>, the external housing or casing of the camera module <b>10</b>′ is electrically conductive and contacts a ground (not shown) such as spring loaded clip within the chamber <b>35</b>. Thus, recharge of the battery <b>79</b> can be accomplished.
P-0068[0068] As shown in FIG. 8, the charge circuit <b>95</b> receives power from power supply board <b>64</b>. Thus, the battery <b>62</b> of the PDA also provides recharging capability to the battery <b>79</b>.
P-0069[0069] The operation of the PDA is essentially the same in the second embodiment. If the user desires to transmit video images to another party, the user would grasp the camera module <b>10</b>′, remove it from chamber <b>35</b>, and then point it at the target. The camera module <b>10</b>′ collects the video images through the objective lens group <b>18</b> which conditions images received by the image sensor <b>40</b>. The plurality of conductors housed in the shielded miniature cable <b>21</b> transfers the video signals to the transceiver radio element <b>91</b>. The transceiver radio element <b>91</b>, among other functions, adds a high frequency carrier signal and base band protocol to the video signal which is then transmitted to the transceiver radio module <b>85</b>. The video signal transmitted by the transceiver radio element <b>91</b> is authenticated by the transceiver radio module <b>85</b>, the video signal is stripped of its carrier, and then routed by a link controller (not shown as a separate element apart from transceiver <b>85</b>) to the video processor circuitry <b>50</b>. The video signal is then handled in the same manner as the first embodiment. The user would depress the video switch <b>37</b> to initiate transmission of the video to the other party of the telephone call. Once the camera module <b>10</b>′ is removed from its seated position in the chamber <b>35</b>, the contact between contacts <b>77</b> and <b>87</b> is broken. This break in electrical contact would allow the battery <b>79</b> to energize the camera module <b>10</b>′, and thus allow the camera module <b>10</b>′ to begin wirelessly communicating with the transceiver radio module <b>85</b> . The user would be able to easily hold and point the camera module <b>10</b>′ with one hand, while operating the PDA <b>22</b> in the other hand. As with the first embodiment, the video monitor <b>26</b> would display the video images simultaneously while video images were being transmitted to the other party so long as video switch <b>37</b> was depressed. If the user wished to receive video images transmitted from the other party, the user would simply reset the video switch <b>37</b> to its off or inactive state. The camera module <b>10</b>′ would continue to shoot video and communicate with the module <b>85</b>; however, the video images would not be seen on screen <b>26</b>. Again as with the first embodiment, a remote video device <b>60</b> could receive video images and remotely display and record the same.
P-0070[0070] Although FIG. 8 illustrates the video processor board <b>50</b> located within the PDA <b>22</b>, the video processor board <b>50</b> may alternatively be co-located with the imaging device <b>40</b> within the distal tip of the camera module <b>10</b>′. Accordingly, all necessary aid video processing may take place within the camera module and the video signal which would be transmitted by the radio transceiver element <b>91</b> is a post video signal which is ready for viewing by either the video monitor <b>26</b>, or the remote video device <b>60</b> once the transceiver radio module <b>85</b> receives, authenticates, and strips the video signal of its carrier frequency as transmitted by the radio transceiver element <b>91</b>.
P-0071[0071]FIG. 9 is a schematic diagram illustrating one way in which the imaging device <b>11</b> may be constructed. As illustrated, the image sensor <b>40</b> may include the timing and control circuits on the same planar structure. Power is supplied to image sensor <b>40</b> by power supply board <b>64</b>. The connection between image sensor <b>40</b> and board <b>64</b> may simply be a cable having two conductors therein, one for ground and another for transmitting the desired voltage. These are illustrated as conductors <b>44</b> and <b>46</b>. The output from image sensor <b>40</b> in the form of the pre-video signal is input to video processor board <b>50</b> by means of the conductor <b>48</b>. In the configuration of FIG. 7, conductor <b>48</b> may simply be a 50-ohm conductor. Power and ground also are supplied to video processing board <b>50</b> by conductors <b>44</b> and <b>46</b> from power supply board <b>52</b>. The output signal from the video processor board <b>50</b> is in the form of the post-video signal and which may be carried by conductor <b>49</b> which can also be a 50 ohm conductor. As discussed above with respect to the second embodiment, in lieu of a hard wired connection by conductors <b>48</b> and <b>49</b>, the pre-video or post-video signal is transmitted wirelessly to the transceiver radio module <b>85</b>.
P-0072[0072] Although FIG. 9 illustrates the image sensor and the timing and control circuits being placed on the same circuit board or planar structure, it is possible to separate the timing and control circuits from the pixel array and place the timing and control circuits onto video processing board <b>50</b>. The advantage in placing the timing and control circuits on the same planar structure as the image sensor is that only three connections are required between image sensor <b>40</b> and the rest of the imaging device, namely, conductors <b>44</b>, <b>46</b> and <b>48</b>. Additionally, placing the timing and control circuits on the same planar structure with the pixel array results in the pre-video signal having less noise. Furthermore, the addition of the timing and control circuits to the same planar structure carrying the image sensor only adds a negligible amount of size to one dimension of the planar structure. If the pixel array is to be the only element on the planar structure, then additional connections must be made between the planar structure and the video processing board <b>50</b> in order to transmit the clock signals and other control signals to the pixel array. For example, a ribbon-type cable (not shown) or a plurality of 50-ohm coaxial cables (not shown) must be used in order to control the downloading of information from the pixel array. Each of these additional connections would be hard wired between the boards.
P-0073[0073]FIG. 9<i>a </i>is a more detailed schematic diagram of image sensor <b>40</b> which contains an array of pixels <b>90</b> and the timing and control circuits <b>92</b>. One example of a pixel array <b>90</b> which can be used within the invention is similar to that which is disclosed in U.S. Pat. No. 5,471,515 to Fossum, et al., said patent being incorporated by reference herein. More specifically, FIG. 3 of Fossum, et al. illustrates the circuitry that makes up each pixel in the array of pixels <b>90</b>. The array of pixels <b>90</b> as described in Fossum, et al. is an active pixel group with intra-pixel charged transfer. The image sensor made by the array of pixels is formed as a monolithic complementary metal oxide semiconductor (CMOS) integrated circuit which may be manufactured in an industry standard complementary metal oxide semiconductor process. The integrated circuit includes a focal plane array of pixel cells, each one of the cells including a photo gate overlying the substrate for accumulating the photo generated charges. In broader terms, as well understood by those skilled in the art, an image impinges upon the array of pixels, the image being in the form of photons which strike the photo diodes in the array of pixels. The photo diodes or photo detectors convert the photons into electrical energy or electrons which are stored in capacitors found in each pixel circuit. Each pixel circuit has its own amplifier which is controlled by the timing and control circuitry discussed below. The information or electrons stored in the capacitors is unloaded in the desired sequence and at a desired frequency, and then sent to the video processing board <b>50</b> for further processing.
P-0074[0074] Although the active pixel array disclosed in U.S. Pat. No. 5,471,515 is mentioned herein, it will be understood that the hybrid CCD/CMOS described above, or any other solid state imaging device may be used wherein timing and control circuits can be placed either on the same circuit board or planar structure with the pixel array, or may be separated and placed remotely. Furthermore, it will be clearly understood that the invention claimed herein is not specifically limited to an image sensor as disclosed in the U.S. Pat. No. 5,471,515, but encompasses any image sensor which may be configured for use in conjunction with the other processing circuitry which makes up the imaging device of this invention.
P-0075[0075] To summarize the different options available in terms of arrangement of the components of the imaging device <b>11</b>, the array of pixels <b>90</b> of the image sensor <b>40</b> may be placed alone on a first plane, or the timing and control circuitry <b>92</b> may be placed with the array of pixels <b>90</b> on the first plane. If the timing and control circuitry <b>92</b> is not placed with the array of pixels <b>90</b> on the first plane, the timing and control circuitry <b>92</b> may be placed by itself on a second plane, or the timing and control circuitry <b>92</b> may be placed on a second plane with some or all of the processing circuitry from video processing board <b>50</b>. The video processing board <b>50</b> itself may be placed on one or more planes on corresponding circuit boards containing video processing circuitry. FIG. 1<i>a </i>illustrates a single video processor board <b>50</b> located directly behind image sensor <b>40</b>; however, it shall be understood that additional circuit boards containing additional circuitry may be placed behind the image sensor <b>40</b> and behind the video processing board <b>50</b>. Some or all of the video processing circuitry may be placed within the camera module <b>10</b> near the distal end thereof adjacent the image sensor <b>40</b>. Video processing circuitry which is not placed within the distal end of the camera module <b>10</b> may be placed within the housing <b>24</b> of the PDA. If video processing circuitry is placed near the distal end of the camera module <b>10</b>, it is preferable to arrange the video processing circuitry in a stacked relationship behind the image sensor <b>40</b>. Additionally, it is preferable to place the processing circuitry in a parallel arrangement with respect to image sensor <b>40</b> and to center such video processing circuitry along axis X-X in order to minimize the size of camera module <b>10</b>.
P-0076[0076] The timing and control circuits <b>92</b> are used to control the release of the image information or image signal stored in the pixel array. In the image sensor of Fossum, et al., the pixels are arranged in a plurality of rows and columns. The image information from each of the pixels is first consolidated in a row by row fashion, and is then downloaded from one or more columns that contain the consolidated information from the rows. As shown in FIG. 9<i>a</i>, the control of information consolidated from the rows is achieved by latches <b>94</b>, counter <b>96</b>, and decoder <b>98</b>. The operation of the latches, counter and decoder is similar to the operation of similar control circuitry found in other imaging devices. That is, a latch is a means of controlling the flow of electrons from each individual addressed pixel in the array of pixels. When a latch <b>94</b> is enabled, it will allow the transfer of electrons to the decoder <b>98</b>. The counter <b>96</b> is programmed to count a discrete amount of information based upon a clock input from the timing and control circuits <b>92</b>. When the counter <b>96</b> has reached its set point or overflows, the image information is allowed to pass through the latches <b>94</b> and be sent to the decoder <b>98</b> which places the consolidated information in a serial format. Once the decoder <b>98</b> has decoded the information and placed it in the serial format, then the row driver <b>100</b> accounts for the serial information from each row and enables each row to be downloaded by the column or columns. In short, the latches <b>94</b> will initially allow the information stored in each pixel to be accessed. The counter <b>96</b> then controls the amount of information flow based upon a desired time sequence. Once the counter has reached its set point, the decoder <b>98</b> then knows to take the information and place it in the serial format. The whole process is repeated, based upon the timing sequence that is programmed. When the row driver <b>100</b> has accounted for each of the rows, the row driver reads out each of the rows at the desired video rate.
P-0077[0077] The information released from the column or columns is also controlled by a series of latches <b>102</b>, a counter <b>104</b> and a decoder <b>106</b>. As with the information from the rows, the column information is also placed in a serial format which may then be sent to the video processing board <b>50</b>. This serial format of column information is the pre-video signal carried by conductor <b>48</b>. The column signal conditioner <b>108</b> places the column serial information in a manageable format in the form of desired voltage levels. In other words, the column signal conditioner <b>108</b> only accepts desired voltages from the downloaded column(s).
P-0078[0078] The clock input to the timing and control circuits <b>92</b> may simply be a quartz crystal timer. This clock input is divided into many other frequencies for use by the various counters. The run input to the timing and control circuit <b>92</b> may simply be an on/off control. The default input can allow one to input the pre-video signal to a video processor board which may run at a frequency of other than 30 hertz. The data input controls functions such as zoom. At least for a CMOS type active pixel array which can be accessed in a random manner, features such as zoom are easily manipulated by addressing only those pixels which locate a desired area of interest by the user.
P-0079[0079] A further discussion of the timing and control circuitry which may be used in conjunction with an active pixel array is disclosed in U.S. Pat. No. 5,471,515 and is also described in an article entitled “Active Pixel Image Sensor Integrated With Readout Circuits” appearing in <i>NASA Tech Briefs</i>, October 1996, pp. 38 and 39. This particular article is also incorporated by reference.
P-0080[0080] Once image sensor <b>40</b> has created the pre-video signal, it is sent to the video processing board <b>50</b> for further processing. At board <b>50</b>, as shown in FIG. 9<i>b</i>, the pre-video signal is passed through a series of filters. One common filter arrangement may include two low pass filters <b>114</b> and <b>116</b>, and a band pass filter <b>112</b>. The band pass filter only passes low frequency components of the signal. Once these low frequency components pass, they are then sent to detector <b>120</b> and white balance circuit <b>124</b>, the white balance circuit distinguishing between the colors of red and blue. The white balance circuit helps the imaging device set its normal, which is white. The portion of the signal passing through low pass filter <b>114</b> then travels through gain control <b>118</b> which reduces the magnitude or amplitude of this portion to a manageable level. The output from gain control <b>118</b> is then fed back to the white balance circuit <b>124</b>. The portion of the signal traveling through filter <b>116</b> is placed through the processor <b>122</b>. In the processor <b>122</b>, the portion of the signal carrying the luminance or non-chroma is separated and sent to the Y chroma mixer <b>132</b>. Any chroma portion of the signal is held in processor <b>122</b>.
P-0081[0081] Referring to the output of the white balance circuit <b>124</b>, this chroma portion of the signal is sent to a delay line <b>126</b> where the signal is then further reduced by switch <b>128</b>. The output of switch <b>128</b> is sent through a balanced modulator <b>130</b> and also to the Y chroma mixer <b>132</b> where the processed chroma portion of the signal is mixed with the processed non-chroma portion. Finally, the output from the Y chroma mixer <b>132</b> is sent to the NTSC/PAL encoder <b>134</b>, commonly known in the art as a “composite” encoder. The composite frequencies are added to the signal leaving the Y chroma mixer <b>132</b> in encoder <b>134</b> to produce the post-video signal which may be accepted by a television. Additionally, the signal from Y chroma mixer <b>132</b> is sent to the digital signal processor <b>72</b> so those images can be viewed on monitor <b>26</b>.
P-0082[0082] In addition to the functions described above that are achieved by the digital signal processor <b>72</b>, the processor <b>72</b> can also provide additional digital enhancements. Specifically, digital enhancement can sharpen or otherwise clarify the edges of an image viewed on a video screen which might normally be somewhat distorted. Additionally, selected background or foreground images may be removed thus only leaving the desired group of images.
P-0083[0083] In addition to digital enhancement, the digital signal processor <b>72</b> can include other circuitry that may further condition the signal received from board <b>50</b> so that it may be viewed in a desired format other than NTSC/PAL. One common encoder which can be used would be an RGB encoder. An RGB encoder separates the signal into the three primary colors (red, green and blue). A SVHS encoder (super video home system) encoder could also be added to processor <b>72</b>. This type of encoder splits or separates the luminance portion of the signal and the chroma portion of the signal. Some observers believe that a more clear signal is input to the video device by such a separation, which in turn results in a more clear video image viewed on the video device. Another example of an encoder which could be added to processor <b>72</b> includes a VGA compatible encoder, which enables the video signal to be viewed on a standard VGA monitor which is common to many computer monitors.
P-0084[0084] One difference between the arrangement of image sensor <b>40</b> and the outputs found in FIG. 3 of the Fossum, et al. patent is that in lieu of providing two analog outputs [namely, VS out (signal) and VR out (reset)], the reset function takes place in the timing and control circuitry <b>92</b>. Accordingly, the pre-video signal only requires one conductor <b>48</b>.
P-0085[0085]FIGS. 10<i>a</i>-<b>10</b><i>e </i>illustrate in more detail one example of circuitry which may be used in the video processing board <b>50</b> in order to produce a post-video signal which may be directly accepted by a NTSC/PAL compatible video device such as a television. The circuitry disclosed in FIGS. 10<i>a</i>-<b>10</b><i>e </i>is very similar to circuitry that is found in a miniature quarter-inch Panasonic camera, Model KS-162. It will be understood by those skilled in the art that the particular arrangement of elements found in FIGS. 10<i>a</i>-<b>10</b><i>e </i>are only exemplary of the type of video processing circuitry which may be incorporated in order to take the pre-video signal and condition it to be received by a desired video device.
P-0086[0086] As shown in FIG. 10<i>a</i>, 5-volt power is provided along with a ground by conductors <b>44</b> and <b>46</b> to board <b>50</b>. The pre-video signal carried by conductor <b>48</b> is buffered at buffer <b>137</b> and then is transferred to amplifying group <b>138</b>. Amplifying group <b>138</b> amplifies the signal to a usable level as well as achieving impedance matching for the remaining circuitry.
P-0087[0087] The next major element is the automatic gain control <b>140</b> shown in FIG. 10<i>b</i>. Automatic gain control <b>140</b> automatically controls the signal from amplifying group <b>138</b> to an acceptable level and also adds other characteristics to the signal as discussed below. More specifically, automatic gain control <b>140</b> conditions the signal based upon inputs from a 12-channel digital to analog converter <b>141</b>. Converter <b>141</b> retrieves stored information from EEPROM (electrically erasable programmable read only memory) <b>143</b>. EEPROM <b>143</b> is a non-volatile memory element, which may store user information, for example, settings for color, tint, balance and the like. Thus, automatic gains controls <b>140</b> changes the texture or visual characteristics based upon user inputs. Housing <b>24</b> could also include buttons for controlling the image viewed on monitor <b>26</b> such as a gain control <b>140</b>. The signal leaving the automatic gain control <b>140</b> is an analog signal until being converted by analog to digital converter <b>142</b>.
P-0088[0088] Digital signal processor <b>144</b> of FIG. 10<i>c </i>further processes the converted signal into a serial type digital signal. One function of the microprocessor <b>146</b> is to control the manner in which digital signal processor <b>144</b> sorts the digital signals emanating from converter <b>142</b>. Microprocessor <b>146</b> also controls analog to digital converter <b>142</b> in terms of when it is activated, when it accepts data, when to release data, and the rate at which data should be released. Microprocessor <b>146</b> may also control other functions of the imaging device such as white balance. The microprocessor <b>146</b> may selectively receive the information stored in the EEPROM <b>143</b> and carry out its various commands to further control the other elements within the circuitry.
P-0089[0089] After the signal is processed by digital signal processor <b>144</b>, the signal is sent to digital encoder <b>148</b> illustrated in FIG. 10<i>d</i>. Some of the more important functions of digital encoder <b>148</b> are to encode the digital signal with synchronization, modulated chroma, blanking, horizontal drive, and the other components necessary so that the signal may be placed in a condition for reception by a video device such as a television monitor. As also illustrated in FIG. 10<i>d</i>, once the signal has passed through digital encoder <b>148</b>, the signal is reconverted into an analog signal through digital to analog converter <b>150</b>.
P-0090[0090] This reconverted analog signal is then buffered at buffers <b>151</b> and then sent to amplifier group <b>152</b> of FIG. 10<i>e </i>which amplifies the signal so that it is readily accepted by a desired video device. Specifically, as shown in FIG. 10<i>e</i>, one SVHS outlet is provided at <b>160</b>, and two composite or NTSC outlets are provided at <b>162</b> and <b>164</b>, respectively.
P-0091[0091] From the foregoing, it is apparent that an entire imaging device may be incorporated within the distal tip of the camera module, or may have some elements of the imaging device being placed in the housing of the PDA. Based upon the type of image sensor used, the profile area of the imaging device may be made small enough to be placed into a camera module which has a very small diameter.
P-0092[0092] This invention has been described in detail with reference to particular embodiments thereof, but it will be understood that various other modifications can be effected within the spirit and scope of this invention.
Contents5
15 sheets
Sheet 1 Sheet 2 Sheet 3 Sheet 4 Sheet 5 Sheet 6 Sheet 7 Sheet 8 Sheet 9 Sheet 10 Sheet 11 Sheet 12 Sheet 13 Sheet 14 Sheet 15
Every citation, both ways
| Document | Relation | Office | Cited during |
|---|---|---|---|
| US10912487B2 | Cited by | United States of America | Applicant |
| US2010279609A1 | Cited by | United States of America | Pre-grant |
| US2006088018A1 | Cited by | United States of America | Pre-grant |
| US8930727B1 | Cited by | United States of America | Applicant |
| US8810637B2 | Cited by | United States of America | Search report |
| US9980633B2 | Cited by | United States of America | Applicant |
| US2015111498A1 | Cited by | United States of America | Pre-grant |
| US12507906B2 | Cited by | United States of America | Applicant |
| US11766175B2 | Cited by | United States of America | Applicant |
| US2004067768A1 | Cited by | United States of America | Pre-grant |
| US2006094464A1 | Cited by | United States of America | Pre-grant |
| US10069561B2 | Cited by | United States of America | Search report |
| US2008255416A1 | Cited by | United States of America | Pre-grant |
| US10952593B2 | Cited by | United States of America | Applicant |
| US11179029B2 | Cited by | United States of America | Applicant |
| US6879842B2 | Cited by | United States of America | Applicant |
| US2012184814A1 | Cited by | United States of America | Pre-grant |
| US2006029008A1 | Cited by | United States of America | Pre-grant |
| US2008262304A1 | Cited by | United States of America | Pre-grant |
| US11601622B2 | Cited by | United States of America | Applicant |
| US10537234B2 | Cited by | United States of America | Applicant |
| US10791566B2 | Cited by | United States of America | Applicant |
| US11936466B2 | Cited by | United States of America | Applicant |
| US10701254B2 | Cited by | United States of America | Applicant |
| US2022236554A1 | Cited by | United States of America | Search report |
| US11496212B2 | Cited by | United States of America | Applicant |
| US12316437B2 | Cited by | United States of America | Applicant |
| US7541987B2 | Cited by | United States of America | Search report |
| US10980400B2 | Cited by | United States of America | Applicant |
| US6775560B2 | Cited by | United States of America | Applicant |
| US10205515B2 | Cited by | United States of America | Search report |
| US9461735B2 | Cited by | United States of America | Search report |
| US10582834B2 | Cited by | United States of America | Applicant |
| US2004177284A1 | Cited by | United States of America | Pre-grant |
| US10799089B2 | Cited by | United States of America | Search report |
| US2003224832A1 | Cited by | United States of America | Pre-grant |
| US10881272B2 | Cited by | United States of America | Applicant |
| US2019372662A1 | Cited by | United States of America | Search report |
| US9986895B2 | Cited by | United States of America | Applicant |
| US10880000B2 | Cited by | United States of America | Search report |
| US10874292B2 | Cited by | United States of America | Applicant |
| US2007057815A1 | Cited by | United States of America | Pre-grant |
| US7422523B2 | Cited by | United States of America | Search report |
| US2003236446A1 | Cited by | United States of America | Pre-grant |
| US2011085041A1 | Cited by | United States of America | Pre-grant |
| US11682682B2 | Cited by | United States of America | Applicant |
| US2017311777A1 | Cited by | United States of America | Search report |
| US11234611B2 | Cited by | United States of America | Applicant |
| US10383509B2 | Cited by | United States of America | Applicant |
| US7961150B2 | Cited by | United States of America | Applicant |
| US12150620B2 | Cited by | United States of America | Applicant |
| US10715248B2 | Cited by | United States of America | Search report |
| US8976767B2 | Cited by | United States of America | Applicant |
| US10750933B2 | Cited by | United States of America | Applicant |
| US9763566B2 | Cited by | United States of America | Applicant |
| US2012026377A1 | Cited by | United States of America | Pre-grant |
| US2008262297A1 | Cited by | United States of America | Pre-grant |
| US10749737B2 | Cited by | United States of America | Applicant |
| US2009184884A1 | Cited by | United States of America | Pre-grant |
| US2011037876A1 | Cited by | United States of America | Pre-grant |
| US7664815B2 | Cited by | United States of America | Search report |
| US11026565B2 | Cited by | United States of America | Applicant |
| US2011238977A1 | Cited by | United States of America | Pre-grant |
| US11241164B2 | Cited by | United States of America | Applicant |
| US2011300830A1 | Cited by | United States of America | Pre-grant |
| US2004088452A1 | Cited by | United States of America | Pre-grant |
| US2007282208A1 | Cited by | United States of America | Pre-grant |
| US11903564B2 | Cited by | United States of America | Applicant |
| US9907459B2 | Cited by | United States of America | Applicant |
| US2003016284A1 | Cited by | United States of America | Pre-grant |
| US12292563B2 | Cited by | United States of America | Search report |
| US2007238660A1 | Cited by | United States of America | Pre-grant |
| US10548025B2 | Cited by | United States of America | Applicant |
| US10426555B2 | Cited by | United States of America | Applicant |
| US2019372662A1 | Cited by | United States of America | Search report |
| US10321803B2 | Cited by | United States of America | Applicant |
| US11344189B2 | Cited by | United States of America | Applicant |
| US12399359B1 | Cited by | United States of America | Search report |
| US12100716B2 | Cited by | United States of America | Applicant |
| US2009247854A1 | Cited by | United States of America | Pre-grant |
| US9610133B2 | Cited by | United States of America | Search report |
| US9164271B2 | Cited by | United States of America | Search report |
| US2007038020A1 | Cited by | United States of America | Pre-grant |
| US10382122B2 | Cited by | United States of America | Search report |
| US10863894B2 | Cited by | United States of America | Applicant |
| US2025271656A1 | Cited by | United States of America | Search report |
| US2006143014A1 | Cited by | United States of America | Pre-grant |
| US7057639B2 | Cited by | United States of America | Applicant |
| WO2013119567A1 | Cited by | World Intellectual Property Organization (WIPO) | International search |
| US2008032627A1 | Cited by | United States of America | Pre-grant |
| US10070801B2 | Cited by | United States of America | Applicant |
| US7493500B2 | Cited by | United States of America | Search report |
| US7466909B2 | Cited by | United States of America | Search report |
| US9668639B2 | Cited by | United States of America | Applicant |
| US11253139B2 | Cited by | United States of America | Applicant |
| EP1765144A4 | Cited by | European Patent Office (EPO) | Search report |
| US10413165B2 | Cited by | United States of America | Applicant |
| US2004067769A1 | Cited by | United States of America | Pre-grant |
| US11109750B2 | Cited by | United States of America | Applicant |
| US11432715B2 | Cited by | United States of America | Applicant |
112 members in 8 offices; this record represents the family
Priority claims4
| Document | Office | Kind | Date |
|---|---|---|---|
| 94432297 | United States of America | A | |
| 17568598 | United States of America | A | |
| 49631200 | United States of America | A | |
| 63897600 | United States of America | A |
Members112
| Document | Office | Kind | |
|---|---|---|---|
| CA2301714A1 | Canada | A1 | |
| WO9918613A1 | World Intellectual Property Organization (WIPO) | A1 | |
| US5929901A | United States of America | A | |
| US5986693A | United States of America | A | |
| US6043839A | United States of America | A | |
| US6086528A | United States of America | A | |
| EP1029356A1 | European Patent Office (EPO) | A1 | |
| CA2345811A1 | Canada | A1 | |
| WO0108549A1 | World Intellectual Property Organization (WIPO) | A1 | |
| US6190877B1 | United States of America | B1 | |
| US6211904B1 | United States of America | B1 | |
| CA2301714C | Canada | C | |
| CA2395325A1 | Canada | A1 | |
| WO0148477A1 | World Intellectual Property Organization (WIPO) | A1 | |
| EP1117324A1 | European Patent Office (EPO) | A1 | |
| CA2368245A1 | Canada | A1 | |
| WO0156458A1 | World Intellectual Property Organization (WIPO) | A1 | |
| US6275255B1 | United States of America | B1 | |
| JP2001519610A | Japan | A | |
| US6310642B1 | United States of America | B1 | |
| US6316215B1 | United States of America | B1 | |
| US2001052930A1 | United States of America | A1 | |
| EP1164916A1 | European Patent Office (EPO) | A1 | |
| WO0205546A1 | World Intellectual Property Organization (WIPO) | A1 | |
| AU7004101A | Australia | A | |
| WO0215567A1 | World Intellectual Property Organization (WIPO) | A1 | |
| AU7004201A | Australia | A | |
| US2002067408A1 | United States of America | A1 | |
| US2002080248A1 | United States of America | A1 | |
| US2002089589A1 | United States of America | A1 | |
| US6424369B1 | United States of America | B1 | |
| US6452626B1 | United States of America | B1 | |
| US2002159948A1 | United States of America | A1 | |
| EP1254368A1 | European Patent Office (EPO) | A1 | |
| US2002163578A1 | United States of America | A1 | |
| US2002180867A1 | United States of America | A1 | |
| WO03015619A1 | World Intellectual Property Organization (WIPO) | A1 | |
| WO03019660A2 | World Intellectual Property Organization (WIPO) | A2 | |
| WO03019940A2 | World Intellectual Property Organization (WIPO) | A2 | |
| AU2001293121A1 | Australia | A1 | |
| AU2001293138A1 | Australia | A1 | |
| EP1300001A1 | European Patent Office (EPO) | A1 | |
| WO03030525A1 | World Intellectual Property Organization (WIPO) | A1 | |
| EP1310090A1 | European Patent Office (EPO) | A1 | |
| JP2003518626A | Japan | A | |
| WO03019940A3 | World Intellectual Property Organization (WIPO) | A3 | |
| JP2003521324A | Japan | A | |
| CA2432777A1 | Canada | A1 | |
| US2003235531A1 | United States of America | A1 | |
| EP1374912A1 | European Patent Office (EPO) | A1 | |
| EP1376125A1 | European Patent Office (EPO) | A1 | |
| CA2433114A1 | Canada | A1 | |
| JP2004512704A | Japan | A | |
| JP2004131467A | Japan | A | |
| WO03019660A8 | World Intellectual Property Organization (WIPO) | A8 | |
| US6750037B2 | United States of America | B2 | |
| US6753160B2 | United States of America | B2 | |
| JP2004188211A | Japan | A | |
| US2004202609A1 | United States of America | A1 | |
| US2004202610A1 | United States of America | A1 | |
| US2004202612A1 | United States of America | A1 | |
| JP2004536467A | Japan | A | |
| US6862036B2 | United States of America | B2 | |
| EP1376125B1 | European Patent Office (EPO) | B1 | |
| AT290690T | Austria | T | |
| ATE290690T1 | Austria | T1 | |
| CA2395325C | Canada | C | |
| DE60300369D1 | Germany | D1 | |
| EP1029356B1 | European Patent Office (EPO) | B1 | |
| DE69830921D1 | Germany | D1 | |
| EP1575092A2 | European Patent Office (EPO) | A2 | |
| US6982740B2 | United States of America | B2 | |
| US6982742B2 | United States of America | B2 | |
| US6984498B2 | United States of America | B2 | |
| US2006022234A1 | United States of America | A1 | |
| US7002621B2 | United States of America | B2 | |
| EP1300001B1 | European Patent Office (EPO) | B1 | |
| DE69830921T2 | Germany | T2 | |
| AT320693T | Austria | T | |
| ATE320693T1 | Austria | T1 | |
| US7030904B2 | United States of America | B2 | |
| DE60117989D1 | Germany | D1 | |
| EP1575092A3 | European Patent Office (EPO) | A3 | |
| US7067276B2 | United States of America | B2 | |
| EP1679083A2 | European Patent Office (EPO) | A2 | |
| EP1679083A3 | European Patent Office (EPO) | A3 | |
| EP1374912B1 | European Patent Office (EPO) | B1 | |
| AT336266T | Austria | T | |
| ATE336266T1 | Austria | T1 | |
| US7110808B2 | United States of America | B2 | |
| DE60307545D1 | Germany | D1 | |
| JP3842041B2 | Japan | B2 | |
| DE60117989T2 | Germany | T2 | |
| US2007043289A1 | United States of America | A1 | |
| JP2007116741A | Japan | A | |
| DE60307545T2 | Germany | T2 | |
| EP1575092B1 | European Patent Office (EPO) | B1 | |
| DE69839857D1 | Germany | D1 | |
| JP4312800B2 | Japan | B2 | |
| JP4488172B2 | Japan | B2 |
44 transactions on the USPTO file
Allowed after 1 non-final rejection.
- Non-final rejections
- 1
- Final rejections
- 0
- RCEs
- 0
- Appeals
- 0
Over time
Point at a mark for the transactionTransactions
| Event | Code | |
|---|---|---|
| Request for Trial Denied | – | |
| Request for Trial Denied | – | |
| Request for Trial Denied | – | |
| Petition Requesting Trial | – | |
| Petition Requesting Trial | – | |
| Petition Requesting Trial | – | |
| Mail Miscellaneous Communication to ApplicantMM327 | MM327 | |
| Miscellaneous Communication to Applicant - No Action CountM327 | M327 | |
| Recordation of Patent Grant MailedPGM/ | PGM/ | |
| Patent Issue Date Used in PTA CalculationAllowedPTAC | PTAC | |
| Issue Notification MailedAllowedWPIR | WPIR | |
| Dispatch to FDCD1935 | D1935 | |
| Application Is Considered Ready for IssuePILS | PILS | |
| Response to Reasons for AllowanceREAS | REAS | |
| Issue Fee Payment VerifiedN084 | N084 | |
| Issue Fee Payment ReceivedIFEE | IFEE | |
| Mail Notice of AllowanceAllowedMN/=. | MN/=. | |
| Notice of Allowance Data Verification CompletedAllowedN/=. | N/=. | |
| Case Docketed to Examiner in GAUDOCK | DOCK | |
| Reference capture on IDSRCAP | RCAP | |
| Information Disclosure Statement (IDS) Filed | – | |
| Information Disclosure Statement (IDS) Filed | – | |
| Date Forwarded to ExaminerFWDX | FWDX | |
| Reference capture on IDSRCAP | RCAP | |
| Information Disclosure Statement (IDS) Filed | – | |
| Information Disclosure Statement (IDS) Filed | – | |
| Response after Non-Final ActionA... | A... | |
| Request for Extension of Time - GrantedXT/G | XT/G | |
| Mail Non-Final RejectionNon-final rejectionMCTNF | MCTNF | |
| Non-Final RejectionNon-final rejectionCTNF | CTNF | |
| IFW TSS Processing by Tech Center CompleteTSSCOMP | TSSCOMP | |
| Reference capture on IDSRCAP | RCAP | |
| Information Disclosure Statement (IDS) Filed | – | |
| Information Disclosure Statement (IDS) Filed | – | |
| Case Docketed to Examiner in GAUDOCK | DOCK | |
| Application Dispatched from OIPEOIPE | OIPE | |
| Application Is Now CompleteCOMP | COMP | |
| Preliminary AmendmentA.PE | A.PE | |
| Reference capture on IDSRCAP | RCAP | |
| Information Disclosure Statement (IDS) Filed | – | |
| Information Disclosure Statement (IDS) Filed | – | |
| Correspondence Address ChangeC.AD | C.AD | |
| IFW Scan & PACR Auto Security Review | – | |
| Initial Exam Team nnIEXX | IEXX |
13 legal events, as the office reported them to INPADOC
Over the term
Point at a mark for the eventEvents
| Event | Code | |
|---|---|---|
| Reexamination decision: claims changed and/or cancelledREEXAMINATION CERTIFICATE; CLAIMS 22, 42, 58 AND 66 ARE CANCELLED. CLAIMS 1-21, 23-41, 43-57, 59-65 AND 67-83 WERE NOT REEXAMINED.LIMR | LIMR | |
| Request for reexamination filedRR | RR | |
| Aia trial proceeding filed before the patent and appeal board: inter partes reviewAppealIPR | IPR | |
| Aia trial proceeding filed before the patent and appeal board: inter partes reviewAppealIPR | IPR | |
| Aia trial proceeding filed before the patent and appeal board: inter partes reviewAppealIPR | IPR | |
| Fee paymentFPAY | FPAY | |
| AssignmentAS | AS | |
| AssignmentAS | AS | |
| Fee paymentFPAY | FPAY | |
| Fee paymentFPAY | FPAY | |
| Information on status: patent grantGrantedPATENTED CASESTCF | STCF | |
| AssignmentAS | AS | |
| AssignmentAS | AS |
Numbers
- Application
- 93599301
Titles
- English
- Hand-held computers incorporating reduced area imaging devices
Patent term adjustment
- A delay
- +786 daysthe office missed an examination deadline
- Applicant delay
- −60 days
- Net adjustment
- 726 days
Classification
- CPC, 19
- G06F1/1671
- A61B1/00016
- A61B1/00034
- A61B1/00048
- A61B1/00135
- A61B1/0051
- A61B1/05
- G06F1/1616
- G06F1/1626
- G06F1/1686
- G06F1/1698
- G06F3/005
- G06F2200/1634
- H04N7/142
- H04N23/555
- H04N23/51
- H04N23/66
- H04N25/76
- H10W90/00
- IPC, 8
- A61B1 005
- A61B1 05
- G06F1 16
- G06F3 00
- H01L25 16
- H04N5 225
- H04N5 232
- H04N7 14