Portable digital photographing system combining position navigation information and image information
Summary by NHIP
GPS Camera Positioning System
The apparatus combines position navigation data with captured images using a digital signal processing unit. A GPS, Galileo, or ground receiver feeds data to a processor that merges location, time, and position information with video or still images for display.
Claim Score by NHIP
Abstract
Taught is a portable digital photographing system combining position navigation information and image information, wherein the position navigation information and the captured image information is combined and processed by a digital signal processing unit. The combined information then is stored in a register and displayed through an interface circuit. The portable digital photographing system can merge the location, time, and position information into the image or video. In addition, an electronic map corresponding to a position navigation information can be displayed on a display monitor.

Term
4.2 yearsleft in the term
Expires 24 November 2030, including 975 days of term adjustment.
- Priority
- Filed
- Granted
- Today
- Expires
20 claims: 3 independent, 17 dependent
- 1Broadest claimClaim Score 76, broad(NHIP)A portable digital photographing and positioning apparatus for combining position navigation information and image information, comprising a portable digital photographing apparatus having a display screen;and a position information receiver for capturing position and navigation information;wherein the captured position and navigation information is displayed on said display screen.
- 16A portable digital photographing and positioning apparatus for combining position navigation information and image information, comprising a portable digital photographing apparatus having a display screen;a position information receiver for capturing position information at location of said portable digital photographing apparatus and for capturing navigation information around the location;and a position resolving and image digital signal processing unit;wherein said position resolving and image digital signal processing unit processes the position and navigation information received by said position information receiver, and outputs processed information to a register, an interface circuit, and/or said display monitor;and the portable digital photographing and positioning apparatus is loaded with an electronic map software, the position and navigation information is then displayed through said display screen in accordance with the correspondent electronic map.
- 20A portable digital photographing and positioning apparatus for combining position navigation information and image information, comprising a portable digital photographing apparatus having a display screen;a position information receiver for capturing position information at location of said portable digital photographing apparatus and for capturing navigation information around the location;and a position resolving and image digital signal processing unit;wherein said position resolving and image digital signal processing unit processes the position and navigation information received by said position information receiver;said position resolving and image digital signal processing unit processes the image information captured by said portable digital photographing apparatus;said position resolving and image digital signal processing unit combines the position and navigation information and the image information to obtain a combined information, and outputs processed information to a register, an interface circuit, and/or said display monitor;and the portable digital photographing and positioning apparatus is loaded with an electronic map software, the processed combined information is then displayed through said display screen in accordance with the correspondent electronic map.
Independent claims3
52 paragraphs in 4 sections, as filed
BACKGROUND OF THE INVENTION
1. Field of the Invention
The invention relates to the fields of electronic devices, digital home appliances, navigational positioning, electronic imaging, etc., and specifically, to a portable digital photographing system combining position navigation information and image information.
2. Description of the Related Art
Mobile camera phones, standalone digital cameras, and video recorders are ubiquitous in the modern world.
It is generally preferable to include location and time information with pictures or videos taken for future review, reference or description. On the other hand many camera users wish to obtain traffic and position information even when not taking pictures. However, conventional standalone digital cameras, and video recorders do not offer this function.
SUMMARY OF THE INVENTION
To realize the combination of position navigation function and portable digital photographing function, in one aspect of the invention, provided is a portable digital photographing system combining the position navigation information and the image information.
To achieve the objective of the invention, provided is a portable digital photographing system combining navigation information and image information, comprising: a portable digital photographing apparatus and a position information receiver capable of displaying the captured position information on the display screen of the portable digital photographing apparatus.
In certain embodiments of the invention, the position information receiver has or is combined with one or more functional units of a GPS receiver, or a Galileo receiver, or a ground positioning receiver.
In certain embodiments of the invention, the portable digital photographing apparatus is a portable digital camera or a portable digital video recorder.
In certain embodiments of the invention, the portable digital photographing system further comprises a position resolving and image digital signal processing unit.
In certain embodiments of the invention, position information received by the position information receiver is processed by the position resolving and image digital signal processing unit, and then is stored and output to an interface circuit and/or is displayed on the display screen of the portable digital photographing apparatus.
In certain embodiments of the invention, the position resolving and image digital signal processing unit processes the image information captured by the portable digital photographing apparatus; the processed image information is then stored and output to an interface circuit and/or is displayed on the display screen of the portable digital photographing apparatus.
In certain embodiments of the invention, the position resolving and image digital signal processing unit processes the position information received by the position information receiver and the image information captured by the portable digital photographing apparatus at the same time to get a combined information; the combined information is then stored and output to an interface circuit and/or is displayed on the display screen of the portable digital photographing apparatus.
In certain embodiments of the invention, the portable digital photographing system combining the position navigation information and image information also comprises a position and image information register, wherein the position and image information register stores the position information received by the position information receiver, the image information captured by the portable digital photographing apparatus, and/or the combined information from the position resolving and image digital signal processing unit.
In certain embodiments of the invention, the portable photographing apparatus comprises a camera head, an image signal processing circuit, an analog-to-digital converter, and a display monitor, wherein the position resolving and image digital signal processing unit is connected with the position information receiver, the analog-to-digital converter and the display monitor of the portable photographing apparatus.
In certain embodiments of the invention, the position resolving and image digital signal processing unit and the position and image information register are embedded inside of the position information receiver, wherein the position resolving and image digital signal processing unit is connected with the portable digital photographing apparatus via an interface circuit.
In certain embodiments of the invention, the position resolving and image digital signal processing unit and the position and image information register are embedded in the portable digital photographing apparatus, wherein the position resolving and image digital signal processing unit is connected with the position information receiver via an interface circuit.
In certain embodiments of the invention, the position resolving and image digital signal processing unit and the position and image information register can be combined as one independent module, wherein the independent module exchanges and processes data with the portable digital photographing apparatus and the position information receiver via an interface circuit.
In certain embodiments of the invention, the portable digital photographing system is loaded with electronic maps, wherein the position information received by the position information receiver can be displayed in accordance with the correspondent electronic map via the display screen of the portable digital photographing apparatus.
In certain embodiments of the invention, the position information receiver comprises further a 1 pps port (one pulse per second port) for providing 1 pps signal, wherein the 1 pps signal of the position information receiver serves as time synchronous clock for the portable digital photographing system.
In certain embodiments of the invention, the position resolving and image digital signal processing unit further comprises an encryption unit for encrypting data to avoid any unwanted data modification.
As a result, the invention provides the following general advantages: <ul><li id="ul0001-0001" num="0000"><ul><li id="ul0002-0001" num="0023">1) location, time, and position information is included with an image or video for future recall, review, or description;</li><li id="ul0002-0002" num="0024">2) navigation and position information is displayed in connection with electronic maps for transportation purposes;</li><li id="ul0002-0003" num="0025">3) the combination of the three processing units (position resolving, image digital signal processing, and encryption units) allows for unique functionality;</li><li id="ul0002-0004" num="0026">4) the application of 1 pps data allows the combination of high resolution images with location, time, and position information; and</li><li id="ul0002-0005" num="0027">5) location, time, and position information is combined with an image and encrypted to assure data safety.</li></ul></li></ul>
BRIEF DESCRIPTION OF THE DRAWINGS
<figref idrefs="DRAWINGS">FIG. 1</figref> illustrates a combined structure of a portable digital photographing system according to one embodiment of the invention;
<figref idrefs="DRAWINGS">FIG. 2</figref> is a schematic diagram of the portable digital photographing system according to a first embodiment of the invention;
<figref idrefs="DRAWINGS">FIG. 3</figref> is a schematic diagram of the portable digital photographing system according to a second embodiment of the invention; and
<figref idrefs="DRAWINGS">FIG. 4</figref> is a schematic diagram of the portable digital photographing system according to a third embodiment of the invention.
Legend: position resolving digital signal processor—a<b>1</b>; antenna—a<b>11</b>; radio frequency front end—a<b>12</b>; analog-to-digital converter—a<b>13</b>; received signal correlator—a<b>14</b>; position and image information register/position data register—a<b>15</b>; interface circuit—a<b>16</b>; position information receiver—a<b>101</b>; digital signal processing and controlling unit—b<b>1</b>; portable digital photographing apparatus—b<b>10</b>; camera head—b<b>11</b>; image signal processing circuit—b<b>12</b>; analog-to-digital converter—b<b>13</b>; data compression and expansion unit—b<b>14</b>; position and image information register—b<b>15</b>; interface circuit/interface circuit of information data—b<b>16</b>; display monitor—b<b>17</b>; portable digital photographing apparatus—b<b>101</b>; portable digital photographing apparatus—b<b>102</b>; position resolving and image digital signal processing unit—c<b>1</b>; independent module—c<b>10</b>; interface circuit connected with the position information receiver—c<b>11</b>; position and image information register—c<b>12</b>; and output interface circuit—c<b>13</b>; combined position and image information register of portable digital photographing apparatus and position information receiver—ab<b>15</b>; position resolving and image digital signal processing unit for both portable digital photographing apparatus and position information receiver—abc<b>1</b>; position resolving and image digital signal processing unit—ac<b>1</b>; position resolving and image digital signal processing unit—bc<b>1</b>.
DETAILED DESCRIPTION OF THE INVENTION
The portable digital photographing system combining position navigation information and image information comprises a portable digital photographing apparatus and a position information receiver capable of displaying captured position information on the display screen of the portable digital photographing apparatus. When photographing, the position information received by the position information receiver can be stored and displayed in the image or video taken by the portable digital photographing apparatus. The position information receiver has or is combined with one or more the functions of GPS receiver, Galileo receiver, or any other ground positioning receiver. The ground positioning receiver can be a receiver for receiving position information from a mobile phone cell, which is usually a simple position information. The portable digital photographing apparatus can be a portable digital camera or a portable digital video recorder.
The portable digital photographing system further comprises a position resolving and image digital signal processing unit. When the portable digital photographing system is being used as a navigation terminal, the position resolving and image digital signal processing unit processes the position information received by the position information receiver. The processed information then is stored and output to the interface circuit and/or is displayed on the display screen of the portable digital photographing apparatus.
When the portable digital photographing system is being used as a photographing terminal, the position resolving and image digital signal processing unit processes the image information received by the portable digital photographing apparatus, the processed information then is stored and output to the interface circuit and/or is displayed on the display screen of the portable digital photographing apparatus.
When the portable digital photographing system is being used as both navigation terminal and photographing terminal, the position resolving and image digital signal processing unit processes and integrates the position information received by the position information receiver and the image information captured by the portable digital photographing apparatus. The combined information then is stored and output to the interface circuit and/or is displayed on the display screen of the portable digital photographing apparatus.
The portable digital navigation photographing system combining position navigation information and image information is loaded with electronic maps. Therefore, the position information received by the position information receiver can be displayed on the display screen of the portable digital photographing apparatus in combination with the correspondent electronic map, so that the portable digital photographing system can be used as a portable navigation terminal.
<figref idrefs="DRAWINGS">FIG. 1</figref> illustrates the first embodiment of the portable digital photographing system, wherein the function of position navigation is added to the image or video taken by the portable digital camera or digital video recorder. With the powerful digital signal processing and controlling units, and by combining the digital position information and image information, the combined information containing all or part of the information of position, navigation, time, map information, and image information is stored in a high capacity register, and is then output via the information data interface circuit.
The combination processing of the portable digital photographing system is described hereinafter in more detail. When combining information, the light signal collected by the sensor of the camera head b<b>11</b> of the portable digital photographing apparatus is converted into a digital signal via analog-to-digital converter b<b>13</b> through the photoelectric converter circuit and image signal processing circuit b<b>12</b>. The digital signal is then transmitted to the position resolving and image digital signal processing unit abc<b>1</b> for both portable digital photographing apparatus and position information receiver via data compression and expansion circuit b<b>14</b>. After being mixed, filtered, and amplified by a converter of the radio frequency front end a<b>12</b>, the radio frequency position information signal received by the antenna all is converted into a digital signal via the analog-to-digital converter a<b>13</b>. Then, the digital signal is calculated by the received signal correlator a<b>14</b> so as to realize signal trapping, tracing, and position resolving with the position resolving and image digital signal processing unit abc<b>1</b>. Then, the signal processing unit abc<b>1</b> integrates the position information and image digital signal, stores the combined information in the position and image information register ab<b>15</b>, outputs it through the information data interface circuit b<b>16</b>, and at the same time, the combined information is displayed on the display monitor b<b>17</b>.
In a specific application, the combination of position information data with information on the electronic map can form characteristic information in the image or video. With the combination of position information data and the data information image of the electronic map, a name best reflecting the photographing location is selected and is combined automatically with the image information. For example, when photographing at the Beijing Tian'anmen Square, besides the time and geographic location, the wording “Tian'anmen Square” will also be displayed in the picture or video.
Besides, by utilizing its own display monitor of the portable digital camera or digital video recorder, the electronic map software can be loaded into the portable digital photographing system combining the position navigation information and image information. The correspondent electronic map in accordance with the position information received by the position information receiver can then be brought up by opening the electronic map function key of the apparatus, so that road traffic navigation and position information can be obtained.
In order to integrate accurately the position information and image information, time and sequence should be synchronized when processing and controlling the entire system signal. For this purpose, a precise time output port namely, the 1 pps data port, is set in the position information receiver. By utilizing the 1 pps port as the time synchronous clock, the relevant components and circuits of the entire apparatus can be controlled and the signal can be processed synchronously, so that precise time and location information can be included in the image or video information.
In certain special applications such as in police or exploration application, the content recorded by the portable photographing system of the invention should not be modified or changed. The content can be combined and encrypted in the position resolving and image information digital signal processing unit, so that any modification to the location, time, or position information of the image or video is prevented.
The portable digital photographing apparatus comprises but not limited to three processing units: the position resolving and image information digital signal processing unit; the combined information data register; and the interface circuit. The combined structure of the three combination processing units is shown in <figref idrefs="DRAWINGS">FIG. 1</figref>.
The image information of the portable digital photographing apparatus and the data information received by the position information receiver are combination processed in the position resolving and image information digital signal processing unit abc<b>1</b>, the combined information then is stored in the register ab<b>15</b>, output through the interface circuit b<b>16</b>, and displayed through the display monitor b<b>17</b>.
<figref idrefs="DRAWINGS">FIG. 2</figref> illustrates another embodiment of the portable digital photographing system combining position information and image information. Namely, the three combination processing units are embedded into the position information receiver.
When the three combination processing units are embedded in the position information receiver, the portable digital photographing system comprises a position information receiver a<b>101</b> and a portable photographing apparatus b<b>101</b>. The position information receiver a<b>101</b> comprises an antenna a<b>11</b>, a radio frequency front end a<b>12</b>, an analog-to-digital converter a<b>13</b>, a received signal correlator a<b>14</b>, a position resolving and image digital signal processing unit ac, a register a<b>15</b>, and an interface circuit a<b>16</b>. The portable photographing apparatus b<b>101</b> comprises a camera head b<b>11</b>, an image signal processing circuit b<b>12</b>, an analog-to-digital converter b<b>13</b>, a data compression and expansion b<b>14</b>, an image register b<b>15</b>, an interface circuit b<b>16</b>.
The position resolving and image information digital signal processing unit of the position navigation information and portable digital photographing apparatus, the correspondent data register, and the interface circuit are embedded in the position information receiver. Through the position resolving and image information digital signal processing unit ac, the position information and image information is combined, and is then stored in the register ab<b>15</b>. The combined information is then output through the information data interface circuit a<b>16</b>, and at the same time, the position information, image information, and/or the combined information is displayed or recorded through the display monitor.
<figref idrefs="DRAWINGS">FIG. 3</figref> illustrates another embodiment of the portable digital photographing system combining position information and image information. Namely, the three combination processing units are embedded into the portable digital photographing apparatus.
When the three combination processing units are embedded in the portable digital photographing apparatus, the portable digital photographing system comprises a position information receiver a<b>102</b> and a portable photographing apparatus b<b>102</b>. The position information receiver a<b>102</b> comprises an antenna all, a radio frequency front end a<b>12</b>, an analog-to-digital converter a<b>13</b>, a received signal correlator a<b>14</b>, a position resolving and image digital signal processing unit a<b>1</b>, a register a<b>15</b>, and an interface circuit a<b>16</b>. The portable photographing apparatus b<b>102</b> comprises a camera head b<b>11</b>, an image signal processing circuit b<b>12</b>, an analog-to-digital converter b<b>13</b>, a data compression and expansion b<b>14</b>, an image register b<b>15</b>, an interface circuit b<b>16</b>, and a position resolving and image digital signal processing unit bc<b>1</b>.
The position resolving and image information digital signal processing unit of the position navigation information and portable digital photographing apparatus, the correspondent position and image information register, and the interface circuit are embedded in the portable digital photographing apparatus. Through the position resolving and image information digital signal processing unit bc<b>1</b>, the position information and image information is combined, and then is stored in the register b<b>15</b>. The combined information is then output through the information data interface circuit b<b>16</b>, and at the same time, the position information, image information, and/or the combined information is displayed or recorded through the display monitor b<b>17</b>.
<figref idrefs="DRAWINGS">FIG. 4</figref> illustrates another embodiment of the portable digital photographing system combining position information and image information. Namely, the three combination processing units are combined as an independent module outside of the portable digital photographing apparatus and the position information receiver.
When the three combination processing units are combined as an independent module outside of the portable digital photographing apparatus and the position information receiver, the portable digital photographing system comprises a position information receiver a<b>10</b>, a portable photographing apparatus b<b>10</b>, and an independent module c<b>10</b>.
The position information receiver a<b>10</b> comprises an antenna all, a radio frequency front end a<b>12</b>, an analog-to-digital converter a<b>13</b>, a received signal correlator a<b>14</b>, a position resolving and image digital signal processing unit a<b>1</b>, a position data register a<b>15</b>, and an interface circuit a<b>16</b>. The portable photographing apparatus b<b>10</b> comprises a camera head b<b>11</b>, an image signal processing circuit b<b>12</b>, an analog-to-digital converter b<b>13</b>, a data compression and expansion b<b>14</b>, an image register b<b>15</b>, an interface circuit b<b>16</b>, and a digital signal processing and controlling unit b<b>1</b>. The independent module c<b>10</b> comprises a position resolving and image digital signal processing and controlling unit c<b>1</b>, an interface c<b>11</b> connected with the position information receiver, a combined position and image information register c<b>12</b>, and an output interface circuit c<b>13</b>.
The position resolving and image information digital signal processing unit c<b>1</b> of the position navigation information and portable digital photographing apparatus, the position and image information register c<b>12</b>, and the interface circuits c<b>1</b> and c<b>13</b> are combined as an independent module outside of the portable digital photographing apparatus and the position information receiver. Through the position resolving and image information digital signal processing unit c<b>1</b>, the position information and image information is combined, then is stored in the register c<b>12</b>, and is output through the information data interface circuit c<b>13</b>.
This invention is not to be limited to the specific embodiments disclosed herein and modifications for various applications and other embodiments are intended to be included within the scope of the appended claims. While this invention has been described in connection with particular examples thereof, the true scope of the invention should not be so limited since other modifications will become apparent to the skilled practitioner upon a study of the drawings, specification, and following claims.
All publications and patent applications mentioned in this specification are indicative of the level of skill of those skilled in the art to which this invention pertains. All publications and patent applications mentioned in this specification are herein incorporated by reference to the same extent as if each individual publication or patent application mentioned in this specification was specifically and individually indicated to be incorporated by reference.
Contents4
5 sheets
Sheet 1 Sheet 2 Sheet 3 Sheet 4 Sheet 5
Every citation, both ways
| Document | Relation | Office | Cited during |
|---|---|---|---|
| US2006066752A1 | Cites | United States of America | Search report |
| US2008295010A1 | Cites | United States of America | Search report |
| US5815411A | Cites | United States of America | Search report |
| US6525768B2 | Cites | United States of America | Search report |
| US6657661B1 | Cites | United States of America | Search report |
6 members in 4 offices
Priority claims8
| Document | Office | Kind | Date |
|---|---|---|---|
| 200710073659 | China | A | |
| 200710073659 | China | A | |
| 200810082450 | China | A | |
| 200810082450 | China | A | |
| 200710073659 | – | – | – |
| 200810082450 | – | – | – |
| CN2007173659 | – | – | – |
| CN2008182450 | – | – | – |
Members6
| Document | Office | Kind | |
|---|---|---|---|
| CN101272456A | China | A | |
| US2008231697A1 | United States of America | A1 | |
| WO2008116376A1 | World Intellectual Property Organization (WIPO) | A1 | |
| WO2008116376A8 | World Intellectual Property Organization (WIPO) | A8 | |
| JP2010534455A | Japan | A | |
| US8102420B2This record | United States of America | B2 |
35 transactions on the USPTO file
Allowed after 1 non-final rejection.
- Non-final rejections
- 1
- Final rejections
- 0
- RCEs
- 0
- Appeals
- 0
Over time
Point at a mark for the transactionTransactions
| Event | Code | |
|---|---|---|
| Recordation of Patent Grant MailedPGM/ | PGM/ | |
| Patent Issue Date Used in PTA CalculationAllowedPTAC | PTAC | |
| Email NotificationEML_NTR | EML_NTR | |
| Issue Notification MailedAllowedWPIR | WPIR | |
| Dispatch to FDCD1935 | D1935 | |
| Application Is Considered Ready for IssuePILS | PILS | |
| Issue Fee Payment VerifiedN084 | N084 | |
| Issue Fee Payment ReceivedIFEE | IFEE | |
| Electronic ReviewELC_RVW | ELC_RVW | |
| Email NotificationEML_NTF | EML_NTF | |
| Mail Notice of AllowanceAllowedMN/=. | MN/=. | |
| Notice of Allowance Data Verification CompletedAllowedN/=. | N/=. | |
| Date Forwarded to ExaminerFWDX | FWDX | |
| Response after Non-Final ActionA... | A... | |
| Electronic ReviewELC_RVW | ELC_RVW | |
| Email NotificationEML_NTF | EML_NTF | |
| Mail Non-Final RejectionNon-final rejectionMCTNF | MCTNF | |
| Non-Final RejectionNon-final rejectionCTNF | CTNF | |
| Case Docketed to Examiner in GAUDOCK | DOCK | |
| Case Docketed to Examiner in GAUDOCK | DOCK | |
| Case Docketed to Examiner in GAUDOCK | DOCK | |
| Case Docketed to Examiner in GAUDOCK | DOCK | |
| Email NotificationEML_NTR | EML_NTR | |
| PG-Pub Issue NotificationPG-ISSUE | PG-ISSUE | |
| Request for Foreign Priority (Priority Papers May Be Included)RQPR | RQPR | |
| Case Docketed to Examiner in GAUDOCK | DOCK | |
| IFW TSS Processing by Tech Center CompleteTSSCOMP | TSSCOMP | |
| Application Dispatched from OIPEOIPE | OIPE | |
| Email NotificationEML_NTR | EML_NTR | |
| Filing ReceiptFLRCPT.O | FLRCPT.O | |
| Application Is Now CompleteCOMP | COMP | |
| Sent to Classification ContractorPGPC | PGPC | |
| Cleared by OIPE CSRL194 | L194 | |
| IFW Scan & PACR Auto Security ReviewSCAN | SCAN | |
| Initial Exam Team nnIEXX | IEXX |
4 legal events, as the office reported them to INPADOC
Over the term
Point at a mark for the eventEvents
| Event | Code | |
|---|---|---|
| Maintenance fee paymentMAFP | MAFP | |
| Maintenance fee paymentMAFP | MAFP | |
| Fee paymentFPAY | FPAY | |
| Information on status: patent grantGrantedPATENTED CASESTCF | STCF |
Numbers
- Publication
- 08102420
- Publication, DOCDB
- 8102420
- Publication, EPODOC
- US8102420
- Application
- 12053660
- Application, DOCDB
- 5366008
- Application, EPODOC
- US20080053660
Titles
- English
- Portable digital photographing system combining position navigation information and image information
Patent term adjustment
- A delay
- +795 daysthe office missed an examination deadline
- B delay
- +306 dayspendency past three years
- Overlap
- −126 daysdelays counted once
- Net adjustment
- 975 days
Classification
- CPC, 2
- H04N1/32106
- H04N2201/3253
- IPC, 2
- G06F12 00
- H04N7 18
- USPC, 1
- 348113000