Method for generating a 3D image dataset
Summary by NHIP
Remote 3D X-ray Reconstruction
The method generates a three-dimensional volume dataset from two-dimensional x-ray recordings transmitted from a remote imaging facility to a separate reconstruction center. Calibration of projection geometry occurs exclusively at the reconstruction center before generating the dataset, while a monetary charge is applied substantially contemporaneously with transmitting the final 3D volume back to the customer.
Claim Score by NHIP
Abstract
In a method for the generation of a 3D dataset from 2D x-ray datasets, the 2D data are forwarded from a customer to a 3D reconstruction center in which a calibration of the projection geometry ensues by means of a software package and/or a specialist. As a result a 3D volume dataset is calculates and made available to the customer.
Term
Term ended
Expired 6 December 2025, 0.8 years ago.
- Priority
- Filed
- Granted
- Expired
- Today
12 claims: 2 independent, 10 dependent
- 1Broadest claimClaim Score 28, narrow(NHIP)A method for generating a three-dimensional image dataset from a plurality of two-dimensional x-ray recordings, comprising the steps of:obtaining a plurality of 2D x-ray recordings of a subject, respectively at different projection directions, using an imaging facility at a first location without making a calibration from said 2D x-ray recordings of a projection geometry needed for generating a three-dimensional volume dataset from said 2D x-ray recordings, said 2D x-ray recordings being selected from the group consisting of visually observable 2D complete x-ray images from which a diagnosis of the subject can be made, and electronic data representing visually observable 2D complete x-ray images from which a diagnosis of the subject can be made;establishing a customer/service provider relationship between said imaging facility and a reconstruction center located remote from said first location by being physically and spatially unassociated with and separated from said first location and by being operable independently of said imaging facility, with said imaging facility as a customer and said reconstruction center as a service provider thereto;transmitting said plurality of 2D x-ray recordings from said first location to said reconstruction center at said second location;only at said reconstruction center, making said calibration from said 2D x-ray recordings of said projection geometry needed for generating said three-dimensional volume dataset from said 2D x-ray recordings and, using said calibration and said plurality of 2D x-ray recordings, generating a 3D volume dataset;transmitting said 3D volume dataset from said reconstruction center at said second location back to said first location;and substantially contemporaneously with transmitting said 3D volume dataset from said reconstruction center back to said first location, making a monetary charge to said imaging facility by said reconstruction center, based on said customer/service provider relationship, to require payment by said imaging facility to said reconstruction center at least for generating said 3D volume dataset.
- 12A method for generating a three-dimensional image dataset from a plurality of two-dimensional x-ray recordings, comprising the steps of:obtaining a plurality of 2D x-ray recordings of a subject, respectively at different projection directions, using an imaging facility at a first location without calibrating a projection geometry needed for generating a three-dimensional volume dataset from said plurality of 2D x-ray recordings, said 2D x-ray recordings being selected from the group consisting of visually observable 2D complete x-ray images from which a diagnosis of the subject can be made, and electronic data representing visually observable 2D complete x-ray images from which a diagnosis of the subject can be made;establishing a customer/service provider relationship between said imaging facility and a reconstruction center located remote from said first location by being physically and spatially unassociated with and separated from said first location and by being operable independently of said imaging facility, with said imaging facility as a customer and said reconstruction center as a service provider thereto;transmitting said plurality of 2D x-ray recordings from said first location to a reconstruction center at said second location;at said reconstruction center, automatically calibrating said projection geometry needed for generating said three-dimensional volume dataset from said plurality of 2D x-ray recordings and, using said projection geometry, calculating said 3D volume dataset from said plurality of two-dimensional x-ray recordings;transmitting said 3D volume dataset from said reconstruction center at said second location back to said first location;and substantially contemporaneously with transmitting said 3D volume dataset from said reconstruction center back to said first location, making a monetary charge to said imaging facility by said reconstruction center, based on said customer/service provider relationship, to require payment by said imaging facility to said reconstruction center at least for generating said 3D volume dataset.
Independent claims2
20 paragraphs in 3 sections, as filed
BACKGROUND OF THE INVENTION
00011. Field of the Invention
0002The invention concerns a method for generating a 3D dataset from 2D x-ray recordings that require elaborate calibrations of a C-arm system used to generate the 20 datasets. It is desirable for a reconstruction of this type to ensue on a standard computer that is networked with the x-ray installation, however, the 3D option is not available on many installations and an offline reconstruction cannot be done because no calibration data are available.
00032. Description of the Prior Art
0004Although methods exist to calculate the projection parameters from datasets obtained without calibration samples, they are not 100% dependable or may not be numerically possible under the circumstances, since the projections are recorded nonlinearly.
0005A Picture Archiving and Communication System (PACS) for the treatment of acquired image data and the visualization of volume date is described in the article “Three-Dimensional Medical Visualization Bound To Break The Limits Of Diagnostics And Treatment”, by Leslie Versweyveld, Virtual Medical World Monthly, May 2001. Visualization refers to a class of algorithms that allow image data to be visualized on a monitor. For example, a volume renderer forms a 3D volume that can then be presented on a 2D monitor from a 2D image.
SUMMARY OF THE INVENTION
0006An object of the invention is to provide a method for the reconstruction of a 3D dataset for users of simple C-arm systems that are not equipped to derive such a 3D volume dataset as needed from 2D x-ray recordings. As used herein, a U.S.P.Q.2d x-ray recording means the x-ray image itself or a dataset representing the image.
0007This object is achieved in accordance with the invention in a method wherein the 2D recordings from a customer are forwarded to a 3D reconstruction center, in which a calibration of the projection geometry ensues by means of a software package and/or by a specialist, and as a result a 3D volume dataset is calculated and made available to the customer.
0008By the inventive relocation of the generation of a 3D dataset to a suitably equipped reconstruction center, every user of a C-arm system can have such a 3D dataset prepared as needed without the expensive and elaborate installation for the generation of a 3D dataset, by the customer sending the 2D x-ray recordings to the reconstruction central in various manners. In addition to the possibility to burn the data on a CD and to forward this and, if necessary, the 2D x-ray recording itself, through the mail to the reconstruction central, it is especially practical for the customer to be connected to the reconstruction central via the Internet, so that the customer can electronically transmit 2D datasets and download the desired results via the Internet.
0009As used herein, reconstruction means a class of algorithms that calculate the original data (i.e. before the projection) from the projection data recorded from various directions. For example, the result of the 3D reconstruction from 2D projections is a volume dataset.
0010In addition to the possibility of the creation of a 3D volume (for example, in DICOM), the reconstruction center can create a video of the rendered dataset, or make specially rendered individual exposures of the 3D dataset available.
0011A software package and/or a specialist using this data effects a calibration of the project geometry in the reconstruction center, which can ensue in various manners:
DESCRIPTION OF THE PREFERRED EMBODIMENTS
0012Many physicians have, in their office or clinic, access to an x-ray imaging system which is capable of generating two-dimensional (2D) x-ray images or x-ray image datasets. For many everyday applications, such two dimensional x-ray images are sufficient for the physician's needs, however, occasionally the physician may have a need for making a diagnosis based on a three-dimensional image. Since a software package to produce such a three-dimensional image from multiple 2D projections is relatively expensive, it is not cost-justified for the physician to purchase such a package only for such occasional uses. In accordance with the invention, when the physician has a need for making a diagnosis based on a three dimensional image, the physician communicates multiple sets of 2D projection data, or possibly the x-ray images themselves, to a reconstruction center, which is remote from the location of the physician. The reconstruction center has the computational capability of generating a three-dimensional image from multiple 2D projection datasets. After the reconstruction center generates the three-dimensional image, the data representing this three-dimensional image are communicated back to the physician.
0013For generating the three-dimensional image, it is necessary to reference the respective 2D projections relative to each other, in terms of their spatial relationship (calibration). There are several techniques available for undertaking this step.
0014An autocalibration can ensue at the reconstruction center in such a manner that natural landmarks are automatically detected and point correspondences calculated with image processing methods (segmentation). The 3D coordinates of the points as well as the projection parameters (extrinsic and intrinsic camera parameters) are subsequently assessed.
0015In a further autocalibration, natural landmarks are manually detected and the point correspondences calculated with image processing methods (segmentation) at the reconstruction center. The 3D coordinates of the points as well as the projection parameters are again subsequently assessed.
0016In a third embodiment of an autocalibration, markers are applied to the patient when the 2D projections are obtained and these markers are automatically detected and the point correspondences calculated with image processing methods (segmentation) at the reconstruction center. The 3D coordinates of the points as well as the projection parameters (extrinsic and intrinsic camera parameters) are again subsequently assessed.
0017Calibration with a reference sample can also ensue, by a calibration sample with known 3D geometry being located together with the patient data in the exposure. The point features are automatically detected and the point correspondences are calculated. Again, the assessment of the project parameters ensues with known 3D geometry.
0018An advantage of the inventive method is that the customer is given the possibility to have a 3D volume dataset generated via the Internet, even without a 3D package. This is important for the presentation of interesting, scientific, and new medical applications. The inventive method, however, also will further the usage of 3D reconstruction from x-ray recordings, and enable wide as well as cost-effective applications. In addition, the inventive method provides the opportunity to effect a 3D reconstruction from projections that have been generated with installations of another provider.
0019The 3D reconstruction center that, as a matter of course, has a suitable accounting system at its disposal for use in conjunction with the creation of the 3D datasets, and that is paid by the customers for each download, can be, for example, a producer of x-ray devices that in this way offers its customers an inexpensive possibility for an expanded use of a simpler x-ray systems. Generally most doctors that employ C-arm systems wish to create such a 3D dataset in only a few instances, and as a result it is not cost-justified to install elaborate 3D software on a standard computer networked with the C-arm installation. The inventive method allows such physicians nevertheless to be able to obtain and use a 3D dataset when needed.
0020Although modifications and changes may be suggested by those skilled in the art, it is the intention of the inventors to embody within the patent warranted hereon all changes and modifications as reasonably and properly come within the scope of their contribution to the art.
Contents3
Every citation, both ways
| Document | Relation | Office | Cited during |
|---|---|---|---|
| US8532258B2 | Cited by | United States of America | Applicant |
| US2008186311A1 | Cited by | United States of America | Pre-grant |
| US2002085668A1 | Cites | United States of America | Search report |
| US2002122536A1 | Cites | United States of America | Search report |
| US2002151781A1 | Cites | United States of America | Search report |
| US2003156745A1 | Cites | United States of America | Search report |
| US2004030585A1 | Cites | United States of America | Search report |
| US4744029A | Cites | United States of America | Search report |
| US5482043A | Cites | United States of America | Search report |
| US5550376A | Cites | United States of America | Search report |
| US5558638A | Cites | United States of America | Search report |
| US5603323A | Cites | United States of America | Search report |
| US5655084A | Cites | United States of America | Search report |
| US5715823A | Cites | United States of America | Search report |
| US5807256A | Cites | United States of America | Search report |
| US5851186A | Cites | United States of America | Search report |
| US5949491A | Cites | United States of America | Search report |
| US5963613A | Cites | United States of America | Search report |
| US5976088A | Cites | United States of America | Search report |
| US5987519A | Cites | United States of America | Search report |
| US6050940A | Cites | United States of America | Search report |
| US6055487A | Cites | United States of America | Search report |
| US6081577A | Cites | United States of America | Search report |
| US6101407A | Cites | United States of America | Search report |
| US6118845A | Cites | United States of America | Search report |
| US6157853A | Cites | United States of America | Search report |
| US6259943B1 | Cites | United States of America | Search report |
| US6307914B1 | Cites | United States of America | Search report |
| US6683933B2 | Cites | United States of America | Search report |
| US6721590B2 | Cites | United States of America | Search report |
| US20020085668A1 | Cites | United States of America | Search report |
| US20020122536A1 | Cites | United States of America | Search report |
| US20020151781A1 | Cites | United States of America | Search report |
| US20030156745A1 | Cites | United States of America | Search report |
| US20040030585A1 | Cites | United States of America | Search report |
| “Three-Dimensional medical Visualisation Bound to Break The Limits Of Diagnostics and Treatment,” Versweyveld, Virtual Medical World Monthly, May 2001. | Non-patent | – | Third party observation |
| “Bildgebende Systeme für die Medizinische Diagnostik,” Morneburg, 1985, pp. 684-696. | Non-patent | – | Third party observation |
| “The Application Service Providers in Healthcare,” Emig et al, electromedica 69 (2001), vol. 1, pp. 2-4. | Non-patent | – | Third party observation |
| "Three-Dimensional medical Visualisation Bound to Break The Limits Of Diagnostics and Treatment," Versweyveld, Virtual Medical World Monthly, May 2001. | Non-patent | – | Applicant |
| "Bildgebende Systeme für die Medizinische Diagnostik," Morneburg, 1985, pp. 684-696. | Non-patent | – | Applicant |
| "The Application Service Providers in Healthcare," Emig et al, electromedica 69 (2001), vol. 1, pp. 2-4. | Non-patent | – | Applicant |
3 members in 2 offices
Priority claims2
| Document | Office | Kind | Date |
|---|---|---|---|
| 10227307 | Germany | – | |
| 10227307 | Germany | A |
Members3
| Document | Office | Kind | |
|---|---|---|---|
| DE10227307A1 | Germany | A1 | |
| US2004041807A1 | United States of America | A1 | |
| US7536040B2This record | United States of America | B2 |
54 transactions on the USPTO file
Allowed after 3 non-final rejections, 1 final rejection and 1 RCE.
- Non-final rejections
- 3
- Final rejections
- 1
- RCEs
- 1
- Appeals
- 0
Over time
Point at a mark for the transactionTransactions
| Event | Code | |
|---|---|---|
| Expire PatentEXP. | EXP. | |
| Recordation of Patent Grant MailedPGM/ | PGM/ | |
| Patent Issue Date Used in PTA CalculationAllowedPTAC | PTAC | |
| Issue Notification MailedAllowedWPIR | WPIR | |
| Dispatch to FDCD1935 | D1935 | |
| Application Is Considered Ready for IssuePILS | PILS | |
| Issue Fee Payment VerifiedN084 | N084 | |
| Issue Fee Payment ReceivedIFEE | IFEE | |
| Mail Notice of AllowanceAllowedMN/=. | MN/=. | |
| Notice of Allowance Data Verification CompletedAllowedN/=. | N/=. | |
| Case Docketed to Examiner in GAUDOCK | DOCK | |
| Date Forwarded to ExaminerFWDX | FWDX | |
| Response after Non-Final ActionA... | A... | |
| Mail Non-Final RejectionNon-final rejectionMCTNF | MCTNF | |
| Non-Final RejectionNon-final rejectionCTNF | CTNF | |
| Date Forwarded to ExaminerFWDX | FWDX | |
| Date Forwarded to ExaminerFWDX | FWDX | |
| Disposal for a RCE / CPA / R129AbandonedABN9 | ABN9 | |
| Request for Continued Examination (RCE)RCEX | RCEX | |
| Workflow - Request for RCE - BeginBRCE | BRCE | |
| Mail Examiner Interview Summary (PTOL - 413)MEXIN | MEXIN | |
| Examiner Interview Summary Record (PTOL - 413)EXIN | EXIN | |
| Mail Final Rejection (PTOL - 326)Final rejectionMCTFR | MCTFR | |
| Final RejectionFinal rejectionCTFR | CTFR | |
| Date Forwarded to ExaminerFWDX | FWDX | |
| Response after Non-Final ActionA... | A... | |
| Mail Non-Final RejectionNon-final rejectionMCTNF | MCTNF | |
| Non-Final RejectionNon-final rejectionCTNF | CTNF | |
| Date Forwarded to ExaminerFWDX | FWDX | |
| Case Docketed to Examiner in GAUDOCK | DOCK | |
| Case Docketed to Examiner in GAUDOCK | DOCK | |
| Affidavit(s) (Rule 131 or 132) or Exhibit(s) ReceivedAF/D | AF/D | |
| Response after Non-Final ActionA... | A... | |
| Mail Non-Final RejectionNon-final rejectionMCTNF | MCTNF | |
| Non-Final RejectionNon-final rejectionCTNF | CTNF | |
| Case Docketed to Examiner in GAUDOCK | DOCK | |
| Case Docketed to Examiner in GAUDOCK | DOCK | |
| Case Docketed to Examiner in GAUDOCK | DOCK | |
| IFW TSS Processing by Tech Center CompleteTSSCOMP | TSSCOMP | |
| Case Docketed to Examiner in GAUDOCK | DOCK | |
| Transfer Inquiry to GAUTI1050 | TI1050 | |
| Information Disclosure Statement consideredIDSC | IDSC | |
| Information Disclosure Statement (IDS) FiledM844 | M844 | |
| Information Disclosure Statement (IDS) FiledWIDS | WIDS | |
| Application Dispatched from OIPEOIPE | OIPE | |
| Application Is Now CompleteCOMP | COMP | |
| Additional Application Filing FeesADDFLFEE | ADDFLFEE | |
| A statement by one or more inventors satisfying the requirement under 35 USC 115, Oath of the ApplicOATHDECL | OATHDECL | |
| Notice Mailed--Application Incomplete--Filing Date AssignedINCD | INCD | |
| Cleared by OIPE CSRL194 | L194 | |
| Referred to Level 2 (LARS) by OIPE CSRL198 | L198 | |
| IFW Scan & PACR Auto Security ReviewSCAN | SCAN | |
| Request for Foreign Priority (Priority Papers May Be Included)RQPR | RQPR | |
| Initial Exam Team nnIEXX | IEXX |
8 legal events, as the office reported them to INPADOC
Over the term
Point at a mark for the eventEvents
| Event | Code | |
|---|---|---|
| Lapsed due to failure to pay maintenance feeLapsedFP | FP | |
| Information on status: patent discontinuationPATENT EXPIRED DUE TO NONPAYMENT OF MAINTENANCE FEES UNDER 37 CFR 1.362STCH | STCH | |
| Information on status: patent discontinuationPATENT EXPIRED DUE TO NONPAYMENT OF MAINTENANCE FEES UNDER 37 CFR 1.362STCH | STCH | |
| Lapse for failure to pay maintenance feesLapsedLAPS | LAPS | |
| Maintenance fee reminder mailedREMI | REMI | |
| AssignmentAS | AS | |
| Fee paymentFPAY | FPAY | |
| AssignmentAS | AS |
Numbers
- Publication
- 7536040
- Application
- 10465104
Titles
- English
- Method for generating a 3D image dataset
Patent term adjustment
- A delay
- +901 daysthe office missed an examination deadline
- Net adjustment
- 901 days
Classification
- CPC, 6
- G06T1/20
- G06T2211/428
- A61B90/36
- A61B2090/364
- A61B34/10
- G06T12/20
- IPC, 7
- G06K9 00
- A61B19 00
- G06T1 00
- G06T11 00
- G06T15 00
- G06T17 00
- H05G1 61