Stereovision guided laser drilling system
Abstract
A method for assisting the laser drilling of a hole in a part comprising the steps of providing a camera (35) mounted to the laser (13), providing a target hole ( 18) at a first position, capturing a first image of the target hole ( 18) at the first position with the camera (35), moving the target hole (18) to a second position and capturing a second image of the target hole (18), and computing a drilling location of the target hole (18) from the first image and the second image, said computed drilling location used to laser drill the target hole (18).

Term
Term ended
Projected expiry passed 29 September 2024, 2 years ago.
- Priority
- Filed
- Published
- Projected expiry
- Today
18 claims: 8 independent, 10 dependent
- 1A method for assisting the laser drilling of a hole in a part, comprising the steps of:providing a camera (35);providing a target hole (18) at a first position;capturing a first image of said target hole (18) at said first position with said camera (3 5);moving said target hole (18) to a second position and capturing a second image of said target hole (18);and computing a drilling location of said target hole (18) from said first image and said second image, said computed drilling location used to laser drill said target hole (18).
- 4The method of any preceding claim comprising the additional step of calibrating said camera (35).
- 6The method of any preceding claim wherein providing said target hole (18) comprises providing a part having at least one said target hole.
- 8The method of any preceding claim comprising the additional step of retrieving a nominal position of said target hole (18) from a storage medium;and moving said target hole (18) to said nominal position.
- 9The method of any preceding claim wherein computing said drilling location of said target hole (18) comprises using image processing software to locate an actual target hole location, and computing an offset between said actual target hole location and said nominal position.
- 10A method for assisting the laser drilling of a hole in a part, comprising the steps of:providing a camera (35);providing a target hole (18) at a first position;capturing a first image of said target hole (18) at said first position with said camera (35);positioning said target hole in a second position relative to said camera (35) and capturing a second image of said target hole (18);and computing a drilling location of said target hole (18) from said first image and said second image, said computed drilling location used to laser drill said target hole (18).
- 11A apparatus for laser drilling a hole in a part, comprising:a laser (13);a camera (35) mounted to said laser (13) for capturing a first image of a target hole (18) on a part at a first position and a second image of said target hole (18) at a second position;and means for computing a drilling location of said target hole (18) from said first image and said second image.
- 15A vision system, comprising:a single camera (35) to image a part;a fixture (19) for said part, said fixture (19) movable between a first position where said camera (35) can capture a first image of said part and a second position where said camera (35) can capture a second image of said part;and means for computing a location of a target (18) on said part from said first image and said second image.
Independent claims8
21 paragraphs in 4 sections, as filed
BACKGROUND OF THE INVENTION
(1) Field of the Invention
0001The present invention relates to an apparatus, and method for so using, for locating and finish drilling cooling holes using a stereovision guided laser drilling process.
(2) Description of the Related Art
0002In the turbine blades/vanes manufacturing process, the parts are first precision-cast and then the cooling holes are installed either by laser drilling or by electrical discharge machining (EDM). A method that casts the cooling holes at the time of casting the part, offers the advantage of process simplification with enhanced quality and precision. In addition, complex cooling hole schemes, such as shaped non-cylindrical holes with complex diffuser and metering section geometries, can be cast in by this process that are difficult to directly laser drill or EDM. However, even a high-precision casting process cannot fully cast the complete hole geometry due to the limitations of the casting process (cold shut, core mismatch, slag formation, etc.). These limitations result in partially cast holes - with most of the top portion of the hole geometry completely cast and the bottom portion of the hole geometry shut or plugged by debris or slag.
0003A CATSCAN system using Computer-aided Tomography, can give scanned slices of the part and by taking the scans very closely one can build up the inside and outside profiles of a part but this takes an inordinately long time to scan at the precision needed and also requires a separate radiation chamber. The evolving QMP (Quartz Micro Probing) system can locate the holes precisely but the rough locations must be known before hand. Also QMP takes a long time and cannot be mounted on the laser machine bed. 3D machine vision alternatives including structured light techniques, have proven difficult due to the depth or shallow angle of the cooling holes. What is therefore needed is an apparatus, and method for using the apparatus, which overcomes the shortcomings of the related art - capable of being mounted on the laser machine alongside the laser drill and with the necessary precision needed.
SUMMARY OF THE INVENTION
0004Accordingly, it is an object of the present invention to provide an apparatus, and method for so using, for locating and finish drilling cooling holes using a stereovision guided laser drilling process.
0005It is a further object of the present invention to provide a method for assisting the laser drilling of a hole in a part which comprises the steps of providing a camera mounted to the laser, providing a target hole at a first position, capturing a first image of the target hole at the first position with the camera, moving the target hole to a second position and capturing a second image of the target hole, and computing a drilling location of the target hole from the first image and the second image, the computed drilling location used to laser drill the target hole.
0006It is a further object of the present invention to provide an apparatus for laser drilling a hole in a part which comprises a laser, a target hole, a camera mounted to the laser for capturing a first image of a target hole on a part at a first position and a second image of the target hole at a second position, and means for computing a drilling location of the target hole from the first image and the second image.
0007It is a further object of the present invention to provide a vision system which comprises a single camera to image a part, a fixture for the part, the fixture movable between a first position where the camera can capture a first image of the part and a second position where the camera can capture a second image of the part, and means for computing a location of a target on the part from the first image and the second image.
BRIEF DESCRIPTION OF THE DRAWINGS
0008<ul id="ul0001" list-style="none" compact="compact"><li>FIG. 1 is a diagram of the laser drilling system of the present invention.</li><li>FIG. 2 is an illustration of the fixture and calibration target of the present invention FIG. 3 is an illustration of the calibration block of the present invention.</li></ul>
DETAILED DESCRIPTION
0009It is therefore an object of the present invention to teach a method for locating and finish drilling partially cast-in holes in a precision-cast part by a stereovision guided laser drilling process. The vision-guided system mounted, or attached, to the laser drilling machine locates the position of each hole and guides the laser drill to the position of each hole to fire the laser pulses to finish drill the partially drilled holes. In a preferred embodiment, the machined part is a turbine blade and the holes are shaped cooling holes. By "mounted" it is meant that the vision system moves in a coordinated manner with the laser drilling machine.
0010The embodiment described herein can use a single Black & White CCD Video Camera with the desired pixel resolution (.5 Mega pixel being the minimum; the higher the pixel resolution of the camera the more accurate the results) and a PC-based frame grabber. With reference to FIG. 1, there is illustrated one embodiment of the stereovision guided laser system of the present invention. As will be described more fully below, this single camera 35 is used to align the laser drilling system 13. In order to accomplish the alignment, it is necessary to calibrate the camera 35 after the camera 35 is mounted to the laser drilling system 13. The vision system hardware, consisting, in part, of the camera 35, is preferably mounted on laser machine slides, generally parallel to the laser axis and preferably offset by a few inches.
0011A camera calibration routine, running on control mechanism 12, calibrates the camera for the perspective transformation, scaling factors, radial lens distortion, and the transformation from the camera coordinate system, denoted by image pixels, to the machine coordinate system, comprising the three dimensional space through which the laser drilling equipment is manipulated. The laser drilling system 13, camera 35, and rotary mount are controlled by a control mechanism 12. Preferably, control mechanism 12 is an electronic computing drive. Control mechanism 12 could have a suitable processor capable of running computer programs, or applications, and have internal memory configured to store and retrieve electronic data from storage medium 14.
0012Binocular stereovision is the process by which three-dimensional structure is recovered from a pair of images of a scene taken from slightly different viewpoints. The difference in positions causes relative displacements or disparities that enable the depth to be calculated by triangulation. One of the major problems in stereovision is matching features in the two images. By focusing on one target hole 18 at a time and working in a known orientation, feature matching is accomplished in the present invention. Normally, two cameras provide the pair of images required for stereovision in a similar fashion to human vision. In the present invention, however, by moving the target hole 18 to two different positions, a single camera 35 is utilized to obtain a pair of images. This method eliminates the need for a second camera. In a preferred embodiment, the target hole 18 is fabricated into a part 15 forming a turbine blade. The camera must be calibrated after initial assembly of the device to provide a 3D-to-2D mapping for stereovision. With reference to FIG. 2, there is illustrated the calibration target 39 required for camera calibration. In a preferred embodiment, the calibration target 39 comprises a backlit glass plate containing a grid of black squares of known location. Any calibration target may be utilized which provides a plurality of targets of known location in two dimensions. A 3D-to-2D mapping is generated using pairs of known world coordinates and measured camera coordinates for each comer of each square. This 3D-to-2D mapping is preferably stored on storage medium 14 and is capable of being queried as necessary. Using this 3D-to-2D mapping, the stereovision algorithm of the present invention combines the camera coordinates for a feature from each of two images captured from different perspectives to generate a 3D coordinate of the feature in the drilling machine's 13 coordinate system. This calibration may be repeated as necessary should misalignment occur but is not required for continuous operation.
0013The camera coordinates of each feature, such as target hole 18 of a part 15, are located by capturing and processing two images of the feature at two different perspectives. In the preferred embodiment, the part is moved to produce the two perspectives, however the camera can be moved in other embodiments. The present invention utilizes image processing software running on control mechanism 12 to process each of the two digitized images. The image processing software scans both images with a set of various sized rectangular models using a normalized correlation approach. The rectangular models are a set of image templates with various sizes and aspect ratios. The set should contain enough variety of sizes and aspect ratios so that one rectangle in the set will always match a rectangular hole feature. In the preferred embodiment, the rectangle is white with a black background. Any pattern recognition approach which can detect the location of rectangular features may be substituted here. A good match with any of the rectangular models indicates that the rectangular section at the bottom of a target hole 18 has been located.
0014In the case where there is more than one hole in either image, the image processing software selects the one that is closest to the nominal location. Ideally, the nominal location of the target hole 18 is stored in an electronic format, such as a CAD file, in storage medium 14 and is retrieved by the control mechanism 12 of the present invention. Using the 3D-to-2D mapping, the camera coordinates from each comer of the rectangle forming the target hole are converted to machine coordinates of the actual target hole location. These comer locations are then used to generate a drilling location located in the middle of the comer locations. The physical offset between the camera and laser is ascertained as described below and is used to identify the nominal drilling location for the laser.
0015With continued reference to Fig. 1, there is illustrated in detail the manner in which the vision system of the present invention is set up. In a preferred embodiment, a five-axis laser 1 is used to form the drilling system 13. The laser 1 of the drilling system 13 is preferably held stationary while the part 15 is moved under (CNC) computer numerical control guided by control mechanism 12. Preferably, the part 15 is mounted on a fixture that can be translated in the three principal axis directions and, using a rotary mount 17 preferably comprising two rotary tables, can provide three rotational degrees of freedom. This fixture manipulates the part 15 to allow the camera 35 to take images of the part 15 from different perspectives. A fixture 19 mounted on the machine table provides the reference for mounting either the calibration block 41 or the fixture carrying the part 15. The calibration block 41 is illustrated in FIG. 3. Calibration block 41 has a tiny pinhole 47 that is used by the laser drilling system 13 for providing the alignment of the laser axis 49 with a laser beam emitted from said laser. The same calibration block 41 is used to align the camera 35 with the laser axis and for offset calculations between the laser drilling system and the camera. The calibration block 41 is designed to carry a calibration target 39, preferably a square grid block, as was described above.
0016Referring to FIG. 1, the camera 35 is mounted to the laser drilling system 13. The laser 1 is aligned using the calibration block 41. The laser beam is positioned such that it passes through the center of the 0.001" (0.025 mm) diameter alignment hole 47. The machine home position is then reset to this location. Next, the camera calibration target 39 is mounted to the calibration block and the camera is calibrated by moving the z-axis incrementally to several positions and processing the resulting square pattern image at each position. A 3D-to-2D mapping is generated using pairs of known world coordinates and measured camera coordinates for each comer of each square. This 3D-to-2D mapping is preferably stored on storage medium 14 and is capable of being queried as necessary. Next, the machine position is adjusted so that the camera 35 is focused on the front of the laser alignment hole 47 and the imaged hole is at the nominal position in the image.
0017Next the alignment hole is imaged and processed to determine the 2D camera coordinates of the alignment hole 47. The camera 35 is then displaced by approximately 0.1 inches (2.54 mm) to obtain the 2D camera coordinates of the alignment hole from a second position. The stereovision algorithm is then applied to obtain the alignment hole position in machine coordinates using the parameters from the camera calibration stored in storage medium 14. The offset between the camera 35 and laser home position is then computed and recorded from the machine axes values.
0018In actual operation the part 15 is attached to the fixture. A nominal laser-drilling program, running on control mechanism 12, is used to initially position each target hole 17 in front of the camera by adding the pre-calibrated offset between the camera and laser to each nominal target hole 17 drilling location. As noted, the nominal portion of the target hole is stored in an electronic format, or blueprint, and retrieved. Using the stereovision technique, the vision system computes the machine coordinates for each comer of the target hole. The drilling coordinates are then computed using these results. According to the blueprint, this location is the center of the comer hole radius tangent to one of the comers of the shaped diffuser target hole 17. The drilling coordinates are comprised of the nominal hole drilling location +/- an offset computed by the vision system based on the actual, observed position of each target hole. Once all the target holes are located by the vision system, a laser drilling program, running on control mechanism 12, is modified by subtracting the error offset for each hole from each programmed laser drilling location stored on storage medium 14. The laser then drills each target hole 17 by firing the required amount of pulses using the modified program.
0019It is apparent that there has been provided in accordance with the present invention an apparatus, and method for so using, for locating and finish drilling cooling holes using a stereovision guided laser drilling process which fully satisfies the objects, means, and advantages set forth previously herein. While the present invention has been described in the context of specific embodiments thereof, other alternatives, modifications, and variations will become apparent to those skilled in the art having read the foregoing description. Accordingly, it is intended to embrace those alternatives, modifications, and variations as fall within the broad scope of the appended claims.
Contents4
2 sheets
Sheet 1 Sheet 2
Every citation, both ways
| Document | Relation | Office | Category | Cited during | Relevant claims |
|---|---|---|---|---|---|
| EP2602433A1 | Cited by | European Patent Office (EPO) | – | Search report | – |
| US10678206B2 | Cited by | United States of America | – | Applicant | – |
| EP2492766A1 | Cited by | European Patent Office (EPO) | – | Search report | – |
| US9403245B2 | Cited by | United States of America | – | Applicant | – |
| EP2428765A1 | Cited by | European Patent Office (EPO) | – | Search report | – |
| EP1767743A1 | Cited by | European Patent Office (EPO) | – | Search report | – |
| US2015343566A1 | Cited by | United States of America | – | Search report | – |
| US8414264B2 | Cited by | United States of America | – | Applicant | – |
| WO2014116334A2 | Cited by | World Intellectual Property Organization (WIPO) | – | International search | – |
| US2015343566A1 | Cited by | United States of America | – | Search report | – |
| WO2014116334A3 | Cited by | World Intellectual Property Organization (WIPO) | – | International search | – |
| WO2007036437A1 | Cited by | World Intellectual Property Organization (WIPO) | – | International search | – |
| WO2012035060A1 | Cited by | World Intellectual Property Organization (WIPO) | – | International search | – |
| US4727471A | Cites | United States of America | XY | Search report | 15 |
| US5216808A | Cites | United States of America | A | Search report | 1,10,11,15 |
| US5216808A | Cites | United States of America | A | Search report | 1,10,11,15 |
| US5297238A | Cites | United States of America | A | Search report | 1-18 |
| US6380512B1 | Cites | United States of America | Y | Search report | 1-14,16-18 |
| US6723951B1 | Cites | United States of America | PX | Search report | 1,10,11,15 |
| US6723951B1 | Cites | United States of America | PX | Search report | 1,10,11,15 |
| WO9912082A1 | Cites | World Intellectual Property Organization (WIPO) | A | Search report | 1-18 |
| HANQI HUANG ET AL: "On vision-based robot calibration", SOUTHCON /94. CONFERENCE RECORD. ORLANDO, MAR. 29 - 31, 1994, NEW YORK, IEEE, US, 29 March 1994 (1994-03-29), pages 104 - 109, XP010158046, ISBN: 0-7803-9989-7 | Non-patent | – | – | Search report | – |
4 members in 3 offices; this record represents the family
Priority claims2
| Document | Office | Kind | Date |
|---|---|---|---|
| 674997 | United States of America | – | |
| 67499703 | United States of America | A |
Members4
| Document | Office | Kind | |
|---|---|---|---|
| US2005067394A1 | United States of America | A1 | |
| EP1520652A1This record | European Patent Office (EPO) | A1 | |
| JP2005103644A | Japan | A | |
| US6977356B2 | United States of America | B2 |
8 legal events, as the office reported them to INPADOC
Over the term
Point at a mark for the eventEvents
| Event | Code | |
|---|---|---|
| Application deemed to be withdrawnWithdrawn18D | 18D | |
| Information on the status of an ep patent application or granted ep patentGrantedSTATUS: THE APPLICATION IS DEEMED TO BE WITHDRAWNSTAA | STAA | |
| Designation fees paidAKX | AKX | |
| First examination report despatched17Q | 17Q | |
| Request for examination filed17P | 17P | |
| Designated contracting statesAK | AK | |
| Request for extension of the european patentAX | AX | |
| Public reference made under article 153(3) epc to a published international application that has entered the european phaseORIGINAL CODE: 0009012PUAI | PUAI |
Numbers
- Publication
- 1520652
- Application
- 42559856
Titles3
- German
- Stereooptisch gesteuertes System zum Laserbohren
- English
- Stereovision guided laser drilling system
- French
- Système de perçage au laser contrôlé par stéréo vision
Classification
- CPC, 6
- B23K26/382
- B23K26/04
- G05B2219/37555
- G05B2219/45139
- B23K26/389
- G06T7/80
- IPC, 5
- B23K26 04
- B23K26 38
- G05B19 19
- G06T7 00
- B23K26 00
Designated states33
- Contracting states, 28
- Austria
- Belgium
- Bulgaria
- Switzerland
- Cyprus
- Czechia
- Germany
- Denmark
- Estonia
- Spain
- Finland
- France
- United Kingdom
- Greece
- Hungary
- Ireland
- Italy
- Liechtenstein
- Luxembourg
- Monaco
- Netherlands (Kingdom of the)
- Poland
- Portugal
- Romania
and 4 moreShow fewer
- Sweden
- Slovenia
- Slovakia
- Türkiye
- Extension states, 5
- Albania
- Croatia
- Lithuania
- Latvia
- North Macedonia