Method and apparatus of automated optical container code recognition with positional identification for a transfer container crane
Abstract
This record has no abstract on file.
Term
Term ended
Projected expiry passed 9 April 2023, 3.5 years ago.
- Priority and filed
- Published
- Projected expiry
- Today
30 claims: 4 independent, 26 dependent
- 1Claims of equivalent WO 03087890 A2 Claims 1. An optical characteristic system providing container code recognition from a transfer container crane of a container identified by a container code to a container inventory management system, comprising:a computer communicatively coupled to at least two video imaging devices and controlled by a program system comprising program steps residing in a memory accessibly coupled to said computer;said video imaging device is mechanically coupled to said transfer container crane, for each of said video imaging devices;wherein said program system is further comprised ofthe program steps of: generating an optical characteristic of said container code based upon at least one of said video imaging devices;generating a positional identification of said container;and sending said optical characteristic of said container code and said positional identification of said container to said container inventory management system;wherein the program step generating said optical characteristic of said container code is comprised of at least one member ofthe collection comprising the program steps of: acquiring at least one container code image of a container representation of said container code imaged from said video imaging device;applying an optical character recognition process to said container code image to create an estimated container code;acquiring a first container code image from said video imaging device of said container representation of said container code;and compressing said first container code image to create said container code image;wherein each of said video imaging devices belongs to a collection comprising at least a video camera, a digital video camera, and a charged coupled array;wherein the program step generating said positional identification of said container is further comprised of at least one member of the collection comprising the program steps of: generating a loading-operation designation for said container;generating a storage-location designation for said container;and generating a terminal location for said transfer container crane;wherein the program step generating said loading-operation is further comprised of at least one member ofthe collection comprising the program steps of: receiving a locking indication from a programmable logic controller within said transfer container crane;and determining said locking indication from a relay network within said transfer container crane;wherein the program step generating said loading-operation is further comprised of at least one member ofthe collection comprising the program steps of: determining a container hoist position based upon sensing a gray-coded hoist shaft in said transfer container crane;and determining said container hoist position based upon sensing an ultrasonic transponder;and wherein the program step generating said loading-operation is further comprised of the program step of: generating said loading-operation designation based upon at least one member of the collection comprising said locking signal indication and said container hoist position;wherein the program step sending said optical characteristic and said positional identification, is comprised ofthe program steps of: sending a packet from a network to create a received packet;and creating said packet from at least part of at least one member of a sending-data collection;wherein said sending-data collection is comprised of said optical characteristic of said container code and said positional identification of said container;wherein said network employs at least one member of a physical transport collection in communicating from said transfer container crane to container inventory management system;wherein said physical transport collection is comprised of at least one wireline physical transport layer and at least one wireless physical transport layer.
- 2The apparatus of Claim 1, wherein the program step acquiring said container code image is further comprised ofthe at least one member ofthe collection comprising the program steps of:selecting a first of at least two of said video imaging devices;and acquiring said container code image from said first video imaging device of said container representation of said container code.
- 3The apparatus of Claim 1, wherein the program step generating said optical characteristic of said container code is further comprised ofthe program step of:processing said first container code image to create said container code image.
- 4The apparatus of Claim 3, further comprised of the program step of:receiving a modified container code image request;and wherein the program step processing said first container code image is further comprised ofthe program step of: processing said first container code image based upon said modified container code image request to create said container code image.
- 5The apparatus of Claim 1, wherein the program step generating said storage-location designation is further comprised the program step of:deriving said storage-location designation for said container at least in part from said terminal location for said transfer container crane;wherein the program step generating said terminal location for said transfer container crane is further comprised ofthe program step of: receiving a location reading from a Global Positioning System (GPS) receiver to create at least in part said terminal location for said transfer container crane;wherein said GPS receiver is mechanically coupled with said transfer container crane.
- 6The apparatus of Claim 1, wherein the program step sending said optical characteristic and said positional identification, is comprised of at least one member of the collection comprising the program steps of:writing said optical characteristic of said container code and said positional identification of said container to a removable non- volatile memory;writing at least one member of said sending-data collection to a file contained in said removable non- volatile memory;and writing at least one member of said sending-data collection to a record contained in said removable non- volatile memory.
- 7A method providing container code recognition from a transfer container crane of a container identified by a container code to a container inventory management system, comprising the steps of:generating an optical characteristic of said container code based upon at least one video imaging device mechanically coupled to said transfer container crane;generating a positional identification of said container;and sending said optical characteristic of said container code and said positional identification of said container to said container inventory management system;wherein the step generating said optical characteristic of said container code is comprised ofthe steps of: acquiring at least one container code image of a container representation of said container code imaged from said video imaging device;and applying an optical character recognition process to said container code image to create an estimated container code;acquiring a first container code image from said video imaging device of said container representation of said container code;and compressing said first container code image to create said container code image;wherein said video imaging device belongs to a collection comprising at least a video camera, a digital video camera, and a charged coupled array;wherein the step generating said positional identification of said container is further comprised of at least one member ofthe collection comprising the steps of: generating a loading-operation designation for said container;generating a storage-location designation for said container;and generating a terminal location for said transfer container crane;wherein the step generating said loading-operation is further comprised of at least one member ofthe collection comprising the steps of: receiving a locking indication from a programmable logic controller within said transfer container crane;and determining said locking indication from a relay network within said transfer container crane;wherein the step generating said loading-operation is further comprised of at least one member ofthe collection comprising the steps of: determining a container hoist position based upon sensing a gray-coded hoist shaft in said transfer container crane;and determining said container hoist position based upon sensing an ultrasonic transponder;and wherein the step generating said loading-operation is further comprised ofthe step of: generating said loading-operation designation based upon at least one member of the collection comprising said locking signal indication and said container hoist position.
- 8The method of Claim 7, wherein the step acquiring said container code image is further comprised of the at least one member ofthe collection comprising the steps of:selecting a first of at least two of said video imaging devices;and acquiring said container code image from said first video imaging device of said container representation of said container code.
- 9The method of Claim 7, wherein the step generating said optical characteristic of said container code is comprised of the step of:processing said first container code image to create said container code image.
- 10The method of Claim 9, further comprised ofthe step of:receiving a modified container code image request;and wherein the step processing said first container code image is further comprised of the step of: processing said first container code image based upon said modified container code image request to create said container code image.
- 11The method of Claim 7, wherein the step generating said storage-location designation is further comprised the step of:deriving said storage-location designation for said container at least in part from said terminal location for said transfer container crane;and wherein the step generating said terminal location for said transfer container crane is further comprised ofthe step of: receiving a location reading from a Global Positioning System (GPS) receiver to create at least in part said terminal location for said transfer container crane;wherein said GPS receiver is mechanically coupled with said transfer container crane.
- 12The method of Claim 7, wherein the step sending said optical characteristic and said positional identification, is comprised ofthe steps of:sending a packet from a network to create a received packet;and creating said packet from at least part of at least one member of a sending-data collection;wherein said sending-data collection is comprised of said optical characteristic of said container code and said positional identification of said container;wherein said network employs at least one member of a physical transport collection in communicating from said transfer container crane to container inventory management system;wherein said physical transport collection is comprised of at least one wireline physical transport layer and at least one wireless physical transport layer.
- 13The method of Claim 12, wherein the step sending said optical characteristic and said positional identification, is comprised of at least one member of the collection comprising the steps of:writing said optical characteristic of said container code and said positional identification of said container to a removable non- volatile memory;writing at least one member of said sending-data collection to a file contained in said removable non- volatile memory;and writing at least one member of said sending-data collection to a record contained in said removable non-volatile memory.
- 16The system of Claim 15, wherein at least one of said means of Claim 15 is comprised of at least one member ofthe collection comprising:an instruction processor, an inferential processor, a finite state machine, and a memory;wherein said instruction processor includes at least one member of the collection comprising: a Single Instruction Single Datapath (SISD) processor, a Single Instruction Multiple Datapath (SIMD) processor, a Multiple Instruction Single Datapath (MISD) processor, a Multiple Instruction Multiple Datapath (MIMD) processor, a Complex Instruction Set Computer (CISC), a Reduced Instruction Set Computer (RISC) and a Very Long Instruction Word (VLIW) computer;wherein said inferential processor includes at least one member of the collection comprising: a rule-based inferential processor, a constraint-based inferential processor, and a fuzzy logic engine;wherein said finite state machine includes at least one member of the collection comprising: at least part of a programmable logic device, at least part of an application specific integrated circuit;wherein said programmable logic device includes at least one member of the collection comprising: a Field Programmable Gate Array(FPGA), a Programmable Logic Device (PLD), a Complex Programmable Logic Device (CPLD);wherein said memory includes at least one member of the collection comprising: a volatile memory and a non- volatile memory;wherein said non-volatile memory includes at least one member of the collection comprising: a writeable non-volatile memory and a Read Only Memory (ROM);wherein said writeable non-volatile memory includes at least one member of the collection comprising: an electro-magnetically interfaced non-volatile memory and an optically interfaced non- volatile memory.
- 17An optical characteristic system providing container code recognition from a transfer container crane of a container identified by a container code to a container inventory management system, comprising:a computer communicatively coupled to at least one video imaging device and controlled by a program system comprising program steps residing in a memory accessibly coupled to said computer;said video imaging device is mechanically coupled to said transfer container crane, for each of said video imaging devices;wherein said program system is further comprised ofthe program steps of: generating an optical characteristic of said container code based upon at least one of said video imaging devices;generating a positional identification of said container;and sending said optical characteristic of said container code and said positional identification of said container to said container inventory management system;wherein the program step generating said optical characteristic of said container code is comprised of at least one member ofthe collection comprising the program steps of: acquiring at least one container code image of a container representation of said container code imaged from said video imaging device;applying an optical character recognition process to said container code image to create an estimated container code;acquiring a first container code image from said video imaging device of said container representation of said container code;and compressing said first container code image to create said container code image;wherein said video imaging device belongs to a collection comprising at least a video camera, a digital video camera, and a charged coupled array;wherein the program step generating said positional identification of said container is further comprised of at least one member of the collection comprising the program steps of: generating a loading-operation designation for said container;generating a storage-location designation for said container;and generating a terminal location for said transfer container crane;wherein the program step generating said loading-operation is further comprised of at least one member ofthe collection comprising the program steps of: receiving a locking indication from a programmable logic controller within said transfer container crane;and determining said locking indication from a relay network within said transfer container crane;wherein the program step generating said loading-operation is further comprised of at least one member ofthe collection comprising the program steps of: determining a container hoist position based upon sensing a gray-coded hoist shaft in said transfer container crane;and determining said container hoist position based upon sensing an ultrasonic transponder;and wherein the program step generating said loading-operation is further comprised of the program step of: generating said loading-operation designation based upon at least one member of the collection comprising said locking signal indication and said container hoist position.
- 18The apparatus of Claim 17, wherein the program step acquiring said container code image is further comprised ofthe at least one member ofthe collection comprising the program steps of:selecting a first of at least two of said video imaging devices;and acquiring said container code image from said first video imaging device of said container representation of said container code.
- 19The apparatus of Claim 17, wherein the program step generating said optical characteristic of said container code is further comprised ofthe program step of:processing said first container code image to create said container code image.
- 20The apparatus of Claim 19, further comprised ofthe program step of:receiving a modified container code image request;and wherein the program step processing said first container code image is further comprised ofthe program step of: processing said first container code image based upon said modified container code image request to create said container code image.
- 21The apparatus of Claim 17, wherein the program step generating said storage-location designation is further comprised the program step of:deriving said storage-location designation for said container at least in part from said terminal location for said transfer container crane;wherein the program step generating said terminal location for said transfer container crane is further comprised ofthe program step of: receiving a location reading from a Global Positioning System (GPS) receiver to create at least in part said terminal location for said transfer container crane;wherein said GPS receiver is mechanically coupled with said transfer container crane.
- 22The apparatus of Claim 17, wherein the program step sending said optical characteristic and said positional identification, is comprised ofthe program steps of:sending a packet from a network to create a received packet;and creating said packet from at least part of at least one member of a sending-data collection;wherein said sending-data collection is comprised of said optical characteristic of said container code and said positional identification of said container;wherein said network employs at least one member of a physical transport collection in communicating from said transfer container crane to container inventory management system;wherein said physical transport collection is comprised of at least one wireline physical transport layer and at least one wireless physical transport layer.
- 23The apparatus of Claim 22, wherein the program step sending said optical characteristic and said positional identification, is comprised of at least one member of the collection comprising the program steps of:writing said optical characteristic of said container code and said positional identification of said container to a removable non- volatile memory;writing at least one member of said sending-data collection to a file contained in said removable non-volatile memory;and writing at least one member of said sending-data collection to a record contained in said removable non- volatile memory.
- 24A method providing container code recognition from a transfer container crane of a container identified by a container code to a container inventory management system, comprising the steps of:generating an optical characteristic of said container code based upon at least two video imaging devices mechanically coupled to said transfer container crane;generating a positional identification of said container;and sending said optical characteristic of said container code and said positional identification of said container to said container inventory management system;wherein the step generating said optical characteristic of said container code is comprised ofthe steps of: acquiring at least one container code image of a container representation of said container code imaged from said video imaging device;and applying an optical character recognition process to said container code image to create an estimated container code;acquiring a first container code image from said video imaging device of said container representation of said container code;and compressing said first container code image to create said container code image;wherein each of said video imaging devices belongs to a collection comprising at least a video camera, a digital video camera, and a charged coupled array;wherein the step generating said positional identification of said container is further comprised of at least one member of the collection comprising the steps of: generating a loading-operation designation for said container;generating a storage-location designation for said container;and generating a terminal location for said transfer container crane;wherein the step generating said loading-operation is further comprised of at least one member ofthe collection comprising the steps of: receiving a locking indication from a programmable logic controller within said transfer container crane;and determining said locking indication from a relay network within said transfer container crane;wherein the step generating said loading-operation is further comprised of at least one member ofthe collection comprising the steps of: determining a container hoist position based upon sensing a gray-coded hoist shaft in said transfer container crane;and determining said container hoist position based upon sensing an ultrasonic transponder;and wherein the step generating said loading-operation is further comprised ofthe step of: generating said loading-operation designation based upon at least one member of the collection comprising said locking signal indication and said container hoist position;wherein the step sending said optical characteristic and said positional identification, is comprised ofthe steps of: sending a packet from a network to create a received packet;and creating said packet from at least part of at least one member of a sending-data collection;wherein said sending-data collection is comprised of said optical characteristic of said container code and said positional identification of said container;wherein said network employs at least one member of a physical transport collection in communicating from said transfer container crane to container inventory management system;wherein said physical transport collection is comprised of at least one wireline physical transport layer and at least one wireless physical transport layer.
- 25The method of Claim 24, further comprising the step of:receiving a modified container code image request;and wherein the step acquiring said container code image is further comprised of the at least one member ofthe collection comprising the steps of: selecting a first of at least two of said video imaging devices;and acquiring said container code image from said first video imaging device of said container representation of said container code;wherein the step generating said optical characteristic of said container code is comprised ofthe step of: processing said first container code image to create said container code image;and wherein the step processing said first container code image is comprised ofthe step of: processing said first container code image based upon said modified container code image request to create said container code image.
- 26The method of Claim 24, wherein the step generating said storage-location designation is further comprised the step of:deriving said storage-location designation for said container at least in part from said terminal location for said transfer container crane;and wherein the step generating said terminal location for said transfer container crane is further comprised ofthe step of: receiving a location reading from a Global Positioning System (GPS) receiver to create at least in part said terminal location for said transfer container crane;wherein said GPS receiver is mechanically coupled with said transfer container crane.
- 27The method of Claim 24, wherein the step sending said optical characteristic and said positional identification, is comprised of at least one member ofthe collection comprising the steps of:writing said optical characteristic of said container code and said positional identification of said container to a removable non- volatile memory;writing at least one member of said sending-data collection to a file contained in said removable non- volatile memory;and writing at least one member of said sending-data collection to a record contained in said removable non-volatile memory.
- 30The system of Claim 29, wherein at least one of said means of Claim 29 is comprised of at least one member of the collection comprising:an instruction processor, an inferential processor, a finite state machine, and a memory;wherein said instruction processor includes at least one member of the collection comprising: a Single Instruction Single Datapath (SISD) processor, a Single Instruction Multiple Datapath (SIMD) processor, a Multiple Instruction Single Datapath (MISD) processor, a Multiple Instruction Multiple Datapath (MIMD) processor, a Complex Instruction Set Computer (CISC), a Reduced Instruction Set Computer (RISC) and a Very Long Instruction Word (VLIW) computer;wherein said inferential processor includes at least one member of the collection comprising: a rule-based inferential processor, a constraint-based inferential processor, and a fuzzy logic engine;wherein said finite state machine includes at least one member of the collection comprising: at least part of a programmable logic device, at least part of an application specific integrated circuit;wherein said programmable logic device includes at least one member of the collection comprising: a Field Programmable Gate Array(FPGA), a Programmable Logic Device (PLD), a Complex Programmable Logic Device (CPLD);wherein said memory includes at least one member of the collection comprising: a volatile memory and a non- volatile memory;wherein said non-volatile memory includes at least one member of the collection comprising: a writeable non-volatile memory and a Read Only Memory (ROM);wherein said writeable non-volatile memory includes at least one member of the collection comprising: an electro-magnetically interfaced non-volatile memory and an optically interfaced non- volatile memory.
Independent claims30
209 paragraphs in 1 section, as filed
Description of equivalent WO 03087890 A2
0001METHOD AND APPARATUS OF AUTOMATED OPTICAL CONTAINER CODE RECOGNITION WITH POSITIONAL IDENTIFICATION FOR A TRANSFER CONTAINER
CRANE
0003Technical field
0004This invention relates to automated container code recognition for use on transfer container cranes providing container handling in cargo container storage yards.
0005Background Art
0006In the marine shipping industry, the expected annual container traffic growth is from 4.7% to 7.6%. Container terminals are faced with the challenge of maintaining the inventory control for these escalating numbers of containers. The input, ouput and storage of containers at these terminals must provide an efficiency level that is at least consistent with, or exceeds, past performance.
0007Present and future growth levels have compelled terminal management companies to look for new systems to bring about more efficient resource control and, as a consequence, provide a more profitable operation.
0008Shipping companies wish to reduce the time a ship spends at port in order to increase the productivity of each vessel. Increasing the productivity of berthing operations allows ships to be loaded and unloaded faster, effectively reducing the time spent at port.
0009What is needed by both terminal management and shipping companies is a more accurate, real time accounting of incoming, outgoing and existing container inventory. A more efficient container inventory management system is needed to minimize the time spent at a port or rail yard loading and unloading containers.
0010Figure 1 illustrates a typical berthing process, involving quay container cranes 2200, transports between quay container cranes 2200 and storage yards, and storage yard containers manipulated by transfer container cranes 2100, as found in the prior art.
0011The berthing operations involve the transport of containers between container ships and the storage yard. Currently, quay container cranes 2200 access the containers from above ships 220 and move them to and from transportation units 210, such as trucks, each with a chassis, or Automatically Guided Vehicles (AGN's). The vehicles deliver the containers to storage yards 200 where other vehicles transfer the containers to stacks. The berthing process involves three operations: (1) quay container crane 2200 handling, (2) quay container crane 2200 to storage area 200 transport, and (3) storage area 200 manipulation often by one or more transfer container cranes 2100 as illustrated in Figure 1.
0012Generally, there are two kinds of storage yards 200, wheeled storage yards 200 and stack (or ground) storage yards 200. For a wheeled storage yard 200, each container is on a chassis and there is only one container on a chassis. For a stack (or ground) storage yard 200, containers are stacked up to 5 levels high.
0013The quay container crane 2100 and transport vehicle 210 operations are highly interdependent. A delay in one operation causes the other to pause, reducing the overall productivity of the berthing process. If there are mistakes in these operations, then the overall berthing process is seriously delayed.
0014What is needed is a method for reducing errors and supporting efficient operation ofthe berthing process.
0015Figures 2A and 2B illustrate typical container codes and their representation on the side of a container as found in the prior art.
0016Each cargo container 100 is assigned a unique identification number 110 displayed on the sides and roof of the container. This identification number is represented in the form of a painted code and ID tag. Numerous government agencies and ship regulators require container codes on all containers. As a result, the painted container code representations of numerals and letters are used universally and internationally, as shown in Figures 2 A and 2B.
0017A magnetic tag is another prior art method assigning an identification number to a container. However, the magnetic tag method suffers from several problems. The magnetic tag method is not an international standard. Magnetic tags for containers are only installed by individual shipping line owners at their discretion. Not all container transporters support magnetic tags for their containers.
0018Additionally, a magnetic tag must pass in close proximity to a magnetometer in order for the magnetic tag to be read. The container passing the magnetometer can be outbound and inbound. Moreover, the magnetically tagged container can be moved anywhere. Magnetic tag reading provides no information about the container's physical location.
0019Another prior art alternative can identify containers from a distance. It is a technically more sophisticated and expensive system requiring a transponder tag attached to each container. The transponder tags can be programmed to show different kinds of information in the form of a coded signal when interrogated by a radio frequency transceiver. Such systems are expensive, delicate, and easily damaged.
0020Cargo containers are the individual property ofthe different shipping lines. When used by a non- owner shipping line, a container rental fee is paid to the owner. At the present time, the shipping companies only know the size of each container and whether it is dry or refrigerated.
0021A cargo container can become lost for several reasons. Inadvertently, a container is misplaced in a different location (yard address). Sometimes a container crane operator leaves a container at the wrong address, causing the container to be lost. A computer tracking the containers parked in a container terminal storage area will have an error in the container's tracking data. As a result, the lost container is effectively invisible to the existing container terminal management system (CTMS). While this is usually discovered eventually, the container is inevitably lost for a certain time.
0022A cargo container can become lost when the container ID number is incorrectly input into the CTMS. A cargo container can become lost when the container ID number is unreadable due to dirt, scratches, being covered, or an incorrect label on the container.
0023Any of these errors can result in disruptions of the inventory database. In addition, these errors become particularly serious when one attempts to place a second container into a supposedly vacant location only to find the location is already occupied, which further results in time consuming interruptions. What is needed is an efficient way to track all the containers and update an inventory database. What is further needed is an efficient way to track all containers in both wheeled storage yards and stack storage yards.
0024It can take a week in a major container storage yard to find a lost container. This can delay a ship's departure and/or the container's delivery to its destination. Either and/or both delays cost the shipping companies money. Today, there is a large turnover of cargo containers in the seaports. This cargo turnover makes it necessary to regularly update the CTMS database. What is needed is an automated method of updating the CTMS database in real-time that will work efficiently even during the rush hours.
0025Today, a known disclosure teaching automatic reading of container ID tags on container cranes, is found in U.S. Patent No. 6,356,802 entitled "Method and apparatus for location cargo containers", by Takehara (one of the inventors of this application) and Ng. The '802 patent is assigned to the same assignee as this application, Paceco Corp. The '802 patent discloses "The system can be installed on cranes to identify containers at wharfside and on straddle carrier cranes for identifying containers in single or multiple stack container storage. The system can be installed on cranes to identify containers mounted on rail cars in rail terminals ..." (Lines 50-55, Column 4)
0026"The machine reader, its associated apparatus, and the LDU, are carried onboard a transporter such as a cart which runs on tracks or can be steerable. The cart can either be operator driven or remotely controlled. The apparatus could be mounted onboard the storage yard patrol truck. ... The machine reader can be alternatively aimed by the transporter, remotely controlled, or handheld by an operator." (lines 40-48, Column 6) Note that "LDU" is disclosed as "location determining unit" in line 1 of Column 6.
0027"... the present invention contemplates wireless transmission of the data from the machine reader/transporter to the central terminal where the CTMS is located for real time data updating. This can be accomplished by a wireless modem, or a communication unit, which transmits the container's ID number and its current location back to the stationary central computer which hosts the CTMS program and also contains the inventory database." (line 65 Column 6-line 6 Column 7) CTMS refers to container terminal management system (line 12 Column 3).
0028"The identification means is scanned from a distance by a machine such as an optical character recognition (OCR) unit to interrogate the ID tag and identify the container. It is an important characteristic ofthe invention that an operator ofthe system is able to remotely interrogate an ID tag of a cargo container... without the necessity of physically approaching and contacting the container or even coming in close proximity thereto." (lines 3-10 Column 5)
0029While of value, the '802 patent fails to disclose or teach at least the following: 1. How to track containers in stack storage yards, which may pile containers as many as five levels high.
00302. There are advantages to monitoring cargo container operations by a container crane either through sensing the control system of the container crane, or through the use of sensors external to the container crane's control system.
00313. Real- world optical character recognition systems occasionally make mistakes or are unable to recognize the characters, often requiring reliability estimates of the recognized container ID.
00324. There is a practical requirement for an automatic container code reading machine to send a version of the image(s) captured by its video imaging device(s) to a remote operator.
0033This again stems from the real-world limitations of optical character recognition systems at recognizing the characters.
00345. There is a practical requirement for the machine to minimize bandwidth in sending the video image(s) across at least a wireless physical transport layer.
00356. There are significant advantages in many real- world situations for the machine to have multiple video imaging devices placed apart from at least each other, rigidly affixed to the container crane. Such advantages include the ability to withstand the severe mechanical vibrations container cranes experience, while providing container code observations from various locations about and around the container crane, which include providing the length ofthe cargo container.
00367. There are further advantages to positioning multiple, independently controlled lighting systems to improve the imaging quality ofthe multiple video imaging devices.
0037To summarize, what is needed by both terminal management and shipping companies is a more accurate, real time accounting of incoming, outgoing and existing container inventory as the container cranes act upon and around the containers, particularly with regards to stack storage yards.
0038What is needed is a method of reducing errors and supporting efficient operation in the berthing process through the automated monitoring of cargo container loading and unloading. What is needed is an automatic container code reading machine sending a version of the image(s) captured by its video imaging device(s) to the remote operator. The bandwidth needs to be minimized in sending video image(s) across at least a wireless physical transport layer. The machine needs, in many real-world situations, to include multiple video imaging devices placed apart from each other and rigidly affixed to the container crane. Multiple, independently controlled lighting systems may further be needed, positioned to improve the imaging quality of the multiple video imaging devices.
0039Note that the problems discussed herein also relate to rail yard container inventories as well.
0040Summary ofthe invention
0041The invention solves at least all the problems discussed above regarding the prior art.
0042The invention provides a method and system supporting container code recognition from a transfer container crane 2100 communicating with a container inventory management system. An optical characteristic recognition system preferably tracks container movement within a container stacking yard, which may be either a wheeled storage yard or a stack storage yard.
0043The invention can read the standard universal identification (ID) tags internationally used on containers. Container ID tags will be referred to hereafter as container codes. Container inventory management systems incorporating this invention can be integrated into existing container terminal management systems (CTMS). Since each cargo container carries a standard container code, the invention can be utilized for tracking of all containers with respect to their history, damage, current location, and use.
0044The invention supports operators remotely interrogating a container code without the need to physically approach the container. The optical characteristic system further provides at least one video image, which is compressed and may be sent via a wireless physical transport to the container inventory management system. The video image compression effectively minimizes the bandwidth required to send video images.
0045The invention preferably includes multiple video imaging devices mechanically coupled at distinct locations about the transfer container crane 2100. The invention further preferably includes multiple, independently controlled lighting sources. At least two ofthe multiple lighting sources are further, preferably, mechanically coupled apart from each other on transfer container crane 2100 to provide length estimates of a cargo container.
0046The invention reduces container inventory errors and increases the overall terminal efficiency.
0047Optical characteristic recognition systems are sometimes referred to as container code readers. Optical characteristic recognition systems may further interrogate the contents of a container.
0048These and other advantages of the invention will become apparent upon reading the following detailed descriptions and studying the various figures ofthe drawings.
0049Brief Description ofthe Drawings
0050Figure 1 illustrates a typical berthing process involving quay container cranes 2200, transports between quay container cranes 2200 and storage yards, and storage yard containers manipulated by transfer container cranes 2100, as found in the prior art;
0051Figures 2A and 2B illustrate typical container codes and their representation on the side of a container as found in the prior art;
0052Figure 3 illustrates a marine shipping yard 20 in accord with the invention;
0053Figure 4 A illustrates a simplified block diagram of the container inventory management system 1000 of Figure 3 using the optical characteristic recognition systems;
0054Figure 4B illustrates a system block diagram of the means for operating 3300 optical characteristic system 3000 implementing the inventive method for automated optical container code recognition with positional identification from a transfer container crane 2100 of Figures 3 and 4A;
0055Figure 5 illustrates a simplified block diagram of an optical characteristic system 3000 providing container code recognition from transfer container crane 2100, of a container 100 identified by a container code 110, to container inventory management system 1000;
0056Figure 6 A illustrates a method of operating optical characteristic system 3000 of Figure 5 as program system 3300 of Figure 5; Figure 6B illustrates certain embodiments ofthe optical characteristic 3250 from Figure 5 ofthe container code 110 of Figures 2A-B and 5.
0057Figure 6C illustrates positional identification 3260 of Figure 5 for container 100.
0058Figure 7 illustrates a detail flowchart of operation 3332 of Figure 6A for generating the optical characteristic ofthe container code;
0059Figure 8A illustrates a detail flowchart of operation 3342 of Figure 6A for generating the positional identification ofthe container;
0060Figure 8B illustrates a detail flowchart of operation 3462 of Figure 8A for generating the storage-location designation;
0061Figure 8C illustrates a preferred detail flowchart of operation 3472 of Figure 8 A for generating the terminal location for the transfer container crane 2100;
0062Figure 9A illustrates a detail flowchart of operation 3362 of Figure 7 for acquiring the container code image;
0063Figure 9B illustrates a detail flowchart of program system 3300 of Figure 5 implementing the method of operating the optical characteristic recognition system;
0064Figure 9C illustrates a detail flowchart of operation 3392 of Figure 7 for processing the first container code image;
0065Figure 10 illustrates a detail flowchart of operation 3352 of Figure 6A for sending the optical characteristic and the positional identification;
0066Figures 11A-11C illustrate various detail flowcharts of operation 3452 of Figure 8 A for generating the loading-operation;
0067Figure 12 illustrates optical characteristic recognition system 3000 video imaging devices mechanically coupled to transfer container crane 2100 as found in Figures 3 to 5;
0068Figure 13 illustrates a preferred embodiment of at least part of the mechanical housing of an optical characteristic recoginition system; and Figure 14 illustrates a simplified block diagram of a preferred optical recognition system 3000.
0069Detailed Description ofthe Invention
0070The invention provides a method and system supporting container code recognition of a container, from a transfer container crane 2100 as shown in Figure 1, to manage at least a container inventory. The invention automatically and efficiently tracks the location of the container in a container storage area, automatically updating at least the container inventory database.
0071The invention allows a container code reader to find any container in a storage area including containers carrying specialized tag identifiers. The invention supports remotely interrogating a container for identification.
0072Figure 3 illustrates a marine shipping yard 20 in accord with the invention.
0073System 1000 uses container code recognition of a container 100, identified by a container code 110 as shown in Figures 2A and 2B, from transfer container crane 2100 shown in Figure 1 to manage at least a container inventory. The invention automatically and efficiently tracks the location of the container in a container storage area 200, automatically updating at least a container inventory database.
0074As used herein, a container crane is at least one of the following: a quay side container crane 2200, a transfer container crane 2100, as well as rubber tire gantry container cranes and rail gantry container cranes. Quay container cranes 2200 are illustrated in Figures 1, 3, and 4 A. Transfer container cranes 2100 are illustrated in Figures 1, 3, 4 A to 5, and 12. It should be noted that transfer container cranes 2100 are predominantly rubber tire gantry container cranes, while quay container cranes 2200 are predominantly rail gantry container cranes.
0075Figure 4A illustrates a simplified block diagram of the container inventory management system 1000 of Figure 3 using the optical characteristic recognition systems.
0076The method of operating the system 1000 will be discussed in terms of computer 1010, controlled by a program system 1200, including program steps residing in a memory 1020 accessibly coupled 1022 to computer 1010. The system 1000 further includes computer 1010 communicatively coupled 1002 to optical characteristic system 3000, which is mechanically coupled to transfer container crane 2100.
0077Computer 1010 is also communicatively coupled to optical characteristic system 3000, mechanically coupled to quay container crane 2200. The communicative coupling of computer 1010 and optical characteristic system 3000 may be at least partially provided by network 1004 through network interface 1030, which in turn communicates 1032 with computer 1010.
0078Note that in many embodiments ofthe invention, the communicative coupling of various optical characteristic systems 3000 may employ a uniform coupling mechanism, which in many circumstances may preferably be a network.
0079Network 1004 may employ at least one member of a physical transport collection in communicating with an optical characteristic system 3000 in quay container crane 2200. The physical transport collection includes at least one wireline physical transport layer and preferably at least one wireless physical transport layer.
0080Computer 1010 is communicatively coupled 1102 with database 1100. Note that database 1100 may be included in at least one member of a container inventory management collection comprising a marine shipping inventory management system and a rail yard inventory management system.
0081Note that the system includes received optical characteristic 1100 and received positional identification 1150. In certain systems, it is preferred that both received optical characteristic 1100 and received positional identification 1150 reside in memory 1020. However, the system may include one or both of 1100 and 1150 residing somewhere other than memory 1020, including but not limited to them residing in network interface 1030.
0082Program system 1200 of Figure 4 A manages at least a container inventory using container code recognition of a container identified by a container code. The container code recognition is performed on the container crane, which may be either a transfer container crane 2100 or a quay container crane 2200 seen in Figure 3.
0083The container inventory management includes the following: Receiving an optical characteristic of the container code and a positional identification of the container to create a received optical characteristic 1100 and a received positional identification 1150. Updating a database with the received container code optical characteristic and the received container positional identification.
0084As used herein, a computer will be considered to include at least one of the following: an instruction processor, an inferential processor, a finite state machine, and a memory.
0085An instruction processor will include at least one of the following. A Single Instruction Single Datapath (SISD) processor, a Single Instruction Multiple Datapath (SIMD) processor, a Multiple Instruction Single Datapath (MISD) processor, a Multiple Instruction Multiple Datapath (MIMD) processor, a Complex Instruction Set Computer (CISC), a Reduced Instruction Set Computer (RISC) and a Very Long Instruction Word (NLIW) computer.
0086An inferential processor will include at least one of the following: a rule-based inferential processor, a constraint-based inferential processor, and a fuzzy logic engine.
0087A finite state machine will include at least one of the following: at least part of a programmable logic device, at least part of an application specific integrated circuit. A programmable logic device will refer to at least one member of the following: a Field Programmable Gate Array(FPGA), a Programmable Logic Device (PLD), a Complex Programmable Logic Device (CPLD).
0088As used herein, memory 1020 includes at least one instance of a volatile memory and/or at least one instance of a non-volatile memory. Νon-volatile memory includes at least one of the following: a writeable non-volatile memory and a Read Only Memory (ROM). Writeable non- volatile memory includes at least one member of the following: an electro-magnetically interfaced non- volatile memory and an optically interfaced non- volatile memory.
0089Please refer to Figure 6B for a discussion ofthe optical characteristic ofthe container code.
0090Receiving the optical characteristic and the positional identification ofthe container may include the following. Determining a reliability measure ofthe estimated container code. Examining the container code image to create a second estimated container code, whenever the reliability measure indicates doubt.
0091Examining the container code image may include at least one of the following. Requesting a modified version of the container code image to create a modified container code image request. Receiving a modified container code image based upon the modified container code image request.
0092Also note that the modified container code request may include at least one of the following: a zoom-in request; a zoom-out request; a tilt request; a filter request. The filter request may includes at least one ofthe following: an apply first filter request, an apply second filter request; and an align the first filter to the second filter request.
0093The positional identification of the container as illustrated in Figure 6C may include at least one ofthe following: a loading-operation designation for the container, a storage-location designation for the container, and a terminal location for the container crane.
0094Note that the invention includes embodiments wherein at least one of the storage-location designation and the loading-operation designation for the container, is derived, at least in part, from the terminal location for the container crane.
0095Receiving the optical characteristic and the positional identification may include the following. Receiving a packet from a network to create a received packet. Processing the packet to create at least part of the optical characteristic. Processing the packet to create at least part of the positional identification.
0096The method and system may further include generating a shipping container plan for a ship 220 shown in Figure 3, loaded by quay container crane 2200 based upon database 1100.
0097Note that the container inventory management 1000 is not limited to the following discussion, but is included to illustrate only a preferred use of container crane optical characteristic recognition systems 3000 illustrated in Figure 4B, coupled to transfer container cranes 2100 and quay container cranes 2200, as shown in Figure 4A.
0098Figure 4B illustrates a system block diagram of the means for operating 3300 optical characteristic system 3000 implementing the inventive method for automated optical container code recognition with positional identification from a transfer container crane 2100 of Figures 3 and 4A.
0099Optical characteristic system 3000 includes at least two video imaging devices 3100 and 3110, each communicatively coupled 3104 and 3114, respectively, to means 3332 for generating optical characteristic 3250 of container code based upon at least two video imaging devices 3100 and 3110. Video imaging devices 3100 and 3110 are mechanically coupled 3102 and 3112, respectively, to transfer container crane 2100.
0100Note that optical characteristic recognition system 3000 may also be mechanically coupled 3002 to transfer container crane 2100. Mechanical coupling 3002 may preferably include a mechanical shock absorber to improve the reliability of optical characteristic recognition system 3000.
0101Note that as used herein, a video imaging device such as 3100 belongs to a collection including at least a video camera, a digital video camera, and a charged coupled array. A video imaging device 3100 may further include any of the following: a computer, a digital memory, an image processor and a flash lighting system.
0102Means 3342 for generating position identification 3260 of the container may include any of the following: Coupling to PLC unit 2010 on transfer container crane 2100, coupling to quay crane relay controls 2020, and container sensors 3270. Container sensors 3270 may preferably include sensors to ultrasonic transponders. Coupling to PLC unit 2010 may include one or more indications of container locking, often known as twist locking signals.
0103Means 3342 preferably includes coupling 3232 to a GPS receiver 3230.
0104Means 3352 for sending optical characteristic 3250 and positional identification 3260 to container inventory management system 1000 is communicatively coupled 1002 to container inventory management system 1000.
0105Note that as used herein GPS includes any form of global positioning, including but not limited to, DGPS, (Differential Global Positioning System). Today, DGPS is the preferred global positioning form for the invention, but the invention can use any form of global positioning.
0106Figure 5 illustrates a simplified block diagram of a preferred optical characteristic system 3000 providing container code recognition from a transfer container crane 2100 of a container 100 identified by a container code 110 to container inventory management system 1000 refining Figure 4B.
0107Optical characteristic system 3000 includes at least one, and in Figure 5, two video imaging devices 3100 and 3110, each communicatively coupled 3104 and 3114, respectively, to computer 3200. Video imaging devices 3100 and 3110 are mechanically coupled 3102 and 3112, respectively, to transfer container crane 2100.
0108Note that optical characteristic recognition system 3000 is mechanically coupled 3002 to transfer container crane 2100. Mechanical coupling 3002 preferably includes a mechanical shock absorber to improve the reliability of optical characteristic recognition system 3000.
0109Computer 3200 accesses memory 3210, which includes program steps of program system 3300, which implement the method of operating 3300 the optical characteristic system 3000. The method will be further documented in the discussion of Figures 6 A through 1 IC.
0110The invention may incorporate a number of location determination mechanisms, preferably including a GPS receiver 3230 and communicatively coupled 3232 with computer 3200. GPS receiver 3230 may preferably mechanically couple 3234 with transfer container crane 2100,
0111The invention is preferably communicatively coupled 1002 with container inventory management system 1000. The invention may further preferably include a network interface 3220 with network 1004 providing a coupling from computer 3200 via 3222-3220-1004 with container inventory management system 1000.
0112Network 1004 employs at least one member of a physical transport collection in communicating from the transfer container crane 2100 to container inventory management system 1000. The physical transport collection includes at least one wireline physical transport layer and preferably at least one wireless physical transport layer.
0113Network 1004 preferably employs a packet based communications protocol, which may further preferably provide compatibility to the IEEE 802.11(b) communications standard.
0114Figure 6A illustrates a method of operating optical characteristic system 3000 of Figure 5 as program system 3300 of Figure 5.
0115Operation 3332 performs generating an optical characteristic 3250 of container code 3610 based upon at least one of video imaging devices 3100 and 3110 shown in Figure 5. Optical characteristics 3250 will be further discussed in Figure 6B.
0116Operation 3342 performs generating a positional identification 3260 of container 3600. Positional identification 3260 is further discussed in Figure 6C. Operation 3352 performs sending optical characteristic 3250 of container code 3610 and positional identification 3260 of container 3600 to container inventory management system 1000 as shown in Figures 4B and 5.
0117Figure 6B illustrates certain embodiments of the optical characteristic 3250 from Figure 5 of the container code 110 of Figures 2A-B and 5.
0118The optical characteristic 3250 of the container code 110 includes at least one member of the following: at least one container code image 4010 of a container representation 2620 of the container code 110 imaged from the transfer container crane 2100. The optical characteristic 3250 may also include an estimated container code 4020 based upon an optical character recognition process applied to the container code image 4010. Additionally, optical characteristic 3250 may include a first container code image 4030, which may be further processed and/or modified to create container code image 4010.
0119Figure 6C illustrates positional identification 3260 of Figure 5 for container 100.
0120Positional identification 3260 may further include at least one of the following: a loading operation designation 4110 for container 100, a storage-location designation 4120 for container 100 and a terminal location 4130 for transfer container crane 2100.
0121Note that the invention may include one or more ofthe operations of Figure 7.
0122Figure 7 illustrates a detail flowchart of operation 3332 of Figure 6 A for generating the optical characteristic ofthe container code.
0123Operation 3362 performs acquiring at least one container code image of a container representation ofthe container code imaged from the video imaging device.
0124Operation 3372 performs applying an optical character recognition process to the container code image to create an estimated container code.
0125Operation 3382 performs acquiring a first container code image from the video imaging device of the container representation of the container code.
0126Operation 3392 performs processing the first container code image to create the container code image. Operation 3402 performs compressing the first container code image to create the container code image.
0127The invention may also include one or more ofthe operations of Figure 8 A.
0128Figure 8A illustrates a detail flowchart of operation 3342 of Figure 6A for generating the positional identification ofthe container.
0129Operation 3452 performs generating a loading-operation designation for the container 100 shown in Figure 5.
0130Operation 3462 performs generating a storage-location designation for the container 100 shown in Figure 5.
0131Operation 3472 performs generating a terminal location for the transfer container crane 2100 shown in Figure 5.
0132Figure 8B illustrates a detail flowchart of operation 3462 of Figure 8A for generating the storage-location designation.
0133Operation 3492 performs deriving the storage-location designation for the container at least in part from the terminal location for the transfer container crane 2100 shown in Figure 5.
0134Figure 8C illustrates a preferred detail flowchart of operation 3472 of Figure 8A for generating the terminal location for transfer container crane 2100 shown in Figure 5.
0135Operation 3512 performs receiving a location reading from a Global Positioning System (GPS) receiver 3230 to create at least in part the terminal location for the transfer container crane 2100 shown in Figure 5.
0136The invention may include at least one ofthe operations of Figure 9 A.
0137Figure 9 A illustrates a detail flowchart of operation 3362 of Figure 7 for acquiring the container code image.
0138Operation 3532 performs selecting a first of at least two of the video imaging devices mechanically coupled to the transfer container crane 2100 shown in Figure 5. Operation 3542 performs acquiring the container code image from the first video imaging device ofthe container representation ofthe container code 110 shown in Figure 5.
0139Figure 9B illustrates a detail flowchart of program system 3300 of Figure 5 implementing the method of operating the optical characteristic recognition system.
0140Operation 3552 performs receiving a modified container code image request.
0141Figure 9C illustrates a detail flowchart of operation 3392 of Figure 7 for processing the first container code image.
0142Operation 3572 performs processing the first container code image based upon the modified container code image request to create the container code image.
0143The invention may include at least one ofthe operations of Figure 10.
0144Figure 10 illustrates a detail flowchart of operation 3352 of Figure 6A for sending the optical characteristic 3250 and the positional identification 3260 shown in Figures 5, 6B and 6C.
0145Operation 3592 performs sending a packet across a network 1004 to the container inventory management system 1000 as shown in Figures 4 A and 5.
0146Operation 3602 performs writing the optical characteristic 3250 of the container code 110 and the positional identification 3260 ofthe container 100 to 3242 a removable non-volatile memory 3240 as shown 5.
0147Operation 3612 performs creating the packet from at least part of at least one sending-data collection member.
0148Operation 3622 performs writing at least one sending-data collection member to a file contained in the removable non- volatile memory 3240 shown in Figure 5.
0149Operation 3632 performs writing at least one sending-data collection member to a record contained in the removable non- volatile memory 3240 shown in Figure 5.
0150Note that the sending-data collection includes the optical characteristic 3250 of the container code 110 and the positional identification 3260 ofthe container 100 as shown in Figure 5. The invention may include one of the operations of Figure 11 A. Note that operation 3652 is preferred.
0151Figure 11 A illustrates a detail flowchart of operation 3452 of Figure 8A for generating the loading-operation.
0152Operation 3652 performs receiving a locking indication from a programmable logic controller 2010 within the transfer container crane 2100 as shown in Figure 4B.
0153Operation 3662 performs determining the locking indication from a relay network 2020 within the transfer container crane 2100 as shown in Figure 4B.
0154The invention may include one of the operations of Figure 1 IB. Note that operation 3672 is preferred.
0155Figure 11B illustrates a detail flowchart of operation 3452 of Figure 8 A for generating the loading-operation.
0156Operation 3672 performs determining a container hoist-trolley position based upon sensing a gray-coded hoist shaft in the transfer container crane 2100.
0157Operation 3682 performs determining the container hoist-trolley position based upon sensing an ultrasonic transponder 3270.
0158The coded hoist shaft preferably uses a gray code but the invention may use any coded hoist shaft.
0159Note that a hoist-trolley position as used herein will refer to a hoist position and/or a trolley position.
0160Figure 11C illustrates a detail flowchart of operation 3452 of Figure 8 A for generating the loading-operation.
0161Operation 3692 performs generating the loading-operation designation based upon at least one member of the collection comprising the locking signal indication and the container hoist position. Figure 12 illustrates optical characteristic recognition system 3000 video imaging devices mechanically coupled to transfer container crane 2100 as found in Figures 3 to 5.
0162The transfer container crane 2100's optical characteristic recognition system 3000 tracks container 100 location and movements in the terminal's stack storage areas 200 as shown in Figure 1.
0163The optical characteristic recognition system 3000 tracks containers 100 shown in Figure 5 as they are transferred. Each container's unique ID code is optically read as it passes through transfer container crane 2100's legs, shown in Figure 12. The container code information is preferably processed by computer 3200 shown in Figure 5, installed on container crane 2200. The updated container status is sent to a container inventory management system 1000, shown in Figures 3 to 5, often located at a central office for the container facility. The computer 3200 will interface with the container inventory management system 1000 identifying whether the container is being added or substracted from the terminal's inventory listing.
0164Each time transfer container crane 2100 picks up a container 100 from a chassis or deposits a container onto a chassis, the container code 110 shown in Figure 5 will preferably be read. The container identification is received by computer 3200 shown in Figure 5.
0165The computer 3200 determines whether the container 100 is being added to storage or taken from storage. If it is being added to storage, position information 3260 is preferably given to computer 3200 from container crane 2100 sensors and from an on-board Differential Global Positioning System (DGPS) 3230 as shown in Figure 5.
0166When the container 100 reaches its final location, this information is then sent to the container inventory management system 1000, which updates the master inventory and location listing database 1100 as shown in Figure 3.
0167If the container 100 is being removed from storage to be loaded either onto a ship or moved to another location, computer 3200 shown in Figure 5 sends this data to container inventory management system 1000 and the container's new location is entered into the inventory database 1100 as shown in Figure 3.
0168All container movements are preferably tracked and updated in real time giving terminal management essentially immediate knowledge of all containers at all times. The container code 110 is preferably read as containers 100 are placed on or removed from a chassis. The container code 110 should be identified by the optical characteristic recognition system 3000 as shown in Figures 4B and 5.
0169Figure 13 illustrates a preferred embodiment of at least part of the mechanical housing of an optical characteristic recoginition system 3000 of Figures 3 to 5.
0170The mechanical housing of the optical characteristic recognition system includes at least one video imaging device, as well as preferably including flash lighting, the triggering and systems as illustrated in the block diagram of Figure 5. As to the triggering system, it may include a laser photo and/or a infra-red photo sensor.
0171Other circuitry coupled with a container crane may provide additional storage location information and/or additional information regarding the container contents used by computer 3200 shown in Figure 5.
0172Figure 14 illustrates a simplified block diagram of a preferred optical recognition system 3000 as shown in Figures 4B and 5.
0173Note that container storage areas can be individually separated and not necessarily identified as repository locations located upon a predefined grid, as is often the case in container stacking areas.
0174The optical characteristic recognition system 3000 can be installed on quay container cranes 2200 to identify containers at wharfside, and on transfer carrier container cranes 2100, to identify containers in single or multiple stack container storage.
0175Note that Figures 12 and 13 illustrate at least two and sometimes several video imaging devices (3100-3120) may be preferred in various applications of the inventive optical characteristic systems 3000 as shown in Figures 4B and 5.
0176Each video imaging device preferably has automatic focus control accommodating both the ambient light conditions and the target located at a distance.
0177Preferably, illumination for video imaging is provided by a flash light system. Generally, it includes strobe action to catch the image during daytime and at night in the absence of light. The trigger of the video imaging device is preferably based on at least the loading/unloading conditions on the container crane.
0178In certain applications, the flash light system may be controlled based upon which video imaging devices are selected.
0179The loading/unloading conditions on transfer container crane 2100 can preferably be obtained from the Programmable Logic Controller (PLC) 2010 on the container crane or from sensors 3270 shown in Figure 4 A checking whether there is a container to be loaded/unloaded. The sensors 3270 can be laser, infrared, or ultrasonic sensors. Today, laser sensors are more reliable and accurate, but, more expensive than the infrared, currently making infrared sensors preferable on a cost basis and laser sensors more preferable on a reliability and accuracy basis.
0180The video imaging device may preferably include both an optical character recognition process and an image processing unit to convert the container code images into a standard format. The standard format is preferably compatible with some version of JPEG.
0181Storage location for a container is provided by the invention to identify the container's repository address. A DGPS unit 3230 Figures 4B, 5 and 14 preferably determines the Z axis location of a transfer container crane. Signals of a PLC coupled with the transfer container crane can determine the X and Y axes. This determines the overall position ofthe container.
0182The DGPS unit 3230 shown Figures 4B, 5 and 14 is preferably used in applications with transfer container cranes 2100 due to the importance of their location. However, quay container cranes 2200 do not have the same crane location accuracy requirements, making the use of DGPS receivers 3230 less preferable.
0183In some cases, the address identifier for the repository locations in the container terminal storage areas are not adequately marked by optical character reading, radioactivity identification, or electronic/magnetic detection.
0184In some cases, a less sophisticated version of the invention is preferred, where the container location is operator input through a hand-held keypad.
0185The optical characteristic recognition system 3000 is preferably mounted on a movable container crane and able to operate in all types of weather. The optical characteristic system 3000 may be automatically aimed by the container crane, remotely controlled, and/or hand-held by an operator to interrogate the address for the cargo containers.
0186The container code 110 as optical characteristic 3250 and positional identification 3260 are sent to the container inventory management system 1000 as shown in Figure 5 to verify whether the container is deposited at the proper address.
0187The information may be sent by floppy disk. The data/information is downloaded onto a transportable data storage unit such as a floppy disk, and hand carried to the container inventory management computer system.
0188As shown in Figure 5, the container crane's optical characteristic system 3000 generates information to send to the container inventory management system 1000.
0189GPS unit 3230 as shown in Figure 4B, and at least transfer container crane 2100 coupled PLC unit 2010, are preferably used to generate the positional identification. Both signals are preferably sent to computer 3200 as shown in Figure 14.
0190Computer 3200 shown in Figure 14 may also be coupled with a serial communication board to interpret the signals sent to it. Computer 3200 may also be coupled with a digital signal circuit interacting with any or all ofthe following: switches, buzzers, and lights.
0191Computer 3200 preferably functions as a traffic controller, which manages the transmission of the data through the network interface or wireless modem 3220 shown in Figures 5 and 12, which converts and transmits the signals to the container inventory management system 1000.
0192Computer 3200 preferably determines which signals are to be sent and in which order. The serial communication board preferably receives signals from the outside units such as video imaging devices 3100 and 3110 as shown in Figures 4B and 5, as well as GPS receiver 3230 shown in Figures 4B, 5 and 14.
0193Computer 3200 translates them into a form that computer 1010 shown in Figure 4 A can process. The removable nonvolatile memory 3240 preferably stores the optical characteristic 3250 shown in Figures 4B, 5, and 6B, and positional identification 3260 shown in Figures 4B, 5, and 6C. Note that removable non-volatile media includes, but is not limited to, floppy disks, zip disks, and optical disks.
0194Assume a container crane operator directs the optical characteristic system 3000. The operator can be provided with a hand-held computer input or keypad, allowing the input of data. The operator inputs the data when he locates a target container as well as changes to other data in the container inventory management system.
0195The light and buzzers preferably allow the container inventory management system 1000 shown in Figures 3 to 5 send messages to the container crane operator as well as allow the transfer container crane 2100 equipment to communicate with the human operator.
0196For example, the lights and buzzers may preferably indicate a malfunction in the optical characteristic system 3000 and/or the location determination and/or completion of an operation such as informing the operator that a target container has been found.
0197Network interface 1030 may preferably include a stationary wireless modem unit connected 1032 to computer 1010 as shown in Figure 4A. It allows the container crane's optical characteristic system 3000 and computer 1010 to exchange information. The modem 1030 receives the data transmitted by optical characteristic system 3000 and program system 1200 receives the new data and updates via 1102 database 1100 as shown in Figure 4A.
0198Note that the coupling 1102 shown in Figure 4A is often preferably a Local Area Network (LAN). Note that each container inventory management system 1000 may employ different LANs 1102. Computer 1100 translates the received container code and positional identification into the reigning language of LAN 1102. Note that multiple workstation computers may further be connected to LAN 1102.
0199The invention also includes methods identifying container code and determining container locations in at least terminal storage areas. The steps can be described as follows:
0200(1) Provide an optical characteristic recognition system 3000 on a transfer container crane 2100 shown in Figures 4A to 5 and 14 to interrogate the representations of the container code 110 of a cargo container 100; (2) Aim the optical characteristic recognition system 3000 at the container code representation 2620 shown in Figure 5, generate at least one optical characteristic 3250 for the container code 110 and send the optical characteristic 3250 to the container inventory management system 1000 as shown in Figures 4B, 5 and 6 A;
0201(3) Determine the positional identification 3260 of the container 100 as shown in Figures 4B, 5 and 6A;
0202(4) Send the positional identification 3260 from the transfer container crane 2100 to the container inventory management system 1000 as shown in Figures 4B, 5 and 6 A.
0203(5) At the container inventory management 1000 shown in Figures 4A to 5, compare the information contained in the received signals with the database 1100 to verify whether the container 100 is deposited at the proper address.
0204Various embodiments ofthe invention support some or all ofthe following:
0205• The optical characteristic recognition system 3000 shown in Figures 4 A to 5 and 14 reliably performs under all real-life environmental conditions including any or all of the following: weather, traffic load and power supply variations.
0206• The optical characteristic recognition system 3000 shown in Figures 4A to 5 and 14 can read the representations of a container's code 110, determine the current location of container 100, and then wirelessly transmit this data back to the container inventory management system 1000 shown in Figures 4 A to 5.
0207• The optical characteristic recognition system 3000 shown in Figures 4 A to 5 and 14 downloads and saves the optical characteristic and positional identification to an on-board buffer memory.
0208• The optical characteristic recognition system 3000 shown in Figures 4 A to 5 and 14 and/or the container inventory management system 1000 shown in Figures 4 A to 5 warn the yard clerk if the actual location is different from that listed in the yard's container inventory database 1100, as shown in Figure 4 A. • The optical characteristic recognition system 3000 shown in Figures 4 A to 5 and 14 and/or the container inventory management system 1000 shown in Figures 4A to 5 allow the yard clerk to conveniently change the database 1100.
0209The preceding embodiments have been provided by way of example and are not meant to constrain the scope ofthe following claims.
Every citation, both ways
| Document | Relation | Office | Cited during |
|---|---|---|---|
| WO0212996A1 | Cites | World Intellectual Property Organization (WIPO) | Search report |
42 members in 11 offices
Members42
| Document | Office | Kind | |
|---|---|---|---|
| WO0212996A1 | World Intellectual Property Organization (WIPO) | A1 | |
| AU7816001A | Australia | A | |
| US6356802B1 | United States of America | B1 | |
| US2003190057A1 | United States of America | A1 | |
| US2003191555A1 | United States of America | A1 | |
| US2003191557A1 | United States of America | A1 | |
| WO03086919A1 | World Intellectual Property Organization (WIPO) | A1 | |
| WO03087890A2 | World Intellectual Property Organization (WIPO) | A2 | |
| AU2003224935A1 | Australia | A1 | |
| AU2003224935A8 | Australia | A8 | |
| AU2003230884A1 | Australia | A1 | |
| US6768931B2 | United States of America | B2 | |
| US2004215367A1 | United States of America | A1 | |
| EP1494944A1 | European Patent Office (EPO) | A1 | |
| KR20050018654A | Republic of Korea | A | |
| HK1068858A1 | Hong Kong, China | A1 | |
| US2005131574A1 | United States of America | A1 | |
| JP2005522390A | Japan | A | |
| CN1659090A | China | A | |
| EP1585998A2This record | European Patent Office (EPO) | A2 | |
| WO2005114385A1 | World Intellectual Property Organization (WIPO) | A1 | |
| US7013026B2 | United States of America | B2 | |
| US2006153455A1 | United States of America | A1 | |
| AU2001278160B2 | Australia | B2 | |
| WO03087890A3 | World Intellectual Property Organization (WIPO) | A3 | |
| US7181312B2 | United States of America | B2 | |
| EP1754138A1 | European Patent Office (EPO) | A1 | |
| KR20070040759A | Republic of Korea | A | |
| CN101031874A | China | A | |
| US7308114B2 | United States of America | B2 | |
| JP2008500252A | Japan | A | |
| US2008095405A1 | United States of America | A1 | |
| EP1494944B1 | European Patent Office (EPO) | B1 | |
| AT419207T | Austria | T | |
| ATE419207T1 | Austria | T1 | |
| DE60325574D1 | Germany | D1 | |
| EP1754138A4 | European Patent Office (EPO) | A4 | |
| ES2321286T3 | Spain | T3 | |
| EP1585998A4 | European Patent Office (EPO) | A4 | |
| KR100996978B1 | Republic of Korea | B1 | |
| US7961911B2 | United States of America | B2 | |
| US2012029684A1 | United States of America | A1 |
15 legal events, as 2 offices reported them to INPADOC
Over the term
Point at a mark for the eventEvents
| Event | Code | Office | |
|---|---|---|---|
| Applications withdrawn, deemed to be withdrawn, or refused after publication in hong kongWithdrawnWD | WD | HK | |
| Application deemed to be withdrawnWithdrawn18D | 18D | EP | |
| Information on the status of an ep patent application or granted ep patentGrantedSTATUS: THE APPLICATION IS DEEMED TO BE WITHDRAWNSTAA | STAA | EP | |
| First examination report despatched17Q | 17Q | EP | |
| Supplementary search report drawn up and despatchedA4 | A4 | EP | |
| Information provided on ipc code assigned before grantRIC1 | RIC1 | EP | |
| Information provided on ipc code assigned before grantRIC1 | RIC1 | EP | |
| Information provided on ipc code assigned before grantRIC1 | RIC1 | EP | |
| Availability of information related to the publication of the international search reportORIGINAL CODE: 0009015PUAK | PUAK | EP | |
| Party data changed (applicant data changed or rights of an application transferred)RAP1 | RAP1 | EP | |
| Requests to designate patent in hong kongDE | DE | HK | |
| Request for examination filed17P | 17P | EP | |
| Designated contracting statesAK | AK | EP | |
| Request for extension of the european patentAX | AX | EP | |
| Public reference made under article 153(3) epc to a published international application that has entered the european phaseORIGINAL CODE: 0009012PUAI | PUAI | EP |
Numbers
- Publication
- 1585998
- Application
- 37216330
Titles3
- German
- VERFAHREN UND VORRICHTUNG ZUR AUTOMATISIERTEN OPTISCHEN BEHÄLTERCODEERKENNUNG MIT POSITIONSIDENTIFIKATION FÜR EINEN TRANSFERBEHÄLTERKRAN
- English
- METHOD AND APPARATUS OF AUTOMATED OPTICAL CONTAINER CODE RECOGNITION WITH POSITIONAL IDENTIFICATION FOR A TRANSFER CONTAINER CRANE
- French
- PROCEDE ET APPAREIL DE RECONNAISSANCE OPTIQUE AUTOMATISEE DE CODE DE CONTENEUR AVEC IDENTIFICATION DE POSITION POUR UNE GRUE DE TRANSBORDEMENT DE CONTENEURS
Classification
- CPC, 8
- B66C19/007
- G06Q10/087
- G06Q10/08
- G06V20/62
- G06V30/10
- G06Q50/40
- G06Q10/08744
- G06Q10/0877
- IPC, 2
- B66C19 00
- G06V30 10
Designated states31
- Contracting states, 27
- Austria
- Belgium
- Bulgaria
- Switzerland
- Cyprus
- Czechia
- Germany
- Denmark
- Estonia
- Spain
- Finland
- France
- United Kingdom
- Greece
- Hungary
- Ireland
- Italy
- Liechtenstein
- Luxembourg
- Monaco
- Netherlands (Kingdom of the)
- Portugal
- Romania
- Sweden
and 3 moreShow fewer
- Slovenia
- Slovakia
- Türkiye
- Extension states, 4
- Albania
- Lithuania
- Latvia
- North Macedonia