Real-time field mapping for autonomous agricultural platform
Summary by NHIP
Anticipatory Crop Row Mapping
The method uses an unmanned agricultural robot with aerial mapping sensors to generate a geospatial data map of annual crop rows. The observation window width and length are at least three times the nominal width of the rows, allowing anticipated positions to be replaced by measured data when obstacles are encountered.
Claim Score by NHIP
Abstract
A method of using an unmanned agricultural robot to generate an anticipatory geospatial data map of the positions of annual crop rows planted within a perimeter of an agricultural field, the method including the step of creating a geospatial data map of an agricultural field by plotting actual annual crop row positions in a portion of the geospatial data map that corresponds to a starting point observation window, and filling in a remainder of the geospatial data map with anticipated annual crop row positions corresponding to the annual crop rows outside of the starting point observation window, and refining the geospatial data map by replacing the anticipated annual crop row positions with measured actual annual crop row positions when an unexpected obstacle is encountered.

Term
10.5 yearsleft in the term
Expires 12 March 2037, including 32 days of term adjustment.
- Priority
- Filed
- Granted
- Today
- Expires
1 claim: 1 independent, 0 dependent
- 1Broadest claimClaim Score 24, narrow(NHIP)A method of using an unmanned agricultural robot to generate an anticipatory geospatial data map of positions of annual crop rows planted within a perimeter of an agricultural field, the method comprising:delivering the unmanned agricultural robot to the agricultural field, wherein the unmanned agricultural robot is programmed with a self-direction program;positioning the unmanned agricultural robot at a starting point on the agricultural field;deploying one or more aerial mapping sensors at a height above the agricultural field, so as to enable the one or more aerial mapping sensors to capture geospatial data within an observation window of the agricultural field, the observation window dimensioned such that a width and length of the observation window are at least three times a nominal width of the annual crop rows;using the one or more aerial mapping sensors to measure the actual annual crop row positions within the starting point observation window relative to at least one of the unmanned agricultural robot and the perimeter of the agricultural field;creating the geospatial data map of the entire agricultural field by plotting the actual annual crop row positions in a portion of the geospatial data map that corresponds to the starting point observation window, and filling in a remainder of the geospatial data map with anticipated annual crop row positions corresponding to the annual crop rows outside of the starting point observation window, wherein the measured actual annual crop row positions are used to predict the anticipated annual crop row positions within the perimeter of the agricultural field;activating the self-direction program to autonomously navigate the unmanned agricultural robot within the perimeter of the agricultural field;and using the one or more aerial mapping sensors to periodically refine the geospatial data map by replacing the anticipated annual crop row positions with measured actual annual crop row positions within the observation window when an unexpected obstacle is encountered during autonomous navigation.
56 paragraphs in 6 sections, as filed
RELATED APPLICATION INFORMATION
0001This application claims the benefit of U.S. Provisional Application 62/293,070, filed Feb. 9, 2016, which is hereby incorporated by reference.
TECHNICAL FIELD
0002The present disclosure relates generally to unmanned agricultural robots. More particularly, the present disclosure relates to the generation of a geospatial data map through the use of a combination of measured, actual crop row positions and anticipated crop row positions.
BACKGROUND
0003Specific robotic solutions are currently being developed to aid farmers in the growth of annual row crops, such as corn. Specific solutions include improvements in tailoring the amount of fertilizer added to a particular area of an agricultural field to fit the needs of the crops within that area, fertilizing crops that have grown to a height where use of conventional fertilization equipment would be impractical, seeding a second cover crop while a first crop is still growing or mature and still on the field and/or the collection of various data to maximize the output of an agricultural field. Several examples of unmanned agricultural robots are disclosed in U.S. Pat. Nos. 9,288,938; 9,392,743; and 9,265,187, the contents of which are incorporated by reference herein.
0004Unmanned agricultural robots that operate autonomously in agricultural settings require geospatial data as a basis for their operation. In a typical application, a field perimeter defines an absolute boundary across which an unmanned agricultural robot is restricted from crossing for safety reasons. Within the perimeter, various more refined data may be required to facilitate operation. For example, high-resolution data on the actual crop row positions, either previously collected or generated on-the-fly, may be necessary to prevent crop damage by the unmanned agricultural robot.
0005In cases where the unmanned agricultural robot is expected to navigate between two adjacent crop rows, the geospatial data is often referred to as an “as-planted map,” which is typically created using the GPS-based “precision planting” system on the tractor used for planting operations. However, not all fields are planted with GPS-based systems, and the geospatial data for those fields that are planted with GPS-based systems can be of variable accuracy.
0006In a typical operation of an unmanned agricultural robot, the geospatial data of the crop location is combined with sensors onboard the unmanned robotic platform for fine-scale navigation. That is, one or more sensors determine the proximity of the unmanned agricultural robot side-to-side between the crop rows, thereby providing feedback to the unmanned agricultural robot's control system, which in turn continually adjusts the orientation of the unmanned agricultural robot relative to the crop rows.
0007Assuming that there is a high-quality as-planted map for a field, as well as onboard sensors for understanding the precise location of crop rows, there can still be unexpected situations that would impact the navigation of an unmanned agricultural robot, such as mis-planted rows or weeds. Thus, even the best current precision planting technology may not be sufficient for fully enabling operation of the unmanned agricultural robot on agricultural fields.
0008What is needed for robust navigation of unmanned agricultural robots on agricultural fields is an on-board system that can learn essential details of the field in real time. Such a system would be flexible in the sense that it could map the entire field with minimal pre-existing information, taking into account challenges such as mis-planted rows and patches of weeds.
SUMMARY OF THE DISCLOSURE
0009Embodiments of the present disclosure meet the need for a robust real-time mapping solution to support navigation of unmanned agricultural robots that carry out various in-season management tasks on agricultural fields. Examples of such management tasks include collecting plant and soil data, weed removal, fertilizer application, and seeding of cover crops between rows of a mature crop plants, like corn.
0010One embodiment of the present disclosure provides a method of using an unmanned agricultural robot to generate an anticipatory geospatial data map of the positions of annual crop rows planted within a perimeter of an agricultural field. The method includes delivering an unmanned agricultural robot, programmed with a self-direction program, to the agricultural field. The unmanned agricultural robot can be positioned at a starting point on the agricultural field. One or more aerial mapping sensors can be deployed at a height above the annual crop rows, so as to enable the one or more aerial mapping sensors to capture geospatial data within an observation window of the agricultural field. In one embodiment, the observation window can be dimensioned such that a width and length of the observation window are at least three times a nominal width of the annual crop rows. The deployed one or more aerial mapping sensors can be used to measure the actual annual crop row positions within the starting point observation window. The actual annual crop row positions can be used to create a geospatial data map of the entire agricultural field by plotting the actual annual crop row positions in a portion of the geospatial data map that corresponds to the starting point observation window, and filling in a remainder of the geospatial data map with anticipated annual crop row positions corresponding to the annual crop rows outside of the starting point observation window. In one embodiment, the measured actual annual crop row positions can be used to predict the anticipated annual crop row positions within the perimeter of the agricultural field. The self-direction program can be activated to autonomously navigate the unmanned agricultural robot within the perimeter of the agricultural field.
0011In one embodiment, as the observation window moves along with the unmanned agricultural robot through the agricultural field, the geospatial data map can be refined by replacing the anticipated annual crop row positions with measured actual annual crop row positions. In another embodiment, the one or more aerial mapping sensors can periodically refine the geospatial data map by replacing the anticipated annual crop row positions with measured actual annual crop row positions within the observation window when an unexpected obstacle is encountered during autonomous navigation.
0012One embodiment of the present disclosure provides for an unmanned agricultural robot mapping system that can generate detailed maps of the geospatial location of crop rows as the unmanned agricultural robot moves through the agricultural field. The unmanned agricultural robot mapping system can include one or more unmanned agricultural robots, each having a power source and wheels or tracks or a combination thereof for mobility. Each unmanned agricultural robot can include a mast that extends vertically and can optionally be retracted when not in use. The mast can be used to elevate an aerial mapping sensor module, which can include one or more aerial mapping sensors used to determine the location of an unmanned agricultural robot relative to those crop rows in its surroundings. In one embodiment, the aerial mapping sensor is a digital camera. In one embodiment, the aerial mapping sensor can be configured to determine distances to objects, at can comprise a stereo camera and/or light detection and ranging (LIDAR) sensor.
0013One embodiment of the present disclosure provides for an unmanned agricultural robot mapping system that includes an aerial mapping sensor on an extendable mast combined with one or more computer algorithms that process the sensor data in order to resolve the geospatial location of crop rows in the local surroundings of the autonomous ground robot.
0014One embodiment of the present disclosure provides for the unmanned agricultural robot mapping system to be used for periodically resolving the location of crop rows in the unmanned agricultural robot's local surroundings (local field map or L-FMAP) for the purpose of building a field map (FMAP) in real time. When a new L-FMAP is created, some fraction of the overall FMAP is known; the location of some rows may be regarded as anticipatory or tentative. Each new L-FMAP would extend the proportion of area, or row segments, with known locations.
0015In typical operation, the unmanned agricultural robot could begin at a known location on the FMAP and use on-board navigational sensors, such as LIDAR or stereocamera, to navigate between rows until a non-standard vegetation state is detected ahead, such as a patch of heavy weed growth or crop rows planted substantially perpendicular to the rows in which the unmanned agricultural robot is operating. In these cases, a new L-FMAP could be created thereby improving and updating the row layout on the overall FMAP. In one embodiment of the present disclosure the unmanned agricultural robot could use onboard algorithms to determine the best route to be taken given the now-improved FMAP. In another embodiment, the unmanned agricultural robot can send data including the FMAP and the robot's position and heading relative to the FMAP to a remotely-located human operator, who can make a determination of the best path for the unmanned agricultural robot to take next. In such a case, the onboard systems of the unmanned agricultural robot can create several alternative paths to resolve the navigational impediment, and the remotely-located operator may then select one path from the several alternatives.
0016One embodiment of the present disclosure provides for the use of L-FMAPs in cases where an unexpected obstacle is encountered and inhibits the planned motion of the unmanned agricultural robot. In such a case, the L-FMAP combined with the FMAP can provide one or more alternative courses for the unmanned agricultural robot in order to avoid a collision with the obstacle. The unmanned agricultural robot can then select the appropriate course, or a remotely-located operator could be involved in selecting the course for the unmanned agricultural robot to take to avoid the obstacle. In a situation where the unmanned agricultural robot is operating with many rows of crop on either side of it, a typical resolution involving an obstacle is to alter course to the right (or the left) and then continue parallel to the original direction until clear of the obstacle at which point returning to the left (or the right) until meeting and rejoining the original course. During the course of such a maneuver, the unmanned agricultural robot would necessarily drive over some of the crop in order to avoid the obstacle, and the L-FMAP would be useful in limiting crop damage during the obstacle avoidance maneuver.
0017The summary above is not intended to describe each illustrated embodiment or every implementation of the present disclosure. The figures and the detailed description that follow more particularly exemplify these embodiments.
BRIEF DESCRIPTION OF THE DRAWINGS
0018The disclosure can be more completely understood in consideration of the following detailed description of various embodiments of the disclosure, in connection with the accompanying drawings, in which:
0019<figref idref="DRAWINGS">FIG. 1</figref> is a perspective view depicting an unmanned agricultural robot with extendable mast configured with an aerial mapping sensor, in accordance with an embodiment of the disclosure.
0020<figref idref="DRAWINGS">FIG. 2</figref> is a top view depicting an observation window surrounding an autonomous agricultural robot operating between annual crop rows, in accordance with an embodiment of the disclosure.
0021<figref idref="DRAWINGS">FIG. 3</figref> depicts a geospatial data map depicting a perimeter of an agricultural field and an observation window at a starting point within an agricultural field, in accordance with an embodiment of the disclosure.
0022<figref idref="DRAWINGS">FIG. 4</figref> depicts the geospatial data map of <figref idref="DRAWINGS">FIG. 3</figref> with crop row positions plotted on the geospatial data map, wherein actual crop row positions are indicated by solid lines and anticipated crop row positions are indicated by dashed lines.
0023<figref idref="DRAWINGS">FIG. 5</figref> depicts the geospatial data map of <figref idref="DRAWINGS">FIG. 4</figref>, wherein the observation window has moved, and some of the previously plotted anticipated crop row positions have been replaced by newly verified actual crop row positions.
0024<figref idref="DRAWINGS">FIG. 6</figref> depicts the geospatial data map of <figref idref="DRAWINGS">FIG. 5</figref>, wherein the observation window has moved to a curve at the corner of the agricultural field.
0025<figref idref="DRAWINGS">FIG. 7</figref> depicts the geospatial data map of <figref idref="DRAWINGS">FIG. 6</figref>, wherein the observation window has moved further through the curve at the corner of the agricultural field.
0026<figref idref="DRAWINGS">FIG. 8</figref> depicts the geospatial data map of <figref idref="DRAWINGS">FIG. 7</figref>, wherein newly measured crop row positions have been plotted as actual crop row positions.
0027<figref idref="DRAWINGS">FIG. 9</figref> depicts the geospatial data map of <figref idref="DRAWINGS">FIG. 8</figref>, wherein the observation window has moved to another curve at a corner of the agricultural field.
0028<figref idref="DRAWINGS">FIG. 10</figref> depicts the geospatial data map of <figref idref="DRAWINGS">FIG. 9</figref>, wherein the observation window has moved further through the curve at a corner of the agricultural field.
0029<figref idref="DRAWINGS">FIG. 11</figref> depicts the geospatial data map of <figref idref="DRAWINGS">FIG. 10</figref>, with additional newly measured crop row positions plotted.
0030<figref idref="DRAWINGS">FIG. 12</figref> depicts the geospatial data map of <figref idref="DRAWINGS">FIG. 11</figref>, with the actual crop row positions plotted as a path in proximity to a perimeter of the agricultural field.
0031<figref idref="DRAWINGS">FIG. 13</figref> depicts a partial geospatial data map depicting anticipated crop row positions (indicated by dashed lines), as well as an area of heavy weed growth (hashed area), in accordance with an embodiment of the disclosure.
0032<figref idref="DRAWINGS">FIG. 14</figref> depicts the partial geospatial data map of <figref idref="DRAWINGS">FIG. 13</figref>, wherein the actual crop row positions (indicated by solid lines) surrounding the heavy weed growth (hashed area) within an observation window have been measured, while the remaining rows in the partial geospatial data map outside of the observation window remain as anticipated crop row positions (indicated by dashed lines).
0033<figref idref="DRAWINGS">FIG. 15</figref> depicts a partial geospatial data map depicting an area with partially overlapping crop rows (hashed area), in accordance with an embodiment of the disclosure.
0034<figref idref="DRAWINGS">FIG. 16</figref> depicts a partial geospatial data map, wherein plotted actual crop row positions (indicated by solid lines) include end segments (indicated by heavy dashed lines) that are known to be planted in error in that they overlap actual crop rows oriented in a substantially perpendicular direction.
0035<figref idref="DRAWINGS">FIG. 17</figref> depicts a partial geospatial data map depicting an obstacle (hashed area), such as a rock, located between anticipated crop row positions (indicated by dashed lines), in accordance with an embodiment of the disclosure.
0036<figref idref="DRAWINGS">FIG. 18</figref> depicts the partial geospatial data map of <figref idref="DRAWINGS">FIG. 17</figref>, wherein the actual crop row positions (indicated by solid lines) surrounding the obstacle (hashed area) within an observation window have been measured, while the remaining rows in the partial geospatial data map outside of the observation window remain as anticipated crop row positions (indicated by dashed lines).
0037While embodiments of the disclosure are amenable to various modifications and alternative forms, specifics thereof are shown by way of example in the drawings and will be described in detail. It should be understood, however, that the intention is not to limit the disclosure to the particular embodiments described. On the contrary, the intention is to cover all modifications, equivalents, and alternatives falling within the spirit and scope of the disclosure as defined by the appended claims.
DETAILED DESCRIPTION
0038Referring to <figref idref="DRAWINGS">FIG. 1</figref>, an unmanned agricultural robot <b>100</b> is depicted according to an embodiment of the disclosure. Unmanned agricultural robot <b>100</b> can be configured to selectively perform one or more in season management tasks on an agricultural field <b>101</b> having adjacent rows of annual crop rows <b>102</b> planted so as to provide a conventional annual crop row spacing between two adjacent annual crop rows <b>102</b> of not more than thirty-six inches. Unmanned agricultural robot <b>100</b> can include a base <b>104</b> operably coupled to a plurality of ground engaging wheels <b>106</b>. Unmanned agricultural robot <b>100</b> can have a first lateral side <b>108</b>A and a second lateral side <b>108</b>B, wherein the first and second lateral sides <b>108</b>A/B oppose one another and are separated by a distance defining the width of the unmanned agricultural robot <b>100</b>, the width so dimensioned as to be receivable within the space between two adjacent annual crop rows <b>102</b>. Unmanned agricultural robot <b>100</b> can be programmed with a self-direction program to autonomously navigate the unmanned agricultural robot <b>100</b> between the two adjacent annual crop rows <b>102</b>, and to avoid other unmanned agricultural robots, while selectively performing the one or more in season management tasks on the agricultural field <b>101</b>. In some embodiments, unmanned agricultural robot <b>100</b> can include a first portion <b>110</b>, and a second portion <b>112</b>, wherein the first portion <b>110</b> is pivotably coupled to the second portion <b>112</b>, and wherein each portion includes at least one ground engaging wheel <b>106</b>.
0039In one embodiment, unmanned agricultural robot <b>100</b> includes a mast <b>114</b>. Mast <b>114</b> can be extendable and telescoping, so as to be selectively raised and lowered from the base <b>104</b> of unmanned agricultural robot <b>100</b>. One or more aerial mapping sensors <b>116</b> can be operably coupled to a top portion of the mast <b>114</b>. In one embodiment, mast <b>114</b> can extend vertically above the unmanned agricultural robot <b>100</b>, thereby deploying the one or more aerial mapping sensors <b>116</b> at a height above the annual crop rows <b>102</b>, so as to enable the one or more aerial mapping sensors <b>116</b> to capture geospatial data within an observation window of the agricultural field <b>101</b>.
0040Aerial mapping sensors <b>116</b> can be capable of providing data that can be used to localize the position of the unmanned agricultural robot <b>100</b> in relation to the annual crop rows <b>102</b> within a given observation window. Aerial mapping sensors <b>116</b> can include a standard imaging camera, a stereo camera or a laser rangefinder (LIDAR), or a combination thereof which can provide data useful for determining distances to objects.
0041Referring to <figref idref="DRAWINGS">FIG. 2</figref>, an agricultural field <b>101</b> having annual crop rows <b>102</b> is depicted. Unmanned agricultural robot <b>100</b> is positioned within agricultural field <b>101</b> with one or more aerial sensors <b>116</b> deployed at a height above the annual crop rows <b>102</b> so as to enable the one or more aerial mapping sensors <b>116</b> to capture geospatial data within an observation window <b>118</b>. In one embodiment, observation window <b>118</b> has a length of at least fifty feet and a width of at least fifty feet. In other embodiments, the size of the observation window <b>118</b> depends upon the height of the one or more aerial mapping sensors <b>116</b> above the agricultural field <b>101</b>. In one embodiment, the observation window <b>118</b> can be dimensioned such that width and length are at least equivalent to several times the nominal annual crop row <b>102</b> spacing. For example, in one embodiment, the observation window <b>118</b> has a width and length that is at least three times the nominal width of the annual crop rows <b>102</b>. In another embodiment, the observation window <b>118</b> has a width so as to permit the one or more aerial mapping sensors <b>116</b> to view between four and ten adjacent crop rows, and a length of a substantially similar dimension. Unmanned agricultural robot <b>100</b> can use the one or more aerial mapping sensors <b>116</b> to measure the actual annual crop row positions <b>120</b> within the observation window <b>118</b> for the generation of a geospatial data map <b>122</b>. Referring to <figref idref="DRAWINGS">FIG. 3</figref>, a geospatial data map <b>122</b> is depicted in accordance with an embodiment of the disclosure. The geospatial data map <b>122</b> of the entire agricultural field <b>101</b> is generated by plotting the actual and anticipated annual crop row positions within a perimeter <b>124</b> of the agricultural field <b>101</b>. The perimeter <b>124</b> of an agricultural field <b>101</b> is generally known and can be predefined, but the precise layout of the annual crop rows <b>102</b> is often not known with a high degree of precision.
0042<figref idref="DRAWINGS">FIG. 3</figref> depicts the unmanned agricultural robot <b>100</b> at a starting point. The one or more aerial mapping sensors <b>116</b> can be used to measure the actual annual crop row positions <b>120</b> within the starting point observation window <b>118</b>. One or more computer algorithms in combination with the one or more aerial mapping sensors <b>116</b> can be used to determine the exact geospatial location of the annual crop rows <b>102</b> relative to the unmanned agricultural robot <b>100</b>. The actual crop row positions <b>120</b> can then be plotted on the geospatial data map <b>122</b>, which as depicted in <figref idref="DRAWINGS">FIG. 3</figref>, can be plotted as one or more solid lines.
0043Referring to <figref idref="DRAWINGS">FIG. 4</figref>, plotting of the annual crop row positions can be extended on geospatial data map <b>122</b> by continuing to plot the anticipated annual crop row positions <b>126</b>, corresponding to the annual crop rows <b>102</b> outside of the starting point of the observation window <b>118</b>. The anticipated annual crop row positions <b>126</b> can be plotted on geospatial data map <b>122</b> as one or more dashed or dotted lines. In other embodiments, the various annual crop row positions <b>120</b> and anticipated annual crop row positions <b>126</b> are represented by other figures, including one or more continuous and/or noncontiguous symbols or representations. In embodiments where the geospatial data map <b>122</b> is stored electronically without visual display on a user interface, the anticipated annual crop row positions <b>126</b> and the actual crop row positions <b>120</b> can be represented by mathematical or other data representations.
0044In one embodiment, actual crop row positions <b>120</b> can be extended longitudinally as anticipated annual crop row positions <b>126</b>. Additional anticipated crop row positions <b>126</b> can be added laterally to either side of the actual crop row positions <b>120</b> within the perimeter <b>124</b>. Accordingly, in one embodiment, the actual annual crop row positions <b>120</b> are used to predict the anticipated annual crop row positions <b>126</b> within the perimeter <b>124</b> of agricultural field <b>101</b>.
0045Referring to <figref idref="DRAWINGS">FIG. 5</figref>, the self-direction program of the unmanned agricultural robot <b>100</b> can be activated to autonomously navigate the unmanned agricultural robot <b>100</b> within the perimeter <b>124</b> of the agricultural field <b>101</b>, while selectively performing one or more in season management tasks. As the unmanned agricultural robot <b>100</b> moves through the agricultural field <b>101</b>, onboard navigational sensors guide the machine between both actual crop row positions <b>120</b> (depicted as solid lines) and anticipated crop row positions <b>126</b> (depicted as dashed lines) until such a point that the layout of actual crop rows <b>120</b> or other vegetation create significant uncertainty about the correct path for the agricultural robot <b>100</b> to follow. At this point, the aerial mapping sensor <b>116</b> can be deployed and a local field map (L-FMAP) determined within the observation window <b>118</b>, creating additional actual crop row positions <b>120</b> for reference.
0046In one embodiment, as the unmanned agricultural robot <b>100</b> advances between anticipated crop row positions <b>126</b> without encountering unexpected vegetation, some portion of the anticipated crop row positions <b>126</b> are re-labeled as actual crop rows <b>120</b>.
0047Referring to <figref idref="DRAWINGS">FIGS. 6-12</figref>, a nonstandard annual crop row layout may exist at curved rows at the corners of the agricultural field <b>101</b>. In these situations, the one or more aerial mapping sensors <b>116</b> can be used to capture the actual crop row positions <b>120</b>, and can be used to refine geospatial data map <b>122</b>. When progressing through curved rows, the measured, actual crop row positions <b>120</b> can be used to predict anticipated annual crop row positions <b>126</b>, particularly when approaching the perimeter <b>124</b> of the agricultural field <b>101</b>. For example, given a known location of the perimeter <b>124</b> of the agricultural field, the actual crop row positions <b>120</b> can be used to extend a pattern of anticipated annual crop row positions <b>126</b> to update and further refine the geospatial data map <b>122</b>.
0048Referring to <figref idref="DRAWINGS">FIGS. 13-14</figref>, a partial depiction of a geospatial data map <b>122</b> in which anticipated annual crop row positions <b>126</b> are plotted (depicted by dashed lines) may include one or more areas of heavy weed growth <b>128</b>. The area of heavy weed growth <b>128</b> may not be initially plotted on the geospatial data map <b>122</b>. In other embodiments, known areas of heavy weed growth <b>128</b> can be initially plotted on geospatial data map <b>122</b>, and refined by measurement from aerial mapping sensors <b>116</b> at a later time. For example, observation window <b>118</b> can be moved along with unmanned agricultural robot <b>100</b> to the area of agricultural field <b>101</b> containing the area of heavy weed growth <b>128</b>. The actual position of area of heavy weed growth <b>128</b>, along with its dimensions, density, and the surrounding actual crop row positions <b>120</b> can be measured by the one or more aerial mapping sensors <b>116</b>. The area of heavy weed growth <b>128</b> and the surrounding actual crop row positions <b>120</b> can then be plotted on geospatial data map <b>122</b>, as depicted in <figref idref="DRAWINGS">FIG. 14</figref>. In such a scenario, the unmanned agricultural robot <b>100</b> can then continue moving forward through the area of heavy weed growth <b>128</b> with a high degree of certainty that it is running over weeds and not through annual crop rows <b>102</b>. In another scenario, the unmanned agricultural robot <b>100</b> could simultaneously take action to remediate the identified weed growth as it continues to carry out the main in season management task.
0049Referring to <figref idref="DRAWINGS">FIGS. 15-16</figref>, a partial depiction of a geospatial data map <b>122</b> in which an area with partially overlapping annual crop rows <b>130</b> is depicted. Areas of overlapping annual crop rows <b>130</b> most commonly occur near the perimeter <b>124</b> of the agricultural field <b>101</b>. The area with partially overlapping annual crop rows <b>130</b> may not be initially plotted on the geospatial data map <b>122</b>. In other embodiments, known areas of partially overlapping annual crop rows <b>130</b> can be initially plotted on the geospatial data map <b>122</b>, and refined by measurement from aerial mapping sensors <b>116</b> at a later time. For example, observation window <b>118</b> can be moved along with unmanned agricultural robot <b>100</b> to the area of the agricultural field <b>101</b> containing the area with partially overlapping annual crop rows <b>130</b>. The actual position of the area with partially overlapping crop rows <b>130</b> can be measured by the one or more aerial mapping sensors <b>116</b>, wherein the area with partially overlapping annual crop rows <b>130</b> can be comprised of actual crop row positions <b>120</b> that can be plotted on the geospatial data map <b>122</b>.
0050As depicted in <figref idref="DRAWINGS">FIG. 16</figref>, in one embodiment, the unmanned agricultural robot <b>100</b> can identify some of the actual crop row positions <b>120</b> as having been mis-planted row segments <b>132</b>. The mis-planted row segments <b>132</b> can then be plotted on geospatial data map <b>122</b>. The unmanned agricultural robot can then continue to operate within the area with partially overlapping annual crop rows <b>130</b>, being careful to avoid the correctly planted actual crop row positions <b>120</b>, but treating the mis-planted row segments <b>132</b> as crop plants that can be driven over as needed.
0051Referring to <figref idref="DRAWINGS">FIGS. 17-18</figref>, a partial depiction of the geospatial data map <b>122</b> in which anticipated annual crop row positions <b>126</b> are plotted (depicted by dashed lines) may include one or more obstacles <b>134</b>. An obstacle <b>134</b> may be initially plotted on the geospatial data map <b>122</b>, particularly where an obstacle <b>134</b> is known. In other embodiments, obstacles <b>134</b> may not be recognized until one or more onboard cameras on the unmanned agricultural robot <b>100</b> have detected an obstacle <b>134</b> in the intended path of the unmanned agricultural robot <b>100</b> during operation. In this situation, the mast <b>114</b> could be deployed to raise the aerial mapping sensor <b>116</b> above obstacle <b>134</b> to obtain a bird's eye view of the obstacle <b>134</b>. The actual position of the obstacle <b>134</b>, along with the surrounding actual crop row positions <b>120</b> can then be plotted on geospatial data map <b>122</b>, as depicted in <figref idref="DRAWINGS">FIG. 18</figref>.
0052It should be understood that the individual steps used in the methods of the present teachings may be performed in any order and/or simultaneously, as long as the teaching remains operable. Furthermore, it should be understood that the apparatus and methods of the present teachings can include any number, or all, of the described embodiments, as long as the teaching remains operable.
0053Persons of ordinary skill in the relevant arts will recognize that embodiments may comprise fewer features than illustrated in any individual embodiment described above. The embodiments described herein are not meant to be an exhaustive presentation of the ways in which the various features may be combined. Accordingly, the embodiments are not mutually exclusive combinations of features; rather, embodiments can comprise a combination of different individual features selected from different individual embodiments, as understood by persons of ordinary skill in the art. Moreover, elements described with respect to one embodiment can be implemented in other embodiments even when not described in such embodiments unless otherwise noted. Although a dependent claim may refer in the claims to a specific combination with one or more other claims, other embodiments can also include a combination of the dependent claim with the subject matter of each other dependent claim or a combination of one or more features with other dependent or independent claims. Such combinations are proposed herein unless it is stated that a specific combination is not intended. Furthermore, it is intended also to include features of a claim in any other independent claim even if this claim is not directly made dependent to the independent claim.
0054Moreover, reference in the specification to “one embodiment,” “an embodiment,” or “some embodiments” means that a particular feature, structure, or characteristic, described in connection with the embodiment, is included in at least one embodiment of the teaching. The appearances of the phrase “in one embodiment” in various places in the specification are not necessarily all referring to the same embodiment.
0055Any incorporation by reference of documents above is limited such that no subject matter is incorporated that is contrary to the explicit disclosure herein. Any incorporation by reference of documents above is further limited such that no claims included in the documents are incorporated by reference herein. Any incorporation by reference of documents above is yet further limited such that any definitions provided in the documents are not incorporated by reference herein unless expressly included herein.
0056For purposes of interpreting the claims, it is expressly intended that the provisions of Section 112, sixth paragraph of 35 U.S.C. are not to be invoked unless the specific terms “means for” or “step for” are recited in a claim.
Contents6
21 sheets
Sheet 1 Sheet 2 Sheet 3 Sheet 4 Sheet 5 Sheet 6 Sheet 7 Sheet 8 Sheet 9 Sheet 10 Sheet 11 Sheet 12 Sheet 13 Sheet 14 Sheet 15 Sheet 16 Sheet 17 Sheet 18 Sheet 19 Sheet 20 Sheet 21
Every citation, both ways
| Document | Relation | Office | Cited during |
|---|---|---|---|
| US10874044B2 | Cited by | United States of America | Applicant |
| US11059582B2 | Cited by | United States of America | Applicant |
| US11829155B2 | Cited by | United States of America | Search report |
| US2020255140A1 | Cited by | United States of America | Search report |
| US11001380B2 | Cited by | United States of America | Search report |
| US12219893B2 | Cited by | United States of America | Applicant |
| US11812681B2 | Cited by | United States of America | Search report |
| US2022351508A1 | Cited by | United States of America | Search report |
| US2004264763A1 | Cites | United States of America | Search report |
| US2014379228A1 | Cites | United States of America | Applicant |
| US2016124433A1 | Cites | United States of America | Applicant |
| US2016157415A1 | Cites | United States of America | Applicant |
| US2016361949A1 | Cites | United States of America | Applicant |
| US4628633A | Cites | United States of America | Applicant |
| US5884224A | Cites | United States of America | Applicant |
| US6199000B1 | Cites | United States of America | Applicant |
| US6516271B2 | Cites | United States of America | Applicant |
| US6553299B1 | Cites | United States of America | Applicant |
| US6553312B2 | Cites | United States of America | Applicant |
| US8683742B1 | Cites | United States of America | Applicant |
| US8744626B2 | Cites | United States of America | Applicant |
| US8849523B1 | Cites | United States of America | Applicant |
| US9265187B2 | Cites | United States of America | Applicant |
| US9288938B2 | Cites | United States of America | Applicant |
| US9389298B2 | Cites | United States of America | Applicant |
| US9392743B2 | Cites | United States of America | Applicant |
| US20040264763A1 | Cites | United States of America | Search report |
| US20140379228A1 | Cites | United States of America | Applicant |
| US20160124433A1 | Cites | United States of America | Applicant |
| US20160157415A1 | Cites | United States of America | Applicant |
| US20160361949A1 | Cites | United States of America | Applicant |
7 members in 1 office; this record represents the family
Priority claims1
| Document | Office | Kind | Date |
|---|---|---|---|
| 201662293070 | United States of America | P |
Members7
| Document | Office | Kind | |
|---|---|---|---|
| US2017223889A1 | United States of America | A1 | |
| US10070577B2This record | United States of America | B2 | |
| US2019069475A1 | United States of America | A1 | |
| US10874044B2 | United States of America | B2 | |
| US2021112704A1 | United States of America | A1 | |
| US12219893B2 | United States of America | B2 | |
| US2025160244A1 | United States of America | A1 |
35 transactions on the USPTO file
Allowed without a rejection on record.
- Non-final rejections
- 0
- Final rejections
- 0
- RCEs
- 0
- Appeals
- 0
Over time
Point at a mark for the transactionTransactions
| Event | Code | |
|---|---|---|
| Payment of Maintenance Fee, 4th Yr, Small EntityM2551 | M2551 | |
| Recordation of Patent Grant MailedPGM/ | PGM/ | |
| Patent Issue Date Used in PTA CalculationAllowedPTAC | PTAC | |
| Issue Notification MailedAllowedWPIR | WPIR | |
| Dispatch to FDCD1935 | D1935 | |
| Application Is Considered Ready for IssuePILS | PILS | |
| Issue Fee Payment VerifiedN084 | N084 | |
| Issue Fee Payment ReceivedIFEE | IFEE | |
| Mail Notice of AllowanceAllowedMN/=. | MN/=. | |
| Notice of Allowance Data Verification CompletedAllowedN/=. | N/=. | |
| Reasons for AllowanceEX.R | EX.R | |
| Information Disclosure Statement consideredIDSC | IDSC | |
| Case Docketed to Examiner in GAUDOCK | DOCK | |
| Application ready for PDX access by participating foreign officesCCRDY | CCRDY | |
| PG-Pub Issue NotificationPG-ISSUE | PG-ISSUE | |
| Case Docketed to Examiner in GAUDOCK | DOCK | |
| Case Docketed to Examiner in GAUDOCK | DOCK | |
| Application Dispatched from OIPEOIPE | OIPE | |
| Change in Power of Attorney (May Include Associate POA)PA.. | PA.. | |
| Sent to Classification ContractorPGPC | PGPC | |
| FITF set to YES - revise initial settingFTFS | FTFS | |
| Application Is Now CompleteCOMP | COMP | |
| Filing Receipt - UpdatedFLRCPT.U | FLRCPT.U | |
| Patent Term Adjustment - Ready for ExaminationPTA.RFE | PTA.RFE | |
| Payment of additional filing fee/PreexamFLFEE | FLFEE | |
| Information Disclosure Statement (IDS) FiledWIDS | WIDS | |
| Notice Mailed--Application Incomplete--Filing Date AssignedINCD | INCD | |
| Filing ReceiptFLRCPT.O | FLRCPT.O | |
| Applicant Has Filed a Verified Statement of Small Entity Status in Compliance with 37 CFR 1.27SMAL | SMAL | |
| Cleared by OIPE CSRL194 | L194 | |
| PTO/SB/69-Authorize EPO Access to Search ResultsSREXR141 | SREXR141 | |
| Applicants have given acceptable permission for participating foreignAPPERMS | APPERMS | |
| IFW Scan & PACR Auto Security ReviewSCAN | SCAN | |
| Entity Status Set To Undiscounted (Initial Default Setting or Status Change)BIG. | BIG. | |
| Initial Exam Team nnIEXX | IEXX |
4 legal events, as the office reported them to INPADOC
Over the term
Point at a mark for the eventEvents
| Event | Code | |
|---|---|---|
| Maintenance fee paymentMAFP | MAFP | |
| Maintenance fee paymentMAFP | MAFP | |
| Information on status: patent grantGrantedPATENTED CASESTCF | STCF | |
| AssignmentAS | AS |
Numbers
- Publication
- 10070577
- Application
- 15427265
Titles
- English
- Real-time field mapping for autonomous agricultural platform
Patent term adjustment
- A delay
- +32 daysthe office missed an examination deadline
- Net adjustment
- 32 days
Classification
- CPC, 10
- A01C21/005
- A01C21/007
- G05D1/0274
- A01B69/008
- G05D1/0088
- G05D1/021
- G05D1/00
- G05D2201/0201
- G05D1/227
- G05D1/246
- IPC, 3
- A01C21 00
- G05D1 00
- G05D1 02