Agriculture and Field Robots

Methods for Simultaneous Orchard and Harvesting Robot Design


Robotic manipulators can perform a variety of agricultural tasks. However, despite decades of research, few agricultural robots have been commercialized. One of the reasons for the lack of agricultural robots on the market today is their high cost, which makes them unprofitable for farmers.

To decrease the cost of robot manipulators for agriculture by improving the robot performance, we propose designing a robot that is optimal for a specific task. In the optimization process, the robot’s performance is maximized keeping the ability of the robot to perform the task. To achieve a reliable result, the actual field task must be described and modeled with sufficient precision. However, the complex and unstructured environment of agricultural tasks complicates the task description as well as the robot-design process.

The main goal of this research is to develop methods for simultaneous design of orchard and harvesting robot. The orchard is the geometrical environment of the agricultural tasks, and its influence and interaction with the task-based robot optimal design was analyzed. This analysis allows to simplify the task description by characterizing the environment during the simultaneous design of the robot and its environment.

Relevant publication:

  • A Methodology of Orchard Architecture Design for an Optimal Harvesting Robot. Victor Bloch, Amir Degani, and Avital Bechar, Biosystems Engineering, 166:126-137, doi:10.1016/j.biosystemseng.2017.11.006, 2018 (link).
  • Development of an Environment Characterization Methodology for Optimal Design of an Agricultural Robot. Victor Bloch, Avital Bechar, and Amir Degani,  Industrial Robot, 44(1), doi: 10.1108/IR-03-2016-0113, 2017 (link, PDF).
  • Task characterization and classification for robotic manipulator optimal design in precision agriculture. Victor Bloch (Chernishev), Avital Bechar, and Amir Degani, Proc. of the 10th European Conference on Precision Agriculture (ECPA), Bet Dagan, Israel, July 2015.

Modular Agriculture Task-Based Robot


  

In this work, we suggest a new approach to design an optimal, modular re-configurable agriculture manipulator. The definition of a modular robot is that it comprises of a number of basic modules. These modules can be changed, replaced and reordered at any needed configuration. Moreover, we suggest that the joints be made of the same basic parts, so the length of the joints can also be easily adjusted as needed. Installation angles, e.g. angles between different joints can be also changed during the re-configuration. Below we separate two types of modularity: with or without changing the joints order. In both types, length and installation angles changes are allowed.

Relevant publication:

Design of a Task-Based Modular Re-Configurable Agricultural Robot. Mark Levinand Amir Degani, Proc. of the 5th IFAC Conference on Sensing, Control and Automation for Agriculture (AgriControl 2016), Seattle, WA, Aug., 2016

 

 

Air-Ground collaboration


 

 

In an era of precision agriculture, precise localization is a mandatory capability for every robot. In orchards, where Unmanned Aerial Vehicles (UAVs) and Unmanned Ground Vehicles (UGVs) are common already, it only makes sense to leverage one from another for the achieving better localization. A UAV’s downward looking camera can facilitate the estimation of the relativity between the robots. Streaming this information into each of the robots’ state estimators (typically an Extended Kalman Filter) can lead to improved localization results.

 

Aerial Tree scanning


An important task in precision agriculture is yield monitoring and estimation. In orchards, conclusions can be drawn based on the tree’s shape: canopy volume, trunk diameter, etc. For estimating those parameters and more, a 3D scan of a tree can be very helpful. Aerial vehicles are suitable for this task thanks to their ability to cover a tree from every orientation and at different altitudes. The control of the vehicle and the stitching of a 3D pointcloud present interesting challenges. We have implemented 3D Slam using RTAB using our Bebop2 with a pc and Realsense on top of the aerial vehicle.

Reinforcement Learning for Autonomous Vehicle Navigation in Unknown Rough Terrain


Reinforcement learning is an exciting area of machine learning which takes artificial intelligence to the next level.
Currently, off-road navigation typically classifies obstacles in a binary way of traversable or non-traversable which requires human labeling and can reduce the utilization of off-road vehicles.
We aim to  harness the power of deep neural networks in order to navigate off-road vehicle in rough terrain without human supervision.
Through interaction with the environment the reinforcement learning algorithm learns a policy that maps the robot’s state and observation to an action

Autonomous Stretcher


The overall aim of this project is to design an autonomous system for evacuating wounded soldiers in the field. The system will consist of an autonomous ground vehicle in which the injured soldier can be placed onto a “smart stretcher” and receive initial medical care, and an autonomous vertical take-off and landing air vehicle capable of operating from on top of the ground vehicle. The approach applied in this project will use the benefit of the unmanned ground vehicle which may approach a location without risking more lives and extract the wounded soldier to a location a safe distance from the threatened area, all while initial medical care is administered.

As the off-road autonomous vehicle, we use the Clearphath Grizzly 4X4 skid steering vehicle controlled by the open-sourced Robotic Operating System (ROS) and integrated with a high accuracy dGPS, stereo camera on top of a pan-tilt unit, Sick 2D laser scanner and a custom built shock absorber system for the stretcher.

Past Projects

Vehicle Steering Using an Overhead Guide in Greenhouse Tasks


We have developed an autonomous vehicle steering control algorithm to aid with harvesting and spraying tasks in greenhouses to alleviate the problem of shortage of workers. We use an overhead guide constructed in the greenhouse to mark the desired path of the vehicle. A rigid bar is then connected from the guide to the vehicle. The vehicle steers and corrects itself by sensing the angle and distance of the vehicle from the guide. The control algorithm was developed for a two-dimensional kinematic vehicle model which was found to be valid for low-speed vehicles. The steering control was examined by numerical simulation in order to investigate the effects of parameters such as control-point location on stability deviations of the vehicle path. The asymptotic stability of the system was verified analytically and confirmed using numerical simulations. The control system was then simulated using a multibody dynamics simulation in conditions that better simulated an agricultural environment, thus confirming that the control system also maintained stability under rough conditions. Finally, in accordance with the control algorithm and the simulations, a proof-of-concept prototype of the vehicle was developed and the control algorithm was successfully deployed on a set of experiments.

Relevant publication:

Vehicle Steering Using an Overhead Guide. Gilad Gat, Samuel Gan-Mor, Amir Degani, Computers and Electronics in Agriculture, Computers and Electronics in Agriculture, 121:234 – 244, doi:10.1016/j.compag.2015.12.019, 2016 (link)

Automatic Herding


The motivation of cows to be milked is a key factor in the utilisation of milking robots. If a cow does not voluntarily attend a robot stall, fetching, that requires expensive labour, is required. This research suggests a new concept, herding all the cows to the milking robot using an automatic herding system (AHS). An AHS was built as a system of slow moving mobile fences controlled by an industrial controller. The AHS herds all the cows to the milking robot. The AHS was used in a commercial farm with two milking robots, and the experiment was conducted for three months. The dairy herd was divided into a reference group (43 cows) and an experimental group (38 cows). The AHS was used only with the experiment group. Milking frequency increased in the experimental group by 45.5% (1.89 milkings d−1 vs. 2.75 milkings d−1), while there was no major change in the milking frequency in the reference group 0.4% (2.38 milkings d−1 vs. 2.39 milkings d−1). Milk yield increased in the experiment group 15.7% (35.65 kg d−1 vs. 41.25 kg d−1). There was also no major change in the milk yield in reference group 4% (31 kg d−1 vs. 29.76 kg d−1). There was an 80% decrease in labour time for fetching the cows to the milking robot in the experimental group (5 h day−1 vs. 1 h day−1) while there was no change in labour for the reference group. The AHS was therefore associated with higher milking frequency, higher milk yield and labour reduction, hence economic benefits are expected for the system.

Relevant publication:

Automatic Herding Reduces Labour and Increases Milking Frequency in Robotic Milking. Uri Drach, Ilan Halachmi, Tal Pnini, Ido Izhaki, and Amir DeganiBiosystems Engineering, 2017 (link).