Jay Shroeder, CTO at CNH – Interview Series

-

Jay Schroeder serves because the Chief Technology Officer (CTO) at CNH, overseeing the corporate’s global research and development operations. His responsibilities include managing areas reminiscent of technology, innovation, vehicles and implements, precision technology, user experience, and powertrain. Schroeder focuses on enhancing the corporate’s product portfolio and precision technology capabilities, with the aim of integrating precision solutions across your entire equipment range. Moreover, he’s involved in expanding CNH’s alternative propulsion offerings and providing governance over product development processes to make sure that the corporate’s product portfolio meets high standards of quality and performance.

Through its various businesses, CNH Industrial, produces, and sells agricultural machinery and construction equipment. AI and advanced technologies, reminiscent of computer vision, machine learning (ML), and camera sensors, are transforming how this equipment operates, enabling innovations like AI-powered self-driving tractors that help farmers address complex challenges of their work.

CNH’s self-driving tractors are powered by models trained on deep neural networks and real-time inference. Are you able to explain how this technology helps farmers perform tasks like planting with extreme precision, and the way it compares to autonomous driving in other industries like transportation?

While self-driving cars capture headlines, the agriculture industry has quietly led the autonomous revolution for greater than twenty years. Firms like CNH pioneered autonomous steering and speed control long before Tesla. Today, CNH’s technology goes beyond simply driving to conducting highly automated and autonomous work all while driving themselves. From precisely planting seeds in the bottom exactly where they should be, to efficiently and optimally harvesting crops and treating the soil, all while driving through the sphere, autonomous farming is not just keeping pace with self-driving cars – it’s leaving them within the dust. The longer term of transportation could also be autonomous, but in farming, the longer term is already here.

Further, CNH’s future-proofed tech stack empowers autonomous farming far beyond what self-driving cars can achieve. Our software-defined architecture seamlessly integrates a wide selection of technologies, enabling automation for complex farming tasks which are far more difficult than easy point-A-to-B navigation. Interoperability within the architecture empowers farmers with unprecedented control and suppleness to layer on heightened technology through CNH’s open APIs. Unlike closed systems, CNH’s open API allows farmers to customize their machinery. Imagine camera sensors that distinguish crops from weeds, activated only when needed—all while the vehicle operates autonomously. This adaptability, combined with the flexibility to handle rugged terrain and diverse tasks, sets CNH’s technology apart. While Tesla and Waymo make strides, the true frontier of autonomous innovation lies within the fields, not on the roads.

The concept of an “MRI machine for plants” is fascinating. How does CNH’s use of synthetic imagery and machine learning enable its machines to discover crop type, growth stages, and apply targeted crop nutrition?

Using AI, computer vision cameras, and big data sets, CNH is training models to differentiate crops from weeds, discover plant growth stages, and recognize the health of the crop across the fields to find out the precise amount of nutrients and protection needed to optimize a crop’s yield. For instance, with the Augmenta Field Analyzer, a pc vision application scans the bottom in front of the machine because it’s quickly moving through the sphere (at as much as 20 mph) to evaluate crop conditions on the sphere and which areas should be treated, and at what rate, to make those areas healthier.

With this technology, farmers are capable of know and treat exactly where in the sphere an issue is constructing in order that as a substitute of blanketing a complete field with a treatment to kill weeds, control pests, or add needed nutrients to spice up the health of the crops, AI and data-informed spraying machines robotically spray only the plants that need it. The technology enables the precise amount of chemical needed, applied in precisely the proper spot to exactly address the plants’ needs and stop any threat to the crop. Identifying and spraying only (and exactly) weeds as they grow amongst crops will eventually reduce the usage of chemicals on fields by as much as 90%. Only a small amount of chemical is required to treat each individual threat fairly than treating the entire field so as to reach those self same few threats.

To generate photorealistic synthetic images and improve datasets quickly, CNH uses biophysical procedural models. This permits the team to quickly and efficiently create and classify thousands and thousands of images without having to take the time to capture real imagery at the size needed. The synthetic data augments authentic images, improving model training and inference performance. For instance, through the use of synthetic data, different situations might be created to coach the models – reminiscent of various lighting conditions and shadows that move throughout the day. Procedural models can produce specific images based on parameters to create a dataset that represents different conditions.

How accurate is that this technology in comparison with traditional farming methods?

Farmers make a whole bunch of serious decisions all year long but only see the outcomes of all those cumulative decisions once: at harvest time. The common age of a farmer is increasing and most work for greater than 30 years. There isn’t any margin for error. From the moment the seed is planted, farmers must do every thing they’ll to make certain the crop thrives – their livelihood is on the road.

Our technology takes a number of the guesswork out of farmers’ tasks, reminiscent of determining one of the best ways to look after growing crops, while giving farmers overtime back to deal with solving strategic business challenges. At the tip of the day, farmers are running massive businesses and depend on technology to assist them achieve this most efficiently, productively and profitably.

Not only does the info generated by machines allow farmers to make higher, more informed decisions to improve results, however the high levels of automation and autonomy within the machines themselves perform the work higher and at a better scale than humans are capable of do. Spraying machines are capable of “see” trouble spots in hundreds of acres of crops higher than human eyes and might precisely treat threats; while technology like autonomous tillage is capable of relieve the burden of doing an arduous, time-consuming task and perform it with more accuracy and efficiency at scale than a human could. In autonomous tillage, a totally autonomous system tills the soil through the use of sensors combined with deep neural networks to create ideal conditions with centimeter-level precision. This prepares the soil to permit for highly consistent row spacing, precise seed depth, and optimized seed placement despite often drastic soil changes across even one field. Traditional methods, often reliant on human-operated machinery, typically lead to more variability in results as a consequence of operator fatigue, less consistent navigation, and fewer accurate positioning.

During harvest season, CNH’s mix machines use edge computing and camera sensors to evaluate crop quality in real-time. How does this rapid decision-making process work, and what role does AI play in optimizing the harvest to cut back waste and improve efficiency?

A mix is an incredibly complex machine that does multiple processes — reaping, threshing, and gathering — in a single, continuous operation. It’s called a mix for that very reason: it combines what was once multiple devices right into a single factory-on-wheels. There’s quite a bit happening without delay and little room for error. CNH’s mix robotically makes thousands and thousands of rapid decisions every twenty seconds, processing them on the sting, right on the machine. The camera sensors capture and process detailed images of the harvested crops to find out the standard of every kernel of the crop being harvested — analyzing moisture levels, grain quality, and debris content. The machine will robotically make adjustments based on the imagery data to deploy one of the best machine settings to get optimal results. We will do that today for barley, rice, wheat, corn, soybeans, and canola and can soon add capabilities for sorghum, oats, field peas, sunflowers, and edible beans.

AI at the sting is crucial in optimizing this process through the use of deep learning models trained to acknowledge patterns in crop conditions. These models can quickly discover areas of the harvest that require adjustments, reminiscent of altering the mix’s speed or modifying threshing settings to make sure higher separation of grain from the remainder of the plant (as an example, keeping only every corn kernel and removing all pieces of the cob and stalk). This real-time optimization helps reduce waste by minimizing crop damage and collecting only high-quality crops. It also improves efficiency, allowing machines to make data-driven decisions on the go to maximise farmers’ crop yield, all while reducing operational stress and costs.

Precision agriculture driven by AI and ML guarantees to cut back input waste and maximize yield. Could you elaborate on how CNH’s technology helps farmers cut costs, improve sustainability, and overcome labor shortages in an increasingly difficult agricultural landscape?

Farmers face tremendous hurdles to find expert labor. This is very true for tillage – a critical step most farms require to arrange the soil for winter to make for higher planting conditions within the spring. Precision is important in tillage with accuracy measured to the tenth of an inch to create optimal crop growth conditions. CNH’s autonomous tillage technology eliminates the necessity for highly expert operators to manually adjust tillage implements. With the push of a button, the system autonomizes the entire process, allowing farmers to deal with other essential tasks. This boosts productivity and the precision conserves fuel, making operations more efficient.

In terms of crop maintenance, CNH’s sprayer technology is outfitted with greater than 125 microprocessors that communicate in real-time to boost cost-efficiency and sustainability of water, nutrient, herbicide, and pesticide use. These processors collaborate to investigate field conditions and precisely determine when and where to use these nutrients, eliminating an overabundance of chemicals by as much as 30% today and as much as 90% within the near future, drastically cutting input costs and the quantity of chemicals that go into the soil. The nozzle control valves allow the machine to accurately apply the product by robotically adjusting based on the sprayer’s speed, ensuring a consistent rate and pressure for precise droplet delivery to the crop so each drop lands exactly where it must be for the health of the crop. This level of precision reduces the necessity for frequent refills, with farmers only needing to fill the sprayer once per day, resulting in significant water/chemical conservation.

Similarly, CNH’s Cart Automation simplifies the complex and high-stress task of operating a mix during harvest. Precision is crucial to avoid collisions between the mix header and the grain cart driving inside inches of one another for hours at a time. It also helps lessen crop loss. Cart Automation enables a seamless load-on-the-go process, reducing the necessity for manual coordination and facilitating the mix to proceed performing its job without having to stop. CNH has done physiological testing that shows this assistive technology lowers stress for mix operators by roughly 12% and for tractor operators by 18%, which adds up when these operators are in these machines for as much as 16 hours a day during harvest season.

CNH brand, Recent Holland, recently partnered with Bluewhite for autonomous tractor kits. How does this collaboration fit into CNH’s broader strategy for expanding autonomy in agriculture?

Autonomy is the longer term of CNH, and we’re taking a purposeful and strategic approach to developing this technology, driven by essentially the most pressing needs of our customers. Our internal engineers are focused on developing autonomy for our large agriculture customer segment– farmers of crops that grow in large, open fields, like corn and soybeans. One other vital customer base for CNH is farmers of what we call “everlasting crops” that grow in orchards and vineyards. Partnering with Bluewhite, a proven leader in implementing autonomy in orchards and vineyards, allows us the size and speed to market to have the ability to serve each the massive ag and everlasting crop customer segments with critically needed autonomy. With Bluewhite, we’re delivering a totally autonomous tractor in everlasting crops, making us the primary original equipment manufacturer (OEM) with an autonomous solution in orchards and vineyards.

Our approach to autonomy is to unravel essentially the most critical challenges customers have in the roles and tasks where they’re longing for the machine to finish the work and take away the burden on labor.  Autonomous tillage leads our internal job autonomy development since it’s an arduous task that takes an extended time during a tightly time-constrained period of the yr when quite a lot of other things also must occur. A machine on this instance can perform the work higher than a human operator. Everlasting crop farmers even have an urgent need for autonomy, as they face extreme labor shortages and want machines to fill the gaps. These jobs require the tractors to drive 20-30 passes through each orchard or vineyard row per season, performing vital jobs like applying nutrients to the trees and keeping the grass between vines mowed and freed from weeds.

Lots of CNH’s solutions are being adopted by orchard and vineyard operators. What unique challenges do these environments present for autonomous and AI-driven machinery, and the way is CNH adapting its technologies for such specialized applications? 

The windows for harvesting are changing, and finding expert labor is harder to return by. Climate change is making seasons more unpredictable; it’s mission-critical for farmers to have technology able to go that drives precision and efficiency for when crops are optimal for harvesting. Farming all the time requires precision, however it’s particularly needed when harvesting something as small and delicate as a grape or nut.

Most automated driving technologies depend on GPS to guide machines on their paths, but in orchards and vineyards those GPS signals might be blocked by tree and vine branches. Vision cameras and radar are used along with GPS to maintain machines on their optimal path. And, with orchards and vineyards, harvesting shouldn’t be about acres of uniform rows but fairly individual, varied plants and trees, often in hilly terrain. CNH’s automated systems adjust to every plant’s height, the bottom level, and required picking speed to make sure a top quality yield without damaging the crop. Additionally they adjust around unproductive or dead trees to save lots of unnecessary inputs. These robotic machines robotically move along the plants, safely straddling the crop while delicately removing the produce from the tree or vine. The operator sets the specified picking head height, and the machines robotically adjust to keep up those settings per plant, whatever the terrain. Further, for some fruits, one of the best time to reap is when its sugar content peaks overnight. Cameras equipped with infrared technology work in even the darkest conditions to reap the fruit at its optimal condition.

As more autonomous farming equipment is deployed, what steps is CNH taking to make sure the security and regulatory compliance of those AI-powered systems, particularly in diverse global farming environments?

Safety and regulatory compliance are central to CNH’s AI-powered systems, thus CNH collaborates with local authorities in several regions, allowing the corporate to adapt its autonomous systems to satisfy regional requirements, including safety standards, environmental regulations, and data privacy laws. CNH can also be energetic in standards organizations to make sure we meet all recognized and emerging standards and requirements.

For instance, autonomous safety systems include sensors like cameras, LiDAR, radar and GPS for real-time monitoring. These technologies enable the equipment to detect obstacles and robotically stop when it detects something ahead. The machines may also navigate complex terrain and reply to environmental changes, minimizing the danger of accidents.

What do you see as the largest barriers to widespread adoption of AI-driven technologies in agriculture? How is CNH helping farmers transition to those latest systems and demonstrating their value?

Currently, essentially the most significant barriers are cost, connectivity, and farmer training.

But higher yields, lowered expenses, lowered physical stress, and higher time management through heightened automation can offset the entire cost of ownership. Smaller farms can profit from more limited autonomous solutions, like feed systems or aftermarket upgrade kits.

Inadequate connectivity, particularly in rural areas, poses challenges. AI-driven technologies require consistent, always-on connectivity. CNH helps to deal with that through its partnership with Intelsat and thru universal modems that hook up with whatever network is nearby–wifi, cellular, or satellite–providing field-ready connectivity for purchasers in hard to succeed in locations. While many purchasers fulfill this need for web connectivity with CNH’s market-leading global mobile virtual network, existing cellular towers don’t enable pervasive connection.

Lastly, the perceived learning curve related to AI technology can feel daunting. This shift from traditional practices requires training and a change in mindset, which is why CNH works hand-in-hand with customers to make certain they’re comfortable with the technology and are getting the complete advantage of systems.

Looking ahead, how do you envision CNH’s AI and autonomous solutions evolving over the subsequent decade?

CNH is tackling critical, global challenges by developing cutting-edge technology to provide more food sustainably through the use of fewer resources, for a growing population. Our focus is empowering farmers to enhance their livelihoods and businesses through revolutionary solutions, with AI and autonomy playing a central role. Advancements in data collection, affordability of sensors, connectivity, and computing power will speed up the event of AI and autonomous systems. These technologies will drive progress in precision farming, autonomous operation, predictive maintenance, and data-driven decision-making, ultimately benefiting our customers and the world.

ASK ANA

What are your thoughts on this topic?
Let us know in the comments below.

0 0 votes
Article Rating
guest
0 Comments
Oldest
Newest Most Voted
Inline Feedbacks
View all comments

Share this article

Recent posts

0
Would love your thoughts, please comment.x
()
x