# US 11,993,209 B2 · Work vehicle vision system with contextual task icons > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 11,993,209 B2 - Document ID: US11993209B2 - Status: Granted - Kind: B2 - Application number: 17/673,038 - Filed: 2022-02-16 - Published: 2022-09-29 - Granted: 2024-05-28 - Earliest claimed: 2021-03-24 - Assignees: Deere & Company; Iowa State University Research Foundation, Inc. - Applicants: Deere & Company; Iowa State University Research Foundation, Inc. - Inventors: Brian M. Huenink; Jeremy B. Shuler; Jake Flanders; Christopher M. Hoffman - Web page: https://patentgrep.com/patent/US11993209B2 ## CPC - B60R 1/27: providing all-round vision, e.g. using omnidirectional cameras - A01B 76/00: Parts, details or accessories of agricultural machines or implements, not provided for in groups A01B51/00 - A01B75/00 - B60R 1/0605: {specially adapted for mounting on trucks, e.g. by C-shaped support means} - B60R 1/12: Mirror assemblies combined with other articles, e.g. clocks - B60R 1/22: for viewing an area outside the vehicle, e.g. the exterior of the vehicle - B60R 1/28: with an adjustable field of view - B60R 11/04: Mounting of cameras operative during drive; Arrangement of controls thereof relative to the vehicle - G06F 3/1423: {controlling a plurality of local displays, e.g. CRT and flat panel display} - H04N 7/181: {for receiving images from a plurality of remote sources} - H04N 23/60: Control of cameras or camera modules - H04N 23/63: by using electronic viewfinders - H04N 23/667: Camera operation mode switching, e.g. between still and video, sport and normal or high- and low-resolution modes - H04N 23/90: Arrangement of cameras or camera modules, e.g. multiple cameras in TV studios or sports stadiums - A01C 23/008: {Tanks, chassis or related parts} - A01D 41/127: Control or measuring arrangements specially adapted for combines - A01D 75/185: {Avoiding collisions with obstacles} - A01D 90/10: Unloading means - A01M 7/0071: {Construction of the spray booms} - A01M 7/0085: {Tanks} - B60R 2001/1253: {with cameras, video cameras or video screens} - B60R 2011/004: {outside the vehicle} - B60R 2300/101: using cameras with adjustable capturing direction - B60R 2300/105: using multiple cameras - B60R 2300/20: characterised by the type of display used - B60R 2300/202: displaying a blind spot scene on the vehicle part responsible for the blind spot - B60R 2300/303: using joined images, e.g. multiple camera images - B60R 2300/305: merging camera image with lines or icons - B60R 2300/607: from a bird's eye viewpoint - B60R 2300/70: characterised by an event-triggered choice to display a specific image among a selection of captured images - G09G 2380/10: Automotive applications - B60R: VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR - A01B: SOIL WORKING IN AGRICULTURE OR FORESTRY; PARTS, DETAILS, OR ACCESSORIES OF AGRICULTURAL MACHINES OR IMPLEMENTS, IN GENERAL (making or covering furrows or holes for sowing, planting or manuring A01C5/00; mowers convertible to soil working apparatus or capable of soil working A01D42/04; mowers combined with soil working implements A01D43/12; soil working for engineering purposes E01, E02, E21) - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION - A01C: PLANTING; SOWING; FERTILISING (parts, details or accessories of agricultural machines or implements, in general A01B51/00 - A01B75/00) - A01D: HARVESTING; MOWING - A01M: CATCHING, TRAPPING OR SCARING OF ANIMALS (appliances for catching swarms or drone-catching A01K57/00; fishing A01K69/00 - {A01K99/00}; biocides, pest repellants or attractants A01N); APPARATUS FOR THE DESTRUCTION OF NOXIOUS ANIMALS OR NOXIOUS PLANTS - G09G: ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION (arrangements for transferring data between digital computers and displays G06F3/14; static indicating arrangements comprising an association of a number of separate sources or light control cells G09F9/00; static indicating arrangements comprising integral associations of a number of light sources H01J, H01K, H10H, H05B33/12; scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission, details thereof H04N1/00) ## Abstract A multi-camera vision system is utilized onboard a work vehicle having an operator cabin and an apparatus associated with performance of a work task. The system includes: one or more display devices defining a plurality of display areas and a plurality of cameras carried by the work vehicle and coupled to display feeds at the display areas. A first camera of the cameras is oriented to selectively provide a first selected feed of at least a portion of the apparatus during performance of the work task. A controller is configured to display the first selected feed of the selected feeds with an insert, overlay, or icon that indicates the origin and orientation of the first camera as the first selected feed depicts performance of the work task by the apparatus. ## Claims ### Claim 1 A multi-camera vision system utilized onboard a work vehicle having an operator cabin and an apparatus in the form of a work implement associated with performance of a work task, the multi-camera vision system comprising: a plurality of display devices within the operator cabin defining a plurality of display areas arranged at a first side of the work vehicle, a second side of the work vehicle, and a central location of the work vehicle between the first and second sides relative to an operator field of view (FOV); a plurality of cameras carried by the work vehicle and coupled to the plurality of display devices to display feeds at the plurality of display areas, wherein the plurality of cameras are at or trained on the first side, the second side, and the central location between the first and second sides relative to the operator FOV, including a first camera selectively providing a first selected feed of at least a portion of the apparatus during performance of the work task and including a second camera providing a second selected feed of an area other than the apparatus; a sensor configured to provide sensor data indicative of a position or a status of the apparatus; and a controller having processing architecture configured to control, or receive control instructions regarding, the selection of feeds to display at the plurality of display areas, the controller is configured to display a standard set of feeds from the associated first side, second side, and central location of the plurality of cameras at the plurality of display devices so that the associated feeds are arranged at the first side, the second side, and the central location, respectively, relative to the operator FOV, and wherein the controller is configured to display the standard set of feeds each with an insert, overlay, or icon that indicates an origin and orientation of the associated camera including for the first camera providing the first selected feed depicting performance of the work task by the apparatus; wherein the controller is configured to operate in a non-working mode in which the controller is configured to display a second selected feed from the second camera in at least one of the plurality of display areas and in a working mode in which the controller is configured to display the first selected feed from the first camera in at least one of the plurality of display areas; and wherein the controller is configured to process the sensor data and automatically switch between the non-working mode and the working mode based on the position or status of the apparatus to display either the first selected feed or the second selected feed. ### Claim 2 (depends on 1) The multi-camera vision system of claim 1, wherein the first camera is supported on a chassis of the work vehicle. ### Claim 3 (depends on 1) The multi-camera vision system of claim 1, wherein the first camera is supported on the apparatus. ### Claim 4 (depends on 1) The multi-camera vision system of claim 1, wherein the apparatus is a first apparatus and the work vehicle includes a second apparatus associated with the performance of the work task; and wherein the second camera is oriented to selectively provide the second selected feed of at least a portion of the second apparatus during performance of the work task. ### Claim 5 (depends on 1) The multi-camera vision system of claim 1, wherein the icon is a camera icon indicating the origin of each of the associated cameras. ### Claim 6 (depends on 1) The multi-camera vision system of claim 1, wherein the icon is an arrow indicating the orientation of each of the associated cameras. ### Claim 7 (depends on 1) The multi-camera vision system of claim 1, wherein the apparatus of the work vehicle includes an unloading auger configured to unload material from the work vehicle into cooperating equipment during an unloading function as part of the work task; wherein the first camera is directed toward the unloading auger or cooperating equipment to generate the first selected feed during the unloading function; and wherein the controller is configured to generate the insert, overlay, or icon that represents the origin or orientation of the first camera during the unloading function. ### Claim 8 (depends on 1) The multi-camera vision system of claim 1, wherein the apparatus of the work vehicle includes an agricultural boom configured to support agricultural equipment in an unfolded position during an agricultural function as part of the work task; wherein the first camera is positioned on the agricultural boom to generate the first selected feed during the agricultural function; and wherein the controller is configured to generate the insert, overlay, or icon that represents the origin or orientation of the first camera during the agricultural function. ### Claim 9 (depends on 1) The multi-camera vision system of claim 1, wherein the apparatus of the work vehicle includes an agricultural tank configured to hold agricultural material for use during an agricultural function as part of the work task; wherein the first camera is positioned towards the agricultural tank to generate the first selected feed during the agricultural function; and wherein the controller is configured to generate the insert, overlay, or icon that represents the origin or orientation of the first camera during the agricultural function. ### Claim 10 (depends on 1) The multi-vision system of claim 1, wherein the plurality of cameras includes a front camera oriented in a direction of travel, a first side forward-facing camera, and a second side forward-facing camera. ### Claim 11 (depends on 1) The multi-vision system of claim 1, wherein the plurality of cameras includes a first side mirror camera and a second side mirror camera. ### Claim 12 (depends on 1) The multi-vision system of claim 1, wherein the plurality of cameras includes a first side camera oriented in a first transverse direction and a second side camera oriented in a second transverse direction. ### Claim 13 (depends on 1) The multi-vision system of claim 1, wherein the plurality of cameras includes a first side camera on a first C-post of the work vehicle and a second side camera on a second C-post of the work vehicle. ### Claim 14 (depends on 1) The multi-vision system of claim 1, wherein the plurality of cameras includes a rear-facing camera. ### Claim 15 A work vehicle, comprising: a chassis; an operator cabin supported by the chassis; an apparatus in the form of a work implement supported by the chassis and associated with performance of a work task; and a multi-camera vision system comprising: a plurality of display devices within the operator cabin defining a plurality of display areas arranged at a first side of the work vehicle, a second side of the work vehicle, and a central location of the work vehicle between the first and second sides relative to an operator field of view (FOV); a plurality of cameras carried by the work vehicle and coupled to the plurality of display devices to display feeds at the plurality of display areas, wherein the plurality of cameras are at or trained on the first side, the second side, and the central location between the first and second sides relative to the operator FOV, including a first camera selectively providing a first selected feed of at least a portion of the apparatus during performance of the work task and including a second camera providing a second selected feed of an area other than the apparatus; a sensor configured to provide sensor data indicative of a position or a status of the apparatus; and a controller having processing architecture configured to control, or receive control instructions regarding, the selection of feeds to display at the plurality of display areas, the controller is configured to display a standard set of feeds from the associated first side, second side, and central location of the plurality of cameras at the plurality of display devices so that the associated feeds are arranged at the first side, the second side, and the central location, respectively, relative to the operator FOV, and wherein the controller is configured to display the standard set of feeds each with an insert, overlay, or icon that indicates an origin and orientation of the associated camera including for the first camera providing the first selected feed depicting performance of the work task by the apparatus; wherein the controller is configured to operate in a non-working mode in which the controller is configured to display a second selected feed from the second camera in at least one of the plurality of display areas and in a working mode in which the controller is configured to display the first selected feed from the first camera in at least one of the plurality of display areas; and wherein the controller is configured to process the sensor data and automatically switch between the non-working mode and the working mode based on the position or status of the apparatus to display either the first selected feed or the second selected feed. ### Claim 16 (depends on 15) The work vehicle of claim 15, wherein the apparatus is a first apparatus and the work vehicle includes a second apparatus associated with the performance of the work task; and wherein the second camera is oriented to selectively provide the second selected feed of at least a portion of the second apparatus during performance of the work task. ### Claim 17 (depends on 15) The work vehicle of claim 15, wherein the apparatus of the work vehicle includes an unloading auger configured to unload material from the work vehicle into cooperating equipment during an unloading function as part of the work task; wherein the first camera is directed toward the unloading auger or cooperating equipment to generate the first selected feed during the unloading function; and wherein the controller is configured to generate the insert, overlay, or icon that represents the origin or orientation of the first camera during the unloading function. ### Claim 18 (depends on 15) The work vehicle of claim 15, wherein the apparatus of the work vehicle includes an agricultural boom configured to support agricultural equipment in an unfolded position during an agricultural function as part of the work task; wherein the first camera is positioned on the agricultural boom to generate the first selected feed during the agricultural function; and wherein the controller is configured to generate the insert, overlay, or icon that represents the origin or orientation of the first camera during the agricultural function. ### Claim 19 (depends on 15) The work vehicle of claim 15, wherein the apparatus of the work vehicle includes an agricultural tank configured to hold agricultural material for use during an agricultural function as part of the work task; wherein the first camera is positioned towards the agricultural tank to generate the first selected feed during the agricultural function; and wherein the controller is configured to generate the insert, overlay, or icon that represents the origin or orientation of the first camera during the agricultural function.