# US 2019/0166760 A1 · Combine harvester control information for a remote user with visual feed > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 2019/0166760 A1 - Document ID: US20190166760A1 - Status: Published application - Kind: A1 - Application number: 15/832,056 - Filed: 2017-12-05 - Published: 2019-06-06 - Earliest claimed: 2017-12-05 - Assignees: Deere & Company - Applicants: Deere & Company - Inventors: Bhanu Kiran Reddy Palla; Narendar Reddy Karedla - Web page: https://patentgrep.com/patent/US20190166760A1 ## CPC - A01D 41/1274: {for drives} - A01D 41/127: Control or measuring arrangements specially adapted for combines - H04L 67/00: Network arrangements or protocols for supporting network services or applications (user-to-user messaging H04L51/00; network arrangements, protocols or services for supporting real-time applications in data packet communications networks H04L65/00) - H04L 67/025: for remote control or remote monitoring of applications - H04L 67/75: Indicating network or usage conditions on the user display - A01D 41/06: Combines with headers - A01D: HARVESTING; MOWING - H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M) ## Abstract A user device, that is remote from a combine harvester, communicates with the remote harvester to receive contextual information indicative of machine settings on the combine harvester. Remote view and control logic receives the contextual information from the combine harvester, along with image or video display information generated from an image capture device (such as a video camera or other image capture device) on the combine harvester. The contextual information is displayed, along with the video or image information on the remote user device. ## Claims ### Claim 1 An agricultural harvesting machine, comprising: a visual information capture mechanism that captures visual information; context information correlation logic that identifies context information corresponding to the visual information; output generator logic configured to generate an output including the context information and corresponding visual information; and a transmission system that transmits the output to a remote computing system, remote from the agricultural harvesting machine, for display of the context information and the corresponding visual information. ### Claim 2 (depends on 1) The agricultural harvesting machine of claim 1 wherein the visual information capture mechanism comprises: a plurality of video cameras mounted on the agricultural harvesting machine and each capturing video information. ### Claim 3 (depends on 2) The agricultural harvesting machine of claim 2 wherein first context information corresponds to the video information from a first of the plurality of video cameras and second context information corresponds to the video information from a second of the plurality of video cameras, the first context information being different from the second context information. ### Claim 4 (depends on 3) The agricultural harvesting machine of claim 3 and further comprising: a plurality of sensors each generating a sensor signal indicative of a sensed variable; and a control system generating the context information based on the sensor signals. ### Claim 5 (depends on 4) The agricultural harvesting machine of claim 4 and further comprising: trigger detection logic configured to detect a trigger indicative of when the output including the context information and corresponding video information is to be transmitted to the remote computing system and generating a trigger signal identifying the video information based on detection of the trigger. ### Claim 6 (depends on 5) The agricultural harvesting machine of claim 5 wherein the trigger detection logic comprises: a request detector detecting a request from the remote computing system, the request identifying which video information is to be transmitted. ### Claim 7 (depends on 6) The agricultural harvesting machine of claim 6 wherein the correlation logic is configured to identify the corresponding context information, that corresponds to the identified video information, for transmission with the identified video information. ### Claim 8 (depends on 5) The agricultural harvesting machine of claim 5 wherein the trigger detection logic comprises: a continuous transmission detector generating the trigger signal indicating that the video information and corresponding context information is to be sent continuously, the transmission system being configured to continuously transmit the identified video information and corresponding context information to the remote computing system based on the trigger signal. ### Claim 9 (depends on 5) The agricultural harvesting machine of claim 5 wherein the trigger detection logic comprises: an event detector detecting an event and generating the trigger signal indicating that the video information and corresponding context information is to be sent to the remote computing system based on the detected event, the transmission system being configured to continuously transmit the identified video information and corresponding context information to the remote computing system based on the trigger signal. ### Claim 10 A method of controlling an agricultural harvesting machine, comprising: capturing video information using a video capture mechanism on the agricultural harvesting machine; generating a sensor signal indicative of a sensed variable; identifying context information, based on the sensor signal, corresponding to the video information; generating an output including the context information and corresponding video information; and transmitting the output to a remote computing system, remote from the agricultural harvesting machine, for display of the context information and the corresponding video information. ### Claim 11 (depends on 10) The method of claim 10 wherein capturing video information comprises: capturing video information from each of a plurality of different video cameras mounted on the agricultural harvesting machine. ### Claim 12 (depends on 11) The method of claim 11 wherein identifying context information comprises: identifying first context information corresponding to the video information from a first of the plurality of different video cameras; and identifying second context information corresponding to the video information from a second of the plurality of video capture mechanisms, the first context information being different from the second context information. ### Claim 13 (depends on 12) The method of claim 12 wherein generating a sensor signal comprises: generating a plurality of different sensor signals, each indicative of a different sensed variable; and generating the context information based on the plurality of different sensor signals. ### Claim 14 (depends on 13) The method of claim 13 and further comprising: detecting a request from the remote computing system; and identifying, based on the request, which video information is to be transmitted, wherein identifying context information includes identifying the corresponding context information, that corresponds to the identified video information, for transmission with the identified video information. ### Claim 15 (depends on 14) The method of claim 14 wherein transmitting the output to the remote computing system comprises: continuously transmitting the identified video information and corresponding context information to the remote computing system. ### Claim 16 (depends on 13) The method of claim 13 and further comprising: detecting an event; and identifying which video information and corresponding context information is to be sent to the remote computing system based on the detected event, wherein transmitting comprises continuously transmitting the identified video information and corresponding context information to the remote computing system based on the detected event. ### Claim 17 A mobile device, comprising: machine selector logic that displays a user actuatable machine selection element that is actuatable to select a remote agricultural harvesting machine, that is remote from the mobile device; a communication system that communicates with a selected remote agricultural harvesting machine; video information display logic that displays near real time video information received from a video camera on the selected remote agricultural harvesting machine; and context information display logic that displays near real time context information, corresponding to the video information, received from the selected agricultural harvesting machine and generated based on sensor signals generated by sensors on the selected agricultural harvesting machine. ### Claim 18 (depends on 17) The mobile device of claim 17 wherein the machine selector logic is configured to display a plurality of different machine selector elements that are each actuatable to select a different remote agricultural harvesting machine, and further comprising: a user interaction detector configured to detect user actuation of a plurality of the different machine selector elements to select a plurality of different remote agricultural harvesting machines. ### Claim 19 (depends on 18) The mobile device of claim 18 wherein the video information display logic is configured to display near real time video information received from a video camera on each of the plurality of selected remote agricultural harvesting machines and wherein the context information display logic is configured to display near real time context information, corresponding to the video information, received from each of the selected agricultural harvesting machines and generated based on sensor signals generated by sensors on each of the selected remote agricultural harvesting machines. ### Claim 20 (depends on 17) The mobile device of claim 17 and further comprising: remote control generator logic configured to generate a user actuatable remote control element that is actuated to send a control signal to remotely control the selected remote agricultural harvesting machine.