# US 2023/0273612 A1 · Vehicle control system > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 2023/0273612 A1 - Document ID: US20230273612A1 - Status: Published application - Kind: A1 - Application number: 18/195,274 - Filed: 2023-05-09 - Published: 2023-08-31 - Earliest claimed: 2017-10-25 - Assignees: Oshkosh Corporation - Applicants: Oshkosh Corporation - Inventors: Bryan DATEMA; Cody CLIFTON; Xiang GONG; Zhenyi WEI; Shashank Bhatia - Web page: https://patentgrep.com/patent/US20230273612A1 ## CPC - G05D 1/0016: {characterised by the operator's input device (input arrangements for computing systems in general G06F3/00)} - B28C 5/422: {Controlling or measuring devices (B28C5/4227 takes precedence)} - B28C 7/02: Controlling the operation of the mixing - B28C 7/022: {by measuring the consistency or composition of the mixture, e.g. with supply of a missing component} - G05D 1/0044: {by providing the operator with a computer generated representation of the environment of the vehicle, e.g. virtual reality, maps (maps used for automatic navigation G05D1/0274; flight directors G01C23/005)} - G05D 1/223: Command input arrangements on the remote controller, e.g. joysticks or touch screens - G05D 1/225: operated by off-board computers - G07C 5/0808: {Diagnosing performance data (testing of vehicles G01M17/00; testing of electrical installation on vehicles G01R31/005)} - G07C 5/0816: {Indicating performance data, e.g. occurrence of a malfunction} - B60W 10/30: including control of auxiliary equipment, e.g. air-conditioning compressors or oil pumps - B60W 50/08: Interaction between the driver and the control system - B60W 2050/0064: {using a remote, e.g. cordless, transmitter or receiver unit, e.g. remote keypad or mobile phone} - G05D 1/0278: {using satellite positioning signals, e.g. GPS} - G05D 1/248: generated by satellites, e.g. GPS - G06V 20/20: in augmented reality scenes - G07C 5/008: {communicating information to a remotely located station (transmission systems for measured values G08C)} - G07C 2205/02: using a vehicle scan tool - G05D: SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES - B28C: PREPARING CLAY; PRODUCING MIXTURES CONTAINING CLAY OR CEMENTITIOUS MATERIAL, e.g. PLASTER (preparing material for foundry moulds B22C5/00) - G07C: TIME OR ATTENDANCE REGISTERS; REGISTERING OR INDICATING THE WORKING OF MACHINES; GENERATING RANDOM NUMBERS; VOTING OR LOTTERY APPARATUS; ARRANGEMENTS, SYSTEMS OR APPARATUS FOR CHECKING NOT PROVIDED FOR ELSEWHERE - B60W: CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION; CONTROL SYSTEMS SPECIALLY ADAPTED FOR HYBRID VEHICLES; ROAD VEHICLE DRIVE CONTROL SYSTEMS FOR PURPOSES NOT RELATED TO THE CONTROL OF A PARTICULAR SUB-UNIT - G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING ## Abstract A system includes a non-transitory computer-readable storage medium. The non-transitory computer-readable storage medium has instructions stored thereon that, upon execution by a processor of a portable user device, cause the processor to acquire data from a reader of the portable user device regarding an identifier on a machine, perform a verification process to verify that a user of the portable user device has access to the machine based on the identifier, wirelessly connect the portable user device to the machine in response to the user being verified to access the machine, display a control interface for the machine on a user interface of the portable user device, receive a user input through the control interface regarding operation of a controllable component of the machine, and provide a command to the machine based on the user input to facilitate remote operation of the controllable component of the machine. ## Claims ### Claim 1 A system comprising: a non-transitory computer-readable storage medium having instructions stored thereon that, upon execution by a processor of a portable user device, cause the processor to: acquire data from a reader of the portable user device regarding an identifier on a machine; perform a verification process to verify that a user of the portable user device has access to the machine based on the identifier; wirelessly connect the portable user device to the machine in response to the user being verified to access the machine; display a control interface for the machine on a user interface of the portable user device; receive a user input through the control interface regarding operation of a controllable component of the machine; and provide a command to the machine based on the user input to facilitate remote operation of the controllable component of the machine. ### Claim 2 (depends on 1) The system of claim 1, wherein the reader includes at least one of a camera or a RFID reader, and wherein the identifier includes at least one of a QR code, a barcode, or a RFID tag. ### Claim 3 (depends on 1) The system of claim 1, wherein the control interface includes a drive and steer operation interface that facilitates remotely driving and steering the machine. ### Claim 4 (depends on 1) The system of claim 1, wherein the control interface includes at least one of (a) a power button configured to facilitate remotely powering on or off the machine, (b) a horn button configured to facilitate activating and sounding a horn of the machine, (c) a speed toggle button configured to facilitate toggling between speed modes of the machine, or (d) a drive and steer trackpad including a drive button that is selectively repositionable within the drive and steer trackpad to facilitate driving and turning the machine. ### Claim 5 (depends on 4) The system of claim 4, wherein the control interface includes the power button and the drive and steer trackpad. ### Claim 6 (depends on 5) The system of claim 5, wherein the control interface includes the horn button. ### Claim 7 (depends on 5) The system of claim 5, wherein the control interface includes the speed toggle button. ### Claim 8 (depends on 1) The system of claim 1, wherein the non-transitory computer-readable storage medium having instructions stored thereon that, upon execution by the processor, cause the processor to perform the verification process by transmitting the data to a remote server, and wherein the remote server is configured to verify that the user of the portable user device has access to the machine based on the data. ### Claim 9 (depends on 1) The system of claim 1, wherein the non-transitory computer-readable storage medium having instructions stored thereon that, upon execution by the processor, cause the processor to perform the verification process by locally verifying that the user of the portable user device has access to the machine based on the data. ### Claim 10 (depends on 1) The system of claim 1, wherein the machine is a fire apparatus, and wherein the controllable component includes at least one of a ladder assembly, a water turret, a pump system, or a stabilizer. ### Claim 11 (depends on 1) The system of claim 1, wherein the machine is a refuse vehicle, and wherein the controllable component includes at least one of a lift assembly or a tailgate. ### Claim 12 (depends on 1) The system of claim 1, wherein the machine is a concrete mixer vehicle, and wherein the controllable component includes at least one of a drum assembly or a washout system. ### Claim 13 (depends on 1) The system of claim 1, wherein the machine is a lift machine, and wherein the controllable component includes at least one of a steering actuator, a drive actuator, a boom assembly, a lift assembly, or a leveling actuator. ### Claim 14 (depends on 1) The system of claim 1, wherein the non-transitory computer-readable storage medium having instructions stored thereon that, upon execution by the processor, cause the processor to: provide a live display on the user interface regarding an area in a field of view of a camera of the portable user device; detect the controllable component within the live display; and display the control interface in response to detecting the controllable component within the live display. ### Claim 15 (depends on 14) The system of claim 14, wherein the non-transitory computer-readable storage medium having instructions stored thereon that, upon execution by the processor, cause the processor to project an augmented reality display of the controllable component onto the live display based on the command to facilitate making a comparison between an augmented reality position of the controllable component and an actual position of the controllable component within the live display. ### Claim 16 A system comprising: a non-transitory computer-readable storage medium having instructions stored thereon that, upon execution by a processor of a portable user device, cause the processor to: acquire data from a reader of the portable user device regarding an identifier on a machine, wherein the reader includes at least one of a camera or a RFID reader, and wherein the identifier includes at least one of a QR code, a barcode, or a RFID tag; perform a verification process to verify that a user of the portable user device has access to the machine based on the identifier; wirelessly connect the portable user device to the machine in response to the user being verified to access the machine; display a control interface for the machine on a user interface of the portable user device, wherein the control interface includes two or more of (a) a power button configured to facilitate remotely powering on or off the machine, (b) a horn button configured to facilitate activating and sounding a horn of the machine, (c) a speed toggle button configured to facilitate toggling between speed modes of the machine, or (d) a drive and steer trackpad including a drive button that is selectively repositionable within the drive and steer trackpad to facilitate driving and turning the machine; receive a user input through the control interface regarding operation of the machine; and provide a command to the machine to facilitate remote operation of the machine based on the user input. ### Claim 17 (depends on 16) The system of claim 16, wherein the control interface includes three or more of the power button, the horn, the speed toggle button, or the drive and steer trackpad. ### Claim 18 (depends on 16) The system of claim 16, wherein the non-transitory computer-readable storage medium having instructions stored thereon that, upon execution by the processor, cause the processor to perform the verification process by locally verifying that the user of the portable user device has access to the machine based on the data. ### Claim 19 (depends on 1) The system of claim 1, wherein the non-transitory computer-readable storage medium having instructions stored thereon that, upon execution by the processor, cause the processor to perform the verification process by transmitting the data to a remote server, and wherein the remote server is configured to verify that the user of the portable user device has access to the machine based on the data. ### Claim 20 A method for remotely operating a machine, the method comprising: acquiring, by one or more processing circuits, data from a reader of a portable user device regarding an identifier on a machine, wherein the reader includes at least one of a camera or a RFID reader, and wherein the identifier includes at least one of a QR code, a barcode, or a RFID tag; performing, by the one or more processing circuits, a verification process to verify that a user of the portable user device has access to the machine based on the identifier; wirelessly connecting, by the one or more processing circuits, the portable user device to the machine in response to the user being verified to access the machine; displaying, by the one or more processing circuits, a control interface for the machine on a user interface of the portable user device, wherein the control interface includes (a) a power button configured to facilitate remotely powering on or off the machine and (b) a drive interface configured to facilitate driving and turning the machine; receiving, by the one or more processing circuits, a user input through the control interface regarding operation of the machine; and providing, by the one or more processing circuits, a command to the machine to facilitate remote operation of the machine based on the user input.