# US 12,593,951 B2 · Contextual and user experience based mobile robot control > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 12,593,951 B2 - Document ID: US12593951B2 - Status: Granted - Kind: B2 - Application number: 16/933,401 - Filed: 2020-07-20 - Published: 2022-01-20 - Granted: 2026-04-07 - Earliest claimed: 2020-07-20 - Assignees: iRobot Corporation - Applicants: iRobot Corporation - Inventors: Cory White; Sam Hong; Craig Michael Butterworth; Michael Foster - Web page: https://patentgrep.com/patent/US12593951B2 ## CPC - A47L 9/2857: {User input or output elements for control, e.g. buttons, switches or displays} - A47L 9/009: {Carrying-vehicles; Arrangements of trollies or wheels; Means for avoiding mechanical obstacles} - A47L 9/2826: {the condition of the floor} - A47L 9/2852: {Elements for displacement of the vacuum cleaner or the accessories therefor, e.g. wheels, casters or nozzles} - A47L 11/24: Floor-sweeping machines, motor-driven - A47L 11/28: Floor-scrubbing machines, motor-driven (A47L11/29 takes precedence) - A47L 11/4008: {Arrangements of switches, indicators or the like} - A47L 11/4011: {Regulation of the cleaning machine by electric means; Control systems and remote control systems therefor} - A47L 11/4061: {Steering means; Means for avoiding obstacles; Details related to the place where the driver is accommodated} - A47L 11/4066: {Propulsion of the whole machine} - G05D 1/0011: {associated with a remote control arrangement} - A01D 34/008: {for automated or remotely controlled operation} - A01D 2101/00: Lawn-mowers - A47L 2201/04: Automatic control of the travelling movement; Automatic obstacle detection - A47L 2201/06: Control of the cleaning action for autonomous devices; Automatic detection of the surface condition before, during or after cleaning - A47L: DOMESTIC WASHING OR CLEANING (brushes A46B; cleaning quantities of bottles or of other hollow articles of one kind B08B9/00; laundry D06F); SUCTION CLEANERS IN GENERAL (cleaning in general B08) - G05D: SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES - A01D: HARVESTING; MOWING ## Abstract A machine-readable medium can include instructions for presenting a user interface, which when executed by a processor, can cause the processor to display an image on the user interface representing a mobile cleaning robot that is in communication with the processor. The processor can also display lines representing an environment of the mobile cleaning robot, where the image and the lines can together be indicative of a status of the mobile cleaning robot. ## Claims ### Claim 1 A machine-readable medium including instructions for presenting a user interface, which when executed by a processor, cause the processor to: display an image on the user interface representing a mobile cleaning robot that is in communication with the processor; display lines representing an environment of the mobile cleaning robot, the image and the lines together indicative of a status of the mobile cleaning robot; and display an error indicator at least partially surrounding the image of the mobile cleaning robot, the error indicator indicative of an error of the mobile cleaning robot, wherein the error indicator is an image surrounding the image representing the mobile cleaning robot, and wherein the error indicator is an image of concentric circles around the image representing the mobile cleaning robot. ### Claim 2 (depends on 1) The machine-readable medium of claim 1, wherein the image is an isometric or perspective view of representing the mobile cleaning robot, and wherein the isometric or perspective view indicates that the mobile cleaning robot has a ready status. ### Claim 3 (depends on 2) The machine-readable medium of claim 2, wherein the display lines are isometric or perspective lines of the representative environment, and wherein the isometric or perspective lines, together with the image representing the mobile cleaning robot, indicate that the mobile cleaning robot has a ready status. ### Claim 4 (depends on 3) The machine-readable medium of claim 3, wherein the image is top view representing the mobile cleaning robot, and wherein the top view indicates that the mobile cleaning robot has a mission status, and wherein the display lines are a top view of lines of the representative environment, and wherein the top view of lines indicate that the mobile cleaning robot has a mission status. ### Claim 5 (depends on 1) The machine-readable medium of claim 1, the processor further configured to: display a routine indication selectable to create a new routine; and communicate the new routine to the mobile cleaning robot following creation of the new routine. ### Claim 6 (depends on 5) The machine-readable medium of claim 5, wherein the routine indication is located on the user interface near the image representing the mobile cleaning robot. ### Claim 7 (depends on 1) The machine-readable medium of claim 1, the processor further configured to: display a text display field adjacent the image representing the mobile cleaning robot, the text display field configured to display text based on the status of the mobile cleaning robot; and display text on the text display field including user instructions for performing a required action with regard to the mobile cleaning robot based on the status of the mobile cleaning robot. ### Claim 8 (depends on 7) The machine-readable medium of claim 7, the processor further configured to: determine whether the required action has been performed with regard to mobile cleaning robot; and display a text alert on the user interface based on the display text, based on the status of the mobile cleaning robot, and based on the determination of whether the required action was performed. ### Claim 9 (depends on 8) The machine-readable medium of claim 8, wherein the text alert includes a snooze component selectable to cause the processor to display the text alert at a later time. ### Claim 10 (depends on 9) The machine-readable medium of claim 9, the processor further configured to: actively sense when a user is home by interfacing with an internet of things device; and display the text alert only when the user is typically home. ### Claim 11 (depends on 9) The machine-readable medium of claim 9, the processor further configured to: determine when a user is typically home; and display the text alert only when the user is typically home. ### Claim 12 A machine-readable medium including instructions for presenting a user interface, which when executed by a processor, cause the processor to: display an image on the user interface representing a mobile cleaning robot that is in communication with the processor; display lines representing an environment of the mobile cleaning robot, the image and the lines together indicative of a status of the mobile cleaning robot; display a text display field adjacent the image representing the mobile cleaning robot, the text display field configured to display text based on the status of the mobile cleaning robot; display text on the text display field including user instructions for performing a required action with regard to the mobile cleaning robot based on the status of the mobile cleaning robot; determine whether the required action has been performed with regard to mobile cleaning robot; display a text alert on the user interface based on the text displayed, based on the status of the mobile cleaning robot, and based on the determination of whether the required action was performed, the text alert including a snooze component selectable to cause the processor to display the text alert at a later time; actively sense when a user is home by interfacing with an internet of things device; and display the text alert only when the user is typically home. ### Claim 13 (depends on 12) The machine-readable medium of claim 12, wherein the image is an isometric or perspective view of representing the mobile cleaning robot, and wherein the isometric or perspective view indicates that the mobile cleaning robot has a ready status. ### Claim 14 (depends on 13) The machine-readable medium of claim 13, wherein the display lines are isometric or perspective lines of the representative environment, and wherein the isometric or perspective lines, together with the image representing the mobile cleaning robot, indicate that the mobile cleaning robot has a ready status. ### Claim 15 (depends on 13) The machine-readable medium of claim 13, wherein the image is top view representing the mobile cleaning robot, and wherein the top view indicates that the mobile cleaning robot has a mission status, and wherein the display lines are a top view of lines of the representative environment, and wherein the top view of lines indicate that the mobile cleaning robot has a mission status. ### Claim 16 (depends on 12) The machine-readable medium of claim 12, the processor further configured to: display an error indicator at least partially surrounding the image of the mobile cleaning robot, the error indicator indicative of an error of the mobile cleaning robot. ### Claim 17 (depends on 16) The machine-readable medium of claim 16, wherein the error indicator is an image surrounding the image representing the mobile cleaning robot. ### Claim 18 (depends on 17) The machine-readable medium of claim 17, wherein the error indicator is an image of concentric circles around the image representing the mobile cleaning robot. ### Claim 19 (depends on 12) The machine-readable medium of claim 12, the processor further configured to: display a routine indication selectable to create a new routine; and communicate the new routine to the mobile cleaning robot following creation of the new routine. ### Claim 20 (depends on 19) The machine-readable medium of claim 19, wherein the routine indication is located on the user interface near the image representing the mobile cleaning robot. ### Claim 21 (depends on 12) The machine-readable medium of claim 12, the processor further configured to: determine when the user is typically home; and display the text alert only when the user is typically home. ### Claim 22 A machine-readable medium including instructions for presenting a user interface, which when executed by a processor, cause the processor to: display an image on the user interface representing a mobile cleaning robot that is in communication with the processor; display lines representing an environment of the mobile cleaning robot, the image and the lines together indicative of a status of the mobile cleaning robot; display a text display field adjacent the image representing the mobile cleaning robot, the text display field configured to display text based on the status of the mobile cleaning robot; display text on the text display field including user instructions for performing a required action with regard to the mobile cleaning robot based on the status of the mobile cleaning robot; determine whether the required action has been performed with regard to mobile cleaning robot; display a text alert on the user interface based on the text displayed, based on the status of the mobile cleaning robot, and based on the determination of whether the required action was performed, the text alert including a snooze component selectable to cause the processor to display the text alert at a later time; determine when a user is typically home; and display the text alert only when the user is typically home. ### Claim 23 (depends on 22) The machine-readable medium of claim 22, wherein the image is an isometric or perspective view of representing the mobile cleaning robot, and wherein the isometric or perspective view indicates that the mobile cleaning robot has a ready status. ### Claim 24 (depends on 23) The machine-readable medium of claim 23, wherein the display lines are isometric or perspective lines of the representative environment, and wherein the isometric or perspective lines, together with the image representing the mobile cleaning robot, indicate that the mobile cleaning robot has a ready status. ### Claim 25 (depends on 24) The machine-readable medium of claim 24, wherein the image is top view representing the mobile cleaning robot, and wherein the top view indicates that the mobile cleaning robot has a mission status, and wherein the display lines are a top view of lines of the representative environment, and wherein the top view of lines indicate that the mobile cleaning robot has a mission status. ### Claim 26 (depends on 22) The machine-readable medium of claim 22, the processor further configured to: display an error indicator at least partially surrounding the image of the mobile cleaning robot, the error indicator indicative of an error of the mobile cleaning robot, wherein the error indicator is an image surrounding the image representing the mobile cleaning robot, and wherein the error indicator is an image of concentric circles around the image representing the mobile cleaning robot. ### Claim 27 (depends on 22) The machine-readable medium of claim 22, the processor further configured to: display a routine indication selectable to create a new routine; and communicate the new routine to the mobile cleaning robot following creation of the new routine.