# US 12,008,904 B2 · Terminal device equipped with a camera and display and mounted on a vehicle that predicts an intention of the vehicle to turn left or right > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 12,008,904 B2 - Document ID: US12008904B2 - Status: Granted - Kind: B2 - Application number: 17/701,740 - Filed: 2022-03-23 - Published: 2022-10-06 - Granted: 2024-06-11 - Earliest claimed: 2021-03-30 - Assignees: Honda Motor Co., Ltd. - Applicants: Honda Motor Co., Ltd. - Inventors: Yuji Yasui - Web page: https://patentgrep.com/patent/US12008904B2 ## CPC - G08G 1/163: {involving continuous checking} - B60Q 1/525: {automatically indicating risk of collision between vehicles in traffic or with pedestrians, e.g. after risk assessment using the vehicle sensor data} - B62J 6/26: warning or informing other road users, e.g. police flash lights - B62J 27/00: Safety equipment - G06V 20/58: Recognition of moving objects or obstacles, e.g. vehicles or pedestrians; Recognition of traffic objects, e.g. traffic signs, traffic lights or roads - G08G 1/16: Anti-collision systems (road vehicle drive control systems for predicting or avoiding probable or impending collision otherwise than by control of a particular sub-unit B60W30/08) - B60Q 1/46: for giving flashing caution signals during drive, other than signalling change of direction, e.g. flashing the headlights {or hazard lights} - B60Q 9/008: {for anti-collision purposes} - B62J 50/22: electronic, e.g. displays - G08G: TRAFFIC CONTROL SYSTEMS (guiding railway traffic, ensuring the safety of railway traffic B61L; arrangement of road signs or traffic signals E01F9/00; radar or analogous systems, sonar systems, lidar systems specially adapted for traffic control G01S13/91, G01S15/88, G01S17/88; {radar or analogous systems, sonar systems, lidar systems specially adapted for anti-collision purposes G01S13/93, G01S15/93, G01S17/93}) - B60Q: ARRANGEMENT OF SIGNALLING OR LIGHTING DEVICES, THE MOUNTING OR SUPPORTING THEREOF OR CIRCUITS THEREFOR, FOR VEHICLES IN GENERAL - B62J: CYCLE SADDLES OR SEATS; AUXILIARY DEVICES OR ACCESSORIES SPECIALLY ADAPTED TO CYCLES AND NOT OTHERWISE PROVIDED FOR, e.g. ARTICLE CARRIERS OR CYCLE PROTECTORS - G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING ## Abstract An information supply method is a method of causing a computer of a terminal device equipped with a camera and mounted in a mobile object to execute: a process of acquiring images captured at different times; a process of predicting whether the mobile object has an intention to turn right or left based on the images captured at the different times; and a process of displaying an image for an alarm about presence of a traffic participant on a display provided on a casing in which the camera of the terminal device is provided based on a result of the estimation. ## Claims ### Claim 1 An information supply method of causing at least one processor of a terminal device equipped with a camera and mounted in a mobile object to execute instructions stored in at least one memory of the terminal device, the instructions comprising: acquiring images captured at different times; rotating a first image captured at a first time at a predetermined angle in a left or right direction using a reference position as a starting point; comparing a second image captured at a second time different than the first time with the first image rotated at the predetermined angle; and predicting whether the mobile object has an intention to turn right or left based on a result of the comparing; detecting a traffic participant that has a possibility of interfering with the mobile object based on a third image that is included in the images captured at different times, and notifying an occupant of the mobile object of the traffic participant near the mobile object by displaying an image representation of an alarm representing a presence of the traffic participant on a display device provided on a casing in which the camera of the terminal device is provided based on a result of an estimation and the traffic participant that has a possibility of interfering with the mobile object. ### Claim 2 (depends on 1) The information supply method according to claim 1, wherein the method causes the at least one processor to further execute: predicting whether the moving object is traveling straight ahead or the moving object is turning right or left. ### Claim 3 (depends on 1) The information supply method according to claim 1, wherein the method causes the at least one processor to further execute: comparing the first image in a central portion of the image captured at the first time with the second image at a central portion of the image rotated at the predetermined angle. ### Claim 4 (depends on 3) The information supply method according to claim 3, wherein the method causes the at least one processor to further execute: acquiring the first image of a central portion of each of a plurality of images obtained by rotating the image captured at the first time at each predetermined angle in left and right directions using the reference position as the starting point; comparing each of the first images at the central portions with the second image at the central portion of the image captured at the second time; and predicting that the mobile object has an intention to turn right or left when a rotational angle of the first image in which a difference between the first and second images is minimized is equal to or greater than a threshold. ### Claim 5 (depends on 1) The information supply method according to claim 1, wherein the method causes the at least one processor to further execute: approximating a size of a cutout image in which a specific region is cut from the first image captured at the first time to a size of the second image captured at the second time, rotating the cutout image at the predetermined angle, and comparing the second image captured at the second time with the cutout image rotated at the predetermined angle. ### Claim 6 (depends on 1) The information supply method according to claim 1, wherein the method causes the at least one processor to further execute: a process of displaying the image representation of the alarm about an approach of the traffic participant on the display device when the mobile object is predicted to have an intention to turn right or left and the traffic participant is present or approaches in or near a route through which the mobile object passes when the mobile object turns right or left. ### Claim 7 A non-transitory computer storage medium storing an application program causing a computer of a terminal device to execute a process of: acquiring images captured at different times; rotating a first image captured at a first time at a predetermined angle in a left or right direction using a reference position as a starting point; comparing a second image captured at a second time different than the first time with the first image rotated at the predetermined angle; and predicting whether the mobile object has an intention to turn right or left based on a result of the comparing; detecting a traffic participant that has a possibility of interfering with the mobile object based on a third image that is included in the images captured at different times, and notifying an occupant of the mobile object of the traffic participant near the mobile object by displaying an image representation of an alarm representing a presence of the traffic participant on a display device provided on a casing in which the camera of the terminal device is provided based on a result of an estimation and the traffic participant that has a possibility of interfering with the mobile object. ### Claim 8 A terminal device comprising: a camera provided in a casing; a display provided in the casing; and a processor configure to: rotating a first image captured at a first time at a predetermined angle in a left or right direction using a reference position as a starting point; comparing a second image captured at a second time different than the first time with the first image rotated at the predetermined angle; and predicting whether the mobile object has an intention to turn right or left based on a result of the comparing; detecting a traffic participant that has a possibility of interfering with the mobile object based on a third image that is included in the images captured at different times, and notifying an occupant of the mobile object of the traffic participant near the mobile object by displaying an image representation of an alarm representing a presence of the traffic participant on a display device provided on a casing in which the camera of the terminal device is provided based on a result of an estimation and the traffic participant that has a possibility of interfering with the mobile object.