# US 12,603,016 B2 · Wearable terminal, presentation method, and recording medium > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 12,603,016 B2 - Document ID: US12603016B2 - Status: Granted - Kind: B2 - Application number: 18/768,568 - Filed: 2024-07-10 - Published: 2024-10-31 - Granted: 2026-04-14 - Earliest claimed: 2022-01-27 - Assignees: Panasonic Intellectual Property Corporation of America - Applicants: Panasonic Intellectual Property Corporation of America - Inventors: Risako Tanigawa; Tatsumi Nagashima - Web page: https://patentgrep.com/patent/US12603016B2 ## CPC - G09B 5/06: with both visual and audible presentation of the material to be studied - G06F 3/01: Input arrangements or combined input and output arrangements for interaction between user and computer (G06F3/16 takes precedence) - G06F 3/013: {Eye tracking input arrangements (G06F3/015 takes precedence)} - G09G 5/00: Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators (image data processing or generation, in general G06T) - G09B: EDUCATIONAL OR DEMONSTRATION APPLIANCES; APPLIANCES FOR TEACHING, OR COMMUNICATING WITH, THE BLIND, DEAF OR MUTE; MODELS; PLANETARIA; GLOBES; MAPS; DIAGRAMS (devices for psychotechnics or for testing reaction times A61B5/16; games, sports, amusements A63; projectors, projector screens G03B) - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - G09G: ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION (arrangements for transferring data between digital computers and displays G06F3/14; static indicating arrangements comprising an association of a number of separate sources or light control cells G09F9/00; static indicating arrangements comprising integral associations of a number of light sources H01J, H01K, H10H, H05B33/12; scanning, transmission or reproduction of documents or the like, e.g. facsimile transmission, details thereof H04N1/00) ## Abstract A wearable terminal is a wearable terminal that can be worn by a user, and includes: an image obtainer that obtains an image of a subject appearing in a field of view of the user; a sound obtainer that obtains sound information including a sound occurring in a vicinity of the wearable terminal and a direction of occurrence of the sound; a specifier that, based on the sound information and the image, specifies a point of interest, the point of interest being a location, in the subject, where a sound in a predetermined band included in the sound has occurred; and a presenter that presents, to the user, an object indicating the point of interest. ## Claims ### Claim 1 A wearable terminal that can be worn by a user, the wearable terminal comprising: an image obtainer that obtains an image of a subject appearing in a field of view of the user; a sound obtainer that obtains sound information including a sound occurring in a vicinity of the wearable terminal and a direction of occurrence of the sound; a specifier that, based on the sound information and the image, specifies a point of interest, the point of interest being a location, in the subject, where a sound in a predetermined band included in the sound has occurred; a presenter that presents, to the user, an object indicating the point of interest; a sound outputter that outputs the sound having increased a sound pressure of the sound in the predetermined band; and a detector that detects a line of sight of the user, wherein the predetermined band is a frequency band in which a sound is generated in accordance with a condition of the subject, in addition to the object indicating the point of interest currently specified by the specifier, the presenter presents, to the user, a second object indicating a second point of interest specified before the point of interest in the field of view of the user, and when, based on the line of sight of the user, the line of sight of the user is determined to be directed to the second point of interest, the sound outputter outputs a second sound in the predetermined band occurring at the second point of interest. ### Claim 2 (depends on 1) The wearable terminal according to claim 1, wherein when the sound in the predetermined band is determined to have occurred in a same point of interest, the presenter presents the object indicating the same point of interest to the user in a different presentation format. ### Claim 3 (depends on 1) The wearable terminal according to claim 1, wherein the detector further detects a specific action by the user, and based on the specific action detected by the detector, the presenter performs switching of a presentation format of the object indicating the point of interest, or performs switching between presenting and not presenting the object indicating the point of interest. ### Claim 4 (depends on 3) The wearable terminal according to claim 3, wherein the specific action by the user is an action of the user bringing two fingers together. ### Claim 5 (depends on 3) The wearable terminal according to claim 3, wherein, based on the line of sight of the user detected by the detector, the presenter performs the switching for the object indicating the point of interest when the line of sight of the user is directed at the point of interest. ### Claim 6 (depends on 3) The wearable terminal according to claim 3, wherein the detector further detects a distance between the subject and the user, and when the distance detected by the detector exceeds a first threshold, the presenter presents, to the user, all instances of the object indicating all instances of the point of interest for a set past period. ### Claim 7 (depends on 3) The wearable terminal according to claim 3, further comprising: a controller that switches between presenting and not presenting the object by the presenter, wherein when the object is set to not be presented, the controller keeps the object not presented when a specific sign detected by the detector as the specific action is determined to at least partially overlap with the point of interest specified by the specifier in the image, and switches from not presenting the object to presenting the object when the specific sign is determined not to overlap with the point of interest in the image. ### Claim 8 (depends on 7) The wearable terminal according to claim 7, wherein when the specific sign is determined not to overlap with the point of interest a predetermined number of times consecutively, the controller switches from not presenting the object to presenting the object. ### Claim 9 (depends on 7) The wearable terminal according to claim 7, wherein when a reference point indicating a correct point of interest is prepared in advance, the controller switches from not presenting the object to presenting the object when a percentage of times the specific sign is determined to overlap with the reference point is less than a second threshold. ### Claim 10 (depends on 3) The wearable terminal according to claim 3, further comprising: a controller that switches between presenting and not presenting the object by the presenter, wherein when the object is set to not be presented, the controller keeps the object not presented when a movement trajectory, detected by the detector, of a striking implement used by the user for sonically inspecting the subject overlaps with the point of interest specified by the specifier in the image fewer than a predetermined number of times, and switches from not presenting the object to presenting the object when the movement trajectory of the striking implement overlaps with the point of interest in the image at least a predetermined number of times. ### Claim 11 A presentation method executed by a wearable terminal that can be worn by a user, the presentation method comprising: obtaining an image of a subject appearing in a field of view of the user; obtaining sound information including a sound occurring in a vicinity of the wearable terminal and a direction of occurrence of the sound; specifying, based on the sound information and the image, a point of interest, the point of interest being a location, in the subject, where a sound in a predetermined band included in the sound has occurred; presenting, to the user, an object indicating the point of interest; outputting the sound having increased a sound pressure of the sound in the predetermined band; and detecting a line of sight of the user, wherein the predetermined band is a frequency band in which a sound is generated in accordance with a condition of the subject, in addition to the object indicating the point of interest currently specified in the specifying, the presenting includes presenting, to the user, a second object indicating a second point of interest specified before the point of interest in the field of view of the user, and when, based on the line of sight of the user, the line of sight of the user is determined to be directed to the second point of interest, the outputting includes outputting a second sound in the predetermined band occurring at the second point of interest. ### Claim 12 (depends on 11) A non-transitory computer-readable recording medium having recorded thereon a program for causing a computer to execute the presentation method according to claim 11.