# US 10,768,699 B2 · Presentation to user of indication of object at which another person is looking > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 10,768,699 B2 - Document ID: US10768699B2 - Status: Granted - Kind: B2 - Application number: 16/126,567 - Filed: 2018-09-10 - Published: 2020-03-12 - Granted: 2020-09-08 - Earliest claimed: 2018-09-10 - Assignees: Lenovo (Singapore) Pte. Ltd. - Applicants: Lenovo (Singapore) Pte. Ltd. - Inventors: Nathan J. Peterson; Gary David Cudak; John Scott Crowe; Jennifer Lee-Baron - Web page: https://patentgrep.com/patent/US10768699B2 ## CPC - G06F 3/013: {Eye tracking input arrangements (G06F3/015 takes precedence)} - B60K 35/10: Input arrangements, i.e. from user to vehicle, associated with vehicle functions or specially adapted therefor - B60K 35/22: Display screens - B60K 35/235: with means for detecting the driver's gaze direction or eye points - B60K 35/28: characterised by the type of the output information, e.g. video entertainment or vehicle dynamics information; characterised by the purpose of the output information, e.g. for attracting the attention of the driver - B60K 35/285: {for improving awareness by directing driver's gaze direction or eye points} - B60K 35/50: Instruments characterised by their means of attachment to or integration in the vehicle (B60K35/231 takes precedence) - B60K 35/60: Instruments characterised by their location or relative disposition in or on vehicles (arrangements of lighting devices on dashboards B60Q3/10) - B60K 35/85: Arrangements for transferring vehicle- or driver-related data - G02B 27/0172: {characterised by optical features} - G06F 3/012: {Head tracking input arrangements} - G06F 3/017: {Gesture based interaction, e.g. based on a set of recognized hand gestures (interaction based on gestures traced on a digitiser G06F3/04883)} - G06F 3/167: {Audio in a user interface, e.g. using voice commands for navigating, audio feedback} - B60K 35/29: Instruments characterised by the way in which information is handled, e.g. showing information on plural displays or prioritising information according to driving conditions - B60K 2360/1523: Matrix displays - B60K 2360/177: Augmented reality - B60K 2360/186: Displaying information according to relevancy - B60K 2360/191: Highlight information - B60K 2360/334: Projection means - B60K 2360/589: Wireless data transfers - B60K 2360/5915: Inter vehicle communication - G02B 2027/0138: {comprising image capture systems, e.g. camera} - G02B 2027/014: {comprising information/image processing systems} - G06F 3/011: {Arrangements for interaction with the human body, e.g. for user immersion in virtual reality (blind teaching G09B21/00)} - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - B60K: ARRANGEMENT OR MOUNTING OF PROPULSION UNITS OR OF TRANSMISSIONS IN VEHICLES; ARRANGEMENT OR MOUNTING OF PLURAL DIVERSE PRIME-MOVERS IN VEHICLES; AUXILIARY DRIVES FOR VEHICLES; INSTRUMENTATION OR DASHBOARDS FOR VEHICLES; ARRANGEMENTS IN CONNECTION WITH COOLING, AIR INTAKE, GAS EXHAUST OR FUEL SUPPLY OF PROPULSION UNITS IN VEHICLES - G02B: OPTICAL ELEMENTS, SYSTEMS OR APPARATUS ## Abstract In one aspect, a device includes at least one processor, a display accessible to the at least one processor, and storage accessible to the at least one processor. The storage includes instructions executable by the at least one processor to receive input regarding an object at which one person is looking and to present, to another person via the display, a graphical indication regarding the object. ## Claims ### Claim 1 A first device, comprising: at least one processor; a display accessible to the at least one processor; and storage accessible to the at least one processor and comprising instructions executable by the at least one processor to: receive input regarding an item at which a person is looking; and present information regarding the item to a user via the display, the user being different from the person; wherein the input comprises input received from at least one camera in communication with the first device; wherein input received from the at least one camera is processed using eye tracking to identify first data related to where the person is looking, and wherein the first data is used to present the information; and wherein input received from the at least one camera is processed using gesture recognition to identify second data related to where the person is gesturing with at least a portion of the person's arm, and wherein the second data is used to present the information. ### Claim 2 (depends on 1) The first device of claim 1, wherein the information identifies the item. ### Claim 3 (depends on 1) The first device of claim 1, wherein the information indicates a direction in which the item can be viewed by the user relative to a current head orientation of the user. ### Claim 4 (depends on 1) The first device of claim 1, wherein the device comprises a headset and wherein the display is an at least partially transparent display disposed on the headset. ### Claim 5 (depends on 4) The first device of claim 4, wherein the information is presented using one or more of augmented reality processing and virtual reality processing. ### Claim 6 (depends on 1) The first device of claim 1, wherein the first device comprises a vehicle, and wherein the display is integrated into one or more of a windshield of the vehicle and a window of the vehicle. ### Claim 7 (depends on 1) The first device of claim 1, wherein the input regarding the item is received from a second device different from first device, the second device comprising a headset worn by the person. ### Claim 8 (depends on 1) The first device of claim 1, wherein the information is presented responsive to detection by the first device of the person verbally indicating the item, the detection being based at least in part on input from a microphone in communication with the first device. ### Claim 9 A computer readable storage medium (CRSM) that is not a transitory signal, the computer readable storage medium comprising instructions executable by at least one processor to: receive input regarding a first item at which a person is looking as presented on a first electronic display, wherein the input indicates a predetermined phrase as being spoken by the person; based on the input, present information regarding the first item to a user via a second electronic display different from the first electronic display, the user being different from the person; identify, at a first device comprising the second electronic display, information related to a second item at which the user is looking as presented on the second electronic display; and transmit, to a second device comprising the first electronic display, data regarding the location of the second item, wherein the first device is different from the second device. ### Claim 10 (depends on 9) The CRSM of claim 9, wherein the information related to the second item is identified at least in part based on microphone input received from a microphone on the first device. ### Claim 11 (depends on 9) The CRSM of claim 9, wherein the input indicating the first item at which the person is looking comprises microphone input. ### Claim 12 (depends on 9) The CRSM of claim 9, wherein the input is first input, and wherein the instructions are executable to: receive second input indicating the first item at which the person is looking, wherein the second input is related the person gesturing toward the first item with at least a portion of the person's arm; and based on both the first input and the second input, present the information via the second electronic display. ### Claim 13 (depends on 12) The CRSM of claim 12, wherein the second input is input generated based at least in part on execution of gesture recognition. ### Claim 14 A method, comprising: receiving input regarding an item at which a person is looking; and presenting information regarding the item to a user via a display of a device, the user being different from the person; wherein the input comprises input received from at least one camera in communication with the device; wherein input received from the at least one camera is processed using eye tracking to identify first data related to where the person is looking, and wherein the first data is used to present the information; and wherein input received from the at least one camera is processed using gesture recognition to identify second data related to where the person is gesturing with at least a portion of the person's arm, and wherein the second data is used to present the information. ### Claim 15 (depends on 14) The method of claim 14, wherein the information identifies the item. ### Claim 16 (depends on 14) The method of claim 14, wherein the information indicates a direction in which the item can be viewed by the user relative to a current head orientation of the user. ### Claim 17 (depends on 14) The method of claim 14, wherein the information is presented using one or more of augmented reality processing and virtual reality processing. ### Claim 18 (depends on 14) The method of claim 14, wherein the information is presented responsive to detection by the device of the person verbally indicating the item, the detection being based at least in part on input from a microphone in communication with the device.