# US 12,216,819 B2 · Methods, systems, and related aspects for determining a cognitive load of a sensorized device user > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 12,216,819 B2 - Document ID: US12216819B2 - Status: Granted - Kind: B2 - Application number: 18/556,973 - Filed: 2022-04-28 - Published: 2024-06-27 - Granted: 2025-02-04 - Earliest claimed: 2021-04-28 - Assignees: The Johns Hopkins University - Applicants: The Johns Hopkins University - Inventors: Mathias Unberath; Kinjal Shah; Wenhao Gu - Web page: https://patentgrep.com/patent/US12216819B2 ## CPC - A61B 3/11: for measuring interpupillary distance or diameter of pupils - G06F 3/013: {Eye tracking input arrangements (G06F3/015 takes precedence)} - A61B 3/145: {by video means} - A61B 5/16: Devices for psychotechnics (using teaching or educational appliances G09B1/00 - G09B7/00); Testing reaction times {; Devices for evaluating the psychological state} - A61B 5/163: {by tracking eye movement, gaze, or pupil change} - G06V 40/18: Eye characteristics, e.g. of the iris - A61B: DIAGNOSIS; SURGERY; IDENTIFICATION (usefulness limited to only animals A61D) - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING ## Abstract Provided herein are methods of determining a cognitive load of a sensorized device user in certain aspects. Provided herein are also methods of adjusting an interface between a user and a sensorized device in some aspects. Related devices, systems, and computer program products are also provided. ## Claims ### Claim 1 A method of adjusting an interface between a user and a sensorized device, the method comprising: receiving at least a first substantially real-time pupillometric data value from the user from at least a first time point and at least a first substantially real-time unconstrained environmental data value from at least one location proximal to the user from the first time point; receiving at least a second substantially real-time pupillometric data value from the user from at least a second time point and at least a second substantially real-time unconstrained environmental data value from at least one location proximal to the user from the second time point, wherein the user is using the sensorized device at least proximal to the first time point and/or the second time point; isolating one or more cognitive load factors from one or more non-cognitive load factors influencing the user at the first and second time points based at least upon the first substantially real-time pupillometric data value, the first substantially real-time unconstrained environmental data value, the second substantially real-time pupillometric data value, and/or the second substantially real-time unconstrained environmental data value to determine a cognitive load change in the user between the first and second time points to produce a determined cognitive load change, wherein determining the cognitive load change in the user between the first and second time points comprises determining an inverse probability of the cognitive load change given the first substantially real-time pupillometric data value, the first substantially real-time unconstrained environmental data value, the second substantially real-time pupillometric data value, and/or the second substantially real-time unconstrained environmental data value; and, adjusting at least one function of the sensorized device at least proximal to the first time point and/or the second time point based at least in part on the determined cognitive load change in the user, thereby adjusting the interface between the user and the sensorized device. ### Claim 2 (depends on 1) The method of claim 1, wherein the user is using at least one sensorized device at least proximal to the first time point and wherein the method further comprises adjusting at least one function of the sensorized device at least proximal to the first time point based at least in part on the determined cognitive load of the user. ### Claim 3 (depends on 1) The method of claim 1, wherein the sensorized device comprises a computer. ### Claim 4 (depends on 1) The method of claim 1, wherein the sensorized device and a computer are operably connected to one another. ### Claim 5 (depends on 1) The method of claim 1, wherein the first and/or second substantially real-time pupillometric data value comprises a pupil diameter, a pupil radius, a pupil size, a blink rate, a saccade rate, or other measure of at least one eye of the user. ### Claim 6 (depends on 1) The method of claim 1, wherein the first and/or second substantially real-time unconstrained environmental data value comprises a measure of at least one visual property. ### Claim 7 (depends on 6) The method of claim 6, wherein the visual property comprises an ambient light measure and/or a focal brightness measure. ### Claim 8 (depends on 1) The method of claim 1, wherein the first and/or second substantially real-time unconstrained environmental data value comprises a measure of at least one visual property, at least one auditory property, at least one dictation property, at least one physiological property or state of the user, and/or at least one physical property of an environment external to the user. ### Claim 9 (depends on 1) The method of claim 1, comprising receiving the first and/or second substantially real-time pupillometric data value and/or the first and/or second substantially real-time unconstrained environmental data value from at least one detection device. ### Claim 10 (depends on 9) The method of claim 9, wherein the detection device comprises at least one video camera. ### Claim 11 (depends on 9) The method of claim 9, wherein a wearable device comprises the detection device, which wearable device is worn by the user. ### Claim 12 (depends on 11) The method of claim 11, wherein the wearable device comprises a head-mounted display, a headphone, a spectacle frame, and/or an article of clothing. ### Claim 13 (depends on 1) The method of claim 1, wherein the sensorized device comprises an intelligent personal assistant (IPA) device. ### Claim 14 (depends on 1) The method of claim 1, wherein the sensorized device comprises a virtual reality (VR) device. ### Claim 15 A system, comprising at least one controller that comprises, or is capable of accessing, computer readable media comprising non-transitory computer executable instructions which, when executed by at least one electronic processor, perform at least: receiving at least a first substantially real-time pupillometric data value from a user of a sensorized device from at least a first time point and at least a first substantially real-time unconstrained environmental data value from at least one location proximal to the user from the first time point, and at least a second substantially real-time pupillometric data value from the user from at least a second time point and at least a second substantially real-time unconstrained environmental data value from at least one location proximal to the user from the second time point, when the user is using the sensorized device at least proximal to the first time point and/or the second time point; isolating one or more cognitive load factors from one or more non-cognitive load factors influencing the user at the first and second time points based at least upon the first substantially real-time pupillometric data value, the first substantially real-time unconstrained environmental data value, the second substantially real-time pupillometric data value, and/or the second substantially real-time unconstrained environmental data value to determine a cognitive load change in the user between the first and second time points to produce a determined cognitive load change, wherein determining the cognitive load change in the user between the first and second time points comprises determining an inverse probability of the cognitive load change given the first substantially real-time pupillometric data value, the first substantially real-time unconstrained environmental data value, the second substantially real-time pupillometric data value, and/or the second substantially real-time unconstrained environmental data value; and, adjusting at least one function of the sensorized device at least proximal to the first time point and/or the second time point based at least in part on the determined cognitive load change in the user. ### Claim 16 A non-transitory computer readable medium comprising computer executable instructions which, when executed by at least one electronic processor, perform at least: receiving at least a first substantially real-time pupillometric data value from a user of a sensorized device from at least a first time point and at least a first substantially real-time unconstrained environmental data value from at least one location proximal to the user from the first time point, and at least a second substantially real-time pupillometric data value from the user from at least a second time point and at least a second substantially real-time unconstrained environmental data value from at least one location proximal to the user from the second time point, when the user is using the sensorized device at least proximal to the first time point and/or the second time point; isolating one or more cognitive load factors from one or more non-cognitive load factors influencing the user at the first and second time points based at least upon the first substantially real-time pupillometric data value, the first substantially real-time unconstrained environmental data value, the second substantially real-time pupillometric data value, and/or the second substantially real-time unconstrained environmental data value to determine a cognitive load change in the user between the first and second time points to produce a determined cognitive load change, wherein determining the cognitive load change in the user between the first and second time points comprises determining an inverse probability of the cognitive load change given the first substantially real-time pupillometric data value, the first substantially real-time unconstrained environmental data value, the second substantially real-time pupillometric data value, and/or the second substantially real-time unconstrained environmental data value; and, adjusting at least one function of the sensorized device at least proximal to the first time point and/or the second time point based at least in part on the determined cognitive load change in the user.