# US 10,481,749 B1 · Identifying and rendering content relevant to a user's current mental state and context > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 10,481,749 B1 - Document ID: US10481749B1 - Status: Granted - Kind: B1 - Application number: 15/651,232 - Filed: 2017-07-17 - Granted: 2019-11-19 - Earliest claimed: 2014-12-01 - Assignees: Google Inc. - Applicants: Google LLC - Inventors: Thabet Alfishawi; Sagar Mittal; Mark Stevens - Web page: https://patentgrep.com/patent/US10481749B1 ## CPC - G06F 3/048: Interaction techniques based on graphical user interfaces [GUI] - G16H 50/00: ICT specially adapted for medical diagnosis, medical simulation or medical data mining; ICT specially adapted for detecting, monitoring or modelling epidemics or pandemics - A61B 5/11: Measuring movement of the entire body or parts thereof, e.g. head or hand tremor or mobility of a limb {(A61B5/1038 takes precedence; motion detection to correct for motion artifacts in physiological signals A61B5/721)} - A61B 5/165: {Evaluating the state of mind, e.g. depression, anxiety} - G06F 3/0481: based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance - G16H 10/60: for patient-specific data, e.g. for electronic patient records - A61B 5/1123: {Discriminating type of movement, e.g. walking or running (A61B5/1116, A61B5/112 take precedence)} - G06F 13/00: Interconnection of, or transfer of information or other signals between, memories, input/output devices or central processing units (interface circuits for specific input/output devices G06F3/00 {; multiprogram control therefor G06F9/46}; multiprocessor systems G06F15/16 ) - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - G16H: HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA - A61B: DIAGNOSIS; SURGERY; IDENTIFICATION (usefulness limited to only animals A61D) ## Abstract Systems and methods are provided for identifying and rendering content relevant to a user's current mental state and context. In an aspect, a system includes a state component that determines a state of a user during a current session of the user with the media system based on navigation of the media system by the user during the current session, media items provided by the media system that are played for watching by the user during the current session, and a manner via which the user interacts with or reacts to the played media items. In an aspect, the state of the user includes a mood of the user. A selection component then selects a media item provided by the media provider based on the state of the user, and a rendering component effectuates rendering of the media item to the user during the current session. ## Claims ### Claim 1 A method, comprising: collecting characteristics of a user's context including collecting information specifying a length of media items being viewed by the user during current viewing session; determining a current state of mind of the user based on the length of media items being presented by a streaming media player, including determining that the user is in an entertainment state when the length of the media items is longer in duration and determining that the user is in a work related state when the length of the media items is shorter in duration; selecting a subsequent media item to provide through the streaming media player based on the determined current state of mind of the user; and effectuating streaming of the subsequent media item to the user through the streaming media player. ### Claim 2 (depends on 1) The method of claim 1, comprising collecting characteristics of the context of one or more other users related to the user, including specifying a length of media items being viewed by the one or more other users during separate viewing sessions concurrent with the current viewing session. ### Claim 3 (depends on 2) The method of claim 2, wherein each of the one or more other users related to the user is connected to the user in a social graph, is a friend of the user, shares similar preferences to the user, or shares demographics with the user. ### Claim 4 (depends on 3) The method of claim 3, comprising selecting a subsequent media item to provide through the streaming media player based on the determined current state of mind of the user and the current session information of the one or more other users related to the user. ### Claim 5 (depends on 2) The method of claim 2, comprising: determining a current state of mind of each particular user of the one or more other users based on the length of media items being presented by a streaming media player in each of the separate viewing sessions, including determining that the particular user is in an entertainment state when the length of the media items is longer in duration and determining that the user is in a work related state when the length of the media items is shorter in duration; and selecting a subsequent media item to provide through the streaming media player based on the determined current state of mind of the user and the current session information of the one or more other users related to the user. ### Claim 6 (depends on 1) The method of claim 1, wherein delivering the subsequent media item to the user through the streaming media player comprises providing the subsequent media item in one of a recommendation section or a list of media items recommended to the user during the user's current viewing session. ### Claim 7 (depends on 1) The method of claim 1, comprising determining a current state of mind of the user based on a degree of engagement of the user with the current viewing session, including determining the user is in the entertainment state when at least one of the media item presented to the user through the streaming media player is visible or the volume of the media item presented to the user through the streaming media player is above a predetermined threshold volume. ### Claim 8 A system, comprising: a data store storing data collected by a communications server; the communications server, wherein the communications server is in communication with a client device and a content provider, and performs operations including: collecting characteristics of a user's context including collecting information specifying a length of media items being viewed by the user during current viewing session; determining a current state of mind of the user based on the length of media items being presented by a streaming media player, including determining that the user is in an entertainment state when the length of the media items is longer in duration and determining that the user is in a work related state when the length of the media items is shorter in duration; selecting a subsequent media item to provide through the streaming media player based on the determined current state of mind of the user; and effectuating streaming of the subsequent media item to the user through the streaming media player. ### Claim 9 (depends on 8) The system of claim 8, the operations comprising collecting characteristics of the context of one or more other users related to the user, including specifying a length of media items being viewed by the one or more other users during separate viewing sessions concurrent with the current viewing session. ### Claim 10 (depends on 9) The system of claim 9, wherein each of the one or more other users related to the user is connected to the user in a social graph, is a friend of the user, shares similar preferences to the user, or shares demographics with the user. ### Claim 11 (depends on 10) The system of claim 10, the operations comprising selecting a subsequent media item to provide through the streaming media player based on the determined current state of mind of the user and the current session information of the one or more other users related to the user. ### Claim 12 (depends on 9) The system of claim 9, the operations comprising: determining a current state of mind of each particular user of the one or more other users based on the length of media items being presented by a streaming media player in each of the separate viewing sessions, including determining that the particular user is in an entertainment state when the length of the media items is longer in duration and determining that the user is in a work related state when the length of the media items is shorter in duration; and selecting a subsequent media item to provide through the streaming media player based on the determined current state of mind of the user and the current session information of the one or more other users related to the user. ### Claim 13 (depends on 8) The system of claim 8, wherein delivering the subsequent media item to the user through the streaming media player comprises providing the subsequent media item in one of a recommendation section or a list of media items recommended to the user during the user's current viewing session. ### Claim 14 (depends on 8) The system of claim 8, the operations comprising determining a current state of mind of the user based on a degree of engagement of the user with the current viewing session, including determining the user is in the entertainment state when at least one of the media item presented to the user through the streaming media player is visible or the volume of the media item presented to the user through the streaming media player is above a predetermined threshold volume. ### Claim 15 A non-transitory computer readable medium storing instructions that when executed by one or more computing devices, cause the one or more computing devices to perform operations comprising: collecting characteristics of a user's context including collecting information specifying a length of media items being viewed by the user during current viewing session; determining a current state of mind of the user based on the length of media items being presented by a streaming media player, including determining that the user is in an entertainment state when the length of the media items is longer in duration and determining that the user is in a work related state when the length of the media items is shorter in duration; selecting a subsequent media item to provide through the streaming media player based on the determined current state of mind of the user; and effectuating streaming of the subsequent media item to the user through the streaming media player. ### Claim 16 (depends on 15) The non-transitory computer readable medium of claim 15, the operations comprising collecting characteristics of the context of one or more other users related to the user, including specifying a length of media items being viewed by the one or more other users during separate viewing sessions concurrent with the current viewing session. ### Claim 17 (depends on 16) The non-transitory computer readable medium of claim 16, wherein each of the one or more other users related to the user is connected to the user in a social graph, is a friend of the user, shares similar preferences to the user, or shares demographics with the user. ### Claim 18 (depends on 17) The non-transitory computer readable medium of claim 17, the operations comprising selecting a subsequent media item to provide through the streaming media player based on the determined current state of mind of the user and the current session information of the one or more other users related to the user. ### Claim 19 (depends on 16) The non-transitory computer readable medium of claim 16, the operations comprising: determining a current state of mind of each particular user of the one or more other users based on the length of media items being presented by a streaming media player in each of the separate viewing sessions, including determining that the particular user is in an entertainment state when the length of the media items is longer in duration and determining that the user is in a work related state when the length of the media items is shorter in duration; and selecting a subsequent media item to provide through the streaming media player based on the determined current state of mind of the user and the current session information of the one or more other users related to the user. ### Claim 20 (depends on 15) The non-transitory computer readable medium of claim 15, wherein delivering the subsequent media item to the user through the streaming media player comprises providing the subsequent media item in one of a recommendation section or a list of media items recommended to the user during the user's current viewing session.