# US 12,001,754 B2 · Context based media selection based on preferences setting for active consumer(s) > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 12,001,754 B2 - Document ID: US12001754B2 - Status: Granted - Kind: B2 - Application number: 16/690,443 - Filed: 2019-11-21 - Published: 2021-05-27 - Granted: 2024-06-04 - Earliest claimed: 2019-11-21 - Assignees: Motorola Mobility LLC - Applicants: Motorola Mobility LLC - Inventors: Wendel Malta De Assis; Amit Kumar Agrawal; Lucie Corinne Evelyne Papelier - Web page: https://patentgrep.com/patent/US12001754B2 ## CPC - G06F 3/165: {Management of the audio stream, e.g. setting of volume, audio stream path} - G06F 9/453: {Help systems} - G06F 16/436: {using biological or physiological data of a human being, e.g. blood pressure, facial expression, gestures} - G06V 40/172: {Classification, e.g. identification} - G10L 17/00: Speaker identification or verification techniques - G06F 3/167: {Audio in a user interface, e.g. using voice commands for navigating, audio feedback} - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING - G10L: SPEECH ANALYSIS TECHNIQUES OR SPEECH SYNTHESIS; SPEECH RECOGNITION; SPEECH OR VOICE PROCESSING TECHNIQUES; SPEECH OR AUDIO CODING OR DECODING ## Abstract A method includes detecting, at an electronic device (ED) providing a virtual assistant (VA), an input that triggers the VA to perform a task that comprises outputting media content through an output device associated with the ED. The method includes detecting a presence of at least one registered user in proximity to the ED. Each registered user is associated with a corresponding media preferences profile. The method includes, for each detected registered user, determining whether the detected registered user is an active consumer. The method includes, in response to determining that a detected registered user is an active consumer, outputting, via the output device, media content associated with the media preferences profile of the detected registered user. ## Claims ### Claim 1 A method comprising: detecting, at an electronic device providing a virtual assistant (VA), an input that triggers the VA to perform a task that comprises outputting media content through an output device associated with the electronic device; detecting a presence of at least one registered user in proximity to the electronic device, each registered user being associated with a corresponding media preferences profile, for each of the at least one detected registered user, determining whether the detected registered user is an active consumer who is actively consuming media content outputted by the electronic device or an inactive consumer who is not consuming the media content output, the determining comprising determining an awake/asleep state of the detected registered user based on receiving audio input by the electronic device comprising speech of another user that includes words describing whether the detected registered user is in the awake state or in the asleep state; and in response to determining that the detected registered user is an active consumer, determining whether the detected registered user is alone; in response to determining that the detected registered user is alone: updating contextual information to include an alone designation; and identifying, from a set of volume preferences within the media preferences profile, a volume level at which to output audio content based on the alone designation; and in response to determining that the detected registered user is not alone and there is at least one other active consumer present: updating contextual information to include an applicable group designation based on which particular two or more active consumers are present; and identifying, from a set of volume preferences within the media preferences profile corresponding to the applicable group designation, a selected volume level at which to output audio content based on a context associated with the applicable group designation; and outputting, via the output device, media content associated with the media preferences profile of the detected at least one registered user who is an active consumer at an identified one of the volume level and the selected volume level. ### Claim 2 (depends on 1) The method of claim 1, further comprising: detecting a change of state for the detected registered user from being an active consumer to being a non-consumer; and in response to detecting the change of state, ceasing from outputting and excluding media content associated with the media preferences profile of the detected registered user whose state changed from being an active consumer to a non-consumer, wherein media content of any other detected registered users who remain active consumers continue to be outputted. ### Claim 3 (depends on 1) The method of claim 1, wherein: identifying the at least one registered user comprises at least one of (i) receiving and comparing voice input from the at least one registered user and (ii) obtaining and comparing facial recognition information of the at least one registered user from a camera of the electronic device; and determining whether the detected registered user is an active consumer comprises determining whether the detected registered user is an active consumer based on an awake/asleep state of the detected registered user. ### Claim 4 (depends on 1) The method of claim 1, further comprising: for each active consumer detected, selecting, from media content linked to the media preferences profile of the detected active consumer, a type of media content based on contextual information that comprises a predefined set of registered users being determined as active consumers, the predefined set of registered users being defined in the media preferences profile of the detected active consumer. ### Claim 5 (depends on 4) The method of claim 4, wherein the type of media content comprises at least one of: a specific genre of artistic work; artistic work performed by a specific artist; a specific streaming source of artistic work; or artistic work within a specific directory of stored media content accessible by the electronic device. ### Claim 6 (depends on 1) The method of claim 1, wherein outputting the media content comprises: alternating between media content linked to the media preferences profile of a first active consumer detected and media content linked to the media preferences profile of each other active consumer detected, in response to detecting a plurality of active consumers. ### Claim 7 (depends on 1) The method of claim 1, further comprising determining the presence of the at least one registered user in proximity to the electronic device by at least one of: detecting that a voice within an audio input matches a voice ID of one registered user; and detecting that a mobile device that belongs to a first registered user is connected to a same local network as the electronic device. ### Claim 8 An electronic device providing functionality of a virtual assistant (VA), the electronic device comprising: at least one microphone that receives user input; an output device that outputs media content; a memory storing an active consumer media content selector (ACMCS) module that configures the electronic device to determine whether each registered user detected in proximity to the electronic device is an active consumer and to selectively output media content associated with a media preferences profile of each detected registered user that is an active consumer; and a processor coupled to the at least one microphone, the memory, and the output device, and which executes the ACMCS module that enables the electronic device to: detect an input that triggers the VA to perform a task that comprises outputting media content through the output device; detect a presence of at least one registered user in proximity to the electronic device, each registered user being associated with a corresponding media preferences profile, for each of the at least one detected registered user, determine whether the detected registered user is an active consumer who is actively consuming media content outputted by the electronic device or an inactive consumer who is not consuming the media content output, the determining comprising determining an awake/asleep state of the detected registered user based on receiving audio input by the electronic device comprising speech of another user that includes words describing whether the detected registered user is in the awake state or in the asleep state; and in response to determining that the detected registered user is an active consumer, determine whether the detected registered user is alone; in response to determining that the detected registered user is alone: update contextual information to include an alone designation; and identify, from a set of volume preferences within the media preferences profile, a volume level at which to output audio content; and in response to determining that the detected registered user is not alone and there is at least one other active consumer present: update the contextual information to include an applicable group designation based on which active consumers are present; and identify, from a set of volume preferences within the media preferences profile of the applicable group designation, a volume level at which to output audio content; and output, via the output device, media content associated with the media preferences profile of the detected at least one registered user who is an active consumer. ### Claim 9 (depends on 8) The electronic device of claim 8, wherein the ACMCS module further enables the electronic device to: detect a change of state for the detected registered user from being an active consumer to being a non-consumer; and cease from outputting media content associated with the media preferences profile of the detected registered user whose state changed from being an active consumer to a non-consumer. ### Claim 10 (depends on 8) The electronic device of claim 8, wherein the ACMCS module further enables the electronic device to: identify the at least one registered user comprises at least one of (i) receiving and comparing voice input from the at least one registered user and (ii) obtaining and comparing facial recognition information of the at least one registered user from a camera of the electronic device; and determine whether the detected registered user is an active consumer by determining whether the detected registered user is an active consumer based on an awake/asleep state of the detected registered user. ### Claim 11 (depends on 8) The electronic device of claim 8, wherein the ACMCS module further enables the electronic device to: for each active consumer detected, select, from media content linked to the media preferences profile of the detected active consumer, a type of media content based on contextual information that comprises a predefined set of registered users being determined as active consumers, the predefined set of registered users being defined in media preferences profile of the detected active consumer. ### Claim 12 (depends on 11) The electronic device of claim 11, wherein the type of media content comprises at least one of: a specified genre of artistic work; artistic work performed by a specified artist; a specified streaming source of artistic work; or artistic work within a specified directory of stored media content accessible by the electronic device. ### Claim 13 (depends on 8) The electronic device of claim 8, wherein the ACMCS module further enables the electronic device to output the media content by: alternating between media content linked to the media preferences profile of a first active consumer detected and media content linked to the media preferences profile of each other active consumer detected, in response to detecting a plurality of active consumers. ### Claim 14 A computer program product comprising: a non-transitory computer readable storage device; program code on the computer readable storage device that when executed by a processor associated with an electronic device that provides functionality of a virtual assistant (VA), the program code enables the electronic device to provide the functionality of: detecting an input that triggers the VA to perform a task that comprises outputting media content through an output device associated with the electronic device; detecting a presence of at least one registered user in proximity to the electronic device, each registered user being associated with a corresponding media preferences profile, for each of the at least one detected registered user, determining whether the detected registered user is an active consumer who is actively consuming media content outputted by the electronic device or an inactive consumer who is not consuming the media content output, the determining comprising determining an awake/asleep state of the detected registered user based on receiving audio input by the electronic device comprising speech of another user that includes words describing whether the detected registered user is in the awake state or in the asleep state; and in response to determining that the detected registered user is an active consumer, determining whether the detected registered user is alone; in response to determining that the detected registered user is alone: updating contextual information to include an alone designation; and identifying, from a set of volume preferences within the media preferences profile, a volume level at which to output audio content based on the alone designation; and in response to determining that the detected registered user is not alone and there is at least one other active consumer present: updating the contextual information to include an applicable group designation based on which active consumers are present; and identifying, from a set of volume preferences within the media preferences profile corresponding to the applicable group designation, a selected volume level at which to output audio content based on a context associated with the applicable group designation; and outputting, via the output device, media content associated with the media preferences profile of the detected at least one registered user who is an active consumer at an identified one of the volume level and the selected volume level. ### Claim 15 (depends on 14) The computer program product of claim 14, wherein the program code comprises program code that, when executed by the processor, enables the electronic device to provide the functionality of: detecting a change of state for the detected registered user from being an active consumer to being a non-consumer; and ceasing from outputting media content associated with the media preferences profile of the detected registered user whose state changed from being an active consumer to a non-consumer. ### Claim 16 (depends on 14) The computer program product of claim 14, wherein the program code comprises program code that, when executed by the processor, enables the electronic device to provide the functionality of: identify the at least one registered user comprises at least one of (i) receiving and comparing voice input from the at least one registered user and (ii) obtaining and comparing facial recognition information of the at least one registered user from a camera of the electronic device; and determining whether the detected registered user is an active consumer by determining whether the detected registered user is an active consumer based on an awake/asleep state of the detected registered user. ### Claim 17 (depends on 14) The computer program product of claim 14, wherein the program code comprises program code that, when executed by the processor, enables the electronic device to provide the functionality of: for each active consumer detected, selecting, from media content linked to the media preferences profile of the detected active consumer, a type of media content based on contextual information that comprises a predefined set of registered users being determined as active consumers, the predefined set of registered users being defined in media preferences profile of the detected active consumer.