# US 10,484,459 B2 · Dynamically providing host input control for streaming applications > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 10,484,459 B2 - Document ID: US10484459B2 - Status: Granted - Kind: B2 - Application number: 14/844,907 - Filed: 2015-09-03 - Published: 2017-03-09 - Granted: 2019-11-19 - Earliest claimed: 2015-09-03 - Assignees: NVIDIA Corporation - Applicants: Nvidia Corporation - Inventors: David Eng; Rajesh Medisetty; Amit Chaudhary; Rahil Dhru - Web page: https://patentgrep.com/patent/US10484459B2 ## CPC - H04L 67/10: in which an application is distributed across nodes in the network (software deployment G06F8/60; multiprogramming arrangements G06F9/46) - G06F 3/04886: by partitioning the display area of the touch-screen or the surface of the digitising tablet into independently controllable areas, e.g. virtual keyboards or menus - H04L 67/141: Setup of application sessions (admission control or resource allocation in data switching networks H04L47/70) - H04N 21/2387: Stream processing in response to a playback request from an end-user, e.g. for trick-play - H04N 21/4402: involving reformatting operations of video signals for household redistribution, storage or real-time display {(details of conversion of video standards at pixel level H04N7/01; video transcoding H04N19/40; adapting incoming signals to the display format of the display terminal G09G5/005; media handling at the source in data packet switching networks H04L65/764)} - H04N 21/4788: communicating with other users, e.g. chatting {(arrangements for providing for computer conferences, e.g. chat rooms, to substation in data switching networks H04L12/1813; distributed application using peer-to-peer [P2P] networks H04L67/104)} - H04N 21/8456: {by decomposing the content in the time domain, e.g. in time segments} - H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M) - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION ## Abstract A computer streaming system includes an application hints unit that provides an advisory hint for a remote user device corresponding to a selected streaming application, and a sending unit that manages streaming of the advisory hint and the selected streaming application over a network connected to the remote user device. Additionally, the computer streaming system includes a receiving unit that recovers the advisory hint for the remote user device, and a hints processing unit that applies the advisory hint to the remote user device when employing the selected computer application. Also, the computer streaming system includes a feedback unit that provides remote user feedback information over the network directed to responding to the advisory hint, and an update unit that provides the remote user feedback information. Also provided is a method of streaming a computer application. ## Claims ### Claim 1 A computer streaming system, comprising: a host streaming unit; a remote user device; and a network, wherein: the host streaming unit determines what input methods are suitable for the remote user device for content being streamed in a selected application to the remote user, the host streaming unit comprising: an application hints unit that provides an advisory hint to the remote user device corresponding to a selected streaming application; and a sending unit coupled to the application hints unit to manage streaming of the advisory hint and the content streamed in the selected application over the network connected to the remote user device; and the remote user device comprising: a receiving unit coupled to the network to recover the advisory hint for the remote user device; and a hints processing unit coupled to the receiving unit to apply the advisory hint to the remote user device when employing the selected application such that the determined input method is used by the remote user device. ### Claim 2 (depends on 1) The system as recited in claim 1 wherein the advisory hint includes notification of an event that requires a keyboard or a mouse. ### Claim 3 (depends on 2) The system as recited in claim 2 wherein the keyboard or the mouse is an on-screen keyboard or an on-screen mouse. ### Claim 4 (depends on 1) The system as recited in claim 1 wherein the advisory hint includes notification of an event that requires zooming in or zooming out of the selected streaming application. ### Claim 5 (depends on 1) The system as recited in claim 1 wherein the advisory hint includes notification of an event that requires mapping a remote client control device to provide a keyboard or a mouse for the remote user device or the streaming device. ### Claim 6 (depends on 1) The system as recited in claim 1 further comprising a feedback unit that is coupled to the remote user device to provide remote user feedback information over the network directed to responding to the advisory hint. ### Claim 7 (depends on 6) The system as recited in claim 6 further comprising an update unit that is coupled to the streaming device to provide the remote user feedback information. ### Claim 8 (depends on 1) The system as recited in claim 1 wherein the streaming device is selected from the group consisting of: a local user device; and a cloud server. ### Claim 9 (depends on 1) The system as recited in claim 1 wherein the network includes one selected from the group consisting of: a WI-FI network; the Internet; and a cellular communications network. ### Claim 10 (depends on 1) The system as recited in claim 1 wherein the remote user device is selected from the group consisting of: a computer tablet; a smartphone; a notebook computer; a desk top computer; and a living room device. ### Claim 11 A method of streaming a computer application, comprising: determining, by a host streaming unit, what input methods are suitable for a remote user device for content being streamed in the computer application to the remote user device; providing, by the host streaming unit, an advisory hint for the remote user device corresponding to a selected application; streaming, by the host streaming unit, the advisory hint and the content streamed in the selected application over a network connected to the remote user device; recovering, by the remote user device, the advisory hint for the remote user device; and applying, by the remote user device, the advisory hint to the remote user device when employing the selected application such that the determined input method is used by the remote user device. ### Claim 12 (depends on 11) The method as recited in claim 11 wherein providing the advisory hint includes notification of an event that requires a keyboard or a mouse operation. ### Claim 13 (depends on 12) The method as recited in claim 12 wherein the keyboard or the mouse operation is an on-screen keyboard or an on-screen mouse operation. ### Claim 14 (depends on 11) The method as recited in claim 11 wherein providing the advisory hint includes notification of an event that requires zooming in or zooming out of the selected streaming application. ### Claim 15 (depends on 11) The method as recited in claim 11 wherein providing the advisory hint includes notification of an event that requires mapping of a remote client control device to provide a keyboard or a mouse operation for the remote user device or the streaming source. ### Claim 16 (depends on 11) The method as recited in claim 11 further comprising providing remote user feedback information over the network directed to responding to the advisory hint. ### Claim 17 (depends on 11) The method as recited in claim 11 further comprising providing the remote user feedback information to update the streaming source. ### Claim 18 (depends on 11) The method as recited in claim 11 wherein the streaming source is selected from the group consisting of: a local user device; and a cloud server. ### Claim 19 (depends on 11) The method as recited in claim 11 wherein the network includes one selected from the group consisting of: a WI-FI network; the Internet; and a cellular communications network. ### Claim 20 (depends on 11) The method as recited in claim 11 wherein the remote user device is selected from the group consisting of: a computer tablet; a smartphone; a notebook computer; a desk top computer; and a living room device.