# US 9,436,359 B2 · Methods and systems for enhancing television applications using 3D pointing > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 9,436,359 B2 - Document ID: US9436359B2 - Status: Granted - Kind: B2 - Application number: 13/863,023 - Filed: 2013-04-15 - Published: 2013-09-05 - Granted: 2016-09-06 - Earliest claimed: 2005-02-14 - Assignees: Hillcrest Laboratories, Inc. - Applicants: Hillcrest Laboratories, Inc. - Inventors: Frank A. Hunleth; Negar Moshiri; William J. Napier; Daniel S. Simpkins; Frank J. Wroblewski; Kevin Conroy; Charles W.K. Gritton - Web page: https://patentgrep.com/patent/US9436359B2 ## CPC - G06F 3/0484: for the control of specific functions or operations, e.g. selecting or manipulating an object, an image or a displayed text element, setting a parameter value or selecting a range - G06F 3/017: {Gesture based interaction, e.g. based on a set of recognized hand gestures (interaction based on gestures traced on a digitiser G06F3/04883)} - G06F 3/0346: with detection of the device orientation or free movement in a three-dimensional [3D] space, e.g. 3D mice, 6-DOF [six degrees of freedom] pointers using gyroscopes, accelerometers or tilt-sensors - G06F 3/0481: based on specific properties of the displayed interaction object or a metaphor-based environment, e.g. interaction with desktop elements like windows or icons, or assisted by a cursor's changing behaviour or appearance - G06F 3/0482: Interaction with lists of selectable items, e.g. menus - G06F 3/0483: Interaction with page-structured environments, e.g. book metaphor - G06F 3/0485: Scrolling or panning - H04N 7/163: {by receiver means only} - H04N 7/17318: {Direct or substantially direct transmission and handling of requests} - H04N 21/42204: {User interfaces specially adapted for controlling a client device through a remote control device; Remote control devices therefor (constructive details of casings for the remote control device H01H9/0235; user interfaces for controlling a tuning device of a television receiver through a remote control H03J9/00; remote control of peripheral devices connected to a television receiver through the remote control device of the television receiver H04B1/205)} - H04N 21/4316: {for displaying supplemental content in a region of the screen, e.g. an advertisement in a separate window} - H04N 21/44224: {Monitoring of user activity on external systems, e.g. Internet browsing} - H04N 21/4438: {Window management, e.g. event handling following interaction with the user interface} - H04N 21/47: End-user applications - H04N 21/47202: {for requesting content on demand, e.g. video on demand} - H04N 21/478: Supplemental services, e.g. displaying phone caller identification, shopping application - H04N 21/47815: {Electronic shopping (payment schemes, payment architectures or payment protocols for electronic shopping systems G06Q20/12)} - H04N 21/4782: Web browsing {, e.g. WebTV} - H04N 21/482: End-user interface for programme selection - H04N 21/4821: {using a grid, e.g. sorted out by channel and broadcast time} - H04N 21/4825: {using a list of items to be played back in a given order, e.g. playlists} - G06F 2203/04806: Zoom, i.e. interaction techniques or interactors for controlling the zooming operation - G08C 2201/32: Remote control based on movements, attitude of remote control device - H04N 5/45: Picture in picture {, e.g. displaying simultaneously another television channel in a region of the screen} - H04N 21/42206: {characterized by hardware details} - H04N 21/42214: {using alphanumerical characters} - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) - H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION - G08C: TRANSMISSION SYSTEMS FOR MEASURED VALUES, CONTROL OR SIMILAR SIGNALS (fluid pressure transmitting systems F15B; mechanical means for transferring the output of a sensing member into a different variable G01D5/00; mechanical control systems G05G) ## Abstract Systems and methods according to the present invention provide a control framework for organizing, selecting and launching media items including graphical user interfaces coupled with an optional 3D control device for collection of the basic control primitives of point, click, scroll, hover and zoom which permit for easy and rapid selection of media items, e.g., movies, songs etc., from large or small collections. The remote control maps natural hand movements and gestures into relevant commands while the graphical display uses images, zooming for increased/decreased levels of detail and continuity of GUI objects to provide easy organization, selection and navigation among the media items by a user. ## Claims ### Claim 1 A method for using a device with a software application that displays output on a screen, the method comprising the steps of: displaying a first set of information on said screen associated with said software application, wherein said software application includes at least one of: an electronic program guide, television screen controls, a photo album, a home video collection and a shopping interface; receiving data associated with movement of said device; processing said data associated with movement of said device to compensate for unintended movement of said device; moving a cursor displayed on said screen based on said processed data to a new position on said screen; and changing said display of said first set of information on said screen in response to said new position of said cursor. ### Claim 2 (depends on 1) The method of claim 1, wherein said unintended movement is caused by tremor associated with a user holding said device. ### Claim 3 (depends on 1) The method of claim 1, wherein said unintended movement is caused by a user actuating a movable element on said device. ### Claim 4 (depends on 1) The method of claim 1, further comprising the step of: displaying, at least in part based on said new position of said cursor after said step of moving said cursor, a second set of information on said screen, said second set of information being different than said first set of information. ### Claim 5 (depends on 4) The method of claim 4, wherein said first set of information includes a plurality of images and second set of information is a hoverzoom of an image associated with said first set of information. ### Claim 6 (depends on 4) The method of claim 4, wherein said step of displaying said second set of information requires an additional input from a user in addition to said movement of said cursor. ### Claim 7 (depends on 4) The method of claim 4, wherein said step of displaying said second set of information further comprises the step of: displaying said second set of information in direct response to said cursor position without requiring any additional input from a user. ### Claim 8 (depends on 4) The method of claim 4, wherein said first set of information is a program guide and second set of information is displayed by scrolling a linear list of programs. ### Claim 9 (depends on 4) The method of claim 4, wherein said first set of information is a program guide and said second set of information is a screen control which is displayed in response to a user request. ### Claim 10 (depends on 4) The method of claim 4, wherein said first set of information is a program guide and said second set of information includes cross-links displayed responsive to hovering over an item displayed as part of said first set of information or selecting said item. ### Claim 11 (depends on 4) The method of claim 4, wherein said first set of information is a program guide and said second set of information includes on-screen transport controls associated with the control of video playback. ### Claim 12 (depends on 4) The method of claim 4, wherein said first set of information is a photo collection and wherein second set of information is a playlist to which said photo collection is added. ### Claim 13 (depends on 4) The method of claim 4, wherein said first set of information is a photo collection and wherein said second set of information is a zoomed version of said photo album which provides contextual information associate therewith that permits hierarchical sorting. ### Claim 14 (depends on 4) The method of claim 4, wherein said first set of information is a photo collection and wherein said second set of information includes on-screen transport controls which enable a user to control a slide show presentation of photos. ### Claim 15 (depends on 4) The method of claim 4, wherein said first set of information is a video collection and wherein said second set of information is a playlist to which said video collection is added. ### Claim 16 (depends on 4) The method of claim 4, wherein said first set of information is a video collection and wherein said second set of information is a zoomed version of said video collection which provides contextual information associate therewith that permits hierarchical sorting. ### Claim 17 (depends on 4) The method of claim 4, wherein said first set of information is a video collection and wherein said second set of information includes on-screen transport controls which enable a user to control presentation of said video collection. ### Claim 18 (depends on 4) The method of claim 4, wherein said first set of information is a calendar and wherein said second set of information is information associated with a particular day on said calendar, displayed on said screen in response to movement of said cursor over a respective portion of said calendar. ### Claim 19 (depends on 4) The method of claim 4, wherein said first set of information is a calendar and wherein said second set of information is information associated with a particular day on said calendar, which information can be edited by a user using an on-screen text entry system. ### Claim 20 (depends on 4) The method of claim 4, wherein said first set of information is a calendar and wherein said second set of information is a sorted version of said calendar. ### Claim 21 A system for using a device with a software application stored on a computer-readable medium that displays output on a screen, the system comprising: means for displaying a first set of information on said screen associated with said software application, wherein said software application includes at least one of: an electronic program guide, television screen controls, a photo album, a home video collection and a shopping interface; means for receiving data associated with movement of said device; means for processing said data associated with movement of said device to compensate for unintended movement of said device; means for moving a cursor displayed on said screen based on said processed data to a new position on said screen; and means for changing said display of said first set of information on said screen in response to said new position of said cursor. ### Claim 22 (depends on 21) The system of claim 21, wherein said unintended movement is caused by tremor associated with a user holding said device. ### Claim 23 (depends on 21) The system of claim 21, wherein said unintended movement is caused by a user actuating a movable element on said device. ### Claim 24 (depends on 21) The system of claim 21, further comprising: means for displaying, at least in part based on said new position of said cursor after said step of moving said cursor, a second set of information on said screen, said second set of information being different than said first set of information. ### Claim 25 (depends on 24) The system of claim 24, wherein said first set of information includes a plurality of images and second set of information is a hoverzoom of an image associated with said first set of information. ### Claim 26 (depends on 24) The system of claim 24, wherein said means for displaying said second set of information requires an additional input from a user in addition to said movement of said cursor. ### Claim 27 (depends on 24) The system of claim 24, wherein said means for displaying said second set of information further comprises: means for displaying said second set of information in direct response to said cursor position without requiring any additional input from a user.