# US 2012/0075306 A1 · Mobile device with on-screen optical navigation > Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt - Number: US 2012/0075306 A1 - Document ID: US20120075306A1 - Status: Published application - Kind: A1 - Application number: 13/313,291 - Filed: 2011-12-07 - Published: 2012-03-29 - Earliest claimed: 2003-08-05 - Assignees: Research In Motion Limited - Inventors: Alexei SKARINE - Web page: https://patentgrep.com/patent/US20120075306A1 ## CPC - G06F 3/0317: {in co-operation with a patterned surface, e.g. absolute position or relative movement detection for an optical mouse or pen positioned with respect to a coded surface} - G06F 1/1616: {with folding flat displays, e.g. laptop computers or notebooks having a clamshell configuration, with body parts pivoting to an open position around an axis parallel to the plane they define in closed position} - G06F 1/1626: {with a single-body enclosure integrating a flat display, e.g. Personal Digital Assistants [PDAs]} - G06F 1/1686: {the I/O peripheral being an integrated camera} - G06F 1/169: {the I/O peripheral being an integrated pointing device, e.g. trackball in the palm rest area, mini-joystick integrated between keyboard keys, touch pads or touch stripes (G06F1/1643 takes precedence; constructional details of pointing devices G06F3/033)} - G06F 2200/1637: Sensing arrangement for detection of housing movement or orientation, e.g. for controlling scrolling or cursor movement on the display of an handheld computer - G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N) ## Abstract A mobile computing device, including a main body, a processor and associated memory housed within the main body, a display screen housed within the main body and responsive to signals from the processor, an optical sensor fixed to the main body for capturing successive images and providing image signals representative of the captured images to the processor, and a navigation module associated with the processor for determining, based on the image signals, a relative movement between the main body and a reference surface and moving a pointer on the display screen based on the determined relative movement. ## Claims ### Claim 1 A mobile device, comprising: a casing having a front face and a back face; a display configurable to display a pointer, the display mounted in the front face; a camera configurable to capture successive images and provide image signals representative of the captured images, the camera mounted in the front face; and a microprocessor configurable to: receive the image signals, determine, based on the image signals, a relative movement between the casing and a reference surface, and move a pointer on the display based on the determined relative movement. ### Claim 2 (depends on 1) The mobile device of claim 1 wherein the microprocessor is further configurable to convert the image signals to lower resolution image signals and determine the relative movement based on the lower resolution image signals. ### Claim 3 (depends on 2) The mobile device of claim 2 wherein the camera is configurable to capture high resolution color image signals and the microprocessor is configurable to convert the high resolution color image signals to lower resolution grey scale image signals. ### Claim 4 (depends on 1) The mobile device of claim 1 wherein the microprocessor is further configurable to compare the successive images captured by the camera at a predetermined capture rate to determine a relative direction, distance and speed of movement of the main body relative to the reference surface, and move the pointer on the display screen based on the determined relative direction, distance and speed. ### Claim 5 (depends on 1) The mobile device of claim 1 wherein the microprocessor is further configurable to selectively display the captured images on the display in a camera mode and display the pointer to be moved on-screen based on the captured images in a navigation mode. ### Claim 6 (depends on 5) The mobile device of claim 5 further comprising a select mode for selecting between the camera mode and the navigation mode. ### Claim 7 (depends on 6) The mobile device of claim 6 wherein during said select mode, the microprocessor receives said captured images and determines, based upon said captured images, whether said device is within a threshold distance from the reference surface, and automatically selects between said navigation mode and said camera mode based upon said determination. ### Claim 8 (depends on 1) The mobile device of claim 1 wherein the casing comprises a first case portion and a second case portion, wherein the display is mounted to a front face of the first case portion and the camera is mounted to a front face of the second case portion. ### Claim 9 (depends on 8) The mobile device of claim 8, wherein the first case portion is pivotally mounted to the second case portion to engage the front faces of the first case portion and the second case portion in a closed position. ### Claim 10 (depends on 8) The mobile device of claim 8 further comprising a keyboard mounted to the second case portion. ### Claim 11 (depends on 1) The mobile device of claim 1 wherein the camera is pivotally mounted to the casing. ### Claim 12 (depends on 1) The mobile device of claim 1 wherein the camera is detachable from the casing.