# US 2009/0262200 A1 · Notebook information processor and image reading method

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2009/0262200 A1
- Document ID: US20090262200A1
- Status: Published application
- Kind: A1
- Application number: 12/251,475
- Filed: 2008-10-15
- Published: 2009-10-22
- Earliest claimed: 2008-04-21
- Assignees: Pfu Limited
- Inventors: Masanari Takabatake; Nobuhisa Yamazaki; Satoshi Miyamoto; Jiyun Du
- Web page: https://patentgrep.com/patent/US20090262200A1

## CPC

- H04N 7/18: Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
- G06F 1/1616: {with folding flat displays, e.g. laptop computers or notebooks having a clamshell configuration, with body parts pivoting to an open position around an axis parallel to the plane they define in closed position}
- G06F 1/1686: {the I/O peripheral being an integrated camera}
- H04N 1/00204: {with a digital computer or a digital computer system, e.g. an internet server (programmed control between transmitter and receiver or between image input and image output device H04N1/32561)}
- H04N 1/04: Scanning arrangements {, i.e. arrangements for the displacement of active reading or reproducing elements relative to the original or reproducing medium, or vice versa}(H04N1/387 takes precedence)
- H04N 2101/00: Still video cameras
- H04N 2201/0063: Constructional details
- H04N 2201/0081: Image reader (H04N2201/0091 - H04N2201/0094 take precedence)
- H04N 2201/0084: Digital still camera
- H04N 2201/0436: Scanning a picture-bearing surface lying face up on a support (H04N2201/0434 takes precedence; using cylindrical picture bearing surfaces H04N1/06; with manual scanning H04N1/107)
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

A notebook information processor includes an image photographing unit, a display, a keyboard, a storage unit, and a control unit, wherein the control unit includes, a live view displaying unit that displays a live view obtained by photographing at least a portion of the keyboard within a photographing area of the image photographing unit on the display, a still image obtaining unit that obtains a still image from the live view displayed on the display by the live view displaying unit, when receiving a photographing start signal to start photographing the still image of a document put on the keyboard, and an image processing unit that performs projective transformation on the still image obtained by the still image obtaining unit so as to obtain an image photographed from a front direction, executes image processing so as to perform cropping to clip the document, and stores a transformed image of the document after the image processing in the storage unit.

## Claims

### Claim 1

A notebook information processor comprising an image photographing unit, a display, a keyboard, a storage unit, and a control unit, wherein
the control unit includes:
a live view displaying unit that displays a live view obtained by photographing at least a portion of the keyboard within a photographing area of the image photographing unit on the display;
a still image obtaining unit that obtains a still image from the live view displayed on the display by the live view displaying unit, when receiving a photographing start signal to start photographing the still image of a document put on the keyboard; and
an image processing unit that performs projective transformation on the still image obtained by the still image obtaining unit so as to obtain an image photographed from a front direction, executes image processing so as to perform cropping to clip the document, and stores a transformed image of the document after the image processing in the storage unit.

### Claim 2

A notebook information processor, comprising an image photographing unit, a display, a keyboard, a storage unit, and a control unit, wherein
the control unit includes:
a live view displaying unit that obtains a live view obtained by photographing at least a portion of the keyboard within a photographing area of the image photographing unit, and performs projective transformation on the obtained live view so as to obtain the live view photographed from a front direction, thereby displaying the live view after the projective transformation on the display;
a still image obtaining unit that obtains a still image from the live view displayed on the display by the live view displaying unit, when receiving a photographing start signal to start photographing the still image of a document put on the keyboard; and
an image processing unit that executes image processing to the still image obtained by the still image obtaining unit so as to perform cropping to clip the document, and stores a transformed image of the document after the image processing in the storage unit.

### Claim 3 (depends on 1)

The notebook information processor according to claim 1, wherein
the control unit further includes:
a photographing start signal generating unit that determines presence of the document by comparing a first image in which the document is not on the keyboard and a second image in which the document is on the keyboard obtained by the image photographing unit, and when there is the document, generates the photographing start signal to transmit the signal to the still image obtaining unit.

### Claim 4 (depends on 1)

The notebook information processor according to claim 1, wherein
the control unit further includes:
a brightness adjusting unit that adjusts brightness of the display when obtaining the still image by the still image obtaining unit.

### Claim 5 (depends on 1)

The notebook information processor according to claim 1, wherein
the cropping by the image processing unit detects a corner of the document by comparing a first image in which the document is not on the keyboard and a second image in which the document is on the keyboard obtained by the image photographing unit.

### Claim 6 (depends on 1)

The notebook information processor according to claim 1, wherein the image photographing unit is detachably placed in the notebook information processor, electrified by the notebook information processor, and is communicatably connected to the notebook information processor.

### Claim 7 (depends on 1)

The notebook information processor according to claim 1, wherein the image photographing unit is rotatably placed in the notebook information processor so as to be able to change a photographing direction.

### Claim 8 (depends on 7)

The notebook information processor according to claim 7, wherein the notebook information processor further includes a rotation angle sensor that detects a rotation angle when rotating the image photographing unit so as to change the photographing direction.

### Claim 9 (depends on 7)

The notebook information processor according to claim 7, wherein
the notebook information processor includes a lid in which at least the image photographing unit is placed, and a main body in which at least the keyboard is placed, and further includes an open angle sensor that detects an open angle of the lid with respect to the main body, and a motor that adjusts a rotation angle of the image photographing unit, and
the control unit further includes:
a rotation angle adjusting unit that adjusts a rotation angle of the motor so as to adjust the photographing direction of the image photographing unit based on the open angle detected by the open angle sensor.

### Claim 10

An image reading method executed by a notebook information processor including an image photographing unit, a display, a keyboard, a storage unit, and a control unit,
the method comprising:
a live view displaying step of displaying a live view obtained by photographing at least a portion of the keyboard within a photographing area of the image photographing unit on the display;
a still image obtaining step of obtaining a still image from the live view displayed on the display at the live view displaying step, when receiving a photographing start signal to start photographing the still image of a document put on the keyboard; and
an image processing step of performing projective transformation on the still image obtained at the still image obtaining step so as to obtain an image photographed from a front direction, executing image processing so as to perform cropping to clip the document, and storing a transformed image of the document after the image processing in the storage unit.

### Claim 11

An image reading method executed by a notebook information processor including an image photographing unit, a display, a keyboard, a storage unit, and a control unit,
the method comprising:
a live view displaying step of obtaining a live view obtained by photographing at least a portion of the keyboard within a photographing area of the image photographing unit, and performing projective transformation on the obtained live view so as to obtain the live view photographed from a front direction, thereby displaying the live view after the projective transformation on the display;
a still image obtaining step of obtaining a still image from the live view displayed on the display at the live view displaying step, when receiving a photographing start signal to start photographing the still image of a document put on the keyboard; and
an image processing step of executing image processing to the still image obtained at the still image obtaining step so as to perform cropping to clip the document, and storing a transformed image of the document after the image processing in the storage unit.

### Claim 12 (depends on 10)

The image reading method according to claim 10,
the control unit further comprising:
a photographing start signal generating step of determining presence of the document by comparing a first image in which the document is not on the keyboard and a second image in which the document is on the keyboard obtained by the image photographing unit, and when there is the document, generating the photographing start signal to transmit the signal to the still image obtaining step.

### Claim 13 (depends on 10)

The image reading method according to claim 10,
the control unit further comprising:
a brightness adjusting step of adjusting brightness of the display when obtaining the still image at the still image obtaining step.

### Claim 14 (depends on 10)

The image reading method according to claim 10, wherein
the cropping at the image processing step detects a corner of the document by comparing a first image in which the document is not on the keyboard and a second image in which the document is on the keyboard obtained by the image photographing unit.

### Claim 15 (depends on 10)

The image reading method according to claim 10, wherein the image photographing unit is detachably placed in the notebook information processor, electrified by the notebook information processor, and is communicatably connected to the notebook information processor.

### Claim 16 (depends on 10)

The image reading method according to claim 10, wherein the image photographing unit is rotatably placed in the notebook information processor so as to be able to change a photographing direction.

### Claim 17 (depends on 16)

The image reading method according to claim 16, wherein the notebook information processor further includes a rotation angle sensor that detects a rotation angle when rotating the image photographing unit so as to change the photographing direction.

### Claim 18 (depends on 16)

The image reading method according to claim 16, wherein
the notebook information processor includes a lid in which at least the image photographing unit is placed, and a main body in which at least the keyboard is placed, and further includes an open angle sensor that detects an open angle of the lid with respect to the main body, and a motor that adjusts a rotation angle of the image photographing unit, and
the method further comprising:
a rotation angle adjusting step of adjusting a rotation angle of the motor so as to adjust the photographing direction of the image photographing unit based on the open angle detected by the open angle sensor.
