# US 2013/0156259 A1 · Product imaging device, product imaging method, image conversion device, image processing device, image processing system, program, and information recording medium

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2013/0156259 A1
- Document ID: US20130156259A1
- Status: Published application
- Kind: A1
- Application number: 13/764,283
- Filed: 2013-02-11
- Published: 2013-06-20
- Earliest claimed: 2010-08-30
- Assignees: Rakuten, Inc.
- Inventors: Hiromi HIRANO
- Web page: https://patentgrep.com/patent/US20130156259A1

## CPC

- G06T 1/0007: {Image acquisition}
- G06T 3/02: Affine transformations (for image registration G06T3/147; for image mosaicing G06T3/4038)
- H04N 5/2625: {for obtaining an image which is composed of images from a temporal image sequence, e.g. for a stroboscopic effect (sequence generated by event triggered capturing H04N7/188)}
- H04N 23/633: {for displaying additional information relating to control or operation of the camera}
- G06T: IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

A product imaging device (121) is provided which facilitates a user to capture the image sequence of entire surroundings of a product. An image sensor unit (201) senses incident light from the external world where the product is disposed and outputs an image representing a result of the sensing. An instruction receiving unit (202) receives an image-capture instruction from the user. A memory unit (203) stores the image sensed by the image sensor unit (201) upon reception of an image-capture instruction. A finder display unit (204) synthesizes the image stored in the memory unit (203) with an image presently sensed by the image sensor unit (201) and displays a synthesized image on a finder screen.

## Claims

### Claim 1

An image processing device comprising:
an angle accepting unit that accepts an angle around a rotational axis passing through a product; and
an interpolating unit which interpolates an image sequence of entire surroundings of the product including a plurality of normalized images each associated with a rotational angle based on the accepted angle, and which obtains an interpolated image showing an appearance of the product as viewed at the accepted angle,
the interpolating unit, selects normalized images B [k] and B[k+1] associated with rotational angles θ[k] and θ[k+1] between the accepted angle φ among rotational angles θ[0], θ[1], . . . and θ[N−1] (where θ[0]≦θ[1]≦ . . . and ≦θ[N−1]) associated with respective normalized images B[0], B[1], . . . and B[N−1] included in the image sequence of entire surroundings,
generates a first image L(φ) L[k]−1B[k] and a second image L(φ) L[k+1]−1B[k+1] from affine transformation matrixes L[k] and L[k+1] for projecting a real world in normalized images B [k] and B[k+1], and an affine transformation matrix L(φ) relative to the accepted angle φ for projecting the real world in an image,
divides the first image L(θ) L[k]−1B[k] into (φ−θ[k]) and (θ[k+1]φφ) through a dividing line parallel to the center axis, and extracts a third image at a side where the rotational angle around the center axis is small,
divides the second image L(φ) L[k+1]−1B[k+1] into (φ−θ[k]) and (θ[k+1]−φ) through a dividing line parallel to the center axis, and extracts a fourth image at a side where the rotational angle around the center axis is large, and
disposes and arranges side by side the third image and the fourth image at a side where the rotational angle around the center axis is small and a side where the rotational angle around the center axis is large, thereby obtaining the interpolated image.

### Claim 2

An image processing method comprising:
an angle accepting step of accepting an angle around a rotational axis passing through a product; and
an interpolating step of interpolating an image sequence of entire surroundings of the product including a plurality of normalized images each associated with a rotational angle based on the accepted angle, and obtaining an interpolated image showing an appearance of the product as viewed at the accepted angle,
in the interpolating step,
selecting normalized images B [k] and B[k+1] associated with rotational angles θ[k] and θ[k+1] between the accepted angle φ among rotational angles θ[0], θ[1], . . . and θ[N−1] (where θ[0]≦θ[1]≦ . . . and ≦θ[N−1]) associated with respective normalized images B[0], B[1], . . . and B[N−1] included in the image sequence of entire surroundings,
generating a first image L(φ) L[k]−1B[k] and a second image L(φ) L[k+1]−1B[k+1] from affine transformation matrixes L[k] and L[k+1] for projecting a real world in normalized images B [k] and B[k+1], and an affine transformation matrix L(φ) relative to the accepted angle φ for projecting the real world in an image,
dividing the first image L(φ) L[k]−1B[k] into (φ−θ[k]) and (θ[k+1]−φ) through a dividing line parallel to the center axis, and extracting a third image at a side where the rotational angle around the center axis is small,
dividing the second image L(φ) L[k+1]−1B[k+1] into (φ−θ[k]) and (θ[k+1]−φ) through a dividing line parallel to the center axis, and extracting a fourth image at a side where the rotational angle around the center axis is large, and
disposing and arranging side by side the third image and the fourth image at a side where the rotational angle around the center axis is small and a side where the rotational angle around the center axis is large, thereby obtaining the interpolated image.

### Claim 3

A computer-readable non-temporal information recording medium recording therein a program that allows a computer to function as:
an angle accepting unit that accepts an angle around a rotational axis passing through a product; and
an interpolating unit which interpolates an image sequence of entire surroundings of the product including a plurality of normalized images each associated with a rotational angle based on the accepted angle, and which obtains an interpolated image showing an appearance of the product as viewed at the accepted angle,
the interpolating unit,
selects normalized images B [k] and B[k+1] associated with rotational angles θ[k] and θ[k+1] between the accepted angle φ among rotational angles θ[0], θ[1], . . . and θ[N−1] (where θ[0]≦θ[1]≦ . . . and ≦θ[N−1]) associated with respective normalized images B[0], B[1], . . . and B[N−1] included in the image sequence of entire surroundings,
generates a first image L(φ) L[k]−1B[k] and a second image L(φ) L[k+1]−1B[k+1] from affine transformation matrixes L[k] and L[k+1] for projecting a real world in normalized images B [k] and B[k+1], and an affine transformation matrix L(φ) relative to the accepted angle φ for projecting the real world in an image,
divides the first image L(φ) L[k]−1B[k] into (φ−θ[k]) and (θ[k+1]−φ) through a dividing line parallel to the center axis, and extracts a third image at a side where the rotational angle around the center axis is small,
divides the second image L(φ) L[k+1]−1B[k+1] into (φ−θ[k]) and (θ[k+1]−φ) through a dividing line parallel to the center axis, and extracts a fourth image at a side where the rotational angle around the center axis is large, and
disposes and arranges side by side the third image and the fourth image at a side where the rotational angle around the center axis is small and a side where the rotational angle around the center axis is large, thereby obtaining the interpolated image.