# US 2017/0256072 A1 · Information processing system, information processing method, and non-transitory computer-readable storage medium

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2017/0256072 A1
- Document ID: US20170256072A1
- Status: Published application
- Kind: A1
- Application number: 15/446,125
- Filed: 2017-03-01
- Published: 2017-09-07
- Earliest claimed: 2016-03-07
- Assignees: Ricoh Company, Ltd.
- Inventors: Takafumi SHIMMOTO; Satoshi MITSUI
- Web page: https://patentgrep.com/patent/US20170256072A1

## CPC

- G06V 20/53: {Recognition of crowd images, e.g. recognition of crowd congestion}
- G06V 10/147: Details of sensors, e.g. sensor lenses (fingerprint or palmprint sensors G06V40/13; vascular sensors G06V40/145; eye sensors G06V40/19)
- G06V 10/95: {structured as a network, e.g. client-server architectures}
- H04N 21/00: Selective content distribution, e.g. interactive television or video on demand [VOD] (real-time bi-directional transmission of motion video data H04N7/14 {; broadcast or conference over packet switching networks H04L12/18})
- H04N 23/698: for achieving an enlarged field of view, e.g. panoramic image capture
- G06V 10/16: {using multiple overlapping images; Image stitching}
- G06V: IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- H04N: PICTORIAL COMMUNICATION, e.g. TELEVISION

## Abstract

An information processing system includes a server apparatus including one or more processors configured to analyze a plurality of wide angle images acquired through photographing, and transmit a result image indicating a result of analyzing to an information processing terminal; and the information processing terminal communicatable with the server apparatus and including one or more processors configured to receive the result image, and display the result image on a display.

## Claims

### Claim 1

An information processing system comprising a server apparatus and an information processing terminal, wherein
(i) the server apparatus including one or more processors configured to:
analyze a plurality of wide angle images acquired through photographing, and
transmit a result image indicating a result of analyzing to an information processing terminal; and
(ii) the information processing terminal communicatable with the server apparatus and including one or more processors configured to:
receive the result image, and
display the result image on a display.

### Claim 2 (depends on 1)

The information processing system according to claim 1, wherein
(i) the one or more processors of the server apparatus are further configured to:
receive analysis content information indicating analysis contents for the wide angle image, and
analyze the plurality of wide angle images according to the analysis contents indicated by the analysis content information.

### Claim 3 (depends on 2)

The information processing system according to claim 2, wherein
the analysis contents include at least one of the number of objects appearing in the wide angle images; the number of the objects appearing in predetermined specific areas of the wide angle images; the number of drawn images drawn in the wide angle images; and the number of specific ones of the objects appearing in the wide angle images.

### Claim 4 (depends on 1)

The information processing system according to claim 1, wherein
(i) the one or more processors of the server apparatus are further configured to:
identify wide angle images used as a base to derive an analysis result indicated by the result image as base images, and
transmit the base images to the information processing terminal; and
(ii) the one or more processors of the information processing terminal are further configured to:
receive the base images, and
display the wide angle image as the base image on the display.

### Claim 5 (depends on 4)

The information processing system according to claim 4, wherein
(i) the one or more processors of the server apparatus are further configured to:
set initial image information indicating a wide angle image to be first displayed on the display of the information processing terminal from among the wide angle images included in the base images, and
transmit the base images and the initial image information to the information processing terminal; and
(ii) the one or more processors of the information processing terminal are further configured to:
receive the base images and the initial image information, and
display, on the display, the wide angle image indicated by the initial image information from among the wide angle images included in the base images.

### Claim 6 (depends on 5)

The information processing system according to claim 5, wherein
(i) the one or more processors of the server apparatus are further configured to:
set the initial image information according to the analysis contents indicated by the analysis content information.

### Claim 7 (depends on 4)

The information processing system according to claim 4, wherein
(i) the one or more processors of the server apparatus are further configured to:
transmit the base images as the wide angle images as a base to derive the analysis result indicated by the result image, and comparison identification information for identifying other wide angle images for comparison corresponding to the respective wide angle images as the base images to the information processing terminal; and
(ii) the one or more processors of the information processing terminal are further configured to:
receive the base images and the comparison identification information, and
display, on the display, the wide angle image included in the base image and the corresponding wide angle image identified by the comparison identification information.

### Claim 8 (depends on 5)

The information processing system according to claim 5, wherein
(i) the one or more processors of the server apparatus are further configured to:
set initial viewpoint direction information indicating an initial viewpoint direction in the wide angle image, and
transmit the base images, the initial image information, and the initial viewpoint direction information to the information processing terminal; and
(ii) the one or more processors of the information processing terminal are further configured to:
receive the base images, the initial image information, and the initial viewpoint direction information, and
display, on the display, the wide angle image indicated by the initial image information from among the wide angle images included in the base images, using the initial viewpoint direction indicated by the initial viewpoint direction information as a viewpoint direction.

### Claim 9 (depends on 8)

The information processing system according to claim 8, wherein
(i) the one or more processors of the server apparatus are further configured to:
set the initial viewpoint direction information according to the analysis contents indicated by the analysis content information.

### Claim 10 (depends on 1)

The information processing system according to claim 1, wherein
(i) the one or more processors of the server apparatus are further configured to:
analyze each group of a plurality of groups of wide angle images acquired from classifying the plurality of wide angle images according to predetermined classification conditions, and
transmit the result image including a plurality of analysis result images indicating the results of analyzing the respective groups of wide angle images to the information processing terminal.

### Claim 11 (depends on 10)

The information processing system according to claim 10, wherein
the classification conditions include at least either photographed date and time or a photographed place.

### Claim 12 (depends on 1)

The information processing system according to claim 1, wherein
(i) the one or more processors of the information processing terminal are further configured to:
display a wide angle image on the display,
receive a setting of an area in the wide angle image displayed on the display, and
transform coordinates of the area in the display into coordinates of a planar image to be used for analyzing the wide angle image; and
(ii) the one or more processors of the server apparatus are further configured to:
generate information concerning the area considering a result of a comparison between coordinates of a result acquired from analyzing the planar image and the coordinates of the area.

### Claim 13 (depends on 12)

The information processing system according to claim 12, wherein
(i) the wide angle image is an entire celestial sphere image acquired from photographing 360° surroundings;
(ii) the one or more processors of the information processing terminal are further configured to:
if the area the coordinates of which are transformed to the coordinates of the planar image exceeds a resolution of the planar image, calculate a width and a height of the area in consideration of the resolution of the planar image; and
(iii) the one or more processors of the server apparatus are further configured to:
if a lower-right corner of the area in the coordinates of the planar image calculated using the width and height goes across an end of the planar image, divides the area at the end of the planar image, and
compares coordinates of respective areas acquired from dividing the area with the coordinates of the result acquired from analyzing the planar image.

### Claim 14 (depends on 12)

The information processing system according to claim 12, wherein
(i) the one or more processors of the server apparatus are further configured to:
output the information concerning the area for each area.

### Claim 15 (depends on 14)

The information processing system according to claim 14, wherein
(i) if a predetermined object is detected in the planar image, the result acquired from analyzing the planar image includes the coordinates of an object area where the predetermined object is detected; and
(ii) the one or more processors of the server apparatus are further configured to:
if the object area overlaps with the area concerning the setting at least partially, generate the information concerning the area assuming that the object is detected in the area concerning the setting.

### Claim 16 (depends on 15)

The information processing system according to claim 15, wherein
(i) the one or more processors of the server apparatus are further configured to:
determine, for each wide angle image, whether the object area overlaps with the area concerning the setting at least partially, and
if the object area overlaps with the area concerning the setting at least partially, count the number of times when the object is detected, for the area concerning the setting; and
(ii) the one or more processors of the information processing terminal are further configured to:
display the number of times for the area concerning the setting on the display.

### Claim 17 (depends on 16)

The information processing system according to claim 16, wherein
(i) the one or more processors of the information processing terminal are further configured to:
display, on the display, the number of times when the object is detected for the entirety of the wide angle image and the number of times when the object is detected for each area concerning the setting.

### Claim 18 (depends on 12)

The information processing system according to claim 12, wherein
(i) the one or more processors of the information processing terminal are further configured to:
receive one of the setting of the area that is rectangular defined by coordinates of two points indicated by a pointing device on the display; the setting of the area enclosed by a plurality of points indicated by the pointing device on the display; and the setting of the area enclosed by a trajectory indicated by the pointing device on the display.

### Claim 19

An information processing method comprising:
analyzing, by one or more processors of a server apparatus, a plurality of wide angle images acquired through photographing;
transmitting, by the one or more processors of the server apparatus, a result image indicating a result of analyzing to an information processing terminal;
receiving, by one or more processors of the information processing terminal communicatable with the server apparatus, the result image; and
displaying, by one or more processors of the information processing terminal, the result image on a display.

### Claim 20

A non-transitory computer-readable storage medium storing a program to be executed by a computer as a server apparatus to perform a method, the method comprising:
analyzing a plurality of wide angle images acquired through photographing, and
transmitting a result image indicating a result of analyzing to an information processing terminal, wherein
the information processing terminal is communicatable with the server apparatus, receives the result image, and displays the result image on a display.
