# US 2023/0141747 A1 · Communication monitoring method and communication monitoring system

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2023/0141747 A1
- Document ID: US20230141747A1
- Status: Published application
- Kind: A1
- Application number: 18/093,631
- Filed: 2023-01-05
- Published: 2023-05-11
- Earliest claimed: 2020-07-15
- Assignees: Panasonic Intellectual Property Corporation of America
- Applicants: Panasonic Intellectual Property Corporation of America
- Inventors: Tatsumi OBA; Hiroyuki OKADA
- Web page: https://patentgrep.com/patent/US20230141747A1

## CPC

- H04L 41/145: {involving simulating, designing, planning or modelling of a network}
- H04L 63/1425: {Traffic logging, e.g. anomaly detection}
- H04L 41/147: for predicting network behaviour
- H04L 41/16: using machine learning or artificial intelligence
- H04L 43/062: related to network traffic
- H04L 63/0236: {Filtering by address, protocol, port number or service, e.g. IP-address or URL}
- H04L 63/162: {at the data link layer}
- H04L 63/164: {at the network layer}
- H04L 63/166: {at the transport layer}
- Y04S 40/20: Information technology specific aspects, e.g. CAD, simulation, modelling, system security
- H04L: TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION (arrangements common to telegraphic and telephonic communication H04M)
- Y04S: SYSTEMS INTEGRATING TECHNOLOGIES RELATED TO POWER NETWORK OPERATION, COMMUNICATION OR INFORMATION TECHNOLOGIES FOR IMPROVING THE ELECTRICAL POWER GENERATION, TRANSMISSION, DISTRIBUTION, MANAGEMENT OR USAGE, i.e. SMART GRIDS

## Abstract

This method includes: extracting, from communication in a network, a first communication triplet that is a 3-tuple including information indicating a source device, information indicating a destination device, and information indicating the type of communication performed between devices; determining whether the first communication triplet extracted corresponds to any of a plurality of second communication triplets stored in storage in advance as a whitelist and each being a 3-tuple including information indicating a source device, information indicating a destination device, and information indicating the type of communication; and estimating, as a score, a possibility that the first communication triplet emerges as the communication, by using a model that has been trained, when the first communication triplet does not correspond to any of the plurality of second communication triplets.

## Claims

### Claim 1

A communication monitoring method for monitoring communication in a network, the communication monitoring method comprising:
extracting, from the communication, a first communication triplet that is a 3-tuple including information indicating a source device, information indicating a destination device, and information indicating a type of communication performed between devices;
determining whether the first communication triplet extracted corresponds to any of a plurality of second communication triplets stored in storage in advance as a whitelist and each being a 3-tuple including information indicating a source device, information indicating a destination device, and information indicating a type of communication; and
estimating, as a score, a possibility that the first communication triplet emerges as the communication, by using a model that has been trained, and outputting the score when the first communication triplet does not correspond to any of the plurality of second communication triplets.

### Claim 2 (depends on 1)

The communication monitoring method according to claim 1, wherein
in the outputting,
when the score is less than or equal to a threshold value, a monitoring result indicating that the communication is suspicious is output.

### Claim 3 (depends on 1)

The communication monitoring method according to claim 1, wherein
the estimating of the score includes
causing the model that has been trained to perform the following:
converting a set of 3-tuples of the first communication triplet into a multigraph in which the information indicating the source device and the information indicating the destination device are nodes and the information indicating the type of communication is a type of an edge, and mapping each of the nodes of the multigraph to vector representation of a fixed dimension to obtain vector representation of each element of the first communication triplet; and
estimating the score from the vector representation of the first communication triplet obtained.

### Claim 4 (depends on 3)

The communication monitoring method according to claim 3, wherein
the model includes a relational graph convolutional network (R-GCN).

### Claim 5 (depends on 1)

The communication monitoring method according to claim 1, wherein
the estimating of the score includes
causing the model that has been trained to perform the following:
converting a set of 3-tuples of the first communication triplet into a multigraph in which the information indicating the source device and the information indicating the destination device are nodes and the information indicating the type of communication is a type of an edge, and obtaining vector representation of the first communication triplet from the multigraph; and
estimating the score using a link prediction algorithm from the vector representation of the first communication triplet obtained.

### Claim 6 (depends on 5)

The communication monitoring method according to claim 5, wherein
the model includes a composition-based multi-relational graph convolutional network (COMPGCN).

### Claim 7 (depends on 1)

The communication monitoring method according to claim 1, wherein
the estimating of the score includes
causing the model that has been trained to perform the following:
obtaining vector representation of the first communication triplet from a set of 3-tuples of the first communication triplet; and
estimating the score using a link prediction algorithm from the vector representation of the first communication triplet obtained.

### Claim 8 (depends on 7)

The communication monitoring method according to claim 7, wherein
the model includes any of DistMult, convolutional 2D knowledge graph embeddings (convE), translating embeddings for modeling multi-relational data (TransE), holographic embeddings of knowledge graphs (HolE), and complex embeddings for simple link prediction (ComplEx).

### Claim 9 (depends on 1)

The communication monitoring method according to claim 1, wherein
the information indicating the source device is an IP address of a server that is the source device,
the information indicating the destination device is an IP address of a client that is the destination device, and
the information indicating the type of communication includes a TCP/UDP port number or a type of an alert.

### Claim 10 (depends on 1)

The communication monitoring method according to claim 1, wherein
the information indicating the source device is a MAC address or a serial number of the source device,
the information indicating the destination device is a MAC address or a serial number of the destination device, and
the information indicating the type of communication includes a type of an alert or a type of a communication command that is exchanged between the source device and the destination device.

### Claim 11 (depends on 1)

The communication monitoring method according to claim 1, further comprising:
before the extracting,
obtaining the plurality of second communication triplets from network communication performed in a predetermined period; and
performing a learning process using, as data for learning, the plurality of second communication triplets obtained, the learning process including causing the model to obtain vector representation of the plurality of second communication triplets and estimate, as a score, a possibility that the network communication performed in the predetermined period emerges.

### Claim 12 (depends on 1)

The communication monitoring method according to claim 1, further comprising:
before the extracting,
obtaining the plurality of second communication triplets from network communication performed in a predetermined period;
performing a learning process using, as data for learning, the plurality of second communication triplets obtained, the learning process including causing the model to obtain vector representation of the plurality of second communication triplets and estimate, as a score, a possibility that the network communication performed in the predetermined period emerges; and
estimating, as a score indicating an anomaly level, a possibility that each of the plurality of second communication triplets obtained emerges as the communication, by using the model that has been trained, and outputting the score.

### Claim 13 (depends on 11)

The communication monitoring method according to claim 11, wherein
in the learning process of causing the model to obtain the vector representation of the plurality of second communication triplets,
a set of 3-tuples of the plurality of second communication triplets is input to the model, and training is conducted by causing the model to map the information indicating the source device and the information indicating the destination device to vector representation of a fixed dimension and obtain the vector representation of the plurality of second communication triplets.

### Claim 14 (depends on 11)

The communication monitoring method according to claim 11, wherein
in the plurality of second communication triplets that are used as the data for learning,
in addition to the type of communication, a feature amount regarding the network communication performed in the predetermined period is included as the type of communication.

### Claim 15 (depends on 14)

The communication monitoring method according to claim 14, wherein
the feature amount includes at least one of an amount of communication per unit time or a median communication time interval in the network communication performed in the predetermined period.

### Claim 16 (depends on 1)

The communication monitoring method according to claim 1, further comprising:
before the extracting,
obtaining, from network communication performed in a predetermined period, a plurality of third communication triplets each being a 3-tuple including information indicating a source device, information indicating a destination device, and information indicating a type of communication;
performing a learning process using, as data for learning, the plurality of third communication triplets obtained, the learning process including causing the model to obtain vector representation of the plurality of third communication triplets and estimate, as a score, a possibility that the network communication performed in the predetermined period emerges;
estimating, as a score indicating an anomaly level, a possibility that each of the plurality of third communication triplets emerges as the communication, by using the model that has been trained, and outputting the score; and
storing communication triplets obtained by excluding one or more third communication triplets from the plurality of third communication triplets based on the score indicating the anomaly level into the storage as the plurality of second communication triplets.

### Claim 17 (depends on 1)

The communication monitoring method according to claim 1, further comprising:
before the extracting,
obtaining, from network communication performed in a predetermined period, a plurality of third communication triplets each being a 3-tuple including information indicating a source device, information indicating a destination device, and information indicating a type of communication;
performing a learning process using, as data for learning, the plurality of third communication triplets obtained, the learning process including causing the model to obtain vector representation of the plurality of third communication triplets and estimate, as a score, a possibility that the network communication performed in the predetermined period emerges;
estimating, as a score indicating an anomaly level, a possibility that each of the plurality of third communication triplets emerges as the communication, by using the model that has been trained, and outputting the score;
performing a re-learning process using, as data for re-learning, communication triplets obtained by excluding one or more third communication triplets from the plurality of third communication triplets based on the score, the re-learning process including causing the model to obtain vector representation of the plurality of third communication triplets and estimate, as a score, a possibility that the network communication performed in the predetermined period emerges; and
storing communication triplets obtained by excluding one or more third communication triplets from the plurality of third communication triplets based on the score indicating the anomaly level into the storage as the plurality of second communication triplets.

### Claim 18 (depends on 16)

The communication monitoring method according to claim 16, wherein
in the learning process or the re-learning process,
a set of 3-tuples of the plurality of third communication triplets is input to the model, and training is conducted by causing the model to map the information indicating the source device and the information indicating the destination device to vector representation of a fixed dimension and obtain vector representation of the plurality of third communication triplets.

### Claim 19

A communication monitoring system for monitoring communication in a network, the communication monitoring system comprising:
an extractor that extracts, from the communication, a first communication triplet being a 3-tuple including information indicating a source device, information indicating a destination device, and information indicating a type of communication performed between devices;
storage in which a plurality of second communication triplets each being a 3-tuple including information indicating a source device, information indicating a destination device, and information indicating a type of communication are stored as a whitelist; and
a scoring unit that determines whether the first communication triplet extracted corresponds to any of the plurality of second communication triplets and when the first communication triplet does not correspond to any of the plurality of second communication triplets, estimates, as a score, a possibility that the first communication triplet emerges as the communication, by using a model that has been trained, and outputs the score.

### Claim 20 (depends on 1)

The communication monitoring method according to claim 1, wherein
the estimating of the score includes
causing the model that has been trained to perform the following:
obtaining vector representation of each element of the first communication triplet by mapping the information indicating the source device and the information indicating the destination device among a set of 3-tuples of the first communication triplet to vector representation of a fixed dimension; and
estimating the score from the vector representation of the first communication triplet obtained.
