# US 2025/0199963 A1 · Memory access method and input/output memory management unit

> Agents: this data is available as JSON from the patentgrep API and MCP server — see https://patentgrep.com/llms.txt

- Number: US 2025/0199963 A1
- Document ID: US20250199963A1
- Status: Published application
- Kind: A1
- Application number: 18/842,859
- Filed: 2023-02-13
- Published: 2025-06-19
- Earliest claimed: 2022-03-02
- Assignees: Cloud Intelligence Assets Holding (Singapore) Private Limited
- Applicants: Cloud Intelligence Assets Holding (Singapore) Private Limited
- Inventors: Kaijie GUO; Ben LUO; Kaihuan PENG
- Web page: https://patentgrep.com/patent/US20250199963A1

## CPC

- G06F 12/1081: for peripheral access to main memory, e.g. direct memory access [DMA]
- G06F 12/1027: using associative or pseudo-associative address translation means, e.g. translation look-aside buffer [TLB]
- G06F 12/1072: Decentralised address translation, e.g. in distributed shared memory systems
- G06F 12/0833: {in combination with broadcast means (e.g. for invalidation or updating)}
- G06F 2212/1024: Latency reduction
- G06F 2212/254: Distributed memory
- G06F 2212/682: Multiprocessor TLB consistency
- G06F 2212/684: TLB miss handling
- G06F: ELECTRIC DIGITAL DATA PROCESSING (computer systems based on specific computational models G06N)

## Abstract

A memory access method and an input-output memory management unit (IOMMU) are disclosed. The method includes: receiving a memory access request sent by a PCI device, which carrying a virtual address; searching for a physical address corresponding to the virtual address in its IOTLB; in a case that no corresponding physical address is found, broadcasting an address probing message carrying the virtual address to each CPU core; searching for a physical address corresponding to the virtual address in its TLB in response to the address probing message, and sending an address response message carrying the found physical address to the IOMMU after finding the physical address corresponding to the virtual address; and receiving, by the IOMMU, the address response message sent by the CPU core, storing a mapping relationship between the physical address and the virtual address in its IOTLB, and performing memory access based on the physical address.

## Claims

### Claim 1

A memory access method applied to a computer system, the computer system comprising a central processing unit (CPU), the CPU comprising a CPU core and an input/output memory management unit (IOMMU), the method comprising:
receiving, by the IOMMU, a memory access request sent by a peripheral component interconnect (PCI) device, the memory access request carrying a virtual address;
searching, by the IOMMU, for a physical address corresponding to the virtual address in its input/output translation look-aside buffer (IOTLB);
in a case that no physical address corresponding to the virtual address is found, broadcasting, by the IOMMU, an address probing message to each CPU core, the address probing message carrying the virtual address;
searching, by the CPU core, for the physical address corresponding to the virtual address in its TLB in response to the address probing message, and sending an address response message to the IOMMU after finding the physical address corresponding to the virtual address, the address response message carrying the found physical address; and
receiving, by the IOMMU, the address response message sent by the CPU core, storing a mapping relationship between the physical address and the virtual address in its IOTLB, and performing memory access based on the physical address.

### Claim 2 (depends on 1)

The method of claim 1, further comprising:
in a case that no address response message is received, searching, by the IOMMU, for the physical address corresponding to the virtual address based on a process page table in a memory.

### Claim 3 (depends on 1)

The method of claim 1, wherein the address probing message further carries an address space identifier, and searching, by the CPU core, for the physical address corresponding to the virtual address in its TLB comprises:
searching, by the CPU core, for a mapping relationship, that matches the address space identifier, between the virtual address and the physical address, in its TLB; and
searching, by the CPU core, for the physical address corresponding to the virtual address in the found mapping relationship.

### Claim 4 (depends on 1)

The method of claim 1, wherein the broadcasting, by the IOMMU, an address probing message to each CPU core comprises:
broadcasting, by the IOMMU, the address probing message to each CPU core based on the cache detection Snoop protocol.

### Claim 5

A memory access method for memory access of a computer system, the computer system comprising a central processing unit (CPU), the CPU comprising a CPU core and an input/output memory management unit (IOMMU), the method being applied to the IOMMU, comprising:
receiving a memory access request sent by a peripheral component interconnect (PCI) device, the memory access request carrying a virtual address;
searching for a physical address corresponding to the virtual address in an input/output translation look-aside buffer (IOTLB);
in a case that no physical address corresponding to the virtual address is found, broadcasting an address probing message to each CPU core, the address probing message carrying the virtual address, so that the CPU core can search in its TLB for the physical address corresponding to the virtual address;
receiving an address response message sent by the CPU core in response to the address probing message, the address response message carrying the physical address corresponding to the virtual address found by the CPU core; and
storing the mapping relationship between the physical address and the virtual address in the IOTLB and performing memory access based on the physical address.

### Claim 6 (depends on 5)

The method of claim 5, further comprising:
in a case that no address response message is received, searching for the physical address corresponding to the virtual address based on a process page table in a memory.

### Claim 7 (depends on 5)

The method of claim 5, wherein the address probing message further carries an address space identifier, so that the CPU core can search in its TLB for a mapping relationship, that matches the address space identifier, between a virtual address and the physical address, and search for the physical address corresponding to the virtual address in the found mapping relationship.

### Claim 8 (depends on 5)

The method of claim 5, wherein the broadcasting the address probing message to each CPU core comprises:
broadcasting the address probing message to each CPU core based on the cache detection Snoop protocol.

### Claim 9

An input-output memory management unit (IOMMU) configured to:
receive a memory access request sent by a peripheral component interconnect (PCI) device, the memory access request carrying a virtual address;
search for a physical address corresponding to the virtual address in an input/output translation look-aside buffer (IOTLB);
in a case that no physical address corresponding to the virtual address is found, broadcast an address probing message to each CPU core, the address probing message carrying the virtual address, so that the CPU core can search in its TLB for the physical address corresponding to the virtual address;
receive an address response message sent by the CPU core in response to the address probing message, wherein the address response message carries the physical address corresponding to the virtual address found by the CPU core; and
store a mapping relationship between the physical address and the virtual address in the IOTLB and perform memory access based on the physical address.

### Claim at position 10

10-13. (canceled)

### Claim 14 (depends on 9)

The input-output memory management unit (IOMMU) of claim 9, further configured to:
in a case that no address response message is received, searching for the physical address corresponding to the virtual address based on a process page table in a memory.

### Claim 15 (depends on 9)

The input-output memory management unit (IOMMU) of claim 9, wherein the address probing message further carries an address space identifier, and the CPU core searching in its TLB for the physical address corresponding to the virtual address comprises:
searching, by the CPU core, for a mapping relationship, that matches the address space identifier, between the virtual address and the physical address, in its TLB; and
searching, by the CPU core, for the physical address corresponding to the virtual address in the found mapping relationship.

### Claim 16 (depends on 9)

The method of claim 9, wherein the broadcasting the address probing message to each CPU core comprises:
broadcasting the address probing message to each CPU core based on the cache detection Snoop protocol.
