Skip to main content

Glossary

Acronyms and terms used on this image's pages. See the site-wide glossary for all terms.

B​

blkdiscard​

A Linux command from util-linux that discards (trims) a range of blocks, by default all blocks of a device, and so deletes their data. An SSDSSD: Solid-State DriveA storage device that keeps data in flash memory instead of on spinning disks, so it reads and writes much faster than an HDD, especially at random locations. A controller with its own firmware maps logical blocks to flash pages, and many SSDs write incoming data to a fast cache first, then move it to slower flash. Cloud servers use SSDs as local disks and behind network block storage.WikipediaGlossary then treats those blocks as unwritten and can erase them in the background, which restores the write speed of a fresh drive. See man page.

C​

CPU​

Central Processing Unit: The general-purpose processor of a computer, which runs the operating systemOS: operating systemThe software that manages a computer's hardware and runs programs on it, such as Linux or Windows. A cloud server runs the OS of the image it was started from.Glossary and programs. A CPU has one or more physical cores, and with SMT each core runs two or more hardware threads. See Wikipedia.

D​

DRAM​

Dynamic Random-Access Memory: The most common type of volatile computer memory, which stores each bit as a charge in a capacitor that has to be refreshed periodically. Servers use it as main memory, and many storage devices as a cache. See Wikipedia.

F​

fio​

The Flexible I/O Tester, an open-source storage benchmark and I/O workload generator. Each job describes an access pattern, such as random or sequential reads and writes, the block size, the queue depth, and the I/O engine, and fio reports the resulting IOPS, bandwidth, and latency. See fio docs.

FTL​

Flash Translation Layer: The firmware layer of an SSDSSD: Solid-State DriveA storage device that keeps data in flash memory instead of on spinning disks, so it reads and writes much faster than an HDD, especially at random locations. A controller with its own firmware maps logical blocks to flash pages, and many SSDs write incoming data to a fast cache first, then move it to slower flash. Cloud servers use SSDs as local disks and behind network block storage.WikipediaGlossary controller that maps the logical blocks the host sees to physical flash pages. Because flash has to be erased in large blocks before it is rewritten, the FTL writes new data to free pages, and runs garbage collectiongarbage collectionThe background work in which an SSD frees flash for new writes. Flash can only be erased in large blocks, so the drive copies the still-valid pages out of a block, then erases the whole block. It runs when spare area runs low, and it slows the writes that arrive meanwhile, which is why an SSD's sustained write speed is lower than its burst speed. Programming languages use the same term for reclaiming unused memory.WikipediaGlossary and wear leveling in the background. Wikipedia.

G​

garbage collection​

The background work in which an SSDSSD: Solid-State DriveA storage device that keeps data in flash memory instead of on spinning disks, so it reads and writes much faster than an HDD, especially at random locations. A controller with its own firmware maps logical blocks to flash pages, and many SSDs write incoming data to a fast cache first, then move it to slower flash. Cloud servers use SSDs as local disks and behind network block storage.WikipediaGlossary frees flash for new writes. Flash can only be erased in large blocks, so the drive copies the still-valid pages out of a block, then erases the whole block. It runs when spare area runs low, and it slows the writes that arrive meanwhile, which is why an SSD's sustained write speed is lower than its burst speed. Programming languages use the same term for reclaiming unused memory. See Wikipedia.

GCP​

Google Cloud Platform: The cloud computing platform of Google. It offers virtual machines (Compute Engine), object storage, managed databases, Kubernetes and machine learning services, among others. See Google Cloud.

H​

HDD​

Hard Disk Drive: A storage device that reads and writes data with magnetic heads on spinning platters. It offers cheap capacity, but each random access waits for a head to move and a platter to turn, so it completes far fewer random operations per second than an SSDSSD: Solid-State DriveA storage device that keeps data in flash memory instead of on spinning disks, so it reads and writes much faster than an HDD, especially at random locations. A controller with its own firmware maps logical blocks to flash pages, and many SSDs write incoming data to a fast cache first, then move it to slower flash. Cloud servers use SSDs as local disks and behind network block storage.WikipediaGlossary. See Wikipedia.

I​

I/O​

Input/Output: The transfer of data between a computer and the outside world, such as reading and writing disks or sending and receiving network packets. A workload limited by its speed rather than by the CPU is called I/O-bound. See Wikipedia.

ID​

identifier: A name or number that refers to exactly one item, such as a server type, a benchmark run, or a database row.

IOPS​

Input/Output Operations Per Second: The number of read and write operations a storage device completes per second. It is the main measure of random-access performance, and depends on the block size, the queue depth and the mix of reads and writes. See Wikipedia.

J​

JSON​

JavaScript Object Notation: A text format for structured data, built from objects (key-value pairs), arrays, strings, numbers, booleans, and null. Most languages and tools read and write it, which makes it a common format for APIAPI: Application Programming InterfaceA defined set of requests and responses through which one program uses another, such as a web service's HTTP endpoints or a library's functions.WikipediaGlossary responses and benchmark output. See JSON.

L​

LLM inference speed​

How fast hardware runs an LLMLLM: Large Language ModelA neural network, typically with billions of parameters, trained on large amounts of text to predict the next token. It can generate, summarize and translate text, answer questions and write code.WikipediaGlossary, usually measured in tokenstokenThe unit of text that an LLM reads and writes, as defined by the model's tokenizer, such as a word, part of a word, or a punctuation mark. Prompt and output lengths are counted in tokens, and LLM inference speed is usually measured in tokens per second.Glossary per second. It is measured separately for prompt processingprompt processingThe first phase of LLM inference, also called prefill, in which the model reads all tokens of the input prompt and stores their intermediate results in its key-value cache. The prompt's tokens are processed together in batches, so this phase is usually limited by compute and runs much faster per token than text generation. Its speed decides how long a long input takes before the first output token appears.Glossary, in which the model reads the input prompt, and text generationtext generationThe second phase of LLM inference, also called decoding, in which the model produces output tokens one at a time, each depending on the tokens before it. Every step reads all model weights and the key-value cache, so this phase is usually limited by memory bandwidth rather than compute, and runs much slower per token than prompt processing.Glossary, in which it produces output tokens one at a time, because the first is usually limited by compute and the second by memory bandwidth. Benchmarks of LLM servers also measure latency, such as the time to first token, and the throughput of many concurrent requests.

LVM​

Logical Volume Manager: The Linux tool that pools disks or partitions into volume groups and divides these into logical volumes, which can be resized while in use. It also supports snapshots, and striping or mirroring across disks. See man page.

N​

NVMe​

Non-Volatile Memory Express: The interface specification for accessing non-volatile storage, most often SSDsSSD: Solid-State DriveA storage device that keeps data in flash memory instead of on spinning disks, so it reads and writes much faster than an HDD, especially at random locations. A controller with its own firmware maps logical blocks to flash pages, and many SSDs write incoming data to a fast cache first, then move it to slower flash. Cloud servers use SSDs as local disks and behind network block storage.WikipediaGlossary, over PCI Express. It is designed for the parallelism of flash memory, with many deep command queues, and NVMe over Fabrics extends it to network transports. See NVM Express.

O​

OVHcloud​

A French cloud provider, founded in 1999, with data centers in Europe, North America and Asia-Pacific. It offers dedicated (bare-metal) servers, public cloud instances based on OpenStack, and private cloud. See OVHcloud.

P​

PID​

Process Identifier: The number by which the operating systemOS: operating systemThe software that manages a computer's hardware and runs programs on it, such as Linux or Windows. A cloud server runs the OS of the image it was started from.Glossary identifies a running process. On Linux, a PID is assigned when a process starts and can be reused after it exits, and commands such as kill use it to target a process. See Wikipedia.

R​

RAID​

Redundant Array of Independent Disks: A way to combine several disks into one logical device, for redundancy, speed or both. Common levels are RAID 0 (striping), RAID 1 (mirroring) and RAID 5 or 6 (striping with parity); on Linux, the md driver implements RAID in software. See Wikipedia.

RAM​

Random-Access Memory: The main memory of a computer, which holds the running programs and their data. It is much faster than disk storage, and its content is lost when the power is off. See Wikipedia.

S​

SLC​

Single-Level Cell: Flash memory that stores one bit per cell, which makes it faster and more durable than flash storing more bits per cell, such as TLC or QLC. Many SSDs run part of their flash in SLC mode as a write cache, and write more slowly once a long write fills it. See Wikipedia.

SMART​

Self-Monitoring, Analysis, and Reporting Technology: A monitoring system built into HDDs and SSDs that records health and error counters, such as reallocated sectors, power-on hours or wear level. Tools such as smartctl read these counters to spot failing disks early. See Wikipedia.

smartctl​

The command-line tool of the smartmontools package that reads SMART data, self-test logs and device information from ATA, SCSI and NVMe disks, and can start self-tests. See smartmontools.

SSD​

Solid-State Drive: A storage device that keeps data in flash memory instead of on spinning disks, so it reads and writes much faster than an HDD, especially at random locations. A controller with its own firmware maps logical blocks to flash pages, and many SSDs write incoming data to a fast cache first, then move it to slower flash. Cloud servers use SSDs as local disks and behind network block storage. See Wikipedia.

stderr​

The standard error stream of a process, one of the three standard streams with stdin and stdout. Programs write logs, progress, and error messages to it, so that they stay separate from the output on stdout when the output is redirected to a file or another program. See Wikipedia.

stdout​

The standard output stream of a process, one of the three standard streams with stdin and stderr. Programs write their results to it; a shell can redirect it to a file or another program, such as > results.jsonl, while logs on stderr still reach the terminal. See Wikipedia.

U​

UTC​

Coordinated Universal Time: The primary time standard by which the world sets its clocks, the successor of Greenwich Mean Time. It has no time zone offset or daylight saving time, so UTC timestamps compare directly across regions. See Wikipedia.

V​

vCPU​

virtual CPU: A CPU of a virtual machineVM: virtual machineA computer emulated in software on a physical host, with its own OS and a share of the host's CPUs, memory, and storage. Most cloud servers are VMs.WikipediaGlossary, the unit in which cloud vendors sell compute. It is usually one hardware thread of a physical core with SMT, so two vCPUs may share one physical core. See Wikipedia.

Z​

zram​

A Linux kernel module that creates compressed block devices in memory. It is most often used as swap, so swapped-out pages are compressed in RAM instead of written to disk, trading CPU time for memory. See Linux kernel docs.