Glossary
Acronyms and terms used on this image's pages. See the site-wide glossary for all terms.
A
AWS
Amazon Web Services: The cloud computing platform of Amazon, launched in 2006 and the largest public cloud by market share. It offers hundreds of services, from virtual machines (EC2) and object storage (S3) to managed databases and machine learning. See AWS.
B
BenchBase
A framework that benchmarks SQL databases, the successor to OLTPBench. It runs workloads such as YCSB and a Wikipedia workload against any relational database with a JDBCJDBC: Java Database ConnectivityThe standard Java API for connecting to relational databases and running SQL statements against them. Each database vendor supplies a JDBC driver, so one program can work with many databases through the same interface.Java tutorialGlossary (Java Database Connectivity) driver, and collects per-transaction-type latency and throughput logs. See GitHub.
BRIN
Block Range Index: A PostgreSQL index type that stores only a summary, such as the minimum and maximum value, of each range of consecutive table blocks. It is tiny compared to a B-tree, and works well on large tables whose values follow their physical order, such as timestamps of appended rows. See PostgreSQL docs.
C
CDN
Content Delivery Network: A network of distributed servers that cache content, such as web pages, images or video, and serve it from locations close to its users. It lowers latency for the users and offloads traffic from the origin server. See Wikipedia.
concurrency points
The client counts at which a database benchmark measures throughput and latency, each with that number of connections open for a fixed time. Measuring several concurrency points, from one client up to a count derived from the server's size, shows how throughput and latency change with load.
CPU
Central Processing Unit: The general-purpose processor of a computer, which runs the operating systemOS: operating systemThe software that manages a computer's hardware and runs programs on it, such as Linux or Windows. A cloud server runs the OS of the image it was started from.Glossary and programs. A CPU has one or more physical cores, and with SMT each core runs two or more hardware threads. See Wikipedia.
CV
Coefficient of Variation: The standard deviation of a set of measurements divided by their mean, often given as a percentage. As it is scale-free, it compares the variability of measurements of different magnitudes, such as how much repeated runs of different benchmarks vary. See Wikipedia.
D
DBaaS
Database as a Service: A cloud service model in which the vendor runs a database for its users, handling provisioning, backups, patching and replication. Examples are Amazon RDS and Google Cloud SQL. See Wikipedia.
G
GCP
Google Cloud Platform: The cloud computing platform of Google. It offers virtual machines (Compute Engine), object storage, managed databases, Kubernetes and machine learning services, among others. See Google Cloud.
GIN
Generalized Inverted Index: A PostgreSQL index type that maps each element of a composite value, such as an array item, a key of a JSON document, or a word of a text, to the rows that contain it. It speeds up containment and full-text searches, at the cost of slower writes than a B-tree. See PostgreSQL docs.
GUC
Grand Unified Configuration: The configuration system of PostgreSQL, and by extension its individual settings, such as shared_buffers or work_mem. A setting can be set in postgresql.conf, on the command line, per database or role, or per session with SET. See PostgreSQL docs.
H
HammerDB
An open-source database benchmark engine. It runs standardized workloads, such as TPROC-C, with the same test definitions on SQL Server, Db2, Oracle, PostgreSQL, MariaDB, and MySQL, so that results are comparable across database systems. Runs can be scripted and repeated automatically. See HammerDB.
harness
The code that runs a benchmark tool. It prepares the inputs, starts the tool with fixed settings, often several times or in parallel, checks and collects the tool's output, and prints the results in one format. Its settings, not the tool's defaults, decide what the benchmark measures. See Wikipedia.
HTTPS
Hypertext Transfer Protocol Secure: HTTPHTTP: Hypertext Transfer ProtocolThe request-response protocol of the web, in which a client asks a server for a resource by URL and gets back a status code, headers, and a body. HTTPS is HTTP over an encrypted connection.MDNGlossary, the protocol of the web, encrypted with TLS. It protects requests and responses from eavesdropping and tampering, and its certificates let clients verify the identity of the server. See Wikipedia.
I
I/O
Input/Output: The transfer of data between a computer and the outside world, such as reading and writing disks or sending and receiving network packets. A workload limited by its speed rather than by the CPU is called I/O-bound. See Wikipedia.
IaaS
Infrastructure as a Service: A cloud service model that rents out compute, storage and network resources, such as virtual machines and disks, on demand. The vendor runs the hardware, and the user manages the operating systemOS: operating systemThe software that manages a computer's hardware and runs programs on it, such as Linux or Windows. A cloud server runs the OS of the image it was started from.Glossary and everything above it. See Wikipedia.
IOPS
Input/Output Operations Per Second: The number of read and write operations a storage device completes per second. It is the main measure of random-access performance, and depends on the block size, the queue depth and the mix of reads and writes. See Wikipedia.
J
JIT
Just-in-Time Compilation: The compilation of a program's code to machine code while the program runs, instead of before. The compiler can use what is known only at run time, such as the actual data, but the compile time adds to the run time, so it pays off mostly on long-running code. PostgreSQL, for example, compiles parts of long, CPU-bound analytical queries, such as their expressions, with LLVM. See Wikipedia, PostgreSQL docs.
JSON
JavaScript Object Notation: A text format for structured data, built from objects (key-value pairs), arrays, strings, numbers, booleans, and null. Most languages and tools read and write it, which makes it a common format for APIAPI: Application Programming InterfaceA defined set of requests and responses through which one program uses another, such as a web service's HTTP endpoints or a library's functions.WikipediaGlossary responses and benchmark output. See JSON.
L
lz4
A lossless compression algorithm and format by Yann Collet from the LZ77 family, built for speed rather than compression ratiocompression ratioA measure of how much a compressor shrinks data, from the sizes of the uncompressed and the compressed data. It is most often given as uncompressed size divided by compressed size, where higher is better, but some tools report compressed size divided by uncompressed size as a percentage, where lower is better.WikipediaGlossary. It compresses and especially decompresses much faster than gzipgzipA lossless file compressor of the GNU Project, first released in 1992, and its file format, specified in RFC 1952. It uses the DEFLATE algorithm, which combines LZ77 matching and Huffman coding, and is the most widely supported compression format on Unix-like systems and the web. Its levels range from 1 (fastest) to 9 (smallest output).GNU gzipGlossary, at a lower ratio; its higher levels use a slower high-compression mode that keeps decompression fast. See LZ4.
N
netem
Network Emulator: A Linux traffic control queueing discipline that adds delay, jitter, packet loss, duplication or reordering to the packets leaving a network interface. It is used to test how software behaves on slow or unreliable networks. See SRT cookbook.
nice
A Unix command that runs a program with a changed scheduling priority, from -20 (highest) to 19 (lowest). Raising a process's priority above the default needs the CAP_SYS_NICE capability, which root has. See man page.
O
OLTP
Online Transaction Processing: A class of workloads made of many short, concurrent transactions that each read or update a few rows, such as orders, payments or bookings. OLTP databases are optimized for the latency and throughput of such transactions, unlike analytical databases built for large scans. See Wikipedia.
OS
operating system: The software that manages a computer's hardware and runs programs on it, such as Linux or Windows. A cloud server runs the OS of the image it was started from.
P
Parallel Query
A PostgreSQL feature that splits one query across several worker processes, for example to scan, join or aggregate a large table on several CPU cores at once. The max_parallel_workers_per_gather setting limits how many workers one part of a query can use. See PostgreSQL docs.
PassMark
The PerformanceTest benchmark suite of PassMark Software, for Windows, Linux, macOS, and mobile devices. It runs fixed CPU, memory, disk, and graphics tests, such as math workloads involving compression, encryption, and physics simulations, and combines the results into an overall PassMark Rating. See PerformanceTest.
pgbench
The benchmark tool shipped with PostgreSQL. It runs a SQL script repeatedly over many concurrent client sessions, and reports the throughput in transactions per second and the latency. Its built-in script is modeled on TPC-B, and custom scripts can define any other workload. See PostgreSQL docs.
pgtune
A web tool that suggests PostgreSQL settings, such as shared_buffers and work_mem, from the memory, CPU count, storage type and workload of a server. Its suggestions are a starting point for tuning rather than an optimum. See pgtune.
PL/pgSQL
PostgreSQL Procedural Language: The built-in procedural language of PostgreSQL, which adds variables, loops, conditionals and error handling to SQL. It is used to write functions, procedures and triggers that run inside the database server. See PostgreSQL docs.
PostgreSQL
An open-source object-relational database system, developed by a global community and descended from the POSTGRES project at UC Berkeley in 1986. It uses and extends SQL, with transactions, many index types, extensions, and JSON data. See PostgreSQL docs.
R
RAM
Random-Access Memory: The main memory of a computer, which holds the running programs and their data. It is much faster than disk storage, and its content is lost when the power is off. See Wikipedia.
RDBMS
Relational Database Management System: A database system that stores data in tables of rows and columns, related through keys and queried with SQL. It keeps data consistent with constraints and transactions; PostgreSQL, MySQL and Oracle Database are examples. See Wikipedia.
Redis
An open-source, in-memory key-value data store, used as a database, cache, and message broker. It keeps its data in RAM, supports data structures such as strings, hashes, lists, and sets, and can persist data to disk with periodic snapshots or an append-only log. See Redis docs.
RTT
Round-Trip Time: The time a network packet takes to reach its destination plus the time its response takes to get back. It sets a lower bound on the latency of every request-response exchange, and grows with the distance between the endpoints. See Wikipedia.
S
SQL
Structured Query Language: The standard language to define, query and modify data in relational databases. Its declarative statements, such as SELECT, INSERT and UPDATE, describe what data to return or change, and the database plans how to do it. See Wikipedia.
SSD
Solid-State Drive: A storage device that keeps data in flash memory instead of on spinning disks, so it reads and writes much faster than an HDD, especially at random locations. A controller with its own firmware maps logical blocks to flash pages, and many SSDs write incoming data to a fast cache first, then move it to slower flash. Cloud servers use SSDs as local disks and behind network block storage. See Wikipedia.
SSL
Secure Sockets Layer: A protocol that encrypts network connections and verifies the identity of the server, and optionally of the client, with certificates. TLS has replaced it, but SSL is still the common name for both, including in PostgreSQL's settings. See PostgreSQL docs.
stderr
The standard error stream of a process, one of the three standard streams with stdin and stdout. Programs write logs, progress, and error messages to it, so that they stay separate from the output on stdout when the output is redirected to a file or another program. See Wikipedia.
stdout
The standard output stream of a process, one of the three standard streams with stdin and stderr. Programs write their results to it; a shell can redirect it to a file or another program, such as > results.jsonl, while logs on stderr still reach the terminal. See Wikipedia.
sysbench
A scriptable, multi-threaded benchmark tool built on LuaJIT. Its tests cover CPU, memory, file I/O, threads, and mutexes, and its Lua scripts run transactional database workloads against MySQL and PostgreSQL. It reports rates and latency percentiles. See GitHub.
T
TOAST
The Oversized-Attribute Storage Technique: The mechanism with which PostgreSQL stores values too large for a regular 8 kB page, by compressing them, moving them out of line into a separate table, or both. It applies automatically to large values, such as long texts or JSON documents. See PostgreSQL docs.
TPC-B
Transaction Processing Performance Council Benchmark B: A database benchmark of short, update-heavy banking transactions, each updating an account, a teller and a branch balance and logging the change. The TPC retired it in 1995, but the default script of pgbench is still modeled on it. See TPC.
TPM
Transactions Per Minute: A throughput measure of transaction processing systems: the number of transactions they complete per minute. TPC-C reports a variant of it, tpmC, which counts only new-order transactions, while tools such as pgbench report transactions per second (TPS), which is 1/60 of TPM. See Wikipedia.
TPROC-C
HammerDBHammerDBAn open-source database benchmark engine. It runs standardized workloads, such as TPROC-C, with the same test definitions on SQL Server, Db2, Oracle, PostgreSQL, MariaDB, and MySQL, so that results are comparable across database systems. Runs can be scripted and repeated automatically.HammerDBGlossary's transaction processing workload: The OLTP workload of the HammerDB benchmark tool, derived from the TPC-C specification of an order-entry system with warehouses, orders and payments. It is not an official TPC-C implementation, so its results are not comparable with published TPC-C results. See HammerDB docs.
U
URL
Uniform Resource Locator: The address of a resource on the web or a network, such as https://sparecores.com/, made of a scheme, a host, and a path.
V
vCPU
virtual CPU: A CPU of a virtual machine, the unit in which cloud vendors sell compute. It is usually one hardware thread of a physical core with SMT, so two vCPUs may share one physical core. See Wikipedia.
VM
virtual machine: A computer emulated in software on a physical host, with its own OSOS: operating systemThe software that manages a computer's hardware and runs programs on it, such as Linux or Windows. A cloud server runs the OS of the image it was started from.Glossary and a share of the host's CPUs, memory, and storage. Most cloud servers are VMs. See Wikipedia.
VPC
Virtual Private Cloud: An isolated virtual network within a public cloud account, with its own IP address ranges, subnets, routing and firewall rules. Resources such as virtual machines and databases are placed in it to control how they reach each other and the internet. See Wikipedia.
W
WAL
Write-Ahead Logging: A technique in which a database writes each change to a durable log before it changes the data files. After a crash, replaying the log restores a consistent state, and shipping it to other servers drives replication and point-in-time recovery. PostgreSQL, for example, calls its log the WAL, and on write-heavy workloads the speed of WAL writes often limits throughput. See Wikipedia, PostgreSQL docs.
Y
YCSB
Yahoo! Cloud Serving Benchmark: An open-source benchmark framework, released by Yahoo! in 2010, for key-value and NoSQL databases. It runs standard workloads that mix reads, updates, inserts and scans in different proportions, and is widely used to compare cloud data stores. See Wikipedia.
Z
Zipfian
A skewed probability distribution, named after Zipf's law, in which an item's frequency is inversely proportional to its rank, so a few items are accessed far more often than the rest. Benchmarks use it to model real-world hot spots, such as popular products or users. See Wikipedia.