CLOUD INFRASTRUCTURE

Cloud infrastructure is the on-demand compute, storage, and networking that a provider runs in its own data centers and rents out over the internet. Rather than buying physical servers, you provision virtual resources through an API or web console and pay only for what you use — turning a large up-front capital cost into a metered operating cost.

The core primitives

Every cloud, regardless of provider, is built from the same three building blocks. Compute is processing power — virtual machines, containers, and serverless functions that run your code. Storage holds data, from object stores for files and backups to managed databases and data warehouses. Networking connects it all and to the outside world — load balancers, virtual private networks, content delivery, and the egress paths that carry data back out to users. Almost every higher-level service is an abstraction built on these three.

Products vs. solutions

Providers package the primitives at two levels. A product is a single tool that does one job — a virtual machine service, an object store, a managed database. A solution is a layer above: a curated bundle of products plus a reference architecture and deployment guidance aimed at one named problem, like modernizing a data warehouse or deploying a retrieval-augmented chatbot. Most individual builders work directly with products; solutions exist largely to save enterprise teams from assembling a stack themselves.

Why it underpins the AI era

The shift to AI compute made cloud infrastructure strategically central. Training and serving large models requires clusters of specialized accelerators that few organizations can buy and operate themselves, so the clouds became the default place to rent that capacity. The same elasticity that suits a bursty web app suits an AI workload that needs thousands of GPUs for a training run and near-zero between them — which is also why scale-to-zero serverless products have become the default deploy target for agents and lightweight apps.

The economics

Cloud infrastructure converts fixed costs into variable ones, which is why it reshaped how companies build. The trade-offs are real: convenience and elasticity against long-run cost at scale, and the platform economics of depending on a provider whose pricing, regions, and managed services you don't control. The usual surprise in a cloud bill is not compute but egress — data leaving the provider's network — which is why budget alerts and an understanding of what is and isn't metered matter from day one.

Part of the knowledge graph at The Best Blog Ever — reference definitions for ideas that matter.