Agent
A system that uses an LLM to decide which actions to take — calling tools, reading files, calling APIs — rather than following a fixed script, often looping until a task is done.
25 terms
Short definitions for terms used across the trails and projects. New terms get added as they come up — this list isn't meant to be exhaustive.
A system that uses an LLM to decide which actions to take — calling tools, reading files, calling APIs — rather than following a fixed script, often looping until a task is done.
The broader goal of building systems that perform tasks associated with human intelligence, such as understanding language or recognizing images.
A defined way for one piece of software to request data or actions from another, without needing to know the other side's internal implementation.
An isolated location within a cloud region — its own power and networking — used to make a system resilient to a single data-center failure.
Prompting a model to reason through intermediate steps before giving a final answer, which tends to improve accuracy on harder tasks.
The maximum amount of text (measured in tokens) a model can consider at once; content beyond it gets silently truncated or the request fails.
A small facility located close to end users, used to cache or serve content (as in a CDN) with lower latency than routing every request back to a distant region.
A numeric vector representation of text or other data that captures meaning, so similar concepts land close together in vector space — the basis for semantic search and RAG.
Further training an existing model on a smaller, task-specific dataset to specialize its behavior, rather than training a model from scratch.
When a model states something false with full confidence — no error, no signal, just wrong.
The system that defines who — or what service — can perform which actions on which resources within a cloud account.
A document that grants or denies specific permissions, attached to a user, role, or group.
An identity with a defined set of permissions that can be assumed temporarily by a user, service, or application, instead of relying on long-lived credentials.
Running a trained model on new input to produce a prediction or output, as opposed to training the model in the first place.
A model trained on large amounts of text to predict and generate language — the technology behind most modern chat and coding assistants.
An open protocol that lets an LLM application connect to external tools and data sources through a standard interface, instead of custom integration code per tool.
A technique for building AI by training a model on data so it learns patterns, instead of manually coding every rule.
When untrusted input — a webpage, a document, a message — contains instructions that a model follows as if they came from the legitimate user.
Retrieving relevant documents or data at request time and including them in the prompt, so the model answers grounded in that content instead of relying only on what it memorized during training.
A geographic area a cloud provider operates in, containing multiple isolated availability zones — chosen for latency, redundancy, and data-residency requirements.
A non-human identity used by an application or workload to authenticate and call cloud APIs, distinct from a human user account.
The division of security duties between a cloud provider (securing the underlying infrastructure) and the customer (securing their data, access, and configuration) — the split shifts depending on whether the service is IaaS, PaaS, or SaaS.
A setting that controls how random a model's output is — low temperature favors the single most likely next token, high temperature favors more variety.
The unit a model actually processes, roughly a word or word-fragment — used to measure input/output length, context window limits, and cost.
A model's ability to request that a specific function be run with structured arguments and receive the result back, rather than only returning text.