Official-source-led study guide

AWS Certified Machine Learning Engineer - Associate MLA-C02

A decision guide for preparing data, developing models, deploying and orchestrating workloads, monitoring secure production systems, and engineering evaluated generative and agentic AI with responsible LLMOps.

Use a source-of-truth method, not a product list

Start with the current AWS exam guide from the certification page. Convert each task statement into three notes: the decision to make, evidence that proves the decision, and the AWS features that may implement it. Then verify behavior in the current service documentation. This protects against memorizing outdated names or assuming a feature behaves identically across Regions, models, endpoint modes, and SDK versions.

Requirement

Extract latency, throughput, freshness, payload, quality, explainability, privacy, availability, recovery, and budget constraints.

Decision

Choose a data, algorithm, inference, orchestration, monitoring, or security pattern and state why alternatives violate a constraint.

Evidence

Name the metric, test, trace, lineage record, access denial, cost estimate, approval, or rollback exercise that validates the choice.

Data preparation: preserve the prediction-time boundary

Reliable ML starts by defining one row at the moment a prediction is made. Record identifiers, event time, ingestion time, label time, source version, and transformation version make leakage and delayed data visible. Fit stateful transforms only on training partitions. For time-dependent tasks, validate with chronological holdouts or rolling backtests rather than random mixing.

ProblemPreferred responseEvidenceWeak response
Future feature values enter historical rowsEvent-time-aware as-of joinNo source timestamp exceeds prediction timeDrop the timestamp after joining
Training and real-time features differShared versioned definitions; online/offline parity checksSampled values match within defined toleranceMaintain unrelated transformations
Rare positive outcomeTask-aligned metrics plus weighted loss or validated resamplingPrecision-recall behavior on untouched holdoutOptimize aggregate accuracy
Large analytical scansColumnar formats, useful partitions, bounded file sizesMeasured scan bytes and job timeCreate thousands of tiny files
Labels arrive lateStable prediction IDs and a delayed ground-truth joinOne outcome joins to the intended predictionUse drift as a correctness label

Service pattern: Amazon S3 supplies durable object storage; AWS Glue catalogs metadata and runs data integration; Lake Formation governs data-lake permissions; SageMaker Processing runs managed transformations; SageMaker Feature Store supports governed online and offline features. Select from requirements, not because every design needs every service.

Model development: compare systems, not training scores

Begin with a simple reproducible baseline. Use a metric connected to business error costs and a holdout that represents deployment. Track the dataset manifest, source revision, container digest, parameters, random seed, environment, metrics, artifacts, and lineage. Automatic tuning is an experiment coordinator, not a substitute for a valid split or an untouched final holdout.

SignalLikely diagnosisCandidate responseDo not infer
Strong training, weak validationOverfitting, leakage, or distribution mismatchAudit split and features; regularize; simplify; add representative data; stop earlierMore epochs will fix generalization
Both training and validation are weakUnderfit model, poor features, noisy labels, or wrong objectiveInspect labels and features; increase suitable capacity; revisit objectiveA larger endpoint improves model quality
Model does not fit one deviceModel-memory constraintModel parallel or memory-optimization techniquesData parallelism always solves fit
Training is slow but model fitsCompute, input, or scaling bottleneckProfile input pipeline; consider data parallelism, instance choice, or optimized formatsMaximum cluster size is automatically economical
Probabilities are poorly calibratedScores do not correspond well to observed ratesMeasure calibration and consider post-hoc calibration on held-out dataHigh ranking quality guarantees calibrated probabilities

SageMaker Experiments supports organized run tracking; training jobs provide managed compute; Automatic Model Tuning explores defined hyperparameter ranges; Debugger can capture and analyze tensors and system metrics for supported workloads. Always check current framework, algorithm, and feature support.

Deployment and orchestration: match the request contract

OptionBest starting signalKey design questionsOperational caution
Real-time endpointSynchronous low-latency responseTraffic shape, instance type, auto scaling, availability, p95/p99Idle capacity and scaling lag
Serverless InferenceIntermittent synchronous trafficCold starts, concurrency, model size, memory, supported featuresNot every latency target or feature is supported
Asynchronous InferenceLonger processing or larger payload pattern; deferred resultQueue, timeout, output destination, notification, scalingCaller contract must tolerate delayed results
Batch TransformOffline bounded datasetPartitioning, throughput, reconciliation, completion objectiveNot an interactive API

SageMaker Pipelines is purpose-built for ML workflow steps and lineage integration. Model Registry supplies versioned packages and approval state. Step Functions is useful for broader application orchestration, durable state, and service coordination. EventBridge routes events and schedules work. Whatever the orchestrator, retries around side effects require idempotency, stable execution identifiers, and persisted state.

Safe release sequence: immutable candidate -> offline gates -> registry -> authorized approval -> shadow or canary -> alarms -> gradual traffic -> post-release validation. Retain the known-good version, bind alarms to explicit actions, and exercise both automatic rollback and the kill switch.

Monitoring and maintenance: separate the questions

QuestionSignalAWS capability examplesPossible action
Is the service healthy?Errors, latency, throttles, saturation, availabilityCloudWatch metrics, logs, alarmsScale, fail over, roll back, investigate
Did input data change?Schema, missingness, constraint violations, distribution shiftsData quality checks, Model MonitorBlock, investigate source, update baseline with review
Did prediction quality change?Metrics after ground truth arrivesData Capture and Model Monitor model-quality workflowsInvestigate, recalibrate, retrain, pause
Did responsible behavior change?Subgroup metrics, bias, explanations, human overridesSageMaker Clarify plus application metrics and reviewEscalate, constrain use, revise data or model
Is consumption acceptable?Instance time, tokens, requests, retries, storage, tracesCloudWatch, Cost Explorer, Budgets, tagsRight-size, cap, cache safely, sample, shorten retention

Drift is neither an automatic defect nor automatic permission to retrain. A robust response validates data sufficiency, measures actual task quality when labels exist, prevents overlapping jobs, compares against the active baseline, and sends only passing candidates through controlled promotion.

Security architecture: build boundaries the model cannot negotiate

IAM authorization, resource policies, KMS key policies, network paths, service control policies, and application authorization interact. Encryption does not imply authorization, private networking does not imply least privilege, and a content filter does not establish caller identity.

Generative AI and RAG: evaluate the evidence path

Foundation-model choice should use representative task data and explicit quality, safety, latency, availability, and cost constraints. Public leaderboards can inform a shortlist but cannot prove fitness for a private workflow. Record the exact model identifier and inference settings used in every evaluation.

LayerWhat to evaluateTypical failureRemediation direction
CorpusAuthority, freshness, access, format, version, coverageStale or restricted document enters retrievalGovern ingestion and propagate deletion or revocation
Chunk and indexContext preservation, metadata, retrieval unit, versionAnswer spans are split or lose source identityChange chunking and preserve metadata
RetrievalExpected-source recall, relevance, authority, filter complianceCorrect evidence is absent or outrankedImprove filters, query, chunking, result count, or reranking
GenerationFaithfulness, citations, completeness, abstention, safetyFluent unsupported claimRequire evidence, validate citations, abstain, or narrow task
SystemTask success, human outcome, latency, reliability, costGood answers are too slow, unsafe, or expensiveChange architecture, model, context, caching, or scope

Amazon Bedrock provides access to supported foundation models and managed capabilities including Knowledge Bases, Agents, Guardrails, and evaluation features. Availability and feature combinations vary, so verify the current User Guide. Guardrails can add content and safety controls; they are defense in depth, not substitutes for IAM, authorization, schema validation, or human responsibility.

Agentic AI and LLMOps: control authority and change

An agent combines nondeterministic reasoning with tools and state. Use it only where flexible planning adds measured value over deterministic code or a simpler RAG workflow. Deterministic components should own authentication, authorization, policy, schema validation, money or record-changing operations, idempotency, approval binding, and terminal-state enforcement.

Tool contract

Narrow verbs, typed inputs and outputs, fixed destinations, least-privilege identity, timeouts, result limits, audit events, and no hidden side effects.

Execution budget

Maximum model calls, tools, loops, retries, tokens, elapsed time, concurrency, and cost with clear terminal reasons.

Approval boundary

Show exact action, content, destination, evidence, uncertainty, and consequences; bind approval to that version and revalidate immediately before execution.

Trajectory evidence

Trace model and tool steps, validated arguments or hashes, outcomes, policy decisions, errors, latency, retries, versions, and consumption with content minimized.

LLMOps release unit: model ID and settings + system and task prompts + tools and schemas + policies and guardrails + retrieval corpus and configuration + application code + evaluation dataset and results + infrastructure. Canary and rollback the coupled unit, not just the prompt.

Prompt injection can arrive directly from a user or indirectly through documents, web content, messages, memory, or tool output. Treat that content as untrusted evidence. Do not expose secrets to the model unless strictly necessary, constrain each tool independently, validate every boundary, and require a human for consequential or ambiguous action.

Responsible AI: connect metrics to affected people

Responsible AI is a lifecycle practice rather than one bias report. Define intended users and excluded uses, affected groups, foreseeable misuse, failure severity, acceptable uncertainty, accessibility needs, escalation, contestability, retention, and human accountability. Compare the AI system with a simpler or no-AI baseline.

ConcernQuestionEvidenceControl examples
FairnessWho experiences which errors?Task-relevant disaggregated metrics and impact reviewData review, thresholds, use limits, monitoring, appeal
ExplainabilityCan stakeholders understand important drivers and limits?Clarify attributions, examples, stability checks, model cardSuitable model, reviewed explanations, human context
PrivacyIs each data use necessary and authorized?Data inventory, purpose, access, retention, deletion proofMinimization, encryption, isolation, redaction, deletion
Safety and robustnessHow does the system behave under ambiguity, attacks, and shift?Adversarial, stress, abstention, rollback, and incident testsBoundaries, fallback, kill switch, review, monitoring
TransparencyDo users know the system role and limitations?Notices, citations, uncertainty, owner, change recordsSystem card, source display, decision ownership

Answer scenario questions with a constraint ledger

  1. Name the decision. Is the question asking about data validity, model behavior, inference mode, orchestration, monitoring, security, or generative-AI control?
  2. Underline hard constraints. Notice words such as synchronous, delayed, historical, least privilege, private, reproducible, automatic rollback, citation, or human approval.
  3. Remove category errors. A monitoring tool does not repair leakage; a larger instance does not fix bias; encryption does not grant authorization.
  4. Prefer managed purpose-fit behavior when constraints match. Do not choose a more complex architecture without a requirement.
  5. Check the lifecycle. The best design is measurable, secure, cost-aware, reversible, and operable after initial deployment.
  6. Explain rejected options. If two choices look plausible, identify the specific requirement each alternative fails.

Final readiness and lab checklists

Knowledge readiness

Hands-on proof

Official first-party references

Source status was reviewed on 2026-09-11. Recheck the certification page for the current MLA-C02 exam guide and AWS documentation for feature support, quotas, Regions, and prices.

Continue learning