NCP-AAI6 phases10 domains

NVIDIA Certified Professional: Agentic AI NCP-AAI Study Guide

Six phases, grouping the exam's ten domains by weight and by the dependencies the source material names on its own. Every phase tells you how the exam questions that material, gives you a practice exercise, and ends with self-checks you should be able to answer without notes.

How to study for NCP-AAI

To study for the NVIDIA NCP-AAI certification, work through the ten domains in six weighted phases rather than the order they are listed. Start with Agent Architecture and Design and Agent Development (15% each, tied for the largest), covering agent architecture styles, the ReAct loop, multi-agent orchestration topologies, and the Retry and Circuit Breaker resilience patterns. Move to Cognition, Planning, and Memory and Knowledge Integration and Data Handling (10% each), covering the agent memory taxonomy, the five planning directions, and the RAG pipeline including GraphRAG, HybridRAG, and agentic RAG. Then Evaluation and Tuning and Run, Monitor, and Maintain (13% and 5%), which together cover evaluation pipelines, profiling, and continuous production monitoring. Continue with Deployment and Scaling and NVIDIA Platform Implementation (13% and 7%), covering NIM, TensorRT-LLM, Triton, and the NeMo Agent Toolkit. Finish with Safety, Ethics, and Compliance and Human-AI Interaction and Oversight (5% each), covering NeMo Guardrails' five rail stages and human-in-the-loop oversight. Build one working agent early and extend it through every phase, since architecture, resilience, memory, retrieval, evaluation, deployment, and safety all attach to the same system. Most candidates with 1–2 years of applied AI/ML experience need 40 to 60 hours of focused study.

Jump to Phase 1

What to study first for NCP-AAI

Study time should follow exam weight. The five domains and their share of the marks, heaviest first — this is the order the six phases below follow.

  1. The foundational structuring of agentic AI systems: how an agent perceives, reasons, acts, remembers, and communicates, and how multiple agents cooperate.

  2. The hands-on build: prompt chains, multimodal model integration, custom tools, and — the part that separates a demo from production — resilience against transient and persistent failures.

  3. Proving an agent works and then making it better: evaluation pipelines and benchmarks, structured feedback, and tuning against the accuracy-versus-latency trade-off.

  4. Taking an agent from a laptop to production: containerized multi-agent deployment, MLOps governance, profiling under load, and balancing cost against availability.

  5. How an agent thinks: the memory taxonomy, reasoning frameworks, planning strategies for multi-step decisions, and adapting from experience.

  6. Feeding an agent trusted external knowledge: the canonical RAG pipeline, vector databases, ETL and data quality, and reasoning over mixed structured and unstructured sources.

  7. The NVIDIA-specific domain: using the NeMo Agent Toolkit, NIM, NeMo Guardrails, TensorRT-LLM, and Triton together to build and accelerate agentic systems.

  8. Keeping a deployed agent healthy: monitoring dashboards, logs and per-step tracing for root-cause diagnosis, continuous benchmarking, and automated tuning and versioning.

  9. Making an agent responsible: system security and audit trails, compliance guardrails, bias and toxicity mitigation, layered safety, and licensing and regulatory compliance.

  10. Keeping humans in control: intuitive user-in-the-loop interfaces, structured feedback loops, transparency mechanisms, and human oversight and intervention points.

  1. Work the phases in order. Later phases assume the architecture and resilience vocabulary from Phases 1 and 2.
  2. Build one agent early and keep extending it. Memory, retrieval, evaluation, deployment, and safety all attach to the same running system rather than six disconnected exercises.
  3. Answer the self-checks out loud or in writing. If you cannot handle one in four sentences without notes, the phase is not finished.
  4. Finish with timed practice at just over a minute per question, so exam pace is familiar before the day.

The 6-phase NCP-AAI study plan

Each phase names the domains it covers, how the exam questions that material, a practice exercise, and the self-checks that tell you whether to move on.

  1. Agent architecture and design

    Be able to choose an agent architecture style, implement the ReAct loop, and pick the right multi-agent topology and memory layout for a stated scenario.

    • Agent Architecture and Design15%

    What the exam tests you on in this phase

    1. Explaining what makes ReAct different from chain-of-thought — the interleaved observation that grounds reasoning in real tool output
    2. Matching a scenario to reactive, deliberative, or hybrid architecture styles and naming the trade-off each makes
    3. Picking the right multi-agent orchestration topology — centralized, decentralized, federated, or hierarchical — for a described coordination need
    4. Distinguishing short-term memory, a session-scoped context window, from long-term memory, a persistent store
    5. Choosing between a knowledge graph and vector search for a relational, multi-hop reasoning task

    Practice exercise

    A short design document for one agent: its architecture style, memory layout, and orchestration topology, defended against a stated scenario.

    Self-check — answer without notes

    • What does ReAct add that chain-of-thought alone does not, and why does that reduce hallucination?
    • A team of autonomous peers shares information with no central controller — name the topology and one risk it introduces.
    • Why doesn't a single agent with many tools count as a multi-agent system?
    • When would you reach for a knowledge graph instead of vector search, and why?
    • What is the difference between short-term and long-term agent memory, and which one needs a persistent store?
  2. Agent development and resilience

    Build a tool-calling agent and wrap every external call in resilience logic that survives a transient fault without amplifying a real outage.

    • Agent Development15%

    What the exam tests you on in this phase

    1. Choosing between the Retry pattern and the Circuit Breaker pattern for a described failure — transient versus persistent
    2. Naming all three circuit-breaker states (Closed, Open, Half-Open) and what Half-Open is specifically for
    3. Confirming an operation is idempotent before adding retry logic to it
    4. Picking a retry strategy — cancel, retry immediately, or retry after backoff — for a stated fault type
    5. Explaining why nested retry layers amplify load on an already-struggling dependency

    Practice exercise

    A tool-calling agent with retry and circuit-breaker logic around one external call, tested against an injected failure.

    Self-check — answer without notes

    • Why is retrying a non-idempotent operation dangerous, and how do you guard against it?
    • What does the circuit breaker's Half-Open state test, and what happens if a trial request fails there?
    • A validation error comes back from a tool call. Which retry strategy fits, and why?
    • Name two things the NeMo Agent Toolkit means by "reusable, composable function calls."
    • Why does streaming improve perceived latency even when total generation time is unchanged?
  3. Cognition, planning, memory, and knowledge integration

    Design the agent's memory and planning, then ground it in an external knowledge source it does not have in its weights.

    • Cognition, Planning, and Memory10%
    • Knowledge Integration and Data Handling10%

    What the exam tests you on in this phase

    1. Placing a described fact into the right memory category — episodic, semantic, procedural, short-term, or long-term
    2. Naming the five planning directions and picking the right one for a scenario, not just task decomposition
    3. Explaining why stateful orchestration is what carries state across a multi-step task
    4. Walking the canonical RAG pipeline stage by stage and diagnosing which stage produced a bad answer
    5. Choosing between vector RAG, GraphRAG, HybridRAG, and agentic RAG for a described retrieval need
    6. Explaining why query and document embeddings must come from the same vector space

    Practice exercise

    A memory-and-planning design for one agent, driving a working RAG pipeline that grounds it in an external document set.

    Self-check — answer without notes

    • Why can't an LLM remember across calls without an explicit memory component?
    • Name a planning direction other than task decomposition, and what it adds.
    • What is agentic RAG doing differently from a single-shot retrieval lookup?
    • Why is ETL and data quality a cap on retrieval accuracy rather than optional plumbing?
    • When would GraphRAG outperform plain vector RAG, and why does HybridRAG exist?
  4. Evaluation, tuning, and live operations

    Prove an agent works with a repeatable evaluation pipeline, keep it separate from profiling, and carry that same discipline into live monitoring after launch.

    • Evaluation and Tuning13%
    • Run, Monitor, and Maintain5%

    What the exam tests you on in this phase

    1. Distinguishing evaluation (how good the output is) from profiling (where the time and tokens go)
    2. Reasoning about the accuracy-versus-latency trade-off rather than defaulting to "maximize accuracy"
    3. Identifying per-step tracing as what catches agent-behavior drift that infrastructure metrics alone miss
    4. Explaining why continuous benchmarking against prior versions is what catches a regression
    5. Naming reliability metrics — latency percentiles, throughput, error rate, utilization, uptime — and what each one catches

    Practice exercise

    An evaluation pipeline and a profiler trace for the same agent, kept as two separate artifacts, plus one monitoring dashboard sketch for it in production.

    Self-check — answer without notes

    • A change lowered latency. What do you check before calling that a win?
    • Why doesn't structured user feedback replace a repeatable benchmark?
    • How would you diagnose a multi-agent system producing conflicting actions?
    • What is the difference between monitoring and pre-deployment evaluation?
    • Why does the objective call for automated retraining and versioning rather than manual updates?
  5. Deployment, scaling, and the NVIDIA platform

    Deploy an agent on NVIDIA's own serving stack and scale it without confusing what each platform component actually does.

    • Deployment and Scaling13%
    • NVIDIA Platform Implementation7%

    What the exam tests you on in this phase

    1. Matching NIM, TensorRT-LLM, Triton, and the NeMo Agent Toolkit to their one job each in the stack
    2. Explaining why NIM is not a model and not the same thing as Triton
    3. Describing containerization plus load balancing as the scaling mechanism, not a bigger single VM
    4. Reasoning about the cost-versus-availability trade-off and how profiling under load informs right-sizing
    5. Naming the NeMo Agent Toolkit's built-in agent types and confirming its framework-agnostic, bidirectional-MCP design

    Practice exercise

    A deployment plan for one agent naming which NVIDIA component does which job, plus a measured cost-versus-availability tradeoff at a stated load.

    Self-check — answer without notes

    • What does TensorRT-LLM do that Triton does not, and vice versa?
    • Why would you profile a multi-agent system under distributed load before scaling it?
    • Name two frameworks the NeMo Agent Toolkit works alongside without replatforming.
    • What is the difference between over-provisioning and under-provisioning, and what fixes both?
    • Can the NeMo Agent Toolkit act as an MCP server as well as a client?
  6. Safety, compliance, and human oversight

    Attach a concrete control to every safety and oversight principle, so you can name the mechanism and the point where a human can step in.

    • Safety, Ethics, and Compliance5%
    • Human-AI Interaction and Oversight5%

    What the exam tests you on in this phase

    1. Naming all five NeMo Guardrails rail stages — input, dialog, retrieval, execution, output — not just input and output
    2. Explaining why layered safety combines multiple detection methods plus escalation rather than one filter
    3. Distinguishing bias and toxicity mitigation, a data and training concern, from guardrails, a runtime constraint
    4. Naming a benefit and a drawback of human-in-the-loop review, not just the benefits
    5. Connecting the EU AI Act's Article 14 human-oversight requirement to a concrete intervention point in the system

    Practice exercise

    A one-page safety-and-oversight checklist for one agent: each principle, the control that implements it, and the point where a human can intervene.

    Self-check — answer without notes

    • Which NeMo Guardrails rail runs on a tool call rather than on the user's message?
    • Why is human-in-the-loop review not a free accuracy upgrade — what does it cost?
    • What is the difference between RLHF and plain supervised labeling as HITL techniques?
    • Where should authentication and authorization live in an agentic system, and why?
    • What does Article 14 of the EU AI Act require of a high-risk AI system?

How long it takes to study for NCP-AAI

The same six phases on a calendar, at three intensities. Pick the one that matches the time you actually have — total hours matter less than leaving the judgement-shaped material time to settle.

Three weeks, intensive

40–45 hours over 21 days

You already build agentic systems and need the credential soon. Assumes two to three hours on weekdays and a full day each weekend.

  1. Days 1–3Phase 1 — agent architecture, ReAct, orchestration topologies, memory9h
  2. Days 4–6Phase 2 — tool integration, the Retry and Circuit Breaker patterns8h
  3. Days 7–10Phase 3 — memory taxonomy, planning directions, and a working RAG pipeline9h
  4. Days 11–13Phase 4 — evaluation pipelines, profiling, and production monitoring7h
  5. Days 14–17Phase 5 — NIM, TensorRT-LLM, Triton, the NeMo Agent Toolkit, and scaling8h
  6. Days 18–21Phase 6 — NeMo Guardrails, layered safety, HITL, then timed mocks6h

Six weeks, steady

45–50 hours over 42 days

The default recommendation. Around eight hours a week leaves room for the material to settle, which matters for the scenario-shaped questions this exam favors.

  1. Week 1Phase 1 — architecture, ReAct, orchestration, memory9h
  2. Week 2Phase 2 — tool integration and resilience patterns8h
  3. Week 3Phase 3 — cognition, planning, memory, and knowledge integration9h
  4. Week 4Phase 4 — evaluation, tuning, and live operations7h
  5. Week 5Phase 5 — deployment, scaling, and the NVIDIA platform8h
  6. Week 6Phase 6 — safety, compliance, human oversight, then timed mocks6h

Ten weeks, from a standing start

55–65 hours over 10 weeks

You have LLM fundamentals but have not built an agent before. The extra weeks go on Phases 1 through 3, where the new material concentrates.

  1. Weeks 1–2Phase 1 — architecture, ReAct, and orchestration, with the reading12h
  2. Weeks 3–4Phase 2 — build a tool-calling agent and break it with an injected failure11h
  3. Weeks 5–6Phase 3 — memory, planning, and a working RAG pipeline over real documents11h
  4. Week 7Phase 4 — evaluation, profiling, and a monitoring dashboard8h
  5. Week 8Phase 5 — deployment on the NVIDIA stack, with one measured tradeoff8h
  6. Week 9Phase 6 — the two smallest domains, safety and human oversight7h
  7. Week 10Full-length timed mocks, then rebuild whichever domain lags6h

NCP-AAI topics by domain

Everything the plan covers, grouped by domain. Titles that link are published guides; the rest are on the way.

Agent Architecture and Design

15% · 6 topics · 1 published

  • Implementing the ReAct pattern: reasoning, acting, and observationcoming soon
  • Agent architecture styles: reactive, deliberative, hybridcoming soon
  • NVIDIA's glossary names four multi-agent orchestration topologies — centralized, decentralized, federated, and hierarchical — and the choice between them, not the number of agents, is what determines a system's coordination cost, failure mode, and blast radius when something goes wrong.

  • Memory as an architecture decision: short-term vs. long-termcoming soon
  • Knowledge graphs for relational, multi-hop reasoningcoming soon
  • Designing the human-agent interface as an oversight surfacecoming soon

Agent Development

15% · 5 topics · 1 published

  • Retry and Circuit Breaker are two distinct resilience mechanisms for the same underlying problem — a failing dependency — and the exam's most-tested trap is treating them as interchangeable: Retry reattempts a transient fault (immediately for rare blips, after backoff for busy/connectivity faults, never without idempotency), while the Circuit Breaker is a three-state machine (Closed → Open → Half-Open) that stops calling a persistently failing dependency so it gets room to recover.

  • Idempotency as the precondition for a safe retrycoming soon
  • Building and connecting custom tools, APIs, and functionscoming soon
  • Integrating multimodal and generative models across text, vision, audiocoming soon
  • Dynamic prompt chains and streaming conversation flowscoming soon

Evaluation and Tuning

13% · 5 topics

  • Evaluation pipelines and task benchmarkscoming soon
  • Profiling vs. evaluationcoming soon

    The most testable distinction in this domain.

  • The accuracy-vs-latency trade-offcoming soon
  • Structured feedback and the data flywheelcoming soon
  • Targeted optimization: change one variable, re-evaluatecoming soon

Deployment and Scaling

13% · 5 topics

  • NVIDIA NIM: what it is, and what it is notcoming soon
  • Scaling with containers, Kubernetes, and load balancingcoming soon
  • Profiling under distributed load before scalingcoming soon
  • MLOps: CI/CD, monitoring, and governancecoming soon
  • Balancing deployment cost against high availabilitycoming soon

Cognition, Planning, and Memory

10% · 4 topics

  • The memory taxonomy: short-term, long-term, episodic, semantic, proceduralcoming soon
  • The five planning directionscoming soon

    Decomposition is one of five, not the whole answer.

  • Reasoning frameworks: chain-of-thought and task decompositioncoming soon
  • Stateful orchestration: where memory and planning meetcoming soon

Knowledge Integration and Data Handling

10% · 4 topics

  • The canonical RAG pipeline, stage by stagecoming soon
  • Vector databases and shared embedding spacescoming soon
  • Beyond vector RAG: GraphRAG, HybridRAG, agentic RAGcoming soon
  • ETL and data quality as the cap on retrieval accuracycoming soon

NVIDIA Platform Implementation

7% · 4 topics

  • The NeMo Agent Toolkit: framework-agnostic orchestrationcoming soon
  • NIM, TensorRT-LLM, and Triton: three distinct jobscoming soon
  • NeMo Guardrails as a platform componentcoming soon
  • Multimodal input pipelines on NVIDIA hardwarecoming soon

Run, Monitor, and Maintain

5% · 4 topics

  • Monitoring dashboards and reliability metricscoming soon
  • Per-step tracing for root-cause diagnosiscoming soon
  • Continuous benchmarking against prior versionscoming soon
  • Automated tuning, retraining, and versioningcoming soon

Safety, Ethics, and Compliance

5% · 4 topics

  • NeMo Guardrails: the five rail stagescoming soon

    Input, dialog, retrieval, execution, output.

  • Layered safety: filters plus escalationcoming soon
  • PII, agentic security, and audit trailscoming soon
  • Bias and toxicity mitigation vs. guardrailscoming soon

Human-AI Interaction and Oversight

5% · 4 topics

  • Human-in-the-loop: benefits and drawbackscoming soon
  • HITL techniques: supervised learning, RLHF, active learningcoming soon
  • Transparency and decision traceabilitycoming soon
  • Human oversight and intervention pointscoming soon

Common NCP-AAI preparation mistakes

How people waste weeks preparing for this exam, and what to do instead. These are process errors rather than gaps in the material.

  1. Studying the domains in their published order.

    Do this instead

    Follow weight and dependency instead. Agent Architecture and Design is tied for the largest domain and its vocabulary — memory, orchestration, ReAct — is assumed everywhere else.

  2. Treating this as an associate-level review because the vocabulary overlaps with NCA-GENL.

    Do this instead

    Prepare for scenario judgment, not recall. Every domain's own source material carries the same warning: you are expected to reason about why an architecture or pattern fits a scenario, not define it.

  3. Learning the Retry pattern and the Circuit Breaker pattern as one topic.

    Do this instead

    Drill them as a pair with a clear boundary: retry reattempts a transient fault, the breaker stops calling a persistently failing one. Rehearse the breaker's three states by name until Half-Open is automatic.

  4. Skipping the three smallest domains — Run/Monitor/Maintain, Safety/Ethics/Compliance, and Human-AI Interaction — because each is only 5%.

    Do this instead

    Give each a focused session. Together they are 15% of the exam, and each has one or two facts — the five NeMo Guardrails rail stages, the EU AI Act's Article 14 — that alone cover most of what gets asked.

  5. Reading about the NeMo Agent Toolkit, NIM, TensorRT-LLM, and Triton without a clear one-line job for each.

    Do this instead

    Write one sentence per tool: toolkit orchestrates, NIM serves, TensorRT-LLM optimizes, Triton hosts, Guardrails constrains. The exam bait-and-switches between them constantly.

  6. Reciting task decomposition as the whole answer to "how does an agent plan."

    Do this instead

    Learn all five planning directions — Task Decomposition, Plan Selection, External Module, Reflection, Memory — since Reflection and Plan Selection are common distractor-versus-correct pairs.

  7. Treating human-in-the-loop as purely a benefit to argue for.

    Do this instead

    Learn the drawbacks with equal weight: added cost and latency, reviewer inconsistency, and privacy exposure are all named, tested concerns.

NCP-AAI exam-day tactics

Technique rather than content — how to spend the hour, how to handle the questions that give no partial credit, and how to know when you are ready.

Pace at just over a minute a question

The paper can run to 70 questions in 120 minutes, so a little over 90 seconds each is the pace to rehearse. Flag anything still unresolved at two minutes and move on.

Find the constraint before you eliminate

Scenario questions name a constraint — latency, cost, availability, a specific failure type. Two options are usually right for the general subject and wrong for the stated constraint. Find the constraint clause first.

Know each pattern's trigger condition, not just its name

Retry fires on a transient fault; the circuit breaker fires on a persistent one. Knowing the definitions is not the same as knowing which condition in a scenario calls for which — practice classifying the fault first.

Know each NVIDIA tool by its one job

Toolkit orchestrates, NIM serves, TensorRT-LLM optimizes, Triton hosts, Guardrails constrains, a vector database indexes. One clear sentence per tool resolves most platform questions.

Separate "is it good" from "is it fast"

Evaluation and profiling answer different questions. When a scenario reports a metric improved, check which kind of metric it was before assuming the change was a win.

Measure readiness by your weakest domain

A strong overall average can hide a domain you would fail on its own. Track results per domain and keep studying the lowest one, weighting the two largest domains first.

NCP-AAI study questions, answered

The questions people ask most often when planning their preparation.

How do I study for the NCP-AAI exam?

Study the ten domains in six weighted phases rather than the order they are published in. Begin with Agent Architecture and Design and Agent Development, since their vocabulary — memory, orchestration, resilience patterns — carries into every other domain. Then move through cognition and knowledge integration, evaluation and operations, deployment and platform tooling, and finish with safety and human oversight.

How long does it take to prepare for NCP-AAI?

Most candidates with 1–2 years of applied AI/ML experience need 40 to 60 hours of focused study. Expect the upper end if you have not built a multi-agent system or wired up resilience patterns before, and the lower end if you work with agentic frameworks daily.

Can I pass NCP-AAI in three weeks?

Yes, if you already build agentic systems professionally. Three weeks at two to three hours a day covers the ground. Prioritize agent architecture, the Retry and Circuit Breaker patterns, and the RAG pipeline — those three subjects carry the most weight and the most confusable detail.

What should I study first for NCP-AAI?

Agent architecture styles, ReAct, and multi-agent orchestration topologies. It is one of the two largest domains and every later topic — memory, planning, knowledge integration — assumes you already have this vocabulary.

Which NCP-AAI domain is hardest?

Agent Development catches most candidates out, not because the concepts are exotic but because the Retry and Circuit Breaker patterns are easy to describe and hard to apply correctly to a specific scenario. Candidates who read the definitions once and move on lose marks here.

Do I need hands-on NVIDIA experience to pass?

No, but you do need to know the product landscape precisely. The NeMo Agent Toolkit orchestrates, NIM serves, TensorRT-LLM optimizes, Triton hosts, and NeMo Guardrails constrains. One clear sentence about each is enough to answer the questions that name them.

Is a practice test enough to pass NCP-AAI?

Not on its own. Practice questions show you where the gaps are but rarely teach the reasoning behind an answer, and this exam favors scenario judgment over recall. Use them after each phase to find your weakest domain, then return to the material for that domain.

How many hours a day should I study?

Two to three hours a day over four to six weeks suits most people, which fits the 40 to 60 hour range comfortably. Shorter daily sessions with a self-check at the end work better than long weekend blocks for material this dependent on scenario practice.

What is the best order to study the NCP-AAI domains?

Agent Architecture and Design and Agent Development first, then Cognition/Planning/Memory and Knowledge Integration together, then Evaluation/Tuning with Run/Monitor/Maintain, then Deployment/Scaling with NVIDIA Platform Implementation, and Safety/Ethics/Compliance with Human-AI Interaction and Oversight last. This follows both weight and the dependencies the source material names on its own.

How do I know when I am ready to book the exam?

When you score consistently at or above 70% across all ten domains with none lagging, and you can answer the self-checks in this guide without notes. Since only the overall score matters, one weak domain can be carried by strong results elsewhere — but do not plan to rely on that.

Test the plan against real questions.

Practise by domain to find which phase you have not really finished, or sit a full-length timed mock at exam pace.