# Questions to Ask AI Governance Vendors

An RFP and security questionnaire for AI governance, guardrail, red-teaming and monitoring vendors. Each question says what a good answer looks like.

Updated 2026-10-29. Also on the [web page](https://aigovernancetools.fyi/guides/questions-to-ask-ai-governance-vendors).

A demo shows what a product does on a good day. Written answers show what the vendor will commit to. Use these questions in your RFP. Ask for evidence, not adjectives.

This guide is general information. It is not legal advice.

## Scope and fit

1. Which layer does your product cover: inventory and risk workflow, guardrails, red teaming, or monitoring? What is out of scope?
2. Which AI types do you support: classic ML models, LLM applications, agents, third-party AI features?
3. Can you find AI use that is not registered yet? How?
4. Show three customers of our size and sector. Can we speak to one?

A good answer names clear limits. Be careful with a vendor that claims every layer equally well.

## Regulatory mapping

5. Which frameworks do you map to out of the box? EU AI Act, ISO/IEC 42001, NIST AI RMF, others?
6. Does your EU AI Act content reflect Regulation (EU) 2026/1744 (the Digital Omnibus on AI)? For example, Annex III high-risk duties now apply from 2 December 2027 ([Article 113](https://artificialintelligenceact.eu/article/113/)).
7. How fast do you update mappings when a rule changes? Give a recent example.
8. How do you help a deployer meet Article 26 duties, such as human oversight, monitoring and log retention of at least six months ([Article 26](https://artificialintelligenceact.eu/article/26/))?
9. For US banks: how does your model risk content reflect SR 26-2, which replaced SR 11-7 on 17 April 2026 ([Federal Reserve](https://www.federalreserve.gov/supervisionreg/srletters/SR2602.htm))?
10. For hiring tools in New York City: do you support the Local Law 144 bias audit and notice duties ([NYC DCWP](https://www.nyc.gov/site/dca/about/automated-employment-decision-tools.page))?

A good answer shows dates and a change log. A mapping that still shows 2 August 2026 as the Annex III date is out of date.

## Technical testing

11. Which risks do your tests cover? Map them to the [OWASP Top 10 for LLM Applications 2025](https://genai.owasp.org/llm-top-10/), from LLM01 Prompt Injection to LLM10 Unbounded Consumption.
12. Can we add our own tests, attack prompts and evaluators?
13. How do you test bias? Which metrics? Can we use our own protected attributes?
14. What is the added latency of your run-time guardrails? Show it on our traffic, not a benchmark.
15. What is your false-positive rate on our sample data?

## Evidence and audit

16. What does an auditor receive? Show a sample export.
17. Is every approval, change and override logged with user and time?
18. Can you import results from other tools, such as open-source test runs?
19. How long do you keep records? Can we set the period?

## Security and data

20. What data do you collect from our models, prompts and users? Can we turn collection off?
21. Where is data stored and processed? Can we keep it in the EU?
22. Do you use our data to train any model? Put the answer in the contract.
23. Which LLMs run inside your product? Who hosts them?
24. Which third-party audit reports can you share?
25. Do you support SSO, role-based access and customer-managed keys?
26. How do you protect your own product against prompt injection and system prompt leakage (OWASP LLM01 and LLM07)?

## The vendor's own AI governance

27. Do you run an AI management system in line with ISO/IEC 42001 ([ISO](https://www.iso.org/standard/42001))? Is it certified?
28. Which framework do you use for your own AI risk? For example, the four NIST AI RMF functions: govern, map, measure, manage ([NIST AIRC](https://airc.nist.gov/airmf-resources/airmf/5-sec-core/)).

## Commercial terms

29. What is the price at our size, and at twice our size? What is the unit: user, use case, model, trace or token?
30. Which features are only in the enterprise tier?
31. What happens to our data at the end of the contract?

Most governance vendors do not publish prices. See [how AI governance software is priced](/guides/how-ai-governance-software-is-priced). To score the answers, use [how to choose an AI governance platform](/guides/how-to-choose-an-ai-governance-platform).

## Sources

- [Article 113](https://artificialintelligenceact.eu/article/113/) and [Article 26](https://artificialintelligenceact.eu/article/26/), artificialintelligenceact.eu, accessed 2026-10-29
- [SR 26-2: Revised Guidance on Model Risk Management](https://www.federalreserve.gov/supervisionreg/srletters/SR2602.htm), Federal Reserve Board, 17 April 2026, accessed 2026-10-29
- [Automated Employment Decision Tools (AEDT)](https://www.nyc.gov/site/dca/about/automated-employment-decision-tools.page), NYC Department of Consumer and Worker Protection, accessed 2026-10-29
- [OWASP Top 10 for LLM Applications 2025](https://genai.owasp.org/llm-top-10/), OWASP GenAI Security Project, accessed 2026-10-29
- [ISO/IEC 42001:2023](https://www.iso.org/standard/42001), International Organization for Standardization, accessed 2026-10-29
- [AI RMF Core](https://airc.nist.gov/airmf-resources/airmf/5-sec-core/), NIST Trustworthy and Responsible AI Resource Center, accessed 2026-10-29

## Questions

### Should I send a separate security questionnaire?

Yes, if your company has a standard one. Add the AI-specific questions in this guide to it. A governance tool often reads sensitive data about your models and your users.

### Should I ask the vendor how it governs its own AI?

Yes. Many governance tools use LLMs inside the product. Ask which models they use, where data goes, and whether the vendor follows a framework such as ISO/IEC 42001 or the NIST AI RMF.

### How many vendors should get the RFP?

Enough to compare, and few enough to run a real pilot with each finalist. Use the answers to cut the list before the pilot.
