NeMo Guardrails
Toolkit for adding programmable safety and behavioral guardrails to LLM-powered conversational applications.
Overview
NeMo Guardrails lets a team define rules for what an LLM-powered application should and shouldn't do - staying on topic, avoiding certain content, following a specific conversation flow - using a dedicated modeling language, and enforces those rules around the underlying LLM regardless of which model is used. This adds a layer of predictability on top of an inherently unpredictable model.
NeMo Guardrails is a fit for teams deploying LLM applications that need reliable behavioral boundaries, complementing general LLM frameworks like LangChain and Haystack (also in this catalog) by adding a safety and control layer around whatever model or pipeline those frameworks orchestrate.
- Categories
- AI & Machine Learning
- Languages
- Python
- License
- Apache-2.0
Related Projects
CAMEL
Apache-2.0Open-source framework for research and building systems of multiple communicating, role-playing AI agents that collaborate autonomously.
- AI & Machine Learning
CrewAI
MITMulti-agent orchestration framework for building teams of collaborating, role-based AI agents that work together autonomously to complete complex tasks.
- AI & Machine Learning
DeepEval
Apache-2.0Open-source testing framework for evaluating LLM outputs, treating LLM application quality checks like conventional unit tests.
- AI & Machine Learning
DeepSpeed
Apache-2.0Deep learning optimization library from Microsoft for training and running very large models efficiently across multiple GPUs.
- AI & Machine Learning
Spotted an error? Suggest an edit on GitHub.