Getting Started
Pre-configured Evaluations
- Overview
- Ground Truth Comparison Evals
- Response Quality Evals
- Context Awareness Evals
- Security Evals
- Language Quality Evals
- Query Clarity Evals
- Code Related Evals
- Conversation Evals
- Creating Custom Evals
Integrations
- Framework
- Observation Tools
- Vector Database
Tutorials
FAQ
Frequently Asked Questions
Here are some frequently asked questions about UpTrain
UpTrain is an open-source unified platform to evaluate and improve Generative AI applications.
We provide grades for 20+ preconfigured checks (covering language, code, embedding use-cases), perform root cause analysis on failure cases and give insights on how to resolve them.
UpTrain is built for everyone building LLMs. It can help with all the production needs from Evaluation to Experimentation to Improvement.
You can easily get started by installing UpTrain using pip
. Click here for details.
Absolutely yes, we are proudly open-source.
You would just need an OpenAI Key to use UpTrain.
No, we don’t collect your data.
All our evaluations are done locally.
You can check our metrics docs to know more about how we evaluate them.
UpTrain is actively maintained and updated regularly to incorporate new features, improvements, and support for the latest AI advancements.
We would love to have you contribute to UpTrain! Here is a doc you can refer to.
To request features, add a “Feature request” using the New issue
button in GitHub from this link, or you can join our Slack channel to request a feature.
UpTrain offers extensive documentation and dedicated slack channel for troubleshooting and guidance.
Can’t find what you’re looking for? Join our Slack to connect with us!
Was this page helpful?