Grades how well the response generated by the LLM aligns with the provided ground truth.
question
: The question asked by the userresponse
: The response given by the modelground_truth
: The ideal responsemethod
: Different methods to check for response matching
llm (default)
: Uses LLM to check if the response matches the ground truthexact
: Checks if the response is exactly the same as the ground_truthrouge
: Uses ROUGE SCORE to check if the response matches the ground truth