Checks whether the response has answered all the aspects of the question specified
Response completeness score measures if the generated response has adequately answered all aspects to the question being asked.
This check is important to ensure that the model is not generating incomplete responses.
Columns required:
question
: The question asked by the userresponse
: The response given by the modelSample Response:
The question can be divided in following 2 parts:
Though the response provides answer to “Where is the Taj Mahal located?”, it does not state when was it built.
Ultimately, resulting in a low response completeness score.
We evaluate response completeness by determining which of the following three cases apply for the given task data:
Checks whether the response has answered all the aspects of the question specified
Response completeness score measures if the generated response has adequately answered all aspects to the question being asked.
This check is important to ensure that the model is not generating incomplete responses.
Columns required:
question
: The question asked by the userresponse
: The response given by the modelSample Response:
The question can be divided in following 2 parts:
Though the response provides answer to “Where is the Taj Mahal located?”, it does not state when was it built.
Ultimately, resulting in a low response completeness score.
We evaluate response completeness by determining which of the following three cases apply for the given task data: