Evaluates if the list of generated sub-questions comprehensively cover all aspects of the main question.
Sub-Query Completeness checks whether the sub-queries generated from a question are complete. This check considers all the sub-queries and evaluate if all of them taken together answers all aspects of the question or not
Columns required:
question
: The question asked by the usersub_questions
: Sub questions generated from the questionSample Response:
The sub_questions
do not contain some parts of the question
such as: “When was the Taj Mahal?”, “Who built the Taj Mahal?”, “Where is the the Taj Mahal?”
Resulting in low Sub-Query Completeness score.
We evaluate Sub-Query Completeness by determining which of the following three cases apply for the given task data:
Evaluates if the list of generated sub-questions comprehensively cover all aspects of the main question.
Sub-Query Completeness checks whether the sub-queries generated from a question are complete. This check considers all the sub-queries and evaluate if all of them taken together answers all aspects of the question or not
Columns required:
question
: The question asked by the usersub_questions
: Sub questions generated from the questionSample Response:
The sub_questions
do not contain some parts of the question
such as: “When was the Taj Mahal?”, “Who built the Taj Mahal?”, “Where is the the Taj Mahal?”
Resulting in low Sub-Query Completeness score.
We evaluate Sub-Query Completeness by determining which of the following three cases apply for the given task data: