For CAsT year 4, topics are represented as a tree containing one or more conversation paths.
Each turn within a topic (asides the first) have a
parent_turn field through which each conversation path can be traced.
The contents of this directory are as follows:
2022_automatic_evaluation_topics_tree_v1.0.jsoncontains each conversation tree (topic) with an automatic rewrite generated for each user utterance.
2022_evaluation_topics_turn_ids.jsoncontains each conversation tree (topic) with the resolved query for each user utterance.
2022_evaluation_topics_tree_v1.0.jsoncontains all ids that responses/ranked passages need to be returned for.
2022_evaluation_topics_flattened_duplicated_v1.0.jsoncontains all possible conversation paths across all the conversation trees.
2022_mixed_initiative_question_pool.jsoncontains the question pool for the mixed initiative sub task