Skip to main content

​
Evaluate: Explore

The “Explore” component within DataGyro’s Evaluate vertical provides a way to inspect and understand the queries and relevance judgments (qrels) that were automatically generated from your uploaded datasets. This can be particularly useful for:
  • Understanding the Evaluation Basis: See exactly what queries your IR algorithm is being tested against.
  • Verifying Query Quality: Ensure the generated queries are sensible and relevant to your dataset’s content.
  • Analyzing Qrels: Review which documents were marked as relevant for specific queries, helping you understand the ground truth used for scoring.
  • Debugging and Refinement: If your benchmark results are unexpected, exploring the queries and qrels can offer insights into potential discrepancies or areas for improvement in your dataset or algorithm.

​
What You Can Explore

Within the “Explore” section, for a selected “Ready” dataset, you can typically view:
  • List of Generated Queries: See each individual query that was created.
  • Details for Each Query:
    • The query text itself.
    • The corresponding qrels, showing which document IDs from your dataset were deemed relevant to this query and potentially the degree of relevance.

​
How to Use Explore

  1. Navigate to the “Evaluate” section and select the “Explore” tab.
  2. Choose a dataset that is in the “Ready” state (meaning queries and qrels have been generated).
  3. Browse through the list of queries.
  4. Select individual queries to view their associated qrels.
By examining this data, you gain a transparent view into the evaluation process, fostering trust and enabling more informed decisions about your IR system’s development. This exploration can complement the insights you get from the Benchmarks report and help when you Compare results.