Open data

The AI Answer Evidence Index

Round two. The tables, the computed views, the method note, the deviation log, the questions and the scripts behind the two articles. Published under CC BY 4.0.

The answers, the source addresses, the page hashes and the outputs of every step are in the archived copy on Zenodo, which is linked from the articles.

Read the tables

tables.htmlEvery table on one page, each with its own link

Tables

tables.mdEvery table of the two articles, as written by report_tables.py
side-views.jsonThe views beside the registered measure, with their intervals
source-overlap.jsonThe overlap of the sources the engines cite

Summaries of the chain

summary-main.jsonGoogle AI Overviews, ChatGPT and Gemini: the 50 questions
summary-repeat.jsonThe same three engines: the questions asked a second time
summary-perplexity-claude.jsonPerplexity and Claude (API): the 50 questions

Method and log

METHOD-NOTE.mdThe preregistered method note, version 1.0.0
DEVIATION-LOG.mdEvery deviation from the method note, and the run records
questions-main-v1.tsvThe 50 questions, with sector and asking order

Code

extract_figures.pyStep 1: the figures of an answer
fetch_pages.pyStep 2: the cited pages, saved with time, status and hash
check_figures.pyStep 3: is the figure on a cited page
classify_figures.pyStep 4: the labels of the figures not found
summary_figures.pyThe registered table and its intervals
chain_common.pyShared rules of the four steps
side_views.pyWrites side-views.json
report_tables.pyWrites tables.md
source_overlap.pyWrites source-overlap.json