Did the Prime Minister answer? On the same 27 answers, two AI readers agreed 93% of the time; pairs of people agreed 30% to 63%
Can AI help people agree on whether a question at Prime Minister's Questions was answered? Two AI readers agreed with each other on 82% of 9,480 answers. Pairs of human markers, checking a sample, agreed on between 30% and 63%. When one marker read the machine's reasons, he changed his mind on 7 of the 11 differences he looked at again.
Parliament, Prime Minister's Questions