← All questions

MULTI RATER QUALITY

How does Burna AI handle disagreements between raters?

Disagreements go to an adjudicator. When independent raters grade the same adverse event differently, the case is flagged as a conflict and placed in the adjudication queue for the people who hold the adjudicator role in the organization. The first adjudicator to claim a case holds it, so two people cannot rule on it at once. The adjudicator sees each rater's grade and the case evidence side by side, resolves each disagreement, and signs the resolution under 21 CFR Part 11. A term only one rater reported closes the case without adjudication but never becomes a reference grade, because it was not measured twice. Adjudicated grades become the reference against which agreement, including agreement with the AI suggestion, is measured.

Question not answered? Book a 15-minute call.