Individual versus general structured feedback to improve agreement in grant peer review: a randomized controlled trial

Table 4 Reviewer agreement and proposal scores for the Health program by the Norwegian Foundation Dam in 2017 and 2018

	General feedback group (n = 22)		Individual feedback group (n = 19)
Variable	2017	2018	2017	2018
Total number of paired reviews	715	642	545	496
Eligibility agreement, count (%)	612 (86%)	599 (93%)	453 (83%)	417 (84%)
Absolute differences^a, count (%)	601 (84%)	594 (93%)	434 (80%)	409 (82%)
Average proposal score (1–10)	6,3 ± 1,93	6,6 ± 1,85	5,7 ± 2,14	6,2 ± 1,97
Average absolute difference	2,0 ± 1,54	1,8 ± 1,47	2,2 ± 1,59	1,9 ± 1,48

Values are mean ± SD unless otherwise stated. ^aProposals where both reviewers in the paired review considered the proposal to be eligible and a score difference could be calculated. The numbers differ from “Eligibility agreement” because the latter includes both agreement regarding eligibility and ineligibility

ISSN: 2058-8615