Skip to content

Instantly share code, notes, and snippets.

@daaronr

daaronr/eval_sample.csv

Last active March 16, 2023 02:28
Show Gist options
  • Save daaronr/9e7abbcb2aa7cdb3da767e6a50003681 to your computer and use it in GitHub Desktop.
Save daaronr/9e7abbcb2aa7cdb3da767e6a50003681 to your computer and use it in GitHub Desktop.
Download ZIP
ratings_and_prediction_metrics
Raw
eval_sample.csv
paper name here John Smith Anonymous Jane Doe
Category Rating (0-100) 90% CI (0-100) Comments (footnote) Rating (0-100) Confidence: * High = 5, Low = 0 Comments Rating (0-100) 90% CI (0-100) Comments
Overall assessment 50 (40, 65) 50 4 79 59-94
Advancing knowledge and practice 25 (20,40) 90 5 90 70-100
Methods: Justification, reasonableness, validity, robustness 95 (85,97.5) 80 4 70 50-90
Logic & communication 75 (60,90) 80 4 70 50-90
Open, collaborative, replicable N/A N/A 90 3 50 30-70
Engaging with real-world, impact quantification; practice, realism, and relevance 90 70-100
Relevance to global priorities 60 (40,75) 95 3 90 70-100
What ‘quality journal’ do you expect this work will be published in? Note: 0= lowest/none, 5= highest/best 3 (2.5,4.5) 4 5 5 High
On a ‘scale of journals’, what ‘quality of journal’ should this be published in? Note: 0= lowest/none, 5= highest/best 3 (2.5,4.5) 4 5 5 High
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment