Daniel E. Licht Lichtphyz

Data Scientist at "FAIR" Meta AI. Focused on difficult model evaluations an. Former science educator, automation, and astrophysics, FAIR NLLB, UST, Seamless

8 followers · 4 following

@facebookresearch
East San Francisco Bay Area
https://www.linkedin.com/in/daniel-licht-a0680b137/
in/lichtphyz

View GitHub Profile

1 file
1 fork
0 comments
5 stars

cbuntain / agreement.py

Created March 19, 2020 18:38

Example of using NLTK's agreement package to calculate agreement scores for an annotation task

	#
	# Author: Cody Buntain
	# Date: 19 March 2020
	#
	# Description:
	# This code is an example of uysing the agreement package
	#. in NLTK to calculate a number of agreement metrics on
	#. a set of annotations. Currently, this code will work
	#. with two annotators and multiple labels.
	#. You can use Fleiss's Kappa or Krippendorf's Alpha if you