Fleiss’ Kappa Calculator
Measure agreement when three or more raters classify each case, with kappa for each category.
Updated · By Bibin XavierData 60 × 7
| Casetext · 60 levels | Rater_Anumeric · coded | Rater_Bnumeric · coded | Rater_Cnumeric · coded | Judge_1numeric | Judge_2numeric | Judge_3numeric |
|---|---|---|---|---|---|---|
| C01 | 1 | 1 | 1 | 58.8 | 59.8 | 53.4 |
| C02 | 1 | 1 | 1 | 68.1 | 74.1 | 69.3 |
| C03 | 1 | 1 | 1 | 74 | 78.5 | 73.6 |
| C04 | 3 | 4 | 3 | 68.5 | 60.9 | 63.2 |
| C05 | 3 | 3 | 3 | 68.8 | 79.7 | 73.2 |
| C06 | 3 | 3 | 3 | 47.2 | 58.8 | 47.9 |
| C07 | 4 | 4 | 4 | 72.2 | 81.8 | 81.7 |
| C08 | 1 | 3 | 1 | 61.9 | 65.5 | 62.2 |
Variables and options
Results
60 rows · example dataOverall agreement
| κ | SE | z | p | 95% CI | |
|---|---|---|---|---|---|
| Fleiss’ kappa | .581 | .043 | 13.38 | < .001 | [.496, .666] |
Note. SE under the null hypothesis of no agreement (Fleiss, 1971).
Agreement by category
| Category | Proportion of ratings | κ |
|---|---|---|
| 1 | .322 | .669 |
| 2 | .206 | .524 |
| 3 | .228 | .463 |
| 4 | .244 | .639 |
Interpretation
Agreement among the 3 raters is κ = .581, which is moderate.
How to cite this tool
Using these results in a thesis, journal article, report or class assignment? Please cite this free tool so others can find it. It keeps the site free.
APA 7
Xavier, B. (2026). Fleiss’ Kappa Calculator [Web application]. FreeStatisticalTools.com. https://freestatisticaltools.com/fleiss-kappa-calculator/
BibTeX
@software{xavier_fleisskappa_2026,
author = {Xavier, Bibin},
title = {Fleiss’ Kappa Calculator},
publisher = {FreeStatisticalTools.com},
year = {2026},
url = {https://freestatisticaltools.com/fleiss-kappa-calculator/},
note = {Web application}
}Suggested sentence for your methods section: “The analysis was carried out with the free Fleiss’ Kappa Calculator tool on FreeStatisticalTools.com (Xavier, 2026).”
What is Fleiss’ kappa?
Fleiss’ kappa extends Cohen’s kappa to three or more raters who each assign every case to one of several categories.
When to use Fleiss’ kappa
Use it when each case is rated into categories by three or more raters.
How to use this tool
- Enter your data. Paste columns from Excel, Google Sheets or SPSS with variable names in the first row, or upload a CSV or Excel file. The example data shows the expected layout.
- Choose the variables. Select the rater columns.
- Read the results. Results update automatically. Read the plain-English interpretation, then use Copy table to paste APA-style tables into Word and Copy for the results sentence.
Frequently asked questions
What data format does Fleiss’ kappa need?
One row per case and one column per rater, each holding the category that rater assigned.
Can different raters rate different cases?
Yes. Fleiss’ kappa only requires the same number of ratings per case; the raters themselves can differ.
How is it interpreted?
Use the same Landis and Koch benchmarks as Cohen’s kappa.
Related tools
Browse all categories
Data cleaning and preparation · Describe and explore · Compare means · Nonparametric tests · Correlation and regression · Bayesian statistics · Categorical data · Reliability and agreement · Multivariate analysis · Structural equation modeling · Econometrics and time series · Panel data and causal inference · Marketing and decision research · Survival, clinical and meta-analysis · Study planning and calculators · PLS-SEM