Cohen’s Kappa Calculator
Measure how far two raters agree beyond what chance alone would produce. For ordered categories, linear and quadratic weighted kappa credit near misses.
Updated · By Bibin XavierData 60 × 7
| Casetext · 60 levels | Rater_Anumeric · coded | Rater_Bnumeric · coded | Rater_Cnumeric · coded | Judge_1numeric | Judge_2numeric | Judge_3numeric |
|---|---|---|---|---|---|---|
| C01 | 1 | 1 | 1 | 58.8 | 59.8 | 53.4 |
| C02 | 1 | 1 | 1 | 68.1 | 74.1 | 69.3 |
| C03 | 1 | 1 | 1 | 74 | 78.5 | 73.6 |
| C04 | 3 | 4 | 3 | 68.5 | 60.9 | 63.2 |
| C05 | 3 | 3 | 3 | 68.8 | 79.7 | 73.2 |
| C06 | 3 | 3 | 3 | 47.2 | 58.8 | 47.9 |
| C07 | 4 | 4 | 4 | 72.2 | 81.8 | 81.7 |
| C08 | 1 | 3 | 1 | 61.9 | 65.5 | 62.2 |
Variables and options
Results
60 rows · example dataAgreement table
| Rater_A \ Rater_B | 1 | 2 | 3 | 4 | Total |
|---|---|---|---|---|---|
| 1 | 16 | 2 | 2 | 0 | 20 |
| 2 | 1 | 9 | 2 | 0 | 12 |
| 3 | 0 | 2 | 7 | 1 | 10 |
| 4 | 2 | 1 | 4 | 11 | 18 |
Kappa statistics
| Statistic | Value | SE | 95% CI | z | p |
|---|---|---|---|---|---|
| Cohen’s κ | .620 | .076 | [.471, .769] | 8.40 | < .001 |
| Linear weighted κ | .696 | ||||
| Quadratic weighted κ | .748 |
Note. Landis and Koch (1977): .21–.40 fair, .41–.60 moderate, .61–.80 substantial, above .80 almost perfect. Weighted kappa assumes the categories are ordered as listed.
Interpretation
The two raters show substantial agreement beyond chance (κ = .620), agreeing on 71.7% of 60 cases.
How to cite this tool
Using these results in a thesis, journal article, report or class assignment? Please cite this free tool so others can find it. It keeps the site free.
APA 7
Xavier, B. (2026). Cohen’s Kappa Calculator [Web application]. FreeStatisticalTools.com. https://freestatisticaltools.com/cohens-kappa-calculator/
BibTeX
@software{xavier_cohenkappa_2026,
author = {Xavier, Bibin},
title = {Cohen’s Kappa Calculator},
publisher = {FreeStatisticalTools.com},
year = {2026},
url = {https://freestatisticaltools.com/cohens-kappa-calculator/},
note = {Web application}
}Suggested sentence for your methods section: “The analysis was carried out with the free Cohen’s Kappa Calculator tool on FreeStatisticalTools.com (Xavier, 2026).”
What is Cohen’s kappa?
Cohen’s kappa measures agreement between two raters who classify the same cases, correcting for the agreement expected by chance. Weighted kappa credits near misses for ordered categories.
When to use Cohen’s kappa
Use it when two raters classify the same cases into categories. For three or more raters use Fleiss’ kappa; for continuous ratings use the ICC.
How to set up your data
One row per case and one column per rater, holding the category each rater assigned.
How to use this tool
- Enter your data. Paste columns from Excel, Google Sheets or SPSS with variable names in the first row, or upload a CSV or Excel file. The example data shows the expected layout.
- Choose the variables. Select the rater 1 and rater 2.
- Read the results. Results update automatically. Read the plain-English interpretation, then use Copy table to paste APA-style tables into Word and Copy for the results sentence.
Frequently asked questions
How do I interpret Cohen’s kappa?
Landis and Koch (1977): .21–.40 fair, .41–.60 moderate, .61–.80 substantial and above .80 almost perfect agreement.
When should I use weighted kappa?
For ordinal categories such as mild, moderate and severe, where disagreeing by one level is less serious than by two.
What if I have more than two raters?
Use Fleiss’ kappa for three or more raters.
Related tools
Browse all categories
Data cleaning and preparation · Describe and explore · Compare means · Nonparametric tests · Correlation and regression · Bayesian statistics · Categorical data · Reliability and agreement · Multivariate analysis · Structural equation modeling · Econometrics and time series · Panel data and causal inference · Marketing and decision research · Survival, clinical and meta-analysis · Study planning and calculators · PLS-SEM