ROUGE Score Calculator
Calculate the ROUGE score to evaluate text summarization quality against references.
Inputs
ROUGE F1
0.6316
ROUGE Recall
0.6000
ROUGE Precision
0.6667
Step by step
Recall: overlapping ÷ reference n-grams
12 ÷ 20
= 0.600000
Precision: overlapping ÷ candidate n-grams
12 ÷ 18
= 0.666667
F1: harmonic mean
2×0.6667×0.6000 / (0.6667+0.6000)
= 0.631579
How it works
ROUGE (Recall-Oriented Understudy for Gisting Evaluation) measures summarization quality by counting n-gram overlap between a generated summary and reference summaries. Unlike BLEU which emphasizes precision, ROUGE focuses on recall — what fraction of reference content appears in the candidate.
Formula
ROUGE-N
Recall = overlap_ngrams / reference_ngrams; F1 = 2*P*R/(P+R)
- overlap_ngrams
- Number of matching n-grams between candidate and reference
Frequently Asked Questions
What is the difference between ROUGE-1, ROUGE-2, and ROUGE-L?
ROUGE-1 counts unigram overlap, ROUGE-2 counts bigram overlap (captures fluency), and ROUGE-L uses longest common subsequence (captures sentence structure) without requiring consecutive matches.
When should I use ROUGE vs BLEU?
Use ROUGE for summarization tasks (where capturing reference content matters) and BLEU for translation tasks (where precision of generated text matters more).