pyrouge is a python wrapper for the original perl script. TO use it, you need do the following steps:

1. Get the tools/ROUGE-1.5.5

git clone https://github.com/andersjo/pyrouge.git

2. Install pyrouge package

either

pip install pyrouge

or install from local

https://github.com/bheinzerling/pyrouge.git

3. Set path to ROUGE-1.5.5 (the git folder in step 1)

pyrouge_set_rouge_path /absolute/path/to/ROUGE-1.5.5/

4. Possible errors

Cannot open exception db file for reading: data/WordNet-2.0.exc.db

You can run the following:

cd /home/yzhao/soft/ROUGE-1.5.5/RELEASE-1.5.5/data
rm WordNet-2.0.exc.db
./WordNet-2.0-Exceptions/buildExeptionDB.pl ./WordNet-2.0-Exceptions ./smart_common_words.txt ./WordNet-2.0

Illegal division by zero at ./ROUGE-1.5.5.pl line 2450.

That could be the txt contains tokens not allowed such as "<", "<unk>".