access to numbers in classification_report - sklearn

Question

This is a simple example of classification_report in sklearn

from sklearn.metrics import classification_report
y_true = [0, 1, 2, 2, 2]
y_pred = [0, 0, 2, 2, 1]
target_names = ['class 0', 'class 1', 'class 2']
print(classification_report(y_true, y_pred, target_names=target_names))
#             precision    recall  f1-score   support
#
#    class 0       0.50      1.00      0.67         1
#    class 1       0.00      0.00      0.00         1
#    class 2       1.00      0.67      0.80         3
#
#avg / total       0.70      0.60      0.61         5

I want to have access to avg/total row. For instance, I want to extract f1-score from the report, which is 0.61.

How can I have access to the number in classification_report?

are you interested in the f1-score or extracting f1-score from classification report? — Pratik Kumar, Jan 24 '18 at 08:35
@PratikKumar extracting from classification report. I need other reports also. — Hadij, Jan 24 '18 at 08:41

score 23 · Accepted Answer · edited Mar 21 '23 at 17:46

You can output the classification report by adding output_dict=True to the report:

report = classification_report(y_true, y_pred, output_dict=True)

And then access its single values as in a normal python dictionary.

For example, the macro metrics:

macro_precision =  report['macro avg']['precision'] 
macro_recall = report['macro avg']['recall']    
macro_f1 = report['macro avg']['f1-score']

or Accuracy:

accuracy = report['accuracy']

Pratik Kumar · Answer 2 · 2018-04-17T14:12:50.513

21

you can use precision_recall_fscore_support for getting all at once

from sklearn.metrics import precision_recall_fscore_support as score
y_true = [0, 1, 2, 2, 2]
y_pred = [0, 0, 2, 2, 1]
precision,recall,fscore,support=score(y_true,y_pred,average='macro')
print 'Precision : {}'.format(precision)
print 'Recall    : {}'.format(recall)
print 'F-score   : {}'.format(fscore)
print 'Support   : {}'.format(support)

here is the link to the module

edited Apr 17 '18 at 14:12

answered Jan 24 '18 at 08:47

Pratik Kumar

2,211
1
17
41

2

The answer is correct, but please note that you have used the wrong parameters, since the first parameter is `y_true`, the second one should be `y_pred`. – Martin Seeler Apr 16 '18 at 11:33
Does this also work for multi-class datasets? – Hansel Palencia Jan 08 '21 at 15:31

score 9 · Answer 3 · answered Mar 04 '19 at 18:05

9

You can use output_dict parameter in build-in classification_report to return a dictionary:

classification_report(y_true,y_pred,output_dict=True)

answered Mar 04 '19 at 18:05

Gamugo

121
1
2

score 5 · Answer 4 · answered Jan 24 '18 at 08:36

5

classification_report is string so I would suggest you to use f1_score from scikit-learn

from sklearn.metrics import f1_score
y_true = [0, 1, 2, 2, 2]
y_pred = [0, 0, 2, 2, 1]
target_names = ['class 0', 'class 1', 'class 2']

print(f1_score(y_true, y_pred, average=None)

output

answered Jan 24 '18 at 08:36

Sociopath

13,068
19
47
75

Thank you. so there is no way to extract from classification_report? what about the other reports? – Hadij Jan 24 '18 at 08:40
maybe you can use regex to extract this value. can you name the other reports ? – Sociopath Jan 24 '18 at 08:43
If you are talking about recall and precision, yes there are functions like recall_score and precision_score in sklearn – Sociopath Jan 24 '18 at 08:45

access to numbers in classification_report - sklearn

4 Answers4