boot.ci() can't compute confidence intervals for F1 score

Question

I am trying to compute confidence intervals for F1 score using the boot package in R. But it doesn't seem to work and I am not sure why.

library(MLmetrics)
fci<-function(data,indices,x,y){
   d<-data[indices,]
   r<-F1_Score(x,y)
   r
}
set.seed(12345)
bootout<-boot(data=test,
              x=test$jbz,
              y=test$`DR_ai+jd`,
              R=2000,
              statistic=fci
              )
boot.ci(bootout)

Error:

[1] "All values of t are equal to  0.996637873066777 \n Cannot calculate confidence intervals"
NULL

score 0 · Accepted Answer · answered Nov 28 '20 at 14:36

library(MLmetrics)
library(boot)
set.seed(12345)
fci<-function(data,indices,x,y){
   d<-as.data.frame(data[indices,])
   r<-F1_Score(d[,1],d[,2],positive=1)
   r
}

bootout<-boot(data=test,
              x=test$jbz,
              y=test$`DR_ai+jd`,
              R=2000,
              statistic=fci
              )
boot.ci(bootout,type="basic")
F1_Score(y_true = test$jbz, y_pred = test$`DR_ai+jd`,positive="1")

this works well~~

boot.ci() can't compute confidence intervals for F1 score

1 Answers1