Stack Overflow
Stack Overflow

Questions tagged [yardstick]

Use this tag for questions relating to Yardstick, an open-source framework package for writing benchmarks.

Yardstick is an open-source framework package by GridGain Systems for writing benchmarks, and specifically writing benchmarks for clustered or otherwise distributed systems.

More information can be found at Yardstick GitHub and the GridGain website.

25 questions
1
vote
2 answers

R-package development using travis CI gets error due to failing to install dependency package

In RStudio, I'm using usethis::use_travis() and TRAVIS CI with Github. However, my package cannot build because yardstick 0.0.7 cannot build. Note that my package can build locally with both rcmdcheck() and devtools::check(); and my package is not…
Oscar Kjell
  • 1,599
  • 10
  • 32
1
vote
0 answers

How to store the output of Yardstick command in Python variable?

I have written the below script to store the output of yardstick command into a variable(output) and display the value of variable. The script is executing fine and the results are displayed in the console. After executing the script, I want to…
Karthika
  • 109
  • 2
  • 3
  • 6
0
votes
1 answer

How do we calculate multiclass probabilities in yardstick?

I have a multiclass classification problem and want to build a precision-recall curve using pr_curve from yardstick library in R. This function requires that a tibble with probabilities for each class were fed to it, like this (this is…
LocusClassicus
  • 55
  • 9
0
votes
0 answers

tidymodels not treating first factor level as positive class

I am having an issue with tidymodels that I can't seem to figure out. Not sure if this is the intended behavior or an issue, but either way I would appreciate any help! I am building a logistic regression prediction model with a two-level factor as…
out_of_step
  • 1
  • 1
0
votes
1 answer

Is there a way to create a custom metric for use with tune_grid() in tidymodels that allows for a grouped data.frame/tibble?

What I'd like to do I am trying to build a model in tidymodels that will predict the efficacy of drugs on cell lines (like bacteria). The model will rank drugs by efficacy for a given cell line, so I want to use Spearman's correlation (ρ) as a…
perdedorium
  • 41
  • 4
0
votes
1 answer

Error in rmse(., truth = variable, estimate = .pred) : unused arguments (truth = , estimate = .pred) in R Tidymodels (yardstick)

I am Fitting a regression tree model, using this Tidymodels tutorial. # Create a specification tree_spec <- decision_tree() %>% set_engine("rpart") # Create an engine reg_tree_spec <- tree_spec %>% set_mode("regression") # Fit the…
Anakin Skywalker
  • 2,400
  • 5
  • 35
  • 63
0
votes
0 answers

class probability column for yardstick::roc_cruve

I have a doubt regarding the column to pass when calling roc_curve. If you look at the example provided at https://www.tidymodels.org/start/recipes/#predict-workflow you can see that the argument provided is .pred_late. flights_pred %>% …
Jorge
  • 137
  • 4
0
votes
1 answer

How to add beta parameter to F1 Score for fit_resample in TidyModel

I am using the fit_resamples() function in TidyModels to get the F1 metrics as below. I would like to know how to pass the beta parameter whose default is set at 1 at the moment. glm_workflow %>% fit_resamples(resamples = trainDatFolds, …
Zarni
  • 109
  • 6
0
votes
1 answer

how to pass a tibble to caret::confusionmatrix()?

Consider this simple example: data_frame(truth = c(1,1,0,0), prediction = c(1,0,1,0), n_obs = c(100,10,90,50)) # A tibble: 4 x 3 truth prediction n_obs 1 1 1 100 2 1 0 …
ℕʘʘḆḽḘ
  • 18,566
  • 34
  • 128
  • 235
0
votes
1 answer

Apache Ignite and Yardstick

Is there anybody who can explain me about Apache Ignite and Yardstick? To my knowledge, Yardstick is a benchmark tool of Apache Ignite. I know how to run Apache Ignite and how to set its memory capacity. (I know the default is 1 GB) When I ran…
Taejoon Kim
  • 1
  • 2
1
2