Questions tagged [prediction]

For questions related to statistical prediction, especially for programming tasks.

In science, a prediction is a rigorous, often quantitative, statement, forecasting what will happen under specific conditions; for example, if an apple falls from a tree it will be attracted towards the center of the earth by gravity with a specified and constant acceleration. The scientific method is built on testing assertions that are logical consequences of scientific theories. This is done through repeatable experiments or observational studies.

Mathematical equations and models, and computer models (e.g., ), are frequently used to describe the past and future behaviour of a process within the boundaries of that model.

In microprocessors, permits avoidance of pipeline emptying at branch instructions. In engineering, possible failure modes are predicted and avoided by correcting the mechanism causing the failure.

2846 questions
21
votes
3 answers

How to train a RNN with LSTM cells for time series prediction

I'm currently trying to build a simple model for predicting time series. The goal would be to train the model with a sequence so that the model is able to predict future values. I'm using tensorflow and lstm cells to do so. The model is trained with…
Jakob
  • 369
  • 1
  • 3
  • 11
19
votes
1 answer

Subscript out of bounds (Caret variable importance for randomForest)

I have trained a model in R: require(caret) require(randomForest) myControl = trainControl(method='cv',number=5,repeats=2,returnResamp='none') model2 = train(increaseInAssessedLevel~., data=trainData, method = 'rf', trControl=myControl) The dataset…
Jakub Langr
  • 617
  • 1
  • 6
  • 18
18
votes
2 answers

Incremental training of ALS model

I'm trying to find out if it is possible to have "incremental training" on data using MLlib in Apache Spark. My platform is Prediction IO, and it's basically a wrapper for Spark (MLlib), HBase, ElasticSearch and some other Restful parts. In my app…
18
votes
3 answers

Predicting missing values with scikit-learn's Imputer module

I am writing a very basic program to predict missing values in a dataset using scikit-learn's Imputer class. I have made a NumPy array, created an Imputer object with strategy='mean' and performed fit_transform() on the NumPy array. When I print…
xennygrimmato
  • 2,646
  • 7
  • 25
  • 47
17
votes
8 answers

Predict next event occurrence, based on past occurrences

I'm looking for an algorithm or example material to study for predicting future events based on known patterns. Perhaps there is a name for this, and I just don't know/remember it. Something this general may not exist, but I'm not a master of math…
anonymous coward
  • 12,594
  • 13
  • 55
  • 97
17
votes
2 answers

Incorporating user feedback in a ML model

I have developed a ML model for a classification (0/1) NLP task and deployed it in production environment. The prediction of the model is displayed to users, and the users have the option to give a feedback (if the prediction was right/wrong). How…
17
votes
5 answers

What is the difference between classification and prediction?

What is the difference between classification and prediction in machine learning?
James
  • 181
  • 1
  • 1
  • 4
17
votes
1 answer

What does negative %IncMSE in RandomForest package mean?

I used RandomForest for a regression problem. I used importance(rf,type=1) to get the %IncMSE for the variables and one of them has a negative %IncMSE. Does this mean that this variable is bad for the model? I searched the Internet to get some…
mql4beginner
  • 2,193
  • 5
  • 34
  • 73
17
votes
3 answers

Neural network and algorithm(s), predicting future outcome from past

I was working on a algorithm, where I am given some input and I am given output for them, and given the output for 3 months (give or take) I need a way to find/calculate what might be the future output. Now, this problem given can be related to…
Razort4x
  • 3,296
  • 10
  • 50
  • 88
16
votes
1 answer

Difference between predict vs predict_proba in scikit-learn

Suppose I have created a model, and my target variable is either 0, 1 or 2. It seems that if I use predict, the answer is either of 0, or 1 or 2. But if I use predict_proba, I get a row with 3 cols for each row as follows, for example model =…
15
votes
4 answers

What are some good approaches to predicting the completion time of a long process?

tl;dr: I want to predict file copy completion. What are good methods given the start time and the current progress? Firstly, I am aware that this is not at all a simple problem, and that predicting the future is difficult to do well. For context,…
Cam Jackson
  • 11,860
  • 8
  • 45
  • 78
15
votes
6 answers

How to predict when next event occurs based on previous events?

Basically, I have a reasonably large list (a year's worth of data) of times that a single discrete event occurred (for my current project, a list of times that someone printed something). Based on this list, I would like to construct a statistical…
ankushg
  • 1,632
  • 4
  • 17
  • 22
15
votes
1 answer

R: how to make a confusion matrix for a predictive model?

I have a dataframe. first column contains my the predictive score (range from 0 to 100, smaller values is expected to be in class A, larger values is expected to be in class B) for my model, 2nd column contains the real classification of the…
user2718
  • 449
  • 1
  • 7
  • 13
15
votes
4 answers

How to obtain filenames during prediction while using tf.keras.preprocessing.image_dataset_from_directory()?

Keras introduced tf.keras.preprocessing.image_dataset_from_directory function recently, which is more efficient than previously ImageDataGenerator.flow_from_directory method in tensorflow 2.x. I am practising on the catsvsdogs problems and using…
J.Kim
  • 151
  • 1
  • 3
15
votes
3 answers

Pybrain time series prediction using LSTM recurrent nets

I have a question in mind which relates to the usage of pybrain to do regression of a time series. I plan to use the LSTM layer in pybrain to train and predict a time series. I found an example code here in the link below Request for example:…
dnth
  • 879
  • 2
  • 12
  • 22