Questions tagged [mlp]

Tag for questions about Multi layer perceptrons (MLP). It is a class of feedforward artificial neural network. Multilayer perceptrons are sometimes colloquially referred to as "vanilla" neural networks, especially when they have a single hidden layer

275 questions
1
vote
1 answer

MLPRegressor gives very negative scores

I'm kind of new to machine learning and I am using MLPRegressor. I split my data with X_train, X_test, y_train, y_test = train_test_split(X, y, test_size=0.2, random_state=42) then I make and fit the model, using 10-fold validation for test…
Don
  • 11
  • 2
1
vote
2 answers

Very low performance even after oversampling dataset

I'm using an MLPClassifier for classification of heart diseases. I used imblearn.SMOTE to balance the objects of each class. I was getting very good results (85% balanced acc.), but i was advised that i would not use SMOTE on test data, only for…
1
vote
0 answers

How to see overfitting in MLPRegressor with scikit-learn?

I am trying to use a MLPRegressor for multi-variate regression problem. I want to know how can I see if there is overfitting while training? I am able to access the training loss loss_curve_ and the validation scores using validation_scores_, but I…
Sagnik
  • 71
  • 5
1
vote
1 answer

By which technique adapted to time-series can I replace cross-validation in my Keras MLP regression model in Python

I'm currently working with a time series dataset of 46 lines about meteorological measurements on approximately each 3 hours by day during one week. My explanatory variables (X) is composed of 26 variables and some variable has different units of…
JEG
  • 154
  • 1
  • 15
1
vote
0 answers

Setting Multiple Attribute as Class Attribure in Weka Java API for MLP Model

I'm working on single-label multi-class classification task using weka API. I want to train one Multilayer Perceptron model to predict the class percentage values for each class by generating one-hot encoded columns from my class attribute…
1
vote
2 answers

Ways to limit output of NN regression problem in certain limit(i.e. I want my NN to always predict output values only between -20 to +30)

I am training NN for the regression problem. So the output layer has a linear activation function. NN output is supposed to be between -20 to 30. My NN is performing good most of the time. However, sometimes it gives output more than 30 which is not…
jd95
  • 404
  • 6
  • 14
1
vote
2 answers

What does it mean by the prediction results in WEKA?

I'm doing classification using SVM and MLP in WEKA. I have managed to make WEKA produce the result in a csv file. However, I could not understand the prediction results being displayed. For example, actual result 2:1, predicted result 1:0. Can…
Falady
  • 124
  • 1
  • 15
1
vote
0 answers

Regularization (L1, L2, L1_L2) for Regression with MLP in R

for my homework I need to write a regression model of the Boston housing data using MLP as learner and apply regularization (l1 - lasso, l2 - ridge, l1_l2 - elastic net). I found the keras package and some information on classification problems,…
MLU
  • 59
  • 7
1
vote
1 answer

SkikitLearn learning curve strongly dependent on batch size of MLPClassifier ??? Or: how to diagnose bias/ variance for NN?

I am currently working on a classification problem with two classes in ScikitLearn with the solver adam and activation relu. To explore if my classifier suffers from high bias or high variance, I plotted the learning curve with Scikitlearns build-in…
S.Maria
  • 131
  • 2
  • 11
1
vote
1 answer

Spark MultilayerPerceptronClassifier Class Probabilities

I am an experienced Python programmer trying to transition some Python code to Spark for a classification task. This is my first time working in Spark/Scala. In Python, both Keras/tensorflow and sci-kit Learn neural networks do a great job on the…
RKB
  • 73
  • 1
  • 11
1
vote
0 answers

Is it possible to assign a cost matrix while training MLPClassifier in scikitlearn ?

I try to find an answer about whether or not it is possible to assign a cost matrix while training a neural network with MLPClassifier, but I did not. I have an imbalanced dataset; 90% of my data are class A and 10% are class B. Moreover, I am more…
Jagr
  • 363
  • 5
  • 16
0
votes
0 answers

How can we train Multi Layer Perceptron(MLP) model with type float-16, float-8 and int8 through Pytorch?

Currently, I am training an MLP using the float32 data type. I also attempted to train the MLP using the float-16 data type by utilizing Half(), but it resulted in a NAN error. Could someone please assist me in providing the PyTorch code for…
Lucky
  • 1
  • 1
0
votes
0 answers

retrieve the weights in the input layer associated to a certain feature (pytorch)

As I said in the title I want to know which weights in the first layer of my mlp model are connected to a certain freature. So let's say that i have an ordered list of feature names feature_names = data.feat_names and a matrix with a shape (number…
0
votes
0 answers

Transfer MLP Classifier

I have this MLP classifier with four hidden layers (f1, fc2, fc3, outputLayer), I want to transfer the model parameters but want to add two new layers starting from fc3. SO i created TransferMLP class. in here, Just picked the fc3 layer and then…
ddq
  • 16
  • 3
0
votes
1 answer

why does my neural network coded from scratch results have such a weird loss trend?

I am developing neural network from scratch. It consists of of the following input > layer1(sigmoid) > layer2 > output(softmax). The basic coding is complete but when I ran it, I obtain a weird loss plot. Also if I ran the code for large iterations…