Questions tagged [encoder-decoder]
184 questions
0
votes
0 answers
JSON isinstance decoder is only decoding the strings to numbers, but not dates
I have a JSON file that has dates and integers in them. All of them are showing as strings. I used a JSON decoder to get the strings parsed into integers, but I am having issues getting the date strings into actual date format. My JSON file is…
Alphanum3ric
- 39
- 10
0
votes
0 answers
How to calculate the f score for seq2seq model for grammar correction?
I am building a seq2seq model for grammar correction, and I want to calculate F score for my model. But I don’t know how ? Can you help me please
In the evaluation loop I am only calculating the loss, what do I need the model to output so I can use…
0
votes
1 answer
T5Tokenizer and T5EncoderModel are used to encode sentences then nn.TransformerDecoder to decode to a 2-label tensor. It gives error
Used T5Tokenizer to tokenize a sentence then T5EncoderModel to encode. Finally, used the pytorch nn.TransformerDecoder to decode it. The target vector is a torch.tensor [y1, y2] where y1 and y2 have binary value. But it returns an error…
rana
- 69
- 1
- 8
0
votes
0 answers
Bert Config: Num attention heads
I am using the BertConfig() to create a encoder decoder model in the following way:
encoder = BertConfig()
decoder = BertConfig()
config = EncoderDecoderConfig.from_encoder_decoder_configs(encoder, decoder)
bert2bert =…
Ritu Gahir
- 33
- 3
0
votes
0 answers
Multivariate Encoder-Decoder Model approaches value
I am creating my first multivariate multistep encoder-decoder LSTM to forecast revenues.
As you can see, the values move towards a value and then stop at that value. The aim is to create a forecast for a longer period, but there is no deviation at…
J.K.
- 236
- 3
- 5
0
votes
1 answer
when use conv and deconv, the out put shape does not math(The input image's weight is odd)
such as the input shape=[1,64,12,60,33]
when i use
nn.Conv3d(in_channels=128, out_channels=64, kernel_size=(3, 3, 3), stride=2, padding=1)
the out put shape =[1,64,6,30,17]
after that i want to let the output return to [1,64,12,60,33]
but when i…
Truman
- 1
- 1
0
votes
1 answer
Predicting word vectors instead of words (Natural Language Processing)
I wonder whether there are any attempts to predict word embedding vectors as targets in neural networks architectures (like Transformers, Sequence-to-Sequence-Models or simple RNNs) using for example mean squared errors as a loss-function instead of…
Jochen
- 1
- 2
0
votes
0 answers
Loss value + output of encoder-decoder LSTM network return NaN - TensorFlow 2.x
I'm currently training a seq2seq encoder-decoder network powered by LSTM in TensorFlow 2.x. The main problem right now is the loss approaches to NaN and the prediction returned are all NaN as well. I understand the possibility of exploding/vanishing…
YoYo
- 1
- 1
0
votes
1 answer
Netty decoder is infinitely looping
First time working with Netty here, I'm having a bug with my ByteToMessageDecoder class and I'm not able to figure out what's going wrong.
I'm repeatedly sending a fixed length packet from my client to the server like so:
public void…
Anderson T
- 3
- 1
0
votes
0 answers
Training Autoencoder Latent space with custom properties
I trained an autoencoder with 16 latent dimensions on an input of 21*18 matrix and it worked well. However the latent space is not in my control as in, I cannot have each node represent a property i want it to represent.
I was looking for ideas and…
Aditya Vartak
- 380
- 1
- 13
0
votes
1 answer
building an autoencoder network for parameter predictions
I am new to the machine learning domain. I have a 1d signal in the first column and its corresponding frequency, mean_amplitude, and a time is saved in second column of a file: These are the input-output pairs for supervised training i.e. for a…
manas
- 479
- 2
- 14
0
votes
1 answer
Prediction for pretrained model on handwritten text(images)-Pytorch
I have a problem making a prediction using a pre-trained model that contains an encoder and decoder for handwritten text recognition.
What I did is the following:
checkpoint =…
Imen Bouzidi
- 23
- 5
0
votes
1 answer
How can I add code to visualize the model? my model has encoder-decoder architecture
How can I add code to visualize the model? I tried to use plot() function. It keeps give me errors to determine initial data. I tried to build the code without functions but with no any improvement. The same error still exists. Kindly, I need a code…
ahmadnazeeh
- 3
- 2
0
votes
0 answers
3D CNN Model only outputs positive values
I am using 3D Encoder-Decoder model. My input to the model is a 3D grid with added noise. The values contained in the grid are both positive and negative. I want to denoise the model. I don’t know why but my model outputs only positive value. I am…
Rajat
- 1
- 3
0
votes
0 answers
RuntimeError on running ALBERT for obtaining encoding vectors from text
I’m trying to get feature vectors from the encoder model using pre-trained ALBERT v2 weights. i have a nvidia 1650ti gpu (4 GB) , and sufficient RAM(8GB) but for some reason I’m getting Runtime error saying -
RuntimeError: [enforce fail at…
puranjay mishra
- 1
- 1