In autoencoder structure, when encoder side (deformable conv. layers) and decoder side (transposed deformable(?) conv. layers) are seperated, i want to inform the decoder about the offsets used in the encoder side. Desiring result is for the decoder to perform inverse(like) transform of the encoder's deformable convolution layers.
Has anyone ever thought about this?
Thank you in advance.