I ended up with the following issue https://github.com/keras-team/keras-core/issues/774
Currently a warning is given but what is the solution or workaround?
ValueError: Exception encountered when calling Conv3DTranspose.call().
The padding arguments (padding=same) and output_padding=1) lead to a Torch output_padding (1) that is greater than strides (1). This is not supported. You can change the padding arguments, kernel or stride, or run on another backend.
Arguments received by Conv3DTranspose.call(): • inputs=torch.Tensor(shape=torch.Size([16, 96, 6, 6, 128]), dtype=float32)