Turns out there is no such operation as deconvolution in MPS. The closest analogue in tensorflow is conv2d_transpose.
Is it possible to sort of plug-in custom operations between MPS default operations?
MPS now provides MPSCNNConvolutionTranspose in macOS X.13 and tvOS/iOS 11.