Novel highly efficient deep learning framework for reconstructing dynamical systems from *multimodal* data incl. discrete random var.: https://arxiv.org/abs/2212.07892
Clever combination of a multimodal VAE+Teacher Forcing+RNN outperforms everything else we tested.
Manuel Brenner will present this at #aaai WS on #MLmDS.