PERSONAL Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.
Steered-Mixtures-of-Experts (SMoE) present a unified framework for sparse representation and compression of image data with arbitrary dimensionality. Recent work has shown great improvements in the performance of such models for image and light-field representation. However, for the case of videos the straight-forward application yields limited success as the SMoE framework leads to a piece-wise linear representation of the underlying imagery which is disrupted by nonlinear motion. We incorporate a global motion model into the SMoE framework which allows for higher temporal steering of the kernels. This drastically increases its capabilities to exploit correlations between adjacent frames by only adding 2 to 8 motion parameters per frame to the model but decreasing the required amount of kernels on average by 54.25%, respectively, while maintaining the same reconstruction quality yielding higher compression gains. By halving the number of necessary kernels, we achieve a significant reduction in complexity on the decoder side being a crucial step towards real-time processing.
Rolf Jongebloed,Erik Bochinski, andThomas Sikora
"Sparse video representation using steered mixture-of-experts with global motion compensation", Proc. SPIE 12571, Real-time Processing of Image, Depth and Video Information 2023, 125710J (7 June 2023); https://doi.org/10.1117/12.2665600
ACCESS THE FULL ARTICLE
INSTITUTIONAL Select your institution to access the SPIE Digital Library.
PERSONAL Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.
The alert did not successfully save. Please try again later.
Rolf Jongebloed, Erik Bochinski, Thomas Sikora, "Sparse video representation using steered mixture-of-experts with global motion compensation," Proc. SPIE 12571, Real-time Processing of Image, Depth and Video Information 2023, 125710J (7 June 2023); https://doi.org/10.1117/12.2665600