Stitching video streams captured by multi-UAVs with stabilization

Qinglin He; Huaqiang Wu; Xuguang Wang; Nanyun Li

doi:10.1117/12.2524245

6 May 2019 Stitching video streams captured by multi-UAVs with stabilization

Qinglin He, Huaqiang Wu, Xuguang Wang, Nanyun Li

Proceedings Volume 11069, Tenth International Conference on Graphics and Image Processing (ICGIP 2018); 110690E (2019) https://doi.org/10.1117/12.2524245
Event: Tenth International Conference on Graphic and Image Processing (ICGIP 2018), 2018, Chengdu, China

Abstract

A novel video stitching algorithm is proposed which stitches video streams captured by multi-UAVs into panorama video streams. Each UAV captures one video streams, there are independent shakiness and parallax between each temporally aligned frames. A pure 2D homography does not have the capability to solve parallax like spatial-variant homographies, where each input video frame is sliced into grids and each grid is transformed with a local 2D homography. Video stitching has to consider video stabilization due to strong temporal correlations between frames. Video stitching and stabilization are combined, since they are both about putting the grids from video sources into panorama properly. Good stitching results are generated by optimizing the camera paths which describe the grid transformation between girds of frames before and after. In 4 aspects they are optimized: 1) spatially with the grids around, 2) temporally with the grid at the same place from before and after frames, 3) geometrically with the grids from another video, 4) reliably not too far from the original transformations. We focus on video stream processing which does not need the whole video frames, only 7 frames later than the input, state-of-the-art results are generated.

Citation Download Citation

Qinglin He, Huaqiang Wu, Xuguang Wang, and Nanyun Li "Stitching video streams captured by multi-UAVs with stabilization", Proc. SPIE 11069, Tenth International Conference on Graphics and Image Processing (ICGIP 2018), 110690E (6 May 2019); https://doi.org/10.1117/12.2524245

ACCESS THE FULL ARTICLE

INSTITUTIONAL
Select your institution to access the SPIE Digital Library.

SELECT YOUR INSTITUTION

PERSONAL
Sign in with your SPIE account to access your personal subscriptions or to use specific features such as save to my library, sign up for alerts, save searches, etc.

PERSONAL SIGN IN

No SPIE Account? Create one

PURCHASE THIS CONTENT

SUBSCRIBE TO DIGITAL LIBRARY

50 downloads per 1-year subscription

Members: $195

Non-members: $335 ADD TO CART

25 downloads per 1 - year subscription

Members: $145

Non-members: $250 ADD TO CART

PURCHASE SINGLE ARTICLE

Includes PDF, HTML & Video, when available