How Video Stitching Works



Most Video-Stitching software are automated and only require the click of a button to run your 360 degree videos and photos through the entire process of stitching together and blending out remaining errors. Software such as PTGui and Kolor Autopano Video use complex mathematical equations to figure out where everything goes so we don’t have to. In this article, I’ll break down the programming process of stitching. There are multitude of tutorial videos that will give you a better idea of how to stitch together your videos. I recommend taking a look at those after reading about finer details of video stitching,

A Complex Process

There are three main steps to stitching a 360 degree video or image.

The first step is Image Registration. Here, the program looks for similar spots or points in a set of images to minimize image overlap and match up the photos. These “spots” are called control points and they are essential to creating a seamless video. Numerous algorithms are utilized to carry this out.

Calibration, the next major step, takes the control points that were identified during Inage Registration to align sets of images together. The viewpoint of one image will be matched to that of another by adopting new coordinates. The program uses various forms of geometric translation and rotation to change the viewpoint of the image. Calibration also minimizes differences in photos caused by exposure, optical distortions, and other issues that might arise.

Blending is the last step in the stitching process and it executes the adjustments that were began in the second phase. It smooths out problem areas such as ghosting, exposure and color differences, and makes seam line adjustments.


Finally, the panoramic photography is placed on a specific panoramic projection option. The one you choose will depend on which type of panorama you have and which features you want to highlight. For example, if you have an architectural scene, you might want to use rectilinear projection. A cylindrical projection is suitable for 360 degree panoramas. If you want to capture a fully spherical panorama, use the equirectangular projection.

360 Videos

Here are some awesome 360 degree videos that turned out perfectly.