Research & Development World

  • R&D World Home
  • Topics
    • Aerospace
    • Automotive
    • Biotech
    • Careers
    • Chemistry
    • Environment
    • Energy
    • Life Science
    • Material Science
    • R&D Management
    • Physics
  • Technology
    • 3D Printing
    • A.I./Robotics
    • Software
    • Battery Technology
    • Controlled Environments
      • Cleanrooms
      • Graphene
      • Lasers
      • Regulations/Standards
      • Sensors
    • Imaging
    • Nanotechnology
    • Scientific Computing
      • Big Data
      • HPC/Supercomputing
      • Informatics
      • Security
    • Semiconductors
  • R&D Market Pulse
  • R&D 100
    • Call for Nominations: The 2025 R&D 100 Awards
    • R&D 100 Awards Event
    • R&D 100 Submissions
    • Winner Archive
    • Explore the 2024 R&D 100 award winners and finalists
  • Resources
    • Research Reports
    • Digital Issues
    • R&D Index
    • Subscribe
    • Video
    • Webinars
  • Global Funding Forecast
  • Top Labs
  • Advertise
  • SUBSCRIBE

Algorithm Combines Videos from Unstructured Camera Arrays into Panoramas

By R&D Editors | May 4, 2015

Researchers have developed an algorithm for generating panoramic video from unstructured camera arrays. Courtesy of Disney ResearchEven non-professionals may someday be able to create high-quality video panoramas using multiple cameras with the help of an algorithm developed by a team of Disney researchers. Their method smooths out the blurring, ghosting and other distortions that routinely occur when video feeds from unstructured camera arrays are combined to create a single panoramic video. The algorithm corrects for the apparent difference in position of an object caused by different camera angles — known as parallax — and image warping that occurs because of slight timing differences between cameras, both of which are known to lead to visible discontinuities, ghosting, and other imperfections in existing approaches.

The researchers have demonstrated their technique using as many as 14 various types of cameras, generating panoramic video in the order of tens to more than 100 megapixels.

“We can foresee a day when just about anyone could create a high-quality video panorama by setting up a few video cameras or even linking several smartphones, just as many people today can easily create a still photo panorama with their smartphones,” said Alexander Sorkine-Hornung, a senior research scientist at Disney Research Zürich, who collaborated with colleagues at ETH Zürich and Disney Imagineering on the study.

Their findings are being presented at EUROGRAPHICS 2015, the Annual Conference of the European Association for Computer Graphics, May 4-8, in Zürich, Switzerland.

Combining video feeds enables the creation of video panoramas beyond the resolution of any one camera. Though combining, or stitching, separate still images into one is a technique as old as photography, stitching together video feeds remains a difficult challenge due to parallax changing over time.

Though some professional methods using pre-calibrated camera arrays exist for creating video panoramas, the Disney team focused on combining videos from multiple cameras that have overlapping visual fields, but are not precisely positioned and are not perfectly synchronized.

Their technique automatically analyzes the images from the cameras to estimate the position and alignment of each camera, which eliminates the need to use special or manual calibration techniques, and allows for a flexible positioning of the cameras.

The algorithm corrects for differences in parallax that create ghosting and other disturbing effects in the areas of the panorama where images from separate cameras are stitched together. It also detects and corrects for image warping — wavy lane markings on roads, or buildings that appear to bend over — that occurs when images are stitched together. Finally, the technique also compensates for slight differences in the timing of frames between cameras, which otherwise causes jitter and other artifacts in the image.

Abstract: We describe an algorithm for generating panoramic video from unstructured camera arrays. Artifact-free panorama stitching is impeded by parallax between input views. Common strategies such as multi-level blending or minimum energy seams produce seamless results on quasi-static input. However, on video input these approaches introduce noticeable visual artifacts due to lack of global temporal and spatial coherence.

In this paper, we extend the basic concept of local warping for parallax removal. Firstly, we introduce an error measure with increased sensitivity to stitching artifacts in regions with pronounced structure. Using this measure, our method efficiently finds an optimal ordering of pair-wise warps for robust stitching with minimal parallax artifacts. Weighted extrapolation of warps in non-overlap regions ensures temporal stability, while at the same time avoiding visual discontinuities around transitions between views. Remaining global deformation introduced by the warps is spread over the entire panorama domain using constrained relaxation, while staying as close as possible to the original input views. In combination, these contributions form the first system for spatiotemporally stable panoramic video stitching from unstructured camera array input.

  • Download File “Panoramic Video from Unstructured Camera Arrays-Paper”
    [pdf, 54.33 MB]
  • Watch video: https://www.youtube.com/watch?v=SHu8x2YaQJc

Related Articles Read More >

Why IBM predicts quantum advantage within two years
Aardvark AI forecasts rival supercomputer simulations while using over 99.9% less compute
This week in AI research: Latest Insilico Medicine drug enters the clinic, a $0.55/M token model R1 rivals OpenAI’s $60 flagship, and more
How the startup ALAFIA Supercomputers is deploying on-prem AI for medical research and clinical care
rd newsletter
EXPAND YOUR KNOWLEDGE AND STAY CONNECTED
Get the latest info on technologies, trends, and strategies in Research & Development.
RD 25 Power Index

R&D World Digital Issues

Fall 2024 issue

Browse the most current issue of R&D World and back issues in an easy to use high quality format. Clip, share and download with the leading R&D magazine today.

Research & Development World
  • Subscribe to R&D World Magazine
  • Enews Sign Up
  • Contact Us
  • About Us
  • Drug Discovery & Development
  • Pharmaceutical Processing
  • Global Funding Forecast

Copyright © 2025 WTWH Media LLC. All Rights Reserved. The material on this site may not be reproduced, distributed, transmitted, cached or otherwise used, except with the prior written permission of WTWH Media
Privacy Policy | Advertising | About Us

Search R&D World

  • R&D World Home
  • Topics
    • Aerospace
    • Automotive
    • Biotech
    • Careers
    • Chemistry
    • Environment
    • Energy
    • Life Science
    • Material Science
    • R&D Management
    • Physics
  • Technology
    • 3D Printing
    • A.I./Robotics
    • Software
    • Battery Technology
    • Controlled Environments
      • Cleanrooms
      • Graphene
      • Lasers
      • Regulations/Standards
      • Sensors
    • Imaging
    • Nanotechnology
    • Scientific Computing
      • Big Data
      • HPC/Supercomputing
      • Informatics
      • Security
    • Semiconductors
  • R&D Market Pulse
  • R&D 100
    • Call for Nominations: The 2025 R&D 100 Awards
    • R&D 100 Awards Event
    • R&D 100 Submissions
    • Winner Archive
    • Explore the 2024 R&D 100 award winners and finalists
  • Resources
    • Research Reports
    • Digital Issues
    • R&D Index
    • Subscribe
    • Video
    • Webinars
  • Global Funding Forecast
  • Top Labs
  • Advertise
  • SUBSCRIBE