Patch-Based High Dynamic Range Video


Proceedings of SIGGRAPH Asia 2013

ACM Transactions on Graphics (TOG)
Vol. 32, No. 6, November 2013

     Nima Khademi Kalantari1          Eli Shechtman2          Connelly Barnes2,3          Soheil Darabi2     
     Dan B Goldman2          Pradeep Sen1     


1 University of California, Santa Barbara         2 Adobe         3 University of Virginia      

Abstract

Despite significant progress in high dynamic range (HDR) imaging over the years, it is still difficult to capture high-quality HDR video with a conventional, off-the-shelf camera. The most practical way to do this is to capture alternating exposures for every LDR frame and then use an alignment method based on optical flow to register the exposures together. However, this results in objectionable artifacts whenever there is complex motion and optical flow fails. To address this problem, we propose a new approach for HDR reconstruction from alternating exposure video sequences that combines the advantages of optical flow and recently introduced patch-based synthesis for HDR images. We use patch-based synthesis to enforce similarity between adjacent frames, increasing temporal continuity. To synthesize visually plausible solutions, we enforce constraints from motion estimation coupled with a search window map that guides the patch-based synthesis. This results in a novel reconstruction algorithm that can produce high-quality HDR videos with a standard camera. Furthermore, our method is able to synthesize plausible texture and motion in fast-moving regions, where either patch-based synthesis or optical flow alone would exhibit artifacts. We present results of our reconstructed HDR video sequences that are superior to those produced by current approaches.

The Video

Patch-Based High Dynamic Range Video

Paper and Additional Materials

Bibtex

@article{HDRVideo,

author = {Nima Khademi Kalantari and Eli Shechtman and Connelly Barnes and Soheil Darabi

and Dan B Goldman and Pradeep Sen},

title = {{Patch-based High Dynamic Range Video}},

journal = {ACM Transactions on Graphics (TOG) (Proceedings of SIGGRAPH Asia 2013)},

volume = {32},

number = {6},

year = {2013},

}





The information (source code, data sets, etc.) provided on this website is for non-commercial, research purposes only. For commercial inquiries regarding the HDR video reconstruction algorithm presented in this paper, please contact Mr. Christopher Del Vecchio at the UCSB technology and alliances office. His telephone number is (805) 893-5209 and email address is delvecchio@tia.ucsb.edu.

This page contains documents, source code, videos and other files that could be protected by copyright. They are provided here for reasonable academic fair use. Interested parties are referred to the official published version of the documents which are available from the copyright holder through the external link.

This material is based upon work supported by the National Science Foundation under Grants No. IIS-1342931 and IIS-1321168.

Any opinions, findings, and conclusions or recommendations expressed in this material are those of the author(s) and do not necessarily reflect the views of the National Science Foundation.