Real-time Omnidirectional Plenoptic Vision

摘要

Mimicking the multi-faceted insect eye is a challenging target that offers the promise of omnidirectional vision reconstruction, as well as bio-inspired realization of various algorithms such as movement detection, attention attraction, and navigation. A multi-aperture vision sensor system has been conceived consisting of a layered arrangement of multiple commercial cameras over a hemispherical surface. A dedicated hardware architecture is presented that enables recording and omnidirectional image reconstruction of the light field in real-time. The proposed system is scalable, and prototypes ranging from 40mm, through 12.9cm and 57cm in diameter and accommodating 15, 44 through 49 cameras are presented. The hardware architecture enabling the capture and processing of images is implemented into one or several FPGA platforms that enable the image acquisition and reconstruction.