FICS Course on Computational Imaging Algorithms for Light-Field Acquisition, Processing and Visualization
Organized by the Finnish Doctoral Programme in Computational Sciences, the PROLIGHT Marie Curie IAPP Action and 3D Media Group at the Department of Signal Processing, Tampere University of Technology
November 27-29, 2013 at Tampere University of Technology
The course addresses computational imaging aspects of sensing 3D visual scenes by multi-camera setups, their light-field and multi-view multi-depth representations and related processing, and their visualization through modern 3D displays. More specifically, the course addresses the problems of multi-camera rectification and disparity estimation, as well as scene representations ranging from pure image-based, such as Epipolar-Plane Image (EPI) based, to multi-view multi-depth based. Ray interpolation and view rendering techniques are discussed along with production rules for generating correct stereoscopic 3D and techniques for generating visual effects out of multi-camera data. Principles of operation of 3D displays are reviewed and Fourier domain analysis of such displays is presented.
Instructors: Frederik Zilly, Fraunhofer IIS, Germany and Dr. Robert Bregovic, Holografika, Hungary and Tampere University of Technology, Finland
Schedule:
Wednesday, 27 November
Room: TB 224
12:00 – 12:15 Opening the course (Atanas Gotchev)
12:15 – 14:00 Lecture 1: Multi-camera 3D scene sensing (Frederik Zilly).
– Feature-Point-Based Multi-Camera Rectification
– Multi-Camera Disparity Estimation
14:00 – 14:15 Coffee break
14:15 – 16:00 Lecture 2: Light field representations (Robert Bregovic)
– Epipolar-plane image representation
– Light field analysis in Fourier domain
Thursday, 28 November
Room: TB 216
09:15 – 11:00 Lecture 3: Processing of multi-camera data (Frederik Zilly)
– View Rendering / Depth Image Based Rendering
– Visual Effects using Multi-Camera Data: Matrix-Effect, Vertigo-Effect, Synthetic Aperture
11:00 – 12:45 Lunch break
12:45 – 14:15 Lecture 4: 3D displays (Robert Bregovic)
– 3D displays: principles of operation
– Analysis of 3D displays in Fourier domain;
Friday, 29 November
Room: TB 216
09:15 – 11:00 Lecture 5: High-quality Stereoscopic 3D (Frederik Zilly)
– Production Rules for visually pleasant Stereoscopic 3D;
11:00 – 11:15 Instructions for writing the reports and closing the school (Atanas Gotchev)
Credits and grading
2-4 cr; pass/fail
2cr requirements: Attendance, literature survey and four-six pages report on a particular topic agreed with the instructors.
1-2 additional credits: A more extensive study on a particular algorithm agreed with the instructor, including a software implementation (Matlab or C); presentation and a final report with test results.
Administration
Registration: Susanna Anttila susanna.anttila@tut.fi
Send an email to the department secretary Ms Susanna Anttila with the following information:
– Name, affiliation, student number
– Are you a FICS student?
– Do you have any dietary requirements?
Registration deadline: 25.11.2013
Additional information: Atanas Gotchev atanas.gotchev@tut.fi (course organizer) and Ella Bingham ella.bingham@aalto.fi (FICS coordinator)
FICS students will have preference in registration if participation needs to be limited and non-FICS students will be admitted in the order of their registration request.
Bios of course instructors:
Frederik Zilly is Head of the group Computational Imaging and Algorithms in the Moving Picture Department of Fraunhofer IIS in Erlangen, Germany. He has received the Diploma degree in physics from Free University of Berlin, Germany, in 2006. Before joining Fraunhofer IIS, he was Scientific Project Manager in the Immersive Media & 3-D Video Group in the Image Processing Department at Fraunhofer HHI in Berlin where he was involved in several German and European research projects related to 3DTV. In this function he was mainly responsible for the development of the Stereoscopic Analyzer (STAN) and coordinated the activities of the Fraunhofer HHI concerning the European research project MUSCADE project. Frederik Zilly has been honored for his work on the assistance system STAN (Stereoscopic Analyzer) with the Award for Outstanding Merit in Young Scientists, the Rudolf Urtel Prize 2011. He served as reviewer for different international conferences and journals. His research focus lies on multi-camera image processing algorithms.
Dr. Robert Bregovic is Visiting Senior Researcher at Holografika, Hungary. He has graduated as Doctor of Technology (with honours) at Tampere University of Technology, Finland in 2003 with a work on optimal design of perfect-reconstruction and nearly perfect-reconstruction multirate filter banks. He has been Senior Researcher at the Department of Signal Processing, Tampere University of Technology (2003-2015), Visiting Research Fellow at Temasek Laboratories, Nanyang Technological University, Singapore (2005-2006), and Research Fellow at TUT, before going for a research secondment to Holografika, Hungary within the PROLIGHT-IAPP project. His research interests are in the Fourier domain signal analysis, design of filters and filter banks and light field sensing, processing and display. He has co-presented a tutorial on signal processing methods for 3D displays at the recent IEEE Int. Conference on Multimedia and Expo (July 2013, San Jose, CA).