FICS Course

FICS Course on Computational Imaging Algorithms for Light-Field Acquisition, Processing and Visualization

Organized by the Finnish Doctoral Programme in Computational Sciences, the PROLIGHT Marie Curie IAPP Action and 3D Media Group at the Department of Signal Processing, Tampere University of Technology

November 27-29, 2013 at Tampere University of Technology

The course addresses computational imaging aspects of sensing 3D visual scenes by multi-camera setups, their light-field and multi-view multi-depth representations and related processing, and their visualization through modern 3D displays. More specifically, the course addresses the problems of multi-camera rectification and disparity estimation, as well as scene representations ranging from pure image-based, such as Epipolar-Plane Image (EPI) based, to multi-view multi-depth based. Ray interpolation and view rendering techniques are discussed along with production rules for generating correct stereoscopic 3D and techniques for generating visual effects out of multi-camera data. Principles of operation of 3D displays are reviewed and Fourier domain analysis of such displays is presented.

Instructors: Frederik Zilly, Fraunhofer IIS, Germany and Dr. Robert Bregovic, Holografika, Hungary and Tampere University of Technology, Finland

Schedule:

Wednesday, 27 November
Room: TB 224

12:00 – 12:15 Opening  the course (Atanas Gotchev)

12:15 – 14:00 Lecture 1: Multi-camera 3D scene sensing (Frederik Zilly).
–  Feature-Point-Based Multi-Camera Rectification
–  Multi-Camera Disparity Estimation

14:00 – 14:15 Coffee break

14:15 – 16:00 Lecture 2: Light field representations (Robert Bregovic)
– Epipolar-plane image representation
– Light field analysis in Fourier domain

Thursday, 28 November
Room: TB 216

09:15 – 11:00 Lecture 3: Processing of multi-camera data (Frederik Zilly)
– View Rendering / Depth Image Based Rendering
– Visual Effects using Multi-Camera Data: Matrix-Effect, Vertigo-Effect, Synthetic Aperture

11:00 – 12:45 Lunch break

12:45 – 14:15 Lecture 4: 3D displays (Robert Bregovic)
– 3D displays: principles of operation
– Analysis of 3D displays in Fourier domain;

Friday, 29 November
Room: TB 216

09:15 – 11:00 Lecture 5: High-quality Stereoscopic 3D (Frederik Zilly)
– Production Rules for visually pleasant Stereoscopic 3D;

11:00 – 11:15 Instructions for writing the reports and closing the school (Atanas Gotchev)

Credits and grading

2-4 cr; pass/fail

2cr requirements: Attendance, literature survey and four-six pages report on a particular topic agreed with the instructors.

1-2 additional credits:  A more extensive study on a particular algorithm agreed with the instructor, including a software implementation (Matlab or C); presentation and a final report with test results.

Administration

Registration: Susanna Anttila  susanna.anttila@tut.fi
Send an email to the department secretary Ms Susanna Anttila with the following information:
– Name, affiliation, student number
– Are you a FICS student?
– Do you have any dietary requirements?
Registration deadline: 25.11.2013

Additional information: Atanas Gotchev atanas.gotchev@tut.fi (course organizer) and Ella Bingham ella.bingham@aalto.fi (FICS coordinator)

FICS students will have preference in registration if participation needs to be limited and non-FICS students will be admitted in the order of their registration request.

Bios of course instructors:

Frederik Zilly is Head of the group Computational Imaging and Algorithms in the Moving Picture Department of Fraunhofer IIS in Erlangen, Germany. He has received the Diploma degree in physics from Free University of Berlin, Germany, in 2006. Before joining Fraunhofer IIS, he was Scientific Project Manager in the Immersive Media & 3-D Video Group in the Image Processing Department at Fraunhofer HHI in Berlin where he was involved in several German and European research projects related to 3DTV. In this function he was mainly responsible for the development of the Stereoscopic Analyzer (STAN) and coordinated the activities of the Fraunhofer HHI concerning the European research project MUSCADE project. Frederik Zilly has been honored for his work on the assistance system STAN (Stereoscopic Analyzer) with the Award for Outstanding Merit in Young Scientists, the Rudolf Urtel Prize 2011. He served as reviewer for different international conferences and journals. His research focus lies on multi-camera image processing algorithms.

Dr. Robert Bregovic is Visiting Senior Researcher at Holografika, Hungary. He has graduated as Doctor of Technology (with honours) at Tampere University of Technology, Finland in 2003 with a work on optimal design of perfect-reconstruction and nearly perfect-reconstruction multirate filter banks. He has been Senior Researcher at the Department of Signal Processing, Tampere University of Technology (2003-2015), Visiting Research Fellow at Temasek Laboratories, Nanyang Technological University, Singapore (2005-2006), and Research Fellow at TUT, before going for a research secondment to Holografika, Hungary within the PROLIGHT-IAPP project. His research interests are in the Fourier domain signal analysis, design of filters and filter banks and light field sensing, processing and display. He has co-presented a tutorial on signal processing methods for 3D displays at the recent IEEE Int. Conference on Multimedia and Expo (July 2013, San Jose, CA).