Downloadable Documents and Publications

Sections:
- Public documents and presentations

- Public summaries from internal reports
- Public reports
- Academic publications

Stereoscopic sequences repository
As an initiative of the 3D Media Cluster (www.3dmedia-cluster.eu) it has been configured a repository of stereoscopic sequences.
Here there are some steroscopic sequences available for research and development purposes. You can use this sequences mentioning the source.
Go to the repository

Useful links:
- EU funded projects
- Professional associations
- Other interesting resources

Public documents and presentations

DATE  DESCRIPTION
June 26, 2008   Title: "Open FX"
Download OpenFX document in PDF   Developing new tools for stereo imaging postproduction. Common development architecture description (OpenFX)
By Miriam Balaguer, Barcelona Media.
June 3, 2008   Title: "Beyond Stereoscopic 3D"
  Technology presentation by Ralf Tanger of HHI during the Dimension3 expo in Chalon-sur-Saone (France)
http://www.dimension3-expo.com
July 1 , 2008   Title: "Real-Time 3D-Audio for Digital Cinema"
  Presented for the Acoustics 08, held in Paris July 2008
By Pau Arumí, David García, Toni Mateos, Adan Garriga, Jaume Durany, Barcelona Media
May 1 , 2009   May 2009 Newsletter
  Project newsletter. Includes: Immersive revolution P.1 Head swap, an immersive experience P.2 Emerging standards for 3D media P.3 The 2020 3D Media Consortium P.4
May 1 , 2010   May 2010 Newsletter
  Project newsletter. Includes: Depth enhanced inpainting P.1 Dialogue with Bernard Mendiburu P.2 Cinematographic editing and the passive viewer P.3 Spatial audio P.4
    More publishable documents (video, pictures) available upon request: info@20203dmedia.eu

Go to top

Public summaries from internal reports

DATE  DESCRIPTION
May 30, 2008   Title: "Project Hand Book and Quality Plan"
Download OpenFX document in PDF   This document is the Project Handbook for the 2020 3D Media Project

By Eugenia Fuenmayor and Elena Torres, Barcelona Media.
May 30, 2008   Title: "2020 3D Media Initial IP Strategy Document"
  This document describes the way Intellectual Property is handled inside the 2020 3D Media
consortium
By Eugenia Fuenmayor and Elena Torres, Barcelona Media.
May 30, 2008   Title: "Dissemination Stategy"
  Initial version of the plan for disseminating the activities and the generated knowledge and products of the project.
By Santi Fort, Barcelona Media.
August 22, 2008   Title: "Self-assessment Plan"
  Quality Management is a Consortium Management task, designed to assure that the project keeps on track and meets the goals.
By Tom Evans and Peter Stansfield, coordinated by Barcelona Media.
August 28, 2008   Title: "Definition of a new camera architecture"
  This document describes the changes needed in the architecture of a regular professional 2D camera to turn it into a camera that can capture scenes in 2D + depth.
By Klaas Jan Damstra, Grass Valley Netherland
August 31, 2008   Title: "Requirements and definition of new architecture for combining Viper camera with Trifocal Stereo and Structured Light Devicest"
  3D Image Capture combining tri-focal stereovision, spatio-temporal structured light and a cinematographic camera with Z-channel into a unified video-and-depth recording device.
By Ralf Tanger, Fraunhofer HHI and others
October 21, 2008   Title: "Report on magnification errors in the optical path and possible algorithms to create higher resolution out of 2K channels"
  Market trends and state-of-the-art in technology with respect to resolution, frame rates and bit depth concerning high-end cameras to be designed
By Klaas Jan Damstra, Grass Valley Netherland
February 25, 2009   Title: "Support for multi-view content in metadata standards and formats"
  This document collects the metadata elements required for the production of multi-source digital cinema content.
By Werner Bailer, JRS and others.
February 13, 2009   Title: "A new in-field recording architecture"
  Specifycation of the in-field recorder for the need of this project respectively for a general proposed future 3D acquisition approach
By Thomas Brune, DTO
February 11, 2009   Title: "Algorithm to create a higher resolution demonstrated on PC"
  Results of the implementation of the demonstrator of the offset processing
By Klaas Jan Damstra, Grass Valley Netherland
February 28, 2009   Title: "Improved algorithms for 2D-3D image conversion"
  2D-3D conversion consists in turning into 3D any 2D content.
By Philippe Gérard, Doremi.
February 25, 2009   Title: "Image inpainting methods and multi-view image processing"
  Proposal of an image inpainting method adapted to artefact correction in the context of view
synthesis.
By Vicent Caselles, Barcelona Media.
February 26, 2009   Title: "Specification of design and implementation of automated distribution system."
  This document identifies the main requirements and specifies the software functionality for automated identification and distribution of content.
By Dave Stringer, Datasat.
February 28, 2009   Title: "Requirements and Standards for Spatialised Audio play-out"
  This document collects the proposal for a spatial audio format, suitable for distribution which is
independent of the exhibition system.
By Toni Mateos, Barcelona Media.
June 6 , 2009   Title: "Market Analysis, Business Models and Exploitation Planning"
  This document gives an overview of the markets and technology involved in 3-D stereoscopic content creation and distribution, and also the business models to support the exhibition of such contents.
By Jordi Alonso , Mediapro.
May 29 , 2009   Title: "New camera architecture design"
  This report describes what has been achieved until now with respect to the design and (partly) use of the new camera architecture in the 2020 3D Media project.
October 15 , 2009   Title: "Workflow Design and Experimental Testing"
  Considerations on the design of a workflow by the experience of the production of a 3D content using multiple different cameras and tools.
July 31 , 2009   Title: "Content analysis tools for multi-source content"
  This document describes the prototype of the multi-view content analysis framework.
August 25 , 2009   Title: "Prototype recording solution prepared for enhanced resolution application"
  This paper describes a first version prototype of a new portable field recorder solution for 3D image capture.
August 26 , 2009   Title: "Initial Prototype 2K Viper Camera with Satellite Cameras"
  Hardware and software components of a trifocal depth capture prototype are described.
September 02 , 2009   Title: "Initial prototype 2K camera with structured light beamer"
  This document describes our initial prototype of a 2K resolution, real-time capable, depth capture method for cinematographic or broadcast use.
September 08 , 2009   Title: "Immersive/augmented/3D display system v1"
  Description of architecture of initial prototype for displaying immersive and 3D images.
November 27 , 2009   Title: "Prototype (2K) Viper camera with combined satellite/beamer"
  Components of a depth capture prototype combining a structured light and a trifocal approach are described.
February 28 , 2010   Title: "Semantically Driven Workflow System"
  This report presents the Semantically Driven Work-flow System prototype as derived from requirements collected, exposed and analysed.
February 26 , 2010   Title: "Extensions of MPEG-C Part3, MVC and MXF for advanced depth and 3D audio representation"
  This document summarizes the metadata specification throughout the workflows covered by 2020 3D Media.
February 26 , 2010   Title: "Higher resolution algorithm demonstrated on new camera architecture"
  A short description and an MPEG video demo on the enhanced resolution demo package.
February 26 , 2010   Title: "Plug-ins to import depth-enhanced image and auxiliary data"
  This deliverable describes an OpenFx plug-in for post-production tools such as Nuke, Mistika and others.
February 18 , 2010   Title: "Object segmentation and re-detection algorithm for multi-view content v1"
  This deliverable describes the prototypes for fulfilling the pre-processing tasks for object redetection.
February 26 , 2010   Title: "Deconvolution method for audio in real-time"
  The research described here focuses on two blind-algorithms for sound deconvolution.
February 26 , 2010   Title: "Automated distribution systems feeding Cinema and/or public spaces"
  The deliverable presents the initial protptype of a digital distribution system which operates on metadata and orders, to transfer the required files to destinations in an efficient and timely manner.
March 08 , 2010   Title: "Evaluation procedures"
  This deliverable presents the evaluation methodologies to be followed in order to gather feedback from professional and end users.

Go to top

Public reports

DATE  DESCRIPTION
June 12, 2009   Title: "Protocols and standards for data capture"
Download OpenFX document in PDF   Outline of a target system where all three 3D techniques (tri-focal, spatio-temporal
structured light and Z-channel acquisition) are unified
By Thomas Brune, DTO
December 15, 2008   Title: "Initial set of test material of 2D-3D image conversion, set of geometric test patterns for testing the correctness of 2D-3D conversion"
  Technology behind 2D-3D conversion process, that starts by an automatic or semiautomatic
segmentation.
By Philippe Gerard, Doremi
June 1 , 2009   Title: "Emerging Standards for 3D Media"
  This report summarizes the current activities in 3D video standardisation.
By Ralf Tanger, Fraunhofer HHI
February 27, 2008   Title: "Spectator response factors, production, workflow and technology requirements for stereoscopic and immersive video"
  Foundation of research into Immersive and Stereoscopic Cinematography, gathering data about and building an understanding of the audience’s engagement and subjective perception.
By Eric Martrou, Mediapro and Kurt Vanhoutte, CREW
March 13, 2009   Title: "Surround video polycamera system"
  Reports on the 2020 3D media first year development of a omnidirectional camera system
By Philippe Bekaert, Hasselt University
March 13, 2009   Title: "Demonstrator of framework for the capture, manipulation, and display of omnidirectional video"
  Describes “janus” software framework for the capture, manipulation and display of omni-directional video
By Philippe Bekaert, Hasselt University
August 09, 2009   Title: "Workflow, Metadata, and Semantic Definitions Report"
  The document describes the overall process workflow,related actions, actors and semantic relations.
By Atta Badii, Meng Zhu, David Fuschi, Werner Bailer, Georgia Efthymiopoulou
December 18, 2009   Title: "Demonstrator of 2D-3D image conversion material"
  This deliverable presents the improvement obtained in 2D-3D conversion for more complex images.
By Philippe Gérard, Jorge Santos
September 30, 2009   Title: "Project Progress Presentation"
  This document describes what has been done for the dissemination of the project during IBC 2009.
By Santi Fort, Jorge Santos
February 26, 2010   Title: "Cinematography of surround video, assuming a passive spectator"
  Direct translation of classical cinematographic parameters into immersive media proves to be problematic.
By Kurt Vanhoutte, Eric Joris, Brecht Debackere, Nele Wynants, Jorge Santos
February 23, 2010   Title: "Metadata Representation for 3D Cinema Production"
  This document summarizes the metadata specification throughout the workflows covered by 2020 3D Media, their mapping to formats and embedding into containers, where applicable.
By Werner Bailer (JRS), Philippe Bekaert (UoH), Klaas Jan Damstra (GVN), Jan van Rooy (GVN), Stephen Field (DTS), Dave Stringer (Datasat), David Fuschi (UoR), Jorge Santos
February 26, 2010   Title: "Depth enhanced inpainting model and automatic detection of occluded/disoccluded regions"
  This deliverable addresses the problem of inpainting depth-enhanced images.
By Pau Gargallo, Alexandre Hervieu, and Vicent Caselles, Jorge Santos
February 26, 2010   Title: "Spatial Audio Playback for Realistic Cinema Environments"
  This reports contains a description of the tests at a real environment, in the DTS theatre located near London of the BM-audio produced technology for encoding and decoding 3D audio soundtracks.
By Pau Arumí, Giulio Cengarle, Toni Mateos, Jorge Santos

Go to top

Academic publications

DATE  DESCRIPTION
May 1, 2009   Title: "3D-Audio with CLAM and Blender's Game Engine"
Paper to download   Blender can be used as a 3D scene modeler, editor, animator, renderer and Game Engine. This paper describes how it can be linked to a 3D sound plat form working within the CLAM framework, making special emphasis on a speci c application: the recently launched Yo Frankie! open content game for the Blender Game Engine. The game was hacked to interact with CLAM, implementing spatial scene descriptors transmited over the Open Sound Control protocol, and allowing to experiment with many different spatialization and acoustic simulation algorithms. Further new applications of this Blender- CLAM integration are also discussed.
By Natanael Olaiz, Pau Arumí, Toni Mateos and David Garcia, BM
October16, 2008   Title: "Being inside the image. Heightening the sense of presence in a video captured
environment through artistic means: the case of CREW."
Paper to download   This paper explores the use of omni-directional video, a high impact immersive medium, by a performance group and
multi-disciplinary team of artists and scientists.
By Nele Wynants, Kurt Vanhoutte, Theatre, Film and Literature Studies, University of Antwerpen and Philippe Bekaert , Expertise Centre for Digital Media, University of Hasselt
March 23 , 2009   Title: "Estimating 3D camera motion for rendering audio in virtual scenes"
Paper to download  

In the production phase of digital cinema content it is important to allow the director not only to preview the final rendered scene early in the shooting process, but also to prehear the 5.1 surround and HRTF-based binaural versions, thus enabling visual and auditive artistic decisions to be taken at the shooting stage. In many cases camera tracking data is not available for all cameras on the set (e.g. handheld ones) and thus the motion of the camera needs to be estimated. In this paper we describe an approach for estimation of 3D camera motion and its use for real-time audio rendering.
By Werner Bailer, JRS, and Pau Arumí, Toni Mateos, Adan Garriga, Jaume Durany, David García, BM.

September 12 , 2008   Title: "Cognitive immersion "
Paper to download   The goal of this paper is to present our research about the cognitive processes involved in 3D immersion and present our research plans about how this type of environment should be helpful for people with special needs, in particular people with cerebral paralysis.
By Elena Parra and Raquel Navarro, BM
June 22 , 2008   Title: "Video Enhancement Using Reference Photographs"
Paper to download   Handheld digital video cameras have become increasingly popular and cheaper in recent years. Even still cameras offer additional functionality for shooting videos. Unfortunately, the small form factor of these devices limits the light ensitivity, and often the the lens and sensor do not allow for satisfactory image quality. We wish to process a video into a more aesthetically pleasing version, by borrowing information from high quality reference photographs of the same scene. Since the process of taking a photograph is not time-critical, we can afford a longer exposure for reducing noise, and record more information to increase resolution.
By Cosmin Ancuti, Tom Haber, Tom Mertens, Philippe Bekaert, Hasselt University
June 22 , 2008   Title: "Eunomia: Toward a Framework for Multi-touch Information Displays in Public Spaces"
Paper to download   Multi-touch interaction techniques are becoming more widespread because of new industrial initiatives to make this hardware available and affordable for the consumer market. To cope with the diversity in hardware setups and the lack of knowledge about developing generic multitouch applications, we created a framework, Eunomia, for abstracting the hardware from the software and to enable software developers to easily develop interactive applications taking advantage of multi-touch interaction.
By Tom Cuypers, Jan Schneider, Johannes Taelman, Kris Luyten, Philippe Bekaert, Hasselt University
January 1 , 2009   Title: "Time-triggered Static Schedulable Data ows for Multimedia Systems"
Paper to download   Software-based reactive multimedia computation systems are pervasive today in desktops but also in mobile
and ultra-portable devices. Most such systems o er a callback-based architecture to incorporate speci c stream
processing. Article presented at the Electronic Imaging - MultimediaNetworking and Computing conference, in January 2009, in San Jose, California
By Pau Arumí, BM and Xavier Amatriain, Telefonica Research
September 4 , 2009   Title: "Realtime KLT feature point tracking for High Definition video"
Paper to download   Automatic detection and tracking of feature points is an important part of many computer vision methods. A
widely used method is the KLT tracker proposed by Kanade, Lucas and Tomasi. This paper reports work done
on porting the KLT tracker to the GPU, using the CUDA technology by NVIDIA. describing the CUDA port of the point tracker has been accepted as full paper at the Computer Graphics, Computer Vision and Mathematics (GraVisMa) workshop.
By Hannes Fassold, Jakub Rosner, Peter Schallauer and Werner Bailer, JRS
December 9, 2009   Title: "Metadata for Creation and Distribution of Multi-view Video"
Paper to download   This paper reviews the metadata requirements for multi-view video content and analyze how well these requirements are covered in existing metadata standards, both in terms of the coverage of metadata elements and the capabilities to structurally describe multi-view video content. Workshop on Semantic Multimedia Database Technologies (SeMuDaTe)
By Bailer W., Höffernig M. JRS
December 9 , 2009   Title: "Formal Metadata Semantics for Interoperability in the Audiovisual Media Production Process"
Paper to download   Di erent metadata formats and standards are used in the stages of the process, containing metadata properties with similar and partly overlapping semantics, though not fully identical. We attempt to model the metadata properties used throughout the production process in a format independent way by creating an ontology that models these properties
and the relations between them.
By Höffernig M., Bailer W, JRS
December 12 , 2009   Title: "How to Align Media Metadata Schemas? Design and Implementation of the Media Ontology"
Paper to download   Multimedia data is generated, shared, stored and distributed worldwide at an ever increasing rate. This huge amount of content comes with metadata represented in different formats which hardly interoperate although they partially overlap.
By Florian Stegmaier1, Werner Bailer2, Tobias B¨urger3, et al., JRS
November 2 , 2009   Title: "Fast GPU-based KLT feature point tracking using CUDA"
Paper to download   Automatic selection and tracking of feature points is a basic task for many CV algorithms (e. g. structure from motion, object tracking) Very popular due to good performance:
KLT algorithm [Kanade, Lucas and Tomasi]
By Florian Stegmaier1, Werner Bailer2, Tobias B¨urger3, et al., JRS
November 2 , 2009   Title: "Comparing Fact Finding Tasks and User Survey for Evaluating a Video Browsing Tool"
Paper to download   In the multimedia information retrieval community evaluations following the Cranfield paradigm (as e.g. used in TRECVID) have been widely adopted. We have applied two TRECVID style fact finding approaches (retrieval and question answering tasks) and a user survey to the evaluation of a video browsing tool.
By Werner Bailer and Herwig Rehatschek, JRS
December 17 , 2009   Title: "A Video Browsing Tool for Content Management in Post-production"
Paper to download   We propose an interactive video browsing tool for supporting content management and selection in postproduction. The approach is based on a process model for multimedia content abstraction. A software framework based on this process model and desktop and Web-based client applications are presented. International Journal of Digital Multimedia Broadcasting, 2010
By Werner Bailer, Wolfgang Weiss, Gert Kienast, Georg Thallinger, and Werner Haas, JRS
July 14 , 2009   Title: "Integrative Workflow-Embedded Support For Process Automation And Management"
Paper to download   This paper presents the on-going research performed in order to integrate process automation and process management support in the context of media production. This has been addressed on the basis of a holistic approach to software engineering applied to media production modelling to ensure design correctness, completeness and effectiveness. European and Mediterranean Conference on Information Systems 2009
By Badii A., Fuschi D., Zhu M., Univ. of Reading
April 1 , 2010   Title: "Migrating from Process Automation to Process Management Support: a Holistic Approach to Software Engineering applied to Media Production"
Paper to download   This paper presents the on-going research performed in order to migrate from process automation to process management support in the context of media production and more specifically 3D cinematographic immersive and interactive production. Journal of Multimedia
By Badii A., Fuschi D., Zhu M., JRS

Go to top

EU funded projects

 NAME  DESCRIPTION
3D Media Cluster   3D Media Cluster is the main umbrella structure embracing related EC funded projects to develop joint strategic goals towards 3D Media in the context of future Internet.
www.3dmedia-cluster.eu
Mobile 3DTV   MOBILE3DTV - Mobile 3DTV Content Delivery Optimization over DVB-H System - is a three-year project partly funded by the European Union 7th RTD Framework Programme in the context of the Information & Communication Technology (ICT) Cooperation Theme and its objective 1.5 Networked Media. The project started on 1st January 2008. The main objective of MOBILE3DTV is to demonstrate the viability of the new technology of mobile 3DTV. The project develops a technology demonstration system for the creation and coding of 3D video content, its delivery over DVB-H and display on a mobile device.
http://sp.cs.tut.fi/mobile3dtv/
3D4YOU   The 3D4YOU concept is to establish practical 3D television. The key success factor is 3D content. The project will define a 3D delivery format and a content creation process. Establishing practical 3D television will then be demonstrated by embedding this content creation process into a 3DTV production and delivery chain, including capture, image processing, delivery and then display in the home.
http://www.3d4you.eu
3D Presence   The 3D Presence project proposes a research and development agenda that is both timely and necessary. It is born from the realization that effective communication and collaboration with geographically dispersed co-workers, partners, and customers requires a natural, comfortable, and easy-to-use experience that utilizes the full bandwidth of non-verbal communication.
http://www.3dpresence.eu/
FOCUS K 3D   FOCUS K3D (ICT-2007-214993) is a Coordination Action (CA) of the European Union's 7th Framework Programme which aims at promoting the adoption of best-practices for the use of semantics in 3D content modelling and processing.
The project started on March 2008, and will finish on February 2010 (24 months).
http://www.focusk3d.eu/
i3DPost   i3Dpost will improve quality and reduce the cost of high-level media production by applying intelligent technologies to the extraction of structured 3D content models from video. This will enable the increasingly automatic manipulation and re-use of characters, with changes of viewpoint and lighting. The research will advance the state of the art in 3D video production, 3D motion estimation, post-production tools and media semantics. The result will be film quality 3D content in a structured form, with semantic tagging, which can be manipulated in a graphic production pipeline and used across different media platforms.
http://www.i3dpost.eu/
3DPHONE   The project aims to develop technologies and core applications enabling a new level of user experience by developing end-to-end all-3D imaging mobile phone.
http://the3dphone.eu
MUTED   The MUTED project aims to produce the first 3D TVdisplay capable of supporting multiple mobile viewers simultaneously, and without the need for 3D glasses.
http://www.muted3d.eu

Go to top

Professional associations

 NAME  DESCRIPTION
Stereoscopic Society   The Society has been in existence since 1893 and its objectives are to foster the practice, enjoyment and advancement of all forms of stereoscopy - pictures in three dimensions.

www.stereoscopicsociety.org.uk

International
Stereoscopic Union
  The International Stereoscopic Union (ISU) was founded in 1975 and is the only international 3D association in the world. The ISU is a club of individual 3D enthusiasts as well as a club of stereo clubs. The ISU's members currently number more than 1,000 and come from over 40 countries world-wide.

http://www.stereoscopy.com/isu/index.html

Go to top

Magazines

 NAME  DESCRIPTION
Stereoscopy news   This web magazine is fully dedicated to stereoscopy. There is also a compact newsletter, born in September 2009, that is distributed weekly by email

www.stereoscopynews.com

3D review.com   Information about new stereoscopic products from around the world

http://www.rollanet.org/~vbeydler/van/3dreview/

Go to top