(Lecture, Jul 18) Visual Saliency as a proxy for QoE: the 360 image scenario
July 17,2017 17:01:33 readCount:41
Topic: Visual Saliency as a proxy for QoE: the 360 image scenario
Speaker: Prof. Patrick LE CALLET (Université de Nantes)
Venue: Room 308, Building B3, University Town Campus
Time: Tuesday, Jul 18, 2017, 9:30-10:30
VR applications are blooming along with the explosion of consumer grade low-cost HMD (Head Mounted Display). Understanding how users watch a 360° image and analyzing how they scan through the content with a combination of head and eye movement, is necessary to develop appropriate rendering devices and also create good VR/AR content for consumers. Good visual attention modelling is a key factor in that perspective that helps enhance the overall Quality of Experience (QoE). Although a huge number of algorithms have been developed in recent years to gauge visual attention in flat-2D images and videos and also a benchmarking platform where users can submit and assess their results, attention studies in 360 scenarios are absent.
I first illustrate In this talk why In this particular domain, the knowledge of visual attention is particularly crucial to master QoE. Then, I present some of our recent eye tracking experiments and results to understand how people look omnidirectional images in HMD. I finally provide an overview of recent efforts to computationally model visual attention in 360. I noticeably present an overview of the IEEE ICME Grand Challenge salient360! a competition that set the baseline for further efforts of the community.
Patrick Le Callet received both an M.Sc. and a PhD degree in image processing from Ecole polytechnique de l’Université de Nantes. Since 2003, he teaches at Ecole polytechnique de l’Université de Nantes (Engineering School) in the Electrical Engineering and the Computer Science departments where is now a Full Professor. He led for ten years (2006-16) the Image and Video Communication lab at CNRS IRCCyN and was one of the five members (2013-16) of the Board of Governor of CNRS IRCCyN (250 researchers). Since January 2017, he is one of the seven members of the Board of Governor of the CNRS LS2N lab (450 researchers), as representative of Polytech Nantes. He is also since 2015 the scientific director of the cluster “Ouest Industries Créatives”, a five year program gathering more than 10 institutions (including 3 universities). “Ouest Industries Créatives” aims to strengthen Research, Education & Innovation of the Region Pays de Loire in the field of Creative Industries. He is mostly engaged in research dealing with the application of human vision modeling in image and video processing. His current centers of interest are Quality of Experience assessment, Visual Attention modeling and applications, Perceptual Video Coding and Immersive Media Processing. He is co-author of more than 250 publications and communications and co-inventor of 16 international patents on these topics. He serves or has been served as associate editor or guest editor for several Journals such as IEEE TIP, IEEE STSP, IEEE TCSVT, SPRINGER EURASIP Journal on Image and Video Processing, and SPIE JEI. He is serving in IEEE IVMSP-TC (2015- to present) and IEEE MMSP-TC (2015-to present) and one the founding member of EURASIP SAT (Special Areas Team) on Image and Video Processing.

Announced by School of Computer Science & Engineering