propostas de teses de mestrado em computação gráfica ... · computação gráfica, visão por...

ISCTE-IUL, Av. Forças Armadas, 1649-026 Lisboa, Portugal | Phone: + 351 210464023 | email: [email protected] | http://istar.iscte-iul.pt/

http://istar.iscte-iul.pt/

centro de investigação em ciências e tecnologias da informação e arquitetura

Propostas de Teses de Mestrado em

Computação Gráfica, Visão por Computador,

Realidade Virtual, Realidade Aumentada,

Interação Pessoa-Máquina

2014-2015

METI, MEI, MIG, MIASIC ISCTE-IUL

Prof. Miguel Sales Dias

[email protected]

Prof. Associado Convidado DCTI/ISCTE-IUL

Director I&D Microsoft

Prof. Sara Eloy

[email protected]

Prof. Auxiliar DAU/ISCTE-IUL

Diretora do Departamento de Arquitetura e Urbanismo do ISCTE-IUL


Area: Human-Computer Interaction

Topic: Visual Speech Recognition for European

Portuguese using RGB-D sensing

• Scope

• Visual Speech Recognition allows recognition of speech

in highly noisy environments. It is not affected by the

acoustic conditions and noise and contains the

greateast amount of complementary information to the

acoustic signal.

• Description of work

• State-of-the art assessment

• Collect an European Portuguese visual speech

database

• Develop an end-to-end Automatic Visual Speech

Recognition prototype based in articulatory features

• Conduct an usability study of the developed prototype

• Write thesis and national/international conference paper

• Development environment

• C++, C#

• Visual Studio

• Kinect One sensor

• Location: ISCTE-IUL, Lisbon


• Description

• Assess State-of-the art

• Develop tools to collect and manage gesture data from

KinectOne sensor

• Build a training and testing database of captured gestures

• Develop and extend tools , algorithms and techniques for

Portuguese Sign Language Recognition from

Human Gesture, Visual Speech and Body Motion Capture,

using RGB-D sensing (KinectOne for Windows)

• Test and evaluate the solution with a panel of deft users and

compare with the State-of-the Art

• Write International/National conference paper & thesis

• Development Environment

• Microsoft Visual Studio, C#/C++

• Microsoft Kinect SDK for Windows

• Kinect One Sensor

• Location

• ISCTE-IUL, Lisbon


Topic: Portuguese Sign Language Recognition from

Human Gesture, Visual Speech and Body Motion Capture,

using RGB-D sensing


• Description

Assess State-of-the art

Collect and build a database of motion data

Develop tools to annotate and segment motion data

Apply to a virtual animated conversational character, speaking

sign language.

Create tools to produce descriptive scripts for virtual characters

Perform usability evaluation of the system with deft speakers

Write International/National conference paper & thesis

• Developement Environment

Microsoft Visual Studio, C#/C++

Blender 3D, WebGL, HTML5/Javascript

Microsoft Kinect SDK for Windows

OpenSceneGraph 3D Programming

• Location

ISCTE-IUL, Lisbon


Topic: Create Portuguese Sign Language Conversational Animated Virtual Characters

based on Recordings of Human Performance


Area: Image Processing & Computer Vision

Topic: Large RGB-D Full Object Dataset• Scope

RGB-D object datasets are an essential requirement for the

computer vision community, for tasks such as object

categorization, instance recognition and pose estimation. The

availability of 3D object models registered and grouped by

category is a novel interesting R&D hypothesis for the research

community.

• Description of Work

State-of-art assessment.

Collect/Select generic 3D objects using availale ISCTE-IUL

system

Collect object’s point clouds and image frames from multiple

views, using Kinect One Sensor for Windows

Segmentation and local point clouds registration

Develop an object recognition prototype

Benchmark state-of-the-art object classifiers

Write International/national conference paper & thesis

Organize an international context in the framework of Shape

REtrieval Contest (SHREC) -

http://aimatshape.net/event/SHREC


C++, Microsoft Visual Studio

Point Cloud Library, OpenCV

http://www.cs.washington.edu/rgbd-dataset/

• Location• ISCTE-IUL, Lisbon

http://www.cs.washington.edu/rgbd-dataset/



Topic: Live 3D Object Detection using RGB-D

sensing

• Scope

“Object detection determines if a potential object is present in a scene

and its location.” Suetens et al. 1992

3D Object Detection is a challenging open research area mainly due

to multiple objects in scene, occlusion, high computational-cost and

scalability to learned objects. This project focus on developing

innovative solutions for the these problems

• Description of Work

State-of-the-art assessment

Develop methods for object segmentation & detection

Develop a real-time prototype using Kinect One

Integrate the prototype in the existing 3D Reconstruction,

Classification and Tracking framework @ ISTAR-IUL

Write International/National conference paper

Write thesis


C++

Microsoft Visual Studio

Point Cloud Library

OpenCV




Topic: 3D Object Instance Recognition and

Classification using RGB-D sensing

• Scope• The ability to recognize and classify a unknown object based

on similar ones is an emerging trend in the research comunity,

to solve problems attained to video surveillance and assisted

living. Typically the goals are (1) recognize the ID of known

object instances, retrieving information attached to it (e.g.

position, size, utilities) and (2) infer a classification

(category/class) to unknown objects.

• Description of Work• State-of-the-art assessment

• Specify, develop and test techniques for instance recognition

and classification

• Integrate the developed prototype, using Kinect One, in the

framework of 3D Reconstruction, Classification and Tracking

framework @ ISTAR-IUL

• Conduct a benchmark evaluation between the system

developed and other state-of-the-art techniques

• Write International/National conference paper

• Development Environment• C++

• Microsoft Visual Studio

• Point Cloud Library

• OpenCV


Classes

Instances of “Cereal

Box” class

Brain Flakes

Chex

Kellogg's


Area: Virtual Reality

Topic: Understanding presence and emotions in virtual

spaces, via multi-sensorial stimulation and biometric

sensingScope• Virtual Environments are becoming increasingly popular and one niche of application that is attracting attention

is related to Virtual Environments (VEs), since they allow a museum visitor or tourist to feel immersed in sites

that are otherwise unreachable or difficult to visit, or allow a user to visit private or public spaces, before they

are built. In designing these environments, vision, hearing, touch, smell and taste are what VEs try to simulate

via computing means, so that users can report the sense of having been present somewhere else other than

the place they really were. Understanding the emotion felt by the user when navigating through the space, is

also a relevant feedback to the architect of the space. In this context, evaluating the user´s emotion and if the

user felt a physical presence in a VE is an important factor to characterize it.

Description of Work• State-of-the-art assessment

• Use biometric/ Physiological sensing available @ ISTAR-IUL (heart beat rate, electrodermal resistance, EEG,

Emotiv, eye tracking) and RGB-D sensing. Use existing VR spaces (3D building and/or urban model) with 3D

auralization and 3D sound rendering (ambisonics) available @ ISTAR-IUL

• Use several methods to measure presence: through Behavioral and Physiological responses, comparison or

questionnaires. Use several methods to measure emotion (anger, disgust, fear, happiness, sadness and surprise)

through Behavioral and Physiological sensing, comparison or questionnaires.

• Use CaveHollowspace middleware (CAVEH) @ ISTAR-IUL based in OpenSceneGraph

• Perform usability evaluation in the context of students work at Architecture department @ ISCTE-IUL

• Write International/National conference paper & Thesis

Development Environment:• CAVE Hollowspace middleware based in OpenSceneGraph

• C++, C#, Kinect SDK, X-10 SDK, Emotiv SDK, Arduino, FMOD, Processing, Biometric Sensors

• OpenCV, Blender, Unity3D

Location• ISCTE-IUL, Lisbon

Ref: MSC Thesis: 3-D Sound Enhanced Presence in Virtual

Environments (António Sérgio Azevedo)



Topic: Sonification (a form of auditory display, is the

use of non-speech audio to convey information or

perceptualize data) of Interactive Tasks in Virtual

EnvironmentsScope• Human-object and human-human interactions are often facilitated by computational means.

Interaction designers aim at designing such interactions to make them more effective and

pleasant. Sonic Interaction Design emphasizes the role of sound as a mediator of meaningful

interactions.

Description of Work• State-of-the-art assessment

• Develop sonification techniques in 3D sound auralization simulation, to enhance tasks in a

Virtual Environment, such as discovery and path finding, including sounds of Body Motion,

Footsteps, Impact Sounds, Ancillary Gestures, Soundscapes

• Develop Visualization and Auralization techniques

• Compare 3D Sound and 7:1 Surround

• Use CaveHollowspace (CAVEH) with FMOD 3D sound, based in OpenSceneGraph Sound

in a new lab Virtual Reality lab with Ambisonics @ ISTAR-IUL

• Write paper & Thesis

Development Environment:• CaveHollowspace (CAVEH) @ ISTAR-IUL with FMOD 3D sound, based in

OpenSceneGraph

• C++, C#, PureData, Processing, FMOD, Ableton Live, Max MSP, Nuendo, Kinect

Microphones

• OpenSceneGraph, Blender, Unity3D

• Microphones, Audio Techniques (recording and reproducing sound), Ambisonics

Location• ISCTE-IUL, Lisbon

http://pedrolopesresearch.wordpress.com/2011/11/09/its201

1-augmenting-touch-interaction-through-acoustic-sensing/

Ref: MSC Thesis: 3-D Sound Enhanced Presence in Virtual

Environments (António Sérgio Azevedo)

http://pedrolopesresearch.wordpress.com/2011/11/09/its2011-augmenting-touch-interaction-through-acoustic-sensing/


Area: Mobility Apps

Topic: Augmented Reality App for Windows Phone• Scope

• AR is the provision of intuitive information presentation, which enhances

the perceiver’s situational awareness and cognitive perception of the real

world. Enhancement is achieved by placing virtual objects or information

cues into the real world. AR (Azuma 97): (a) combines real and virtual

environments; (b) is interactive in real-time; (c) is registered in 3D

• Description of Work• State-of-the art assessment

• Specify, develop and test an AR prototype for Windows Phone 8 based on

FIRST (Fast Invariant to Rotation and Scaling feature Transform) tracking

system available @ ISTAR-IUL

• Conduct a benchmark evaluation between the system developed and

other state-of-the-art techniques

• Conduct an usability study of the developed prototype in WP8 with a

mobility AR application for: (i) a museum which acts like a complement to

the exhibition showing additional information, or ii) a system for city map

travel (Architect department @ ISCTE-IUL provides the 3D building

models and other elements)

• Write thesis and national/international conference paper

• Development Environment• C# and WP8 SDK

• Universal App framework


• OpenCV

• Location

• ISCTE-IUL, Lisbon

http://vimeo.com/2341387

http://vimeo.com/2341387


• Scope• VR usually defines a set of computer technologies that can be used to

create simulated environments, with several levels of realism. CAVE

(Cave Automatic Virtual Environment) is a multi-projection immersive

virtual reality environment where projectors are directed to several walls

of a room-sized cube


• Improve the existing system for authoring and visualization of content for

the CAVE environment allowing the visualization of several architectural

representations of space, including simulating projected shadows and

lighting effects and performing real time sections in the 3D model.

• Architecture department @ ISCTE-IUL provides the 3D building model)

• Use CaveHollowspace (CaveH) software provided by ISCTE-IUL

• Develop a real-time prototype

• Perform usability evaluation in the context of students work at

Architecture department @ ISCTE-IUL.


• Write thesis

• Development Environment• CAVE Hollowspace middleware based in OpenSceneGraph

• Blender


• C++, C#, Kinect SDK

• Location• Microsoft Porto


Topic: Visualization in an immersive virtual reality environment


• Scope• VR usually defines a set of computer technologies that can be used to create

simulated environments, with several levels of realism. CAVE (Cave

Automatic Virtual Environment) is a multi-projection immersive virtual reality

environment where projectors are directed to several walls of a room-sized

cube. BIM (Building information modeling) is a process involving the

generation and management of digital representations of physical and

functional characteristics of a facility.


• Specify a system allowing to exchange BIM data with the existing CaveH

environment. (Architecture department @ ISCTE-IUL provides the 3D

building model)

• Use CaveHollowspace (CaveH) @ ISTAR-IUL


• Perform usability evaluation in the context of students work at Architecture

department @ ISCTE-IUL.


• Write thesis

• Development Environment• Revit or other BIM

• CAVE Hollowspace middleware based in OpenScenegraph

• Blender


• C++, C#, Kinect SDK



Topic: Use of BIM in an immersive virtual reality environment


• Scope• VR usually defines a set of computer technologies that can be used to create

simulated environments, with several levels of realism. CAVE (Cave Automatic

Virtual Environment) is a multi-projection immersive virtual reality environment

where projectors are directed to several walls of a room-sized cube


• Specify a system allowing the edition (moving, stretching, scaling, erasing, etc)

of a 3D model of building, within immersive VR and using natural gestures and

user-friendly interfaces (Architecture department @ ISCTE-IUL provides the 3D

building model)

• Recognize gestures via RGB-D sensing (Kinect One)

• Use CaveHollowspace (CaveH) @ ISTAR-IUL





• Write thesis

• Development Environment• Cave Hollowspace

• Blender

• C# and Windows 8 RT/WP8 SDK



• OpenCV



Topic: 3D model edition in immersive virtual reality environment


Area: Human-computer interaction

Topic: Media interactive facades

• Scope• Media interactive facades are used in several urban areas to show

advertises and several types of information. Usually these facades

are static and do not interact with pedestrians. The idea is to develop

an interaction system that allows a media facade (e.g. led) to change

according to the movement that occurs in front of it.


• Specify a system allowing to interact with facade modules changing

its appearance (Architecture department @ ISCTE-IUL provides the

specifications for the interaction and content)

• Design tangible interfaces to allow such interaction


• Perform usability evaluation


• Write thesis

• Development Environment• C#



• OpenCV

• Location• ISCTE-IUL, Lisboa



Topic: Tracking people’s movement in real space

• Scope• Tracking people’s movement in space is a common technique to understand

patterns of use and to inform architecture and urban design with real user’s

preferences. Tracking can be done manually (as the image in the bottom) or

by software applications (e.g. using cellphones location tracking

technologies).


• Specify a system allowing to track walking humans featured in video data

captured in static real space positions.

• Generate graphic flows of people’s patterns of movement in that space

(Architecture department @ ISCTE-IUL provides the specifications for

traking and the locations to record video)

• Design tangible interfaces to allow such interaction





• Write thesis




• OpenCV



Area: Computer Aided Design

Topic: Shape grammar applied to an architecture design

problem• Scope

• Shape grammars are “algorithmic systems for creating and understanding

designs directly through computations with shapes, rather than indirectly

through computations with text or symbols.” (Knight, 2000). A shape grammar is

a set of rules that apply step-by-step to shapes to generate a language of

designs. The mechanism used to generate solutions based on a shape

grammar is to a certain extent, similar to an expert system because it uses the

knowledge of an expert to the problem field and, by using a particular

methodology, provides a solution.


• Specify a shape grammar interpreter that uses shapes and shape rules to

generate designs (Architecture department @ ISCTE-IUL provides the

specifications of a shape grammar example)

• Design the user experience





• Write thesis




• OpenCV



http://www.rollingrains.com/2007/03/

Area: AAL - Ambient Assisted Living

Topic: Expert system to choose assistive

technologies according to family profiles• Scope

• Ambient Assisted Living (AAL) technologies for elderly and people with

reduced mobility enable them to live with more independence, mobility and

safety. Smart homes should address residents’ demands and needs.

However there is frequently a gap between the technology implemented

and the user’s real needs. This happens because the implementation of

home automation is usually undertaken without the previous knowledge of

the end-users or without understanding the exact needs of residents.

• Description of Work • State-of-the-art assessment

• Specify an expert system that analyze a family profile (age, members,

budget, etc) and gives as output a list of assistive technologies that should

be used. The proposed system aims to define the appropriate set of

technologies for each family profile.

• Design the user experience


• Perform usability evaluation in the context of QREN AAL4ALL research

project @ ISTAR-IUL.


• Write thesis




Project in the framework of

QREN 13852 AAL4ALL

propostas de teses de mestrado em computação gráfica ... · computação gráfica, visão por...

Documents