Creating facial animations using 3D computer graphics represents a very laborious and time-consuming task. Among the numberless approaches for animating faces, the use of blendshapes remains the most common solution because of their simplic- ity and the ability to produce high-quality results. This approach, however, is also characterized by important drawbacks. With the traditional animation suites, in order to select the blendshapes to be activated animators are generally requested to memorize the mapping between the blendshapes and the influenced mesh vertices; alternatively, they need to adopt a trial-and-error search within the whole library of available blendshapes. Moreover, the level of expressiveness that can be reached may be lower than expected; this is due to the fact that the possibility to apply transformations to vertices different than just linear translations and mechanisms for adding, e.g., exaggerations, are typically not integrated into the same anima- tion environment. In order to tackle these issues, this paper proposes an immersive virtual reality-based interface that leverages sketches for the direct manipulation of blendshapes. Animators can draw both linear and curved strokes, which are used to automatically extract information about the blendshape to be activated and its weight, the trajectories that associated vertices have to follow, as well as the timing of the overall animation. A user study was carried out with the aim of evaluating the proposed approach onto several representative animations tasks. Both objective and subjective measurements were collected. Experimental results showed the benefits of the devised interface in terms of task completion time, animation accuracy, and usability.

A sketch-based interface for facial animation in immersive virtual reality / Cannavo', Alberto; Stellini, Emanuele; Zhang, Congyi; Lamberti, Fabrizio. - In: INTERNATIONAL JOURNAL OF HUMAN-COMPUTER INTERACTION. - ISSN 1532-7590. - STAMPA. - (2023). [10.1080/10447318.2023.2185731]

A sketch-based interface for facial animation in immersive virtual reality

Cannavo', Alberto;Lamberti,Fabrizio
2023

Abstract

Creating facial animations using 3D computer graphics represents a very laborious and time-consuming task. Among the numberless approaches for animating faces, the use of blendshapes remains the most common solution because of their simplic- ity and the ability to produce high-quality results. This approach, however, is also characterized by important drawbacks. With the traditional animation suites, in order to select the blendshapes to be activated animators are generally requested to memorize the mapping between the blendshapes and the influenced mesh vertices; alternatively, they need to adopt a trial-and-error search within the whole library of available blendshapes. Moreover, the level of expressiveness that can be reached may be lower than expected; this is due to the fact that the possibility to apply transformations to vertices different than just linear translations and mechanisms for adding, e.g., exaggerations, are typically not integrated into the same anima- tion environment. In order to tackle these issues, this paper proposes an immersive virtual reality-based interface that leverages sketches for the direct manipulation of blendshapes. Animators can draw both linear and curved strokes, which are used to automatically extract information about the blendshape to be activated and its weight, the trajectories that associated vertices have to follow, as well as the timing of the overall animation. A user study was carried out with the aim of evaluating the proposed approach onto several representative animations tasks. Both objective and subjective measurements were collected. Experimental results showed the benefits of the devised interface in terms of task completion time, animation accuracy, and usability.
File in questo prodotto:
File Dimensione Formato  
Revised_accepted_manuscript.pdf

embargo fino al 10/03/2024

Descrizione: Pre-print authors' accepted version
Tipologia: 2. Post-print / Author's Accepted Manuscript
Licenza: PUBBLICO - Tutti i diritti riservati
Dimensione 3.96 MB
Formato Adobe PDF
3.96 MB Adobe PDF   Visualizza/Apri   Richiedi una copia
A Sketch Based Interface for Facial Animation in Immersive Virtual Reality.pdf

non disponibili

Tipologia: 2a Post-print versione editoriale / Version of Record
Licenza: Non Pubblico - Accesso privato/ristretto
Dimensione 3.5 MB
Formato Adobe PDF
3.5 MB Adobe PDF   Visualizza/Apri   Richiedi una copia
Pubblicazioni consigliate

I documenti in IRIS sono protetti da copyright e tutti i diritti sono riservati, salvo diversa indicazione.

Utilizza questo identificativo per citare o creare un link a questo documento: https://hdl.handle.net/11583/2976290