View Item 
        •   Utrecht University Student Theses Repository Home
        • UU Theses Repository
        • Theses
        • View Item
        •   Utrecht University Student Theses Repository Home
        • UU Theses Repository
        • Theses
        • View Item
        JavaScript is disabled for your browser. Some features of this site may not work without it.

        Browse

        All of UU Student Theses RepositoryBy Issue DateAuthorsTitlesSubjectsThis CollectionBy Issue DateAuthorsTitlesSubjects

        Data-Driven Gaze Animation using Recurrent Neural Networks

        Thumbnail
        View/Open
        FinalThesis.pdf (11.72Mb)
        Publication date
        2018
        Author
        Klein, A.
        Metadata
        Show full item record
        Summary
        We present a real-time gaze animation system using recurrent neural networks. Both motion capture data and video from a head-mounted camera are used to train the network to predict the motion of the body and the eyes. The system is trained separately on different poses, e.g. standing, sitting, and laying down, and is able to learn constraints on movement per pose. A simplified version of the neural network is presented, for scenarios which allow for lower detail gaze animation. We compare various neural network architectures and show that our method has the capability to learn realistic gaze motion from the data, while maintaining performance. Results from a user study conducted among game industry professionals, shows that our method significantly improves perceived naturalness of the gaze animation, compared to a manually created procedural gaze system.
        URI
        https://studenttheses.uu.nl/handle/20.500.12932/39399
        Collections
        • Theses
        Utrecht university logo