• Login / Register
    View Item 
    •   Home
    • Support Departments
    • Harvested data
    • View Item
    •   Home
    • Support Departments
    • Harvested data
    • View Item
    JavaScript is disabled for your browser. Some features of this site may not work without it.

    Browse

    All of ChesterRepCommunitiesTitleAuthorsPublication DateSubmit DateSubjectsPublisherJournalThis CollectionTitleAuthorsPublication DateSubmit DateSubjectsPublisherJournalProfilesView

    My Account

    LoginRegister

    About

    AboutUniversity of Chester

    Statistics

    Display statistics

    Synthesising Facial Macro- and Micro-Expressions Using Reference Guided Style Transfer

    • CSV
    • RefMan
    • EndNote
    • BibTex
    • RefWorks
    Thumbnail
    Name:
    jimaging-07-00142.pdf
    Size:
    1.694Mb
    Format:
    PDF
    Download
    Thumbnail
    Name:
    additional-files.zip
    Size:
    593.9Kb
    Format:
    Unknown
    Download
    Thumbnail
    Name:
    jimaging-07-00142.xml
    Size:
    7.274Kb
    Format:
    XML
    Download
    Authors
    Yap, Chuin Hong; orcid: 0000-0003-2251-9308; email: chuin.h.yap@stu.mmu.ac.uk
    Cunningham, Ryan; orcid: 0000-0001-6883-6515; email: Ryan.Cunningham@mmu.ac.uk
    Davison, Adrian K.; orcid: 0000-0002-6496-0209; email: adrian.davison@manchester.ac.uk
    Yap, Moi Hoon; orcid: 0000-0001-7681-4287; email: M.Yap@mmu.ac.uk
    Publication Date
    2021-08-11
    
    Metadata
    Show full item record
    Abstract
    Long video datasets of facial macro- and micro-expressions remains in strong demand with the current dominance of data-hungry deep learning methods. There are limited methods of generating long videos which contain micro-expressions. Moreover, there is a lack of performance metrics to quantify the generated data. To address the research gaps, we introduce a new approach to generate synthetic long videos and recommend assessment methods to inspect dataset quality. For synthetic long video generation, we use the state-of-the-art generative adversarial network style transfer method—StarGANv2. Using StarGANv2 pre-trained on the CelebA dataset, we transfer the style of a reference image from SAMM long videos (a facial micro- and macro-expression long video dataset) onto a source image of the FFHQ dataset to generate a synthetic dataset (SAMM-SYNTH). We evaluate SAMM-SYNTH by conducting an analysis based on the facial action units detected by OpenFace. For quantitative measurement, our findings show high correlation on two Action Units (AUs), i.e., AU12 and AU6, of the original and synthetic data with a Pearson’s correlation of 0.74 and 0.72, respectively. This is further supported by evaluation method proposed by OpenFace on those AUs, which also have high scores of 0.85 and 0.59. Additionally, optical flow is used to visually compare the original facial movements and the transferred facial movements. With this article, we publish our dataset to enable future research and to increase the data pool of micro-expressions research, especially in the spotting task.
    Citation
    Journal of Imaging, volume 7, issue 8, page e142
    Publisher
    MDPI
    URI
    http://hdl.handle.net/10034/625573
    Type
    article
    Description
    From MDPI via Jisc Publications Router
    History: accepted 2021-08-06, pub-electronic 2021-08-11
    Publication status: Published
    Collections
    Harvested data

    entitlement

     
    DSpace software (copyright © 2002 - 2025)  DuraSpace
    Quick Guide | Contact Us
    Open Repository is a service operated by 
    Atmire NV
     

    Export search results

    The export option will allow you to export the current search results of the entered query to a file. Different formats are available for download. To export the items, click on the button corresponding with the preferred download format.

    By default, clicking on the export buttons will result in a download of the allowed maximum amount of items.

    To select a subset of the search results, click "Selective Export" button and make a selection of the items you want to export. The amount of items that can be exported at once is similarly restricted as the full export.

    After making a selection, click one of the export format buttons. The amount of items that will be exported is indicated in the bubble next to export format.