Publication:
Biosignal Based Emotion-Oriented Video Summarization

dc.contributor.authorDERDİYOK, ŞEYMA
dc.contributor.authorAKBULUT, FATMA PATLAR
dc.date.accessioned2023-09-26T07:39:02Z
dc.date.available2023-09-26T07:39:02Z
dc.date.issued2023
dc.description.abstractDigital video is a crucial component of multimedia that enhances presentations with accurate, engaging visual and aural data that affects several industries. The transition of video storage from analog to digital is being fueled by a variety of causes. Improved compression methods, cheaper technology, and more network needs are some of these drivers. This paper presents a novel video summarization based on physiological signals provided by emotional stimuli. Through these stimuli, 15 emotions are analyzed using physiological signals. The dataset was gathered from 15 participants who watched 61 episodes of 14 television series while wearing a wristband. We built several deep-learning models for the main purpose of recognizing emotions to summarize video. Among the established networks, the best performance has been obtained with the 1D-CNN, with 92.87% accuracy. This work has been done through a series of empirical experiments; since the frequency of the physiological signals is different, we used models with original and resampled configurations in each experiment. The comprehensive comparison result indicates that the oversampling approach gives the highest accuracy as well as the lowest computational complexity. The performance of the proposed video summarization approach was evaluated by a survey of participants, and the results showed that the summaries contained the critical moments of the video. The proposed approach may be useful and effective in physiological signal-based applications requiring emotion recognition, such as emotion-based video summarization or film genre detection. Additionally, reading such summaries facilitates comprehension of the significance of making rapid judgments regarding likes, ratings, comments, etc.en
dc.identifier29
dc.identifier.citationDerdiyok, S., Akbulut, F.P. Biosignal based emotion-oriented video summarization. Multimedia Systems 29, 1513–1526 (2023).
dc.identifier.eissn1432-1882
dc.identifier.issn0942-4962
dc.identifier.scopus2-s2.0-85149971993
dc.identifier.urihttps://doi.org/10.1007/s00530-023-01071-4
dc.identifier.urihttps://hdl.handle.net/11413/8772
dc.identifier.wos000949771800001
dc.language.isoen
dc.publisherSpringer
dc.relation.journalMultimedia Systems
dc.rightsinfo:eu-repo/semantics/restrictedAccess
dc.subjectEmotion Recognition
dc.subjectVideo Summarization
dc.subjectDeep Learning
dc.subjectCNN
dc.subjectPhysiological Signal
dc.titleBiosignal Based Emotion-Oriented Video Summarizationen
dc.typeArticle
dspace.entity.typePublication
local.indexed.atwos
local.indexed.atscopus
local.journal.endpage1526
local.journal.issue3
local.journal.startpage1513
relation.isAuthorOfPublication1d87a9f5-cc5f-4f9a-89c1-3167e684df9d
relation.isAuthorOfPublication16c815c6-a2cb-439b-b155-9ca020f8cc04
relation.isAuthorOfPublication.latestForDiscovery1d87a9f5-cc5f-4f9a-89c1-3167e684df9d

Files

Original bundle

Now showing 1 - 1 of 1
No Thumbnail Available
Name:
↓ Tam Metin/Full Text
Size:
1.3 MB
Format:
Adobe Portable Document Format

License bundle

Now showing 1 - 1 of 1
No Thumbnail Available
Name:
license.txt
Size:
1.81 KB
Format:
Item-specific license agreed upon to submission
Description: