Bilgisayar Mühendisliği Bölümü / Department of Computer Engineering
Permanent URI for this collectionhttps://hdl.handle.net/11413/6817
Browse
Browsing Bilgisayar Mühendisliği Bölümü / Department of Computer Engineering by Author "AKBULUT, FATMA PATLAR"
Now showing 1 - 20 of 26
- Results Per Page
- Sort Options
Publication A cloud-based recommendation service using principle component analysis–scale-invariant feature transform algorithm(2017-10) Çatal, Çağatay; AKBULUT, AKHAN; AKBULUT, FATMA PATLAR; 116056; 108363; 299243Cloud computing delivers resources such as software, data, storage and servers over the Internet; its adaptable infrastructure facilitates on-demand access of computational resources. There are many benefits of cloud computing such as being scalable, paying only for consumption, improving accessibility, limiting investment costs and being environmentally friendly. Thus, many organizations have already started applying this technology to improve organizational efficiency. In this study, we developed a cloud-based book recommendation service that uses a principle component analysis–scale-invariant feature transform (PCA-SIFT) feature detector algorithm to recommend book(s) based on a user-uploaded image of a book or collection of books. The high dimensionality of the image is reduced with the help of a principle component analysis (PCA) pre-processing technique. When the mobile application user takes a picture of a book or a collection of books, the system recognizes the image(s) and recommends similar books. The computational task is performed via the cloud infrastructure. Experimental results show the PCA-SIFT-based cloud recommendation service is promising; additionally, the application responds faster when the pre-processing technique is integrated. The proposed generic cloud-based recommendation system is flexible and highly adaptable to new environments.Publication A decision support system to determine optimal ventilator settings(Biomed Central Ltd, 236 Grays Inn Rd, Floor 6, London Wc1X 8Hl, England, 2014) Akkur, Erkan; Akan, Aydın; Yarman, B. Sıddık; AKBULUT, FATMA PATLARBackground: Choosing the correct ventilator settings for the treatment of patients with respiratory tract disease is quite an important issue. Since the task of specifying the parameters of ventilation equipment is entirely carried out by a physician, physician ' s knowledge and experience in the selection of these settings has a direct effect on the accuracy of his/her decisions. Nowadays, decision support systems have been used for these kinds of operations to eliminate errors. Our goal is to minimize errors in ventilation therapy and prevent deaths caused by incorrect configuration of ventilation devices. The proposed system is designed to assist less experienced physicians working in the facilities without having lung mechanics like cottage hospitals. Methods: This article describes a decision support system proposing the ventilator settings required to be applied in the treatment according to the patients ' physiological information. The proposed model has been designed to minimize the possibility of making a mistake and to encourage more efficient use of time in support of the decision making process while the physicians make critical decisions about the patient. Artificial Neural Network (ANN) is implemented in order to calculate frequency, tidal volume, FiO(2) outputs, and this classification model has been used for estimation of pressure support /volume support outputs. For the obtainment of the highest performance in both models, different configurations have been tried. Various tests have been realized for training methods, and a number of hidden layers mostly affect factors regarding the performance of ANNs. Results: The physiological information of 158 respiratory patients over the age of 60 and were treated in three different hospitals between the years 2010 and 2012 has been used in the training and testing of the system. The diagnosed disease, core body temperature, pulse, arterial systolic pressure, diastolic blood pressure, PEEP, PSO2, pH, pCO(2), bicarbonate data as well as the frequency, tidal volume, FiO(2), and pressure support / volume support values suitable for use in the ventilator device have been recommended to the physicians with an accuracy of 98,44%. Performed experiments show that sequential order weight/bias training was found to be the most ideal ANN learning algorithm for regression model and Bayesian regulation backpropagation was found to be the most ideal ANN learning algorithm for classification models. Conclusions: This article aims at making independent of the choice of parameters from physicians in the ventilator treatment of respiratory tract patients with proposed decision support system. The rate of accuracy in prediction of systems increases with the use of data of more patients in training. Therefore, non-physician operators can use systems in determination of ventilator settings in case of emergencies.Publication A pipeline for adaptive filtering and transformation of noisy left-arm ECG to its surrogate chest signal(MDPI AG, 2020-05) Tanneeru, Akhilesh; Lee, Bongmook; Misra, Veena; Mohaddes, F.; Zhou, Y.; Lobaton, E.; AKBULUT, FATMA PATLARThe performance of a low-power single-lead armband in generating electrocardiogram (ECG) signals from the chest and left arm was validated against a BIOPAC MP160 benchtop system in real-time. The filtering performance of three adaptive filtering algorithms, namely least mean squares (LMS), recursive least squares (RLS), and extended kernel RLS (EKRLS) in removing white (W), power line interference (PLI), electrode movement (EM), muscle artifact (MA), and baseline wandering (BLW) noises from the chest and left-arm ECG was evaluated with respect to the mean squared error (MSE). Filter parameters of the used algorithms were adjusted to ensure optimal filtering performance. LMS was found to be the most effective adaptive filtering algorithm in removing all noises with minimum MSE. However, for removing PLI with a maximal signal-to-noise ratio (SNR), RLS showed lower MSE values than LMS when the step size was set to 1 × 10−5. We proposed a transformation framework to convert the denoised left-arm and chest ECG signals to their low-MSE and high-SNR surrogate chest signals. With wide applications in wearable technologies, the proposed pipeline was found to be capable of establishing a baseline for comparing left-arm signals with original chest signals, getting one step closer to making use of the left-arm ECG in clinical cardiac evaluations.Publication A smart wearable system for short-term cardiovascular risk assessment with emotional dynamics(Elsevier Sci Ltd, The Boulevard, Langford Lane, Kidlington, Oxford Ox5 1Gb, Oxon, England, 2018-11) Akan, Aydın; AKBULUT, FATMA PATLAR; 2918Recent innovative treatment and diagnostic methods developed for heart and circulatory system disorders do not provide the desired results as they are not supported by long-term patient follow-up. Continuous medical support in a clinic or hospital is often not feasible in elderly or aging populations; yet, collecting medical data is still required to maintain a high-quality of life. In this study, a smart wearable system design called Cardiovascular Disease Monitoring (CVDiMo), which provides continuous medical monitoring and creates a health profile with the risk of disease over time. Systematic tests were performed with analysis of six different biosignals from two different test groups with 30 participants. In addition to examining the biosignals of patients, using the physical activity results and stress levels deduced from the emotional state analysis achieved a higher performance in risk estimation. In our experiments, the highest accuracy of determining the short-term health status was obtained as 96%.Publication Analysis of Facial Emotion Expression in Eating Occasions Using Deep Learning(Springer, 2023) ELİF, YILDIRIM; AKBULUT, FATMA PATLAR; Çatal, ÇağatayEating is experienced as an emotional social activity in any culture. There are factors that influence the emotions felt during food consumption. The emotion felt while eating has a significant impact on our lives and affects different health conditions such as obesity. In addition, investigating the emotion during food consumption is considered a multidisciplinary problem ranging from neuroscience to anatomy. In this study, we focus on evaluating the emotional experience of different participants during eating activities and aim to analyze them automatically using deep learning models. We propose a facial expression-based prediction model to eliminate user bias in questionnaire-based assessment systems and to minimize false entries to the system. We measured the neural, behavioral, and physical manifestations of emotions with a mobile app and recognize emotional experiences from facial expressions. In this research, we used three different situations to test whether there could be any factor other than the food that could affect a person’s mood. We asked users to watch videos, listen to music or do nothing while eating. This way we found out that not only food but also external factors play a role in emotional change. We employed three Convolutional Neural Network (CNN) architectures, fine-tuned VGG16, and Deepface to recognize emotional responses during eating. The experimental results demonstrated that the fine-tuned VGG16 provides remarkable results with an overall accuracy of 77.68% for recognizing the four emotions. This system is an alternative to today’s survey-based restaurant and food evaluation systems.Publication Analysis of the Lingering Effects of COVID-19 on Distance Education(Springer Science and Business Media Deutschland GmbH, 2023) KOCAÇINAR, BÜŞRA; QARIZADA, NASIBULLAH; DİKKAYA, CİHAN; AZGUN, EMİRHAN; ELİF, YILDIRIM; AKBULUT, FATMA PATLAREducation has been severely impacted by the spread of the COVID-19 virus. In order to prevent the spread of the COVID-19 virus and maintain education in the current climate, governments have compelled the public to adopt online platforms. Consequently, this decision has affected numerous lives in various ways. To investigate the impact of COVID-19 on students’ education, we amassed a dataset consisting of 10,000 tweets. The motivations of the study are; (i) to analyze the positive, negative, and neutral effects of COVID-19 on education; (ii) to analyze the opinions of stakeholders in their tweets about the transition from formal education to e-learning; (iii) to analyze people’s feelings and reactions to these changes; and (iv) to analyze the effects of different training methods on different groups. We constructed emotion recognition models utilizing shallow and deep techniques, including Convolutional Neural Network (CNN), Recurrent Neural Network (RNN), Long-short Term Memory (LSTM), Random Forest (RF), Naive Bayes (NB), Support Vector Machine (SVM), and Logical Regression (LR). RF algorithms with a bag-of-words model outperformed with over 80% accuracy in recognizing emotions.Publication Bimodal affect recognition based on autoregressive hidden Markov models from physiological signals(2020-10) Perros, H.G; Shahzad, M.; AKBULUT, FATMA PATLARBackground and objective: Affect provides contextual information about the emotional state of a person as he/she communicates in both verbal and/or non-verbal forms. While human's are great at determining the emotional state of people while they communicate in person, it is challenging and still largely an unsolved problem to computationally determine the emotional state of a person. Methods: Emotional states of a person manifest in the physiological biosignals such as electrocardiogram (ECG) and electrodermal activity (EDA) because these signals are impacted by the peripheral nervous system of the body, and the peripheral nervous system is strongly coupled with the mental state of the person. In this paper, we present a method to accurately recognize six emotions using ECG and EDA signals and applying autoregressive hidden Markov models (AR-HMMs) and heart rate variability analysis on these signals. The six emotions include happiness, sadness, surprise, fear, anger, and disgust. Results: We evaluated our method on a comprehensive new dataset collected from 30 participants. Our results show that our proposed method achieves an average accuracy of 88.6% in distinguishing across the 6 emotions. Conclusions: The key technical depth of the paper is in the use of the AR-HMMs to model the EDA signal and the use of LDA to enable accurate emotion recognition without requiring a large number of training samples. Unlike other studies, we have taken a hierarchical approach to classify emotions, where we first categorize the emotion as either positive or negative and then identify the exact emotion.Publication Biosignal Based Emotion-Oriented Video Summarization(Springer, 2023) DERDİYOK, ŞEYMA; AKBULUT, FATMA PATLARDigital video is a crucial component of multimedia that enhances presentations with accurate, engaging visual and aural data that affects several industries. The transition of video storage from analog to digital is being fueled by a variety of causes. Improved compression methods, cheaper technology, and more network needs are some of these drivers. This paper presents a novel video summarization based on physiological signals provided by emotional stimuli. Through these stimuli, 15 emotions are analyzed using physiological signals. The dataset was gathered from 15 participants who watched 61 episodes of 14 television series while wearing a wristband. We built several deep-learning models for the main purpose of recognizing emotions to summarize video. Among the established networks, the best performance has been obtained with the 1D-CNN, with 92.87% accuracy. This work has been done through a series of empirical experiments; since the frequency of the physiological signals is different, we used models with original and resampled configurations in each experiment. The comprehensive comparison result indicates that the oversampling approach gives the highest accuracy as well as the lowest computational complexity. The performance of the proposed video summarization approach was evaluated by a survey of participants, and the results showed that the summaries contained the critical moments of the video. The proposed approach may be useful and effective in physiological signal-based applications requiring emotion recognition, such as emotion-based video summarization or film genre detection. Additionally, reading such summaries facilitates comprehension of the significance of making rapid judgments regarding likes, ratings, comments, etc.Publication Deep Learning-Based User Experience Evaluation in Distance Learning(Springer, 2023) SADIGOV, RAHIM; YILDIRIM, ELİF; KOCAÇINAR, BÜŞRA; AKBULUT, FATMA PATLAR; Çatal, ÇağatayThe Covid-19 pandemic caused uncertainties in many different organizations, institutions gained experience in remote working and showed that high-quality distance education is a crucial component in higher education. The main concern in higher education is the impact of distance education on the quality of learning during such a pandemic. Although this type of education may be considered effective and beneficial at first glance, its effectiveness highly depends on a variety of factors such as the availability of online resources and individuals' financial situations. In this study, the effectiveness of e-learning during the Covid-19 pandemic is evaluated using posted tweets, sentiment analysis, and topic modeling techniques. More than 160,000 tweets, addressing conditions related to the major change in the education system, were gathered from Twitter social network and deep learning-based sentiment analysis models and topic models based on latent dirichlet allocation (LDA) algorithm were developed and analyzed. Long short term memory-based sentiment analysis model using word2vec embedding was used to evaluate the opinions of Twitter users during distance education and also, a topic model using the LDA algorithm was built to identify the discussed topics in Twitter. The conducted experiments demonstrate the proposed model achieved an overall accuracy of 76%. Our findings also reveal that the Covid-19 pandemic has negative effects on individuals 54.5% of tweets were associated with negative emotions whereas this was relatively low on emotion reports in the YouGov survey and gender-rescaled emotion scores on Twitter. In parallel, we discuss the impact of the pandemic on education and how users' emotions altered due to the catastrophic changes allied to the education system based on the proposed machine learning-based models.Publication Deep Sentiment Analysis With Data Augmentation in Distance Education During the Pandemic(Institute of Electrical and Electronics Engineers Inc., 2022) SOSUN, SERA DENİZ; TAYFUN, BÜLENT; NUKAN, YASEMİN; ALTUN, İREM; ERİK, ELİF BERRA; YILDIRIM, ELİF; KOCAÇINAR, BÜŞRA; AKBULUT, FATMA PATLARDuring the global Covid-19 pandemic, the shutdown of educational institutes has resulted in a phenomenal surge in online learning. Academic activities were shifted to online learning platforms to restrict the influence of COVID-19 and block its spread. For both students and parents, the efficiency of online learning is a major concern, particularly in terms of its suitability for students and teachers, as well as its technological applicability in various social situations. Before the online learning approach can be employed on such a big scale, such challenges must be viewed from different aspects. This study aims to assess the efficiency of online learning by examining individuals' sentiments toward it. Due to social media becoming such an essential form of communication, people's opinions can be observed on platforms like Twitter. The main motivation is to use a Twitter dataset featuring online learning-related tweets. Briefly, we focused on specifying the impact of the Covid-19 pandemic on education in many aspects and parameters by using tweets. We utilized natural language processing models for text classification with a gathered dataset that includes fetching tweets consisting of Covid-19 and education topics. We developed a fine-tuned Long short-term memory (LSTM) model that utilizes data augmentation for classifying the emotional states of individuals. With the deep sentiment analysis model that we proposed, we observed that the negative sentiments were experienced more. © 2022 IEEE.Publication e-Vital: A Wrist-Worn Wearable Sensor Device for Measuring Vital Parameters(2019-10-03) Özcan, Özgür; Çınar, İpek; AKBULUT, FATMA PATLAR; 299243; 56720In today’s world, connected wearable sensors became a delicate part of the imperative daily analysis and assessment to identify the urgency of the state of health. Recent advances in sensor designs and analysis techniques enable us to uniquely distinguish noninvasive wearable sensor technology with an exclusive integration to the body surfaces. In this regard, we have developed a low-cost wrist-worn wearable device called E-Vital that can monitor health conditions closely so that patient follow-up can access information directly and in a practical way. We aimed to design the system as a comprehensive and compact monitoring scheme by measuring physiological health parameters in long-term usage. In addition to the measurement of physiological signals such as an electrocardiogram (ECG), Galvanic Skin Response (GSR) and body temperature, it is possible to instantly display and store this health data with the E-Vital mobile application. Bluetooth technology is used to provide instant wireless data communication between the sensor device and the mobile application. Additionally, an SD card module attached to the sensor to prevent data loss against possible connection problems as a local buffer. The measurement performance of the proposed sensor device for capturing the electrophysiological signals, such as an ECG is compared with ECG obtained by a conventional gold standard data. The results indicate that the wearable sensor has an acceptable signal-to-noise ratio (SNR). Both the sensor device and mobile system have successfully been in terms of signal quality, continuous data transportation, and data storing performance during on-body trials.Publication Estimation of beat-to-beat interval from wearable photoplethysmography sensor on different measurement sites during daily activities(2018) Lawless, Kevin; Tanneeru, Akhilesh; Rao, Smriti; Lee, Bongmook; Misra, Veena; AKBULUT, FATMA PATLARIn this study, we present an algorithm to detect beat-to-beat interval from PPG in the presence of motion artifacts. Our approach includes splitting slowly varying DC components, statistical detrending, and Bessel filtering and Fast Fourier Transform with square window to reduce motion artifacts dependent on spectrum analysis. The algorithm segments beat intervals with a spectrogram to find the characteristic points of the waveform such as systolic and diastolic points. Interbeat intervals (IBI) are determined from these characteristic points to calculate heart rate. The PPG IBI algorithm is validated against ECG RR intervals from five different measurement sites during three daily activities. The results show that the most accurate IBI and HR detection from a wearable PPG device during regular user activity is from the upper arm or finger.Publication Evaluating the Effects of the Autonomic Nervous System and Sympathetic Activity on Emotional States(Doç. Dr. Necip Şimşek, 2022) AKBULUT, FATMA PATLAREmotion recognition has attracted more interest by being applied in many application areas from different domains such as medical diagnosis, e-commerce, and robotics. This research quantifies the stimulated short-term effect of emotions on the autonomic nervous system and sympathetic activity. The primary purpose of this study is to investigate the responses of 21 adults by attaching a wearable system to measure physiological data such as an electrocardiogram and electrodermal activity in a controlled environment. Cardiovascular effects were evaluated with heart rate variability indices that included HR, HRV triangular-index, rMSSD (ms), pNN5O (%); frequency analysis of the very low frequency (VLF: 0-0,04 Hz), low frequency (LF: 0,04-0,15 Hz), and high frequency (HF: 0,15-0,4 Hz) components; nonlinear analysis. The sympathetic activity was evaluated with time-varying and time-invariant spectral analysis results of the EDA. The participants who experience calmness had a 4,8% lower heart rate (75,06±16,76 and 78,72±16,52) observed compared to happiness. Negative valance with high-arousal emotions like anger was invariably responded to with a peak in skin conductance level. Besides, negative valance with low-arousal emotions like sadness was allied with a drop in conductance level. Anger, in addition to being the most well-known emotion, elicited coherent time-varying spectral responses.Publication Global Impact of the Pandemic on Education: A Study of Natural Language Processing(Institute of Electrical and Electronics Engineers Inc., 2022) AYAZ, TEOMAN BERKAY; USLU, MUHAMMED SAFA; AĞCABAY, İBRAHİM; AHMED, FARUK; KORKMAZ, ÖMER FARUK; KÜREKSİZ, MESUT; ULUÇAM, EMRE; YILDIRIM, ELİF; KOCAÇINAR, BÜŞRA; AKBULUT, FATMA PATLARSchool closures due to the Covid-19 pandemic have changed education forever and we have witnessed the rise of online learning platforms. The education units of the countries made great efforts to adapt to this new order. The expanding, quick spread of the virus and careful steps have prompted the quest for reasonable choices for continuing education to guarantee students get appropriate education and are not impacted logically or mentally. Different methods were attempted to understand how students were affected by this big change. In addition to the significance of traditional surveys and consulting services, the utilization of social media analysis is used as a supportive approach. This paper analyzes the feedback of students on social media via tweets. Deep sentiment analysis is employed to identify embedded emotions such as negative, neutral, and positive. We also aimed to classify irrelevant tweets as the fourth category. Our experiments showed that the tweets are mostly biased toward negative emotions. © 2022 IEEE.Publication Hybrid Deep Convolutional Model-Based Emotion Recognition Using Multiple Physiological Signals(Taylor & Francis Ltd., 2022) AKBULUT, FATMA PATLAREmotion recognition has become increasingly utilized in the medical, advertising, and military domains. Recognizing the cues of emotion from human behaviors or physiological responses is encouraging for the research community. However, extracting true characteristics from sensor data to understand emotions can be challenging due to the complex nature of these signals. Therefore, advanced feature engineering techniques are required for accurate signal recognition. This study presents a hybrid affective model that employs a transfer learning approach for emotion classification using large-frame sensor signals which employ a genuine dataset of signal fusion gathered from 30 participants using wearable sensor systems interconnected with mobile devices. The proposed approach implements several learning algorithms such as Convolutional Neural Network (CNN), Long Short-Term Memory (LSTM), Recurrent Neural Network (RNN), and several other shallow methods on the sensor input to handle the requirements for the traditional feature extraction process. The findings reveal that the use of deep learning methods is satisfactory in affect recognition when a great number of frames is employed, and the proposed hybrid deep model outperforms traditional neural network (overall accuracy of 54%) and deep learning approaches (overall accuracy of 76%), with an average classification accuracy of 93%. This hybrid deep model also has a higher accuracy than our previously proposed statistical autoregressive hidden Markov model (AR-HMM) approach, with 88.6% accuracy. Accuracy assessment was performed by means of several statistics measures (accuracy, precision, recall, F-measure, and RMSE).Publication Investigating the Effects of Stress on Achievement: BIOSTRESS Dataset(Elsevier Inc., 2023) ÇÖPÜRKAYA, ÇAĞLA; MERİÇ, ELİF; ERİK, ELİF BERRA; KOCAÇINAR, BÜŞRA; AKBULUT, FATMA PATLAR; Çatal, ÇağatayThe effects of chronic stress on academic and professional achievement can have a substantial impact. This relationship is highlighted through a dataset that includes questionnaires and physiological data from a group of individuals. The questionnaire data of 48 individuals, the physiological data of 20 individuals during sessions with a psychologist, and the exam data of 8 individuals were analyzed. The questionnaire data collected includes demographic information and scores on the TOAD stress scale. Physiological data was captured using the Empatica e4, a wearable device, which measured various signals such as blood volume pulse, electrodermal activity, body temperature, interbeat intervals, heart rate, and 3-axis accelerometer data. These measurements were taken under different stress conditions, both high and low, during therapy sessions and an exam respectively. Overall, this study significantly contributes to our understanding of how stress affects achievement. By providing a large dataset consisting of questionnaires and physiological data, this research helps researchers gain a better understanding of the complex relationship between stress and achievement. It also enables them to develop innovative strategies for managing stress and enhancing academic and professional success.Publication Multi-Modal Fusion Learning Through Biosignal, Audio, and Visual Content for Detection of Mental Stress(Springer London Ltd., 2023) GÜLİN, DOĞAN; AKBULUT, FATMA PATLARMental stress is a significant risk factor for several maladies and can negatively impact a person's quality of life, including their work and personal relationships. Traditional methods of detecting mental stress through interviews and questionnaires may not capture individuals' instantaneous emotional responses. In this study, the method of experience sampling was used to analyze the participants' immediate affective responses, which provides a more comprehensive and dynamic understanding of the participants' experiences. WorkStress3D dataset was compiled using information gathered from 20 participants for three distinct modalities. During an average of one week, 175 h of data containing physiological signals such as BVP, EDA, and body temperature, as well as facial expressions and auditory data, were collected from a single subject. We present a novel fusion model that uses double-early fusion approaches to combine data from multiple modalities. The model's F1 score of 0.94 with a loss of 0.18 is very encouraging, showing that it can accurately identify and classify varying degrees of stress. Furthermore, we investigate the utilization of transfer learning techniques to improve the efficacy of our stress detection system. Despite our efforts, we were unable to attain better results than the fusion model. Transfer learning resulted in an accuracy of 0.93 and a loss of 0.17, illustrating the difficulty of adapting pre-trained models to the task of stress analysis. The results we obtained emphasize the significance of multi-modal fusion in stress detection and the importance of selecting the most suitable model architecture for the given task. The proposed fusion model demonstrates its potential for achieving an accurate and robust classification of stress. This research contributes to the field of stress analysis and contributes to the development of effective models for stress detection.Publication NeuroBioSense: A Multidimensional Dataset for Neuromarketing Analysis(Elsevier, 2024) KOCAÇINAR, BÜŞRA; İNAN, PELİN; ZAMUR, ELA NUR; ÇALŞİMŞEK, BUKET; AKBULUT, FATMA PATLAR; Çatal, ÇağatayIn the context of neuromarketing, sales, and branding, the investigation of consumer decision-making processes presents complex and intriguing challenges. Consideration of the effects of multicultural influences and societal conditions from a global perspective enriches this multifaceted field. The application of neuroscience tools and techniques to international marketing and consumer behavior is an emerging interdisciplinary field that seeks to understand the cognitive processes, reactions, and selection mechanisms of consumers within the context of branding and sales. The NeuroBioSense dataset was prepared to analyze and classify consumer responses. This dataset includes physiological signals, facial images of the participants while watching the advertisements, and demographic information. The primary objective of the data collection process is to record and analyze the responses of human subjects to these signals during a carefully designed experiment consisting of three distinct phases, each of which features a different form of branding advertisement. Physiological signals were collected with the Empatica e4 wearable sensor device, considering non-invasive body photoplethysmography (PPG), electrodermal activity (EDA), and body temperature sensors. A total of 58 participants, aged between 18 and 70, were divided into three different groups, and data were collected. Advertisements prepared in the categories of cosmetics for 18 participants, food for 20 participants, and cars for 20 participants were watched. On the emotion evaluation scale, 7 different emotion classes are given: Joy, Surprise, anger, disgust, sadness, fear, and neutral. This dataset will help researchers analyse responses, understand and develop emotion classification studies, the relationship between consumers and advertising, and neuromarketing methods.Publication Neurophysiological and Biosignal Data for Investigating Occupational Mental Fatigue: MEFAR Dataset(Elsevier, 2024) Derdiyok, Şeyma; AKBULUT, FATMA PATLAR; Çatal, ÇağatayThe prevalence of mental fatigue is a noteworthy phenomenon that can affect individuals across diverse professions and working routines. This paper provides a comprehensive dataset of physiological signals obtained from 23 participants during their professional work and questionnaires to analyze mental fatigue. The questionnaires included demographic information and Chalder Fatigue Scale scores indicating mental and physical fatigue. Both physiological signal measurements and the Chalder Fatigue Scale were performed in two sessions, morning and evening. The present dataset encompasses diverse physiological signals, including electroencephalogram (EEG), blood volume pulse (BVP), electrodermal activity (EDA), heart rate (HR), skin temperature (TEMP), and 3-axis accelerometer (ACC) data. The NeuroSky MindWave EEG device was used for brain signals, and the Empatica E4 smart wristband was used for other signals. Measurements were carried out on individuals from four different occupational groups, such as academicians, technicians, computer engineers, and kitchen workers. The provision of comprehensive metadata supplements the dataset, thereby promoting inquiries about the neurophysiological concomitants of mental fatigue, autonomic activity patterns, and the repercussions of a cognitive burden on human proficiency in actual workplace settings. The accessibility of the aforementioned dataset serves to facilitate progress in the field of mental fatigue research while also laying the groundwork for the creation of customized fatigue evaluation techniques and interventions in diverse professional domains.Publication A Real-Time CNN-Based Lightweight Mobile Masked Face Recognition System(IEEE-Inst Electrical Electronics Engineers Inc., 2022) KOCAÇINAR, BÜŞRA; Taş, Bilal; AKBULUT, FATMA PATLAR; Çatal, Çağatay; Mishra, DeeptiDue to the global spread of the Covid-19 virus and its variants, new needs and problems have emerged during the pandemic that deeply affects our lives. Wearing masks as the most effective measure to prevent the spread and transmission of the virus has brought various security vulnerabilities. Today we are going through times when wearing a mask is part of our lives, thus, it is very important to identify individuals who violate this rule. Besides, this pandemic makes the traditional biometric authentication systems less effective in many cases such as facial security checks, gated community access control, and facial attendance. So far, in the area of masked face recognition, a small number of contributions have been accomplished. It is definitely imperative to enhance the recognition performance of the traditional face recognition methods on masked faces. Existing masked face recognition approaches are mostly performed based on deep learning models that require plenty of samples. Nevertheless, there are not enough image datasets containing a masked face. As such, the main objective of this study is to identify individuals who do not use masks or use them incorrectly and to verify their identity by building a masked face dataset. On this basis, a novel real-time masked detection service and face recognition mobile application was developed based on an ensemble of fine-tuned lightweight deep Convolutional Neural Networks (CNN). The proposed model achieves 90.40% validation accuracy using 12 individuals' 1849 face samples. Experiments on the five datasets built in this research demonstrate that the proposed system notably enhances the performance of masked face recognition compared to the other state-of-the-art approaches.