User Experience Usability Testing Using Multimodal Facial Emotion Recognition

Pangestu, Sidiq Bimo (2026) User Experience Usability Testing Using Multimodal Facial Emotion Recognition. Other thesis, Institut Teknologi Sepuluh Nopember.

Text 5024221002-Undergraduate_Thesis.pdf - Accepted Version Restricted to Repository staff only Download (4MB) | Request a copy

Abstract

Usability testing (UT) is an essential stage in validating user experience (UX) within the Software Development Life Cycle (SDLC). However, traditional UT methods require human moderators to observe participants and analyse qualitative data, making the process time-consuming and difficult to scale. This project develops an AI-assisted usability testing platform designed to bridge the gap between design and implementation by automating the validation process through multimodal analysis. The web-based platform integrates Speech-to-Text (STT), Text-to-Speech (TTS), Natural Language Processing (NLP), and Facial Emotion Recognition (FER) to guide participants, transcribe speech, detect emotions, and summarize insights. Built using React, FastAPI, and PostgreSQL, the system adopts an Iterative and Incremental Development (IID) approach for continuous refinement. The expected outcome is a proof-of-concept platform that enhances efficiency, scalability, and objectivity in usability testing to provide supportive, rather than replacement, human expertise in UX evaluation.

Item Type:	Thesis (Other)
Uncontrolled Keywords:	Usability Testing (UT), User Experience (UX), Design Validation
Subjects:	T Technology > T Technology (General) > T59.7 Human-machine systems.
Divisions:	Faculty of Intelligent Electrical and Informatics Technology (ELECTICS) > Computer Engineering > 90243-(S1) Undergraduate Thesis
Depositing User:	Sidiq Bimo Pangestu
Date Deposited:	22 Jul 2026 03:31
Last Modified:	22 Jul 2026 03:31
URI:	http://repository.its.ac.id/id/eprint/136185

Actions (login required)

View Item