Perancangan Prosedur Evaluasi Usability Untuk Rekomendasi Desain Situs Departemen ITS Dengan Pendekatan Kuantitatif Multi-instrumen

Amali, Muhammad Ahdaf (2026) Perancangan Prosedur Evaluasi Usability Untuk Rekomendasi Desain Situs Departemen ITS Dengan Pendekatan Kuantitatif Multi-instrumen. Other thesis, Institut Teknologi Sepuluh Nopember.

Text 5026221129-Undergraduate_Thesis.pdf - Accepted Version Restricted to Repository staff only Download (3MB) | Request a copy

Abstract

Evaluasi usability situs web perguruan tinggi umumnya bertumpu pada satu instrumen sehingga hanya menangkap sebagian dimensi pengalaman pengguna, seperti pendekatan kinerja tugas tidak mencakup persepsi kepercayaan dan loyalitas, sementara kuesioner tunggal tidak menggambarkan hambatan pada tugas tertentu. Penelitian ini bertujuan merancang dan menerapkan prosedur evaluasi usability kuantitatif multi-instrumen pada tiga situs web departemen Institut Teknologi Sepuluh Nopember (ITS), yaitu Sistem Informasi (DSI), Desain Komunikasi Visual (DKV), dan Teknik Kimia (DTK). Prosedur mengintegrasikan Task Success Rate (TSR), Task Completion Time (TCT), Single Ease Question (SEQ) per tugas, dan Standardized User Experience Percentile Rank Questionnaire (SUPR-Q) per situs. Data dikumpulkan dari 30 mahasiswa aktif ITS dalam desain within-subjects dengan lima skenario tugas per situs. Analisis melibatkan Repeated Measures ANOVA, uji Friedman, dan korelasi Spearman hingga Pearson; temuan dipetakan ke 13 usability heuristics pendidikan tinggi dari Singla dan Aggarwal. Situs DKV menunjukkan performa terbaik (TSR 97,3%; TCT 57,99 detik; SEQ 6,28; SUPR-Q 4,41). Situs DSI paling kritis: seluruh responden gagal pada tugas ketiga (TSR 0%; SEQ 1,57) akibat ketidaktersediaan konten, dan waktu penyelesaian tugas kedua mencapai 3,51 kali lebih lambat dari DKV. Perbedaan antarsitus signifikan pada seluruh metrik (η²p hingga 0,548). TSR dan TCT berkorelasi signifikan dengan SEQ tetapi tidak dengan SUPR-Q, mengonfirmasi bahwa persepsi kemudahan per tugas dan kualitas pengalaman situs merupakan dua konstruk berbeda yang perlu diukur bersamaan. Rekomendasi untuk DSI meliputi pemulihan akses konten prosedur tugas akhir, penyederhanaan jalur navigasi kurikulum, dan standardisasi tata letak antarmuka. DTK diprioritaskan pada pemendekan jalur navigasi tugas kedua dan peningkatan keterlihatan konten tugas akhir, sedangkan DKV difokuskan pada pemeliharaan konsistensi navigasi dan visibilitas konten tugas ketiga. Penelitian ini menyediakan bukti empiris lokal mengenai hubungan metrik objektif–subjektif usability pada situs departemen universitas di Indonesia, serta prosedur evaluasi terdokumentasi yang dapat diterapkan tanpa perangkat khusus.
=================================================================================================================================
Usability evaluations of university websites commonly rely on a single instrument, limiting the assessment to specific aspects of the user experience. Performance-based measures do not capture perceptions such as trust and loyalty, while questionnaires alone cannot identify task-specific usability barriers. This study designed and implemented a multi-instrument quantitative usability evaluation procedure for three department websites at the Sepuluh Nopember Institute of Technology (ITS): Information Systems (DSI), Visual Communication Design (DKV), and Chemical Engineering (DTK). The procedure integrated Task Success Rate (TSR), Task Completion Time (TCT), Single Ease Question (SEQ), and Standardized User Experience Percentile Rank Questionnaire (SUPR-Q). Data were collected from 30 active ITS students using a within-subjects design with five task scenarios per website. Data were analyzed using Repeated Measures ANOVA, the Friedman test, and Pearson's and Spearman's correlations, then mapped to the 13 higher education usability heuristics proposed by Singla and Aggarwal. DKV achieved the best overall usability (TSR 97.3%, TCT 57.99 s, SEQ 6.28, SUPR-Q 4.41). DSI showed the poorest performance, with complete failure on the third task (TSR 0%, SEQ 1.57) caused by unavailable content, while the second task required 3.51 times longer than DKV. Significant differences were found across all usability metrics (η²p up to 0.548). TSR and TCT correlated significantly with SEQ but not with SUPR-Q, indicating that task-level perceived ease and overall website experience represent distinct constructs that should be evaluated together. The findings informed website-specific usability improvements and provide empirical evidence on the relationship between objective and subjective usability metrics for Indonesian university websites, alongside a practical evaluation procedure that can be applied without specialized equipment.

Item Type:	Thesis (Other)
Uncontrolled Keywords:	Evaluasi Usability, SUPR-Q, SEQ, Usability Heuristics, Usability Evaluation
Subjects:	T Technology > T Technology (General)
Divisions:	Faculty of Intelligent Electrical and Informatics Technology (ELECTICS) > Information System > 57201-(S1) Undergraduate Thesis
Depositing User:	Muhammad Ahdaf Amali
Date Deposited:	29 Jul 2026 01:33
Last Modified:	29 Jul 2026 01:33
URI:	http://repository.its.ac.id/id/eprint/139154

Actions (login required)

View Item