Text

Evaluasi Kebergunaan Sumatif dan Kuantitatif terhadap Website Sistem Informasi Ujian Mandiri Universitas Diponegoro

---

ABSTRAK
Sistem Informasi Ujian Mandiri Universitas Diponegoro (UM Undip) sebagai kesan dan
representasi layanan penerimaan mahasiswa baru di Universitas Diponegoro memerlukan
evaluasi untuk mengetahui kualitas kebergunaannya berdasarkan penilaian pengguna.
Evaluasi bersifat sumatif untuk menyediakan penilaian keseluruhan dari website UM Undip,
sedangkan tipe evaluasi kuantitatif menghasilkan metriks yang dapat diukur dengan bilangan
sehingga memungkinkan untuk perhitungan benchmark dan analisa statistik. Berdasarkan
data kuantitatif, metode evaluasi terbagi ke dalam metode berbasis kinerja untuk mengukur
aspek effectiveness dan efficiency, serta metode evaluasi berbasis kuisioner untuk mengukur
aspek satisfaction dan learnability. Berdasarkan penilaian confidence interval dengan
confidence level 90% diperoleh nilai usability untuk aspek effectiveness yaitu tingkat
kesuksesan tugas antara 59% - 67%, untuk aspek efficiency diperoleh waktu pengerjaan
tugas antara 85 -115 detik, untuk aspek satisfaction diperoleh nilai kuisioner PSSUQ antara
2,17 – 2,86, untuk aspek learnability diperoleh nilai atribut learnability sebesar 1,99 – 2,81.
Berdasarkan analisa perhitungan benchmark, keempat aspek usability tidak memenuhi
kriteria benchmark usability masing-masing. Ditemukan perbedaan nilai usability yang
signifikan antara perangkat mobile dan perangkat non mobile pada aspek satisfaction dan
learnability dan perbedaan nilai usability yang signifikan antara kategori calon mahasiswa
dan orang tua pada aspek efficiency. Ditemukan rekomendasi perbaikan berdasarkan tiap
aspek usability yaitu: pada fungsi pencarian informasi status kelulusan, dan pencarian
informasi pendaftaran ulang berdasarkan aspek effectiveness; pada fungsi pencarian profil
lulusan program studi, pencarian informasi syarat program studi dan pencarian informasi
status kelulusan berdasarkan aspek efficiency; pada sektor fungsional sistem, kualitas
informasi, dan kualitas antarmuka, berdasarkan aspek satisfaction; serta pada atribut
intuitiveness, consistency, error recovery, task match dan help desk berdasarkan aspek
learnability. Dari analisa korelasi Pearson antara hasil evaluasi metode berbasis kinerja dan
metode berbasis kuisioner, ditemukan korelasi positif tingkat sedang (r = +0,41).
Kata Kunci: Evaluasi Usability, Usability Testing, Kuisioner PSSUQ, sumatif, kuantitatif

ABSTRACT
Independent Exam Information System of Diponegoro University (UM Undip) as an image
and representation of new student admission service in Diponegoro University needed an
evaluation to know its usability quality based on user assessment. Evaluation is summative
hence it provides overall assessment of UM Undip website, while quantitative evaluation
provides metrics which can be measured by number that enables benchmark calculation and
statistic analysis. Based on quantitative data, evaluation method is parted in performance
based method to measure effectiveness and efficiency, and questionnaire based method to
measure satisfaction and learnability. Based on confidence interval statistic by 90%
confidence level, usability score was obtained for effectiveness by 59% - 67% task success
rate, for efficiency by 85 – 115 second task completion time, for satisfaction by 2,11 – 2,86
PSSUQ questionnaire rate, for learnability by 1,99 – 2,81 learnability attribute rate. Based
on benchmark calculation, all four usability aspect did not reach usability criteria for each
aspect. Significal difference was found for usability score between mobile and non mobile
device in satisfaction and learnability aspects, and between prospective student and parent
in efficiency aspect. Improvement recommendation was found based on each usability
aspect: on searching for student’s selection pass function, searching for re-registration
information function based on effectiveness; on searching for study program graduate profile
function, searching for study program requirement information function and searching for
student’s selection pass function based on efficiency; on system usefulness, information
quality and interface quality based on satisfaction; on intuitiveness, consistency, error
recovery, task match and help desk based on learnability. From Pearson correlation analysis,
medium rate positif correlation was found (r = +0,41) between performance based evaluation
and questionnaire based evaluation.
Keyword: Usability Evaluation, Usability Testing, PSSUQ Questionnaire, summmative,
quantitative

---

Ketersediaan

890F20IV

890 F 20-iv

Perpustakaan FSM Undip (Referensi)

Tersedia

Informasi Detail

Judul Seri

ILMU KOMPUTER/INFORMATIKA

No. Panggil

890 F 20-iv

Penerbit

: ., 2020

Deskripsi Fisik

-

Bahasa

Indonesia

ISBN/ISSN

-

Klasifikasi

NONE

Tipe Isi

-

Tipe Media

-

Tipe Pembawa

-

Edisi

-

Subjek

-

Info Detail Spesifik

-

Pernyataan Tanggungjawab

Adam Reyner

Versi lain/terkait

Lampiran Berkas

Komentar

---

Anda harus masuk sebelum memberikan komentar