Evaluating Public Website Performance: Content Analyses on Malang City Government Website

Sajida Sajida; Laela Tul Husna; Karina Widya Rahayu; Indah Ayu Suryawati

doi:10.31506/jog.v8i2.19248

Evaluating Public Website Performance: Content Analyses on Malang City Government Website

Sajida Sajida, Laela Tul Husna, Karina Widya Rahayu, Indah Ayu Suryawati

Abstract

This study evaluates the performance of public websites in Malang City, a heavily digitizing government. Using content analysis, we determine the extent to which the availability of public information has been met and what records still need to be corrected by the Malang city government. This study examines five criteria: information quality, usability, privacy and security, interaction, and accessibility. As a result, the Malangkota. go. id website met the evaluation criteria for general public information availability. However, the government still needs improvement in terms of security and citizen-centered values. Thus, in the future, this research can be used as a basis for policy considerations by the Malang City government to improve the performance of its public services through the provision of good public information.

Keywords

Website Evaluation; Public Information; Website Performance; E-Government

Full Text:

PDF 263-278

References

Abanumy, A., Al-Badi, A., & Mayhew, P. (2005). e Government website accessibility: in depth evaluation of Saudi Arabia and Oman. Electronic Journal of E-Government, 3(3), pp149-156.

Akgül, Y. (2022). Evaluating the performance of websites from a public value, usability, and readability perspectives: a review of Turkish national government websites. Universal Access in the Information Society. https://doi.org/10.1007/s10209-022-00909-4

Ardin, A. (2022, December 4). Situs Pemprov NTT Diretas, Hacker Kirim Pesan Cinta. Detik.Com. https://www.detik.com/bali/nusra/d-6442407/situs-pemprov-ntt-diretas-hacker-kirim-pesan-cinta

Arias, M. I., & Maçada, A. C. G. (2018). Digital government for E-government service quality: A literature review. ACM International Conference Proceeding Series, 7–17. https://doi.org/10.1145/3209415.3209422

Armaini, I., Dar, M. H., & Bangun, B. (2022). Evaluation of Labuhanbatu Regency Government Website based on Performance Variables. Sinkron, 7(2), 760–766. https://doi.org/10.33395/sinkron.v7i2.11404

Baker, D. L. (2009). Advancing E-Government performance in the United States through enhanced usability benchmarks. Government Information Quarterly, 26(1), 82–88. https://doi.org/10.1016/j.giq.2008.01.004

Bélanger, F., & Carter, L. (2008). Trust and risk in e-government adoption. The Journal of Strategic Information Systems, 17(2), 165–176.

Bloor, M., & Wood, F. (2006). Keywords in Qualitative Methods:A Vocabulary of Research Concepts (1st ed.). SAGE Publications.

Bozkurt, A., Akgun-Ozbek, E., Yilmazel, S., Erdogdu, E., Ucar, H., Guler, E., Sezgin, S., Karadeniz, A., Sen-Ersoy, N., Goksel-Canbek, N., Dincer, G. D., Ari, S., & Aydin, C. H. (2015). Trends in distance education research: A content analysis of journals 2009-2013. International Review of Research in Open and Distance Learning, 16(1), 330–363. https://doi.org/10.19173/irrodl.v16i1.1953

Burn, J., & Robins, G. (2003). Moving towards e‐government: a case study of organisational change processes. Logistics Information Management, 16(1), 25–35.

Choi, I., & Gil-Garcia, J. R. (2022). Do different presentations of performance information on government websites affect citizens’ decision making? A survey experiment. International Public Management Journal, 25(1), 140–158. https://doi.org/10.1080/10967494.2021.1913459

Csontos, B., & Heckl, I. (2021). Accessibility, usability, and security evaluation of Hungarian government websites. Universal Access in the Information Society, 20(1), 139–156. https://doi.org/10.1007/s10209-020-00716-9

Daniel, M. (2016). Electronic government: Evaluating status through content analysis of government websites in Papua New Guinea. Contemporary PNG Studies, 25, 24–39.

Doush, I. A., & Almeraj, Z. (2019). Evaluating the accessibility of Kuwaiti e-government websites. Jordanian Journal of Computers and Information Technology, 5(3), 152–169. https://doi.org/10.5455/jjcit.71-1557233833

Elo, S., Kääriäinen, M., Kanste, O., Pölkki, T., Utriainen, K., & Kyngäs, H. (2014). Qualitative content analysis: A focus on trustworthiness. SAGE Open, 4(1), 2158244014522633.

Erwin, M. F., Wardani, N. H., & Perdanakusuma, A. R. (2019). Evaluasi Usability Pada Website Malangmenyapa. malangkota. go. id Dinas Kebudayaan dan Pariwisata Kota Malang Menggunakan Metode Usability Testing. Jurnal Pengembangan Teknologi Informasi Dan Ilmu Komputer E-ISSN, 2548, 964X.

Flavián, C., & Guinalíu, M. (2006). Consumer trust, perceived security and privacy policy: three basic elements of loyalty to a web site. Industrial Management & Data Systems.

Flavián, C., Guinalíu, M., & Gurrea, R. (2006). The role played by perceived usability, satisfaction and consumer trust on website loyalty. Information & Management, 43(1), 1–14.

Fryonanda, H., & Ahmad, T. (2017). Analisis Website Perguruan Tinggi Berdasarkan Keinginan Search Engine Menggunakan Automated Software Testing GTmetrix. Kalbiscientia: Jurnal Sains Dan Teknologi, 4(2), 179–183.

Gunawibawa, E. Y., Oktiani, H., & Prakoso, G. H. (2019). Analisis Konten Informasi E-Government pada Situs Web Pemerintah Kabupaten Pesawaran. PROSIDING SEFILA, 197–206.

Guo, S., Hai, M., & Wang, M. (2010). A performance evaluation model of e-government website based on public attention. 2010 International Conference on E-Product E-Service and E-Entertainment, 1–4.

Harris, J. A., McKenzie, K. S., & Rentfro, R. W. (2011). Performance reporting: Assessing citizen access to performance measures on state government websites. In ACCOUNTING & FINANCIAL MANAGEMENT (Vol. 23, Issue 1). www.recovery.gov,

Haryani, P. (2016). Penilaian kualitas layanan website Pemerintah Kota Yogyakarta menggunakan metode E-GovQual. Data Manajemen Dan Teknologi Informasi (DASI), 17(3), 44–50.

Hidayah, N. A., Subiyakto, A., & Setyaningsih, F. (2019, November 1). Combining Webqual and Importance Performance Analysis for Assessing A Government Website. 2019 7th International Conference on Cyber and IT Service Management, CITSM 2019. https://doi.org/10.1109/CITSM47753.2019.8965408

Hu, F., & Yang, J. (2020). A fuzzy performance evaluation model for government websites based on language property and balanced score card. International Journal of Enterprise Information Systems, 16(2), 148–163. https://doi.org/10.4018/IJEIS.2020040109

Huang, Z. (2006). E-government practices at local levels: an analysis of US counties’ websites. Issues in Information Systems, 7(2), 165–170.

Irwanto. (2022, October 18). 6 Website Milik OPD Sumsel Diretas, Hacker: Anggaran Jangan Dikorups. Merdeka.Com. https://www.merdeka.com/peristiwa/6-website-milik-opd-sumsel-diretas-hacker-anggaran-jangan-dikorupsi.html

Jetzek, T. (2016). Managing complexity across multiple dimensions of liquid open data: The case of the Danish Basic Data Program. Government Information Quarterly, 33(1), 89–104.

Jetzek, T., Avital, M., & Bjorn-Andersen, N. (2012). The value of open government data: A strategic analysis framework. SIG EGovernment Pre-ICIS Workshop, Orlando.

Jetzek, T., Avital, M., & Bjørn-Andersen, N. (2013). Generating Value from Open Government Data. ICIS.

Kaafar, D., Tangari, G., & Ikram, M. (2022). A Security Audit of Australian Government Websites.

Kaisara, G., & Pather, S. (2011). The e-Government evaluation challenge: A South African Batho Pele-aligned service quality approach. Government Information Quarterly, 28(2), 211–221. https://doi.org/10.1016/j.giq.2010.07.008

Karaim, N. A., & Inal, Y. (2019). Usability and accessibility evaluation of Libyan government websites. Universal Access in the Information Society, 18(1), 207–216. https://doi.org/10.1007/s10209-017-0575-3

Karkin, N., & Janssen, M. (2014). Evaluating websites from a public value perspective: A review of Turkish local government websites. International Journal of Information Management, 34(3), 351–363. https://doi.org/10.1016/j.ijinfomgt.2013.11.004

Khanyako, E., & MaigAnnur, C. M. (2021). Persyaratan Berbelit, Keluhan Utama Masyarakat Terhadap Pelayanan Publik. KataData - DataBoks. https://databoks.katadata.co.id/datapublish/2021/12/20/persyaratan-berbelit-keluhan-utama-masyarakat-terhadap-pelayanan-publik

Ashraf, M., Cheema, F. S., Saba, T., & Mateen, A. (2017). Usability of government websites. International Journal of Advanced Computer Science and Applications, 8(8).

Badan Pusat Statistik. (2022). Statistik Telekomunikasi Indonesia 2021 (06300.2212). BPS. https://www.bps.go.id/publication/2022/09/07/bcc820e694c537ed3ec131b9/statistik-telekomunikasi-indonesia-2021.html

Darem, A. B., & Al-Hashmi, A. (2011). Evaluation of the Use of Local Government Websites: Internet Users’ Perspective. IUP Journal of Information Technology, 7(2).

Deloitte. (2022). Digital smart: Accelerating digital government for citizens in the Asia-Pacific (July 2022). Deloitte. https://www2.deloitte.com/content/dam/Deloitte/au/Documents/financial-services/deloitte-au-fs-aasb-17-external-audit-250722-new.pdf

Haryanto, A. T. (2023, February 22). Jumlah Pengguna Internet RI Tembus 212,9 Juta di Awal 2023. Detik.Com. https://inet.detik.com/telecommunication/d-6582738/jumlah-pengguna-internet-ri-tembus-2129-juta-di-awal-2023

Lee-Geiller, S., & Lee, T. D. (2019). Using government websites to enhance democratic E-governance: A conceptual model for evaluation. Government Information Quarterly, 36(2), 208–225.

Melitski, J., & Holzer, M. (2007). Assessing digital government at the local level worldwide: An analysis of municipal web sites throughout the world. In Current issues and trends in e-government research (pp. 1–21). IGI Global.

Rababah, O., Hamtini, T., Harfoushi, O., Al-Shboul, B., Obiedat, R., & Nawafleh, S. (2013). Towards developing successful e-government websites. Journal of Software Engineering and Applications, 6(11), 559.

United Nations. (2022). UN E-Government Survey 2022 (No. 978-92-1-123213–4). United Nations. https://publicadministration.un.org/egovkb/en-us/Reports/UN-E-Government-Survey-2022

a, G. (2013). An information security model for e-government services adoption in Uganda. 2013 IST-Africa Conference & Exhibition, 1–11.

Kim, J., Jin, B., & Swinney, J. L. (2009). The role of etail quality, e-satisfaction and e-trust in online loyalty development process. Journal of Retailing and Consumer Services, 16(4), 239–247.

Lawati, S., & Firdaus, F. (2020). Keterjangkauan Informasi dalam Pelayanan Publik. Jurnal Ilmu Administrasi Dan Studi Kebijakan (JIASK), 2(1), 1–7.

Layne, K., & Lee, J. (2001). Developing fully functional E-government: A four stage model. Government Information Quarterly, 18(2), 122–136.

Lewis, J. M. (2019). Performance indicators and democracy: citizens’ views on the purposes of government websites. Public Money and Management, 39(1), 18–25. https://doi.org/10.1080/09540962.2019.1537703

Li, H., & Le, Z. (2009). Government website’s dynamic performance evaluation based on managerial efficiency. 2009 International Conference on Management of E-Commerce and e-Government, ICMeCG 2009, 120–123. https://doi.org/10.1109/ICMeCG.2009.71

Martani, D., & Fitriasari, D. (2014). Financial and performance transparency on the local government websites in Indonesia. Journal of Theoretical and Applied Information Technology, 28(3). www.jatit.org

Mohasi, L., & Mashao, D. (2006). Text-to-speech technology in human-computer interaction. 5th Conference on Human Computer Interaction in Southern Africa, South Africa (CHISA 2006, ACM SIGHI), 79–84.

Moon, M. J. (2002). The evolution of e‐government among municipalities: rhetoric or reality? Public Administration Review, 62(4), 424–433.

Parajuli, J. (2007). A content analysis of selected government web sites: A case study of Nepal. Electronic Journal of E-Government, 5(1), pp88-95.

Park, H., & Samijadi, M. F. (2021). Citizens Perception of E-Government in Korea: Importance-Performance Analysis on Users Satisfaction and Behavioral Intention. Journal of Public Administration and Governance, 11(2), 357. https://doi.org/10.5296/jpag.v11i2.18677

PemKot Malang. (2010). Peraturan Walikota Malang No. 50 Tahun 2010 tentang Pedoman Pelayanan Informasi Publik. In JDIH Kota Malang.

Putri, C. A. (2022, July 11). Sri Mulyani: Website Pemerintah Sangat Sering Diserang Hacker. CNBC Indonesia. https://www.cnbcindonesia.com/tech/20220711124415-37-354622/sri-mulyani-website-pemerintah-sangat-sering-diserang-hacker

Razak, N. A. (2019). Image of Dunedin as a tourist destination: content analysis of tourism promotional websites. Environment, 4(14), 1–12.

Realita.co. (2023, January 16). Untuk Permudah Pelayanan Masyarakat, Wali Kota Sutiaji Ajak Optimalkan Digitalisasi. Realita.Co. https://realita.co/baca-15886-untuk-permudah-pelayanan-masyarakat-wali-kota-sutiaji-ajak-optimalkan-digitalisasi

Rozikin, M., Hesty, W., & Sulikah, S. (2020). Kolaborasi dan E-Literacy: Kunci Keberhasilan Inovasi E-Government Pemerintah Daerah. Jurnal Borneo Administrator, 16(1), 61–80.

Salvio, K. B. v., & Palaoag, T. D. (2019). Evaluation of the selected Philippine e-government websites’ performance with prescriptive analysis. ACM International Conference Proceeding Series, 129–137. https://doi.org/10.1145/3330482.3330505

Schreier, M. (2013). Qualitative content analysis in practice, reprinted edn. Sage, London.

Setiaman, A., Sugiana, D., & Mahameruaji, J. N. (2013). Implementasi kebijakan keterbukaan informasi publik. Jurnal Kajian Komunikasi, 1(2), 196–205.

Song, Y., & Liu, E. (2021). The influence evaluation of municipal government website in Guangxi Zhuang Autonomous Region based on link analysis. E3S Web of Conferences, 233. https://doi.org/10.1051/e3sconf/202123301161

Stowers, G. N. L. (2002). The state of federal websites. Price Waterhouse Coopers Endowment for the Business of Government.

Tarafdar, M. (2005). Analyzing the influence of web site design parameters on web site usability. Information Resources Management Journal (IRMJ), 18(4), 62–80.

Tubagus Achmad. (2023, January 19). Wali Kota Sutiaji Beberkan 8 Rancangan Prioritas Pembangunan Kota Malang Tahun 2024. Malang Times. https://www.malangtimes.com/baca/89548/20230119/072000/wali-kota-sutiaji-beberkan-8-rancangan-prioritas-pembangunan-kota-malang-tahun-2024

Vaismoradi, M., Turunen, H., & Bondas, T. (2013). Content analysis and thematic analysis: Implications for conducting a qualitative descriptive study. Nursing & Health Sciences, 15(3), 398–405.

Valtolina, S., & Fratus, D. (2022). Local Government Websites Accessibility: Evaluation and Finding from Italy. Digital Government: Research and Practice, 3(3). https://doi.org/10.1145/3528380

Warjiyono, Nur Rais, A., Fandhilah, Erawati, W., Handayani, N., & Mayatopani, H. (2020, November 3). Webqual and importance performance analysis method: The evaluation of tegal city’s public service information system web quality. 2020 5th International Conference on Informatics and Computing, ICIC 2020. https://doi.org/10.1109/ICIC50835.2020.9288518

Warjiyono, W., & Hellyana, C. M. (2018). Pengukuran Kualitas Website Pemerintah Desa Jagalempeni Menggunakan Metode Webqual 4.0. J. Teknol. Inf. Dan Ilmu Komput, 5(2), 139.

Wu, J., & Guo, D. (2015). Measuring E-government performance of provincial government website in China with slacks-based efficiency measurement. Technological Forecasting and Social Change, 96, 25–31. https://doi.org/10.1016/j.techfore.2015.01.007

Zhu, X. H., & Zhang, J. (2013). Situation and countermeasure research of government website performance. Applied Mechanics and Materials, 380–384, 1986–1990. https://doi.org/10.4028/www.scientific.net/AMM.380-384.1986

DOI: http://dx.doi.org/10.31506/jog.v8i2.19248