Understanding the utilisation of information systems evaluation: Four case studies

The aim of this study is to explore and investigate the use of Information System (IS) evaluation in practice. Given that evaluation use is not a well-studied topic in IS research, we first propose a theoretical framework based on literature review, to guide our understanding of relevant issues. This framework identifies three important dimensions in related to IS evaluation: IS evaluation, Stakeholder involvement and Evaluation use. These dimensions are examined in four IS projects in China. In total, 37 interviews have been conducted and data are analysed using Leximancer qualitative data analysis software. Results are organised based on the proposed framework. The results suggest that both the evaluation process and the output from IS evaluation can be used instrumentally, conceptually and symbolically by different stakeholders. A list of such uses are generated in each case, with concepts identified by Leximancer. The cases demonstrate the applicability of the proposed framework and areas for further development are identified.