Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
article

Alternative measures of systems effectiveness: associations and implications

Published: 01 September 1985 Publication History

Abstract

This article reports results from a study that examined the implementation of computerized modeling systems in 29 organizations. The focus is on the use of various MIS effectiveness measures that are reported in MIS research. Specifically, we examine the relationship between user perceived effectiveness measures (user satisfaction) and behavioral measures of system effectiveness (system use).
While much of the existing MIS research implies that the two types of measures are positively associated with each other, the results from this study indicate otherwise. By using a perceived effectiveness instrument that is strongly grounded in a widely accepted theoretical model, the results provide important insights into the nature of this relationship.
The importance of interpreting perceived and behavioral measures of system effectiveness is demonstrated by examining the effect of system sophistication on MIS effectiveness.

References

[1]
Anthony, R.N. Planning and Control Systems: A Framework for Analysis. Harvard University, Boston, Massachusetts, 1965.
[2]
Bailey, J.E. and Pearson, S.W. "Development of a Tool for Measuring and Analyzing Computer User Satisfaction," Management Science, Volume 29, Number 5, May 1983, pp. 530-545.
[3]
Culnan, M.J. "Chauffeured Versus End User Access to Commercial Databases: The Effects of Task and Individual Differences," MIS Quarterly, Volume 7, Number 1, March 1982, pp. 55-67.
[4]
Ein-Dor, P. and Segev, E. "Organizational Context and the Success of Management Information Systems," Management Science, Volume 24, Number 10, June 1978, pp. 1064-1077.
[5]
EPS, Inc. "Selecting and Evaluating a Decision Support System," promotion brochure, 1981.
[6]
Epstein, B.J. and King, W.R. "An Experimental Study of the Value of Information," OMEGA, Volume 10, Number 3, September 1982, pp. 249-258.
[7]
Ginzberg, M.J. "Early Diagnosis of MIS Implementation Failure: Promising Results and Unanswered Questions," Management Science, Volume 27, Number 4, April 1981, pp. 459-478.
[8]
Ginzberg, M.J. "Finding an Adequate Measure of OR/MS Effectiveness," Interfaces, Volume 8, Number 4, August 1978, pp. 59-62.
[9]
Hamilton, S. and Chervany, N.L. "Evaluating IS Effectiveness - Part 1: Comparing Evaluation Approaches," MIS Quarterly, Volume 5, Number 3, September 1981, pp. 55-69.
[10]
Hamilton, S. and Chervany, N.L. "Evaluating IS Effectiveness - Part II: Comparing Evaluation Viewpoints," MIS Quarterly, Volume 5, Number 4, December 1981, pp. 79-86.
[11]
Guthrie, A. "Attitudes of the User Managers Towards MISs," Management Informatics, Volume 3, Number 5, October 1974, pp. 221-232.
[12]
Ives, B. and Olson, M.H. "User Involvement and MIS Success: A Review of Research," Management Science, Volume 30, Number 5, May 1984, pp. 586-603.
[13]
Ives, B., Olson, M. and Baroudi, J. "The Measurement of User Information Satisfaction," Communications of the ACM, Volume 26, Number 10, October 1983, pp. 785-793.
[14]
Jenkins, A.M. and Ricketts, J.A. "Development of an Instrument to Measure User Satisfaction with Management Information Systems," unpublished discussion paper, Indiana University, Bloomington, Indiana, 1979.
[15]
King, J.L. and Schrems, E.L. "Cost-Benefits Analysis in IS Development and Operation," Computing Surveys, Volume 10, Number 1, March 1978, pp. 19-34.
[16]
King, W.R. and Rodriguez, J.I. "Evaluating Management Information Systems," MIS Quarterly, Volume 2, Number 3, September 1978, pp. 43-51.
[17]
Kleijnen, J.P.C. Computers and Profits: Quantifying Financial Benefits of Information, Addison-Wesley, Reading, Massachusetts, 1980.
[18]
Lucas, H.C. The Implementation of Computer Based Models, National Association of Accountants, New York, New York, 1976.
[19]
Lucas, H.C. "Performance and the Use of a Management Information System," Management Science, Volume 3, Number 4, April 1975, pp. 908-919.
[20]
Maish, A.M. "A User's Behavior Toward His MIS," MIS Quarterly, Volume 3, Number 1, March 1979, pp. 39-52.
[21]
Marschak, J. and Radner, R. Economic Theory of Teams, Yale University Press, New Haven, Connecticut, 1972.
[22]
Nigam, R. and Hong, S. "Analytical Hierarchy Process Applied to the Evaluation of Financial Modeling Software," Proceedings of the DSS-81 Conference, Atlanta, Georgia, 1981.
[23]
Robey, D. "User Attitudes and MIS Use," Academy of Management Journal, Volume 22, Number 3, September 1979, pp. 527-538.
[24]
Schewe, C.D. "The Management Information Systems User: An Exploratory Behavioral Analysis," Academy of Management Journal, Volume 19, Number 3, September 1976, pp. 577-589.
[25]
Simon, H.A. The New Science of Management Decision, Harper and Brothers, New York, New York, 1960.
[26]
Srinivasan, A. and Kaiser, K.M. "The Role of Information Accessibility in Information Requirements Analysis," Systems, Objectives, Solutions, Volume 4, Number 4, November 1984, pp. 201-210.
[27]
Swanson, E.B. "Management Information Systems: Appreciation and Involvement," Management Science, Volume 21, Number 2, October 1974, pp. 178-188.
[28]
Welsch, G.M. "Successful Implementation of Decision Support Systems: Pre-Installation Factors, Service Characteristics, and the Role of the Information Transfer Specialist," unpublished Ph.D. dissertation, Northwestern University, Evanston, Illinois, 1980.
[29]
Zmud, R.W. "Individual Difference and MIS Success: A Review of the Empirical Literature," Management Science, Volume 25, Number 10, October 1979, pp. 966-979.

Cited By

View all
  • (2023)Virtual Reality at a Prehistoric Museum: Exploring the Influence of System Quality and Personality on User IntentionsJournal on Computing and Cultural Heritage 10.1145/358542516:2(1-19)Online publication date: 25-Feb-2023
  • (2021)The Factors Affecting the IoT User Satisfaction in Sinyeong City, ChinaProceedings of the 9th International Conference on Computer and Communications Management10.1145/3479162.3479187(166-173)Online publication date: 16-Jul-2021
  • (2019)Quality evaluation for multimedia contents of e-learning systems using the ANP approach on high speed networkMultimedia Tools and Applications10.1007/s11042-019-7351-878:20(28853-28875)Online publication date: 1-Oct-2019
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image MIS Quarterly
MIS Quarterly  Volume 9, Issue 3
September 1985
94 pages

Publisher

Society for Information Management and The Management Information Systems Research Center

United States

Publication History

Published: 01 September 1985

Author Tags

  1. MIS effectiveness measurement
  2. management of information systems

Qualifiers

  • Article

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)0
  • Downloads (Last 6 weeks)0
Reflects downloads up to 14 Oct 2024

Other Metrics

Citations

Cited By

View all
  • (2023)Virtual Reality at a Prehistoric Museum: Exploring the Influence of System Quality and Personality on User IntentionsJournal on Computing and Cultural Heritage 10.1145/358542516:2(1-19)Online publication date: 25-Feb-2023
  • (2021)The Factors Affecting the IoT User Satisfaction in Sinyeong City, ChinaProceedings of the 9th International Conference on Computer and Communications Management10.1145/3479162.3479187(166-173)Online publication date: 16-Jul-2021
  • (2019)Quality evaluation for multimedia contents of e-learning systems using the ANP approach on high speed networkMultimedia Tools and Applications10.1007/s11042-019-7351-878:20(28853-28875)Online publication date: 1-Oct-2019
  • (2017)Factors Influence Intention to Adopt Internet Medical Information on Bulletin BoardsJournal of Organizational and End User Computing10.4018/JOEUC.201701010229:1(23-41)Online publication date: 1-Jan-2017
  • (2016)System sourcing and information processing capability in supply chainsInformation Technology and Management10.1007/s10799-016-0255-717:4(379-391)Online publication date: 1-Dec-2016
  • (2016)A review on objective measurement of usage in technology acceptance studiesUniversal Access in the Information Society10.1007/s10209-015-0443-y15:4(713-726)Online publication date: 1-Nov-2016
  • (2014)Strategic Information Systems and Business OutcomesInternational Journal of Human Capital and Information Technology Professionals10.4018/ijhcitp.20140101025:1(15-25)Online publication date: 1-Jan-2014
  • (2013)Success of enterprise wiki systemsInternational Journal of Information Technology and Management10.1504/IJITM.2013.05488112:3/4(337-358)Online publication date: 1-Jun-2013
  • (2012)Acceptance of post-adoption unanticipated is usageACM SIGMIS Database: the DATABASE for Advances in Information Systems10.1145/2351848.235185043:3(9-25)Online publication date: 20-Aug-2012
  • (2012)Identifying critical factors for corporate implementing virtualization technologyComputers in Human Behavior10.1016/j.chb.2012.06.03228:6(2244-2257)Online publication date: 1-Nov-2012
  • Show More Cited By

View Options

View options

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media