Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
skip to main content
10.1145/974044.974046acmconferencesArticle/Chapter ViewAbstractPublication PagesicpeConference Proceedingsconference-collections
Article

Estimating the CPU utilization of a rule-based system

Published: 01 January 2004 Publication History

Abstract

Rule-based software systems have become very common in telecommunications settings, particularly to monitor and control workflow management of large networks. At the same time, shorter deployment cycles are frequently necessary which has led to modifications being made to the rule base, without a full assessment of the impact of these new rules through extensive performance testing.An approach is presented that helps assess the performance of rule-based systems, in terms of its CPU utilization, by using modeling and analysis. A case study is presented applying this approach to a large rule-based system that is used to monitor a very large industrial telecommunications network.

References

[1]
A. Avritzer and J. Ros and E. J. Weyuker. Reliability Testing of Rule-Based Systems. IEEE Software, September 1996, pp. 76--82.
[2]
A. Avritzer and E. J. Weyuker. The Automatic Generation of Load Test Suites and the Assessment of the Resulting Software IEEE Trans. on Software Engineering, Sept. 1995, pp. 705--716.
[3]
A. Avritzer and E. J. Weyuker. Generating test suites for software load testing. Proceedings of the 1994 International Symposium on Software Testing and Analysis(ISSTA). ACM Press, August 1994.
[4]
A. M. Cheng and J-R. Chen. Response Time Analysis of OPS5 Production Systems. IEEE Trans. on Knowledge and Data Engineering, May/June 2000, pp. 391--409.
[5]
B. J. Cragun and H. J. Steudel. A Decision-table-based Processor for Checking Completeness and Consistency in Rule-based Expert Systems, International Journal of Man-Machine Studies, vol 26, 1987, pp. 633--648.
[6]
A Ginsberg. A New Approach to Checking Knowledge Bases for Inconsistency and Redundancy. Proceedings of Third Annual Expert Systems in Government Conference, 1987, pp. 102--111.
[7]
A. Ginsberg. Knowledge-base reduction: a new approach to checking knowledge bases for inconsistency and redundancy. Proceedings of the Seventh Annual National Conference on Artificial Intelligence, 1988, pp. 585--589.
[8]
C. Grossner, A. D. Preece, P. G. Chander, T. Radhakrishnan and C. Y. Snen, Exploring the Structure of Rule Based Systems, Proceedings of the Eleventh National Conference on Artificial Intelligence, July 1993, pp. 704--709.
[9]
J. L. Hellerstein, An Approach to Selecting Metrics for Detecting Performance Problems in Information Systems Proceedings of IEEE Second International Workshop on System Management, June 1996, pp. 30--39.
[10]
J. Kiper, Structural Testing of Rule-Based Expert Systems, ACM Transaction on Software Engineering and Methodology, vol 1, no 2, Apr 1992, pp. 168--187.
[11]
D. A. Berry and B. W. Lindgren. Statistics: Theory and Methods. Brooks/Cole, 1990.
[12]
T. A. Nguyen, W. A. Perkins, T. J. Lafey and D. Pecora. Checking an Expert Systems Knowledge Base for Consistency and Completeness. Proceedings of 9th IJCAI, 1985, pp. 374--378.
[13]
T. A. Nguyen, W. A. Perkins, T. J. Laffey and D. Pecora. Knowledge Base Verification. AI Magazine, vol 8, no 2, Summer 1987, pp. 69--75.
[14]
R. M. O'Keefe, O. Balci, and E. P. Smith. Validating Expert System Performance. IEEE Expert, Winter 1987, pp. 81--87.
[15]
M. Suwa, S. C. Scott and E. H. Shortliffe. An Approach to Verifying Completeness and Consistency in Rule-Based Expert Systems. AI Magazine, vol 3, no 4, Fall 1982, pp. 16--21.
[16]
R-H. Wang and A. K. Mok. Response-Time Bounds of EQL Rule-Based Programs Under Rule Priority Structure. IEEE Trans. on Software Engineering, vol 21, no 7, July 1995, pp. 605--614.

Cited By

View all
  • (2015)Enhancing Performance And Reliability of Rule Management PlatformsProceedings of the 6th ACM/SPEC International Conference on Performance Engineering10.1145/2668930.2688035(187-198)Online publication date: 28-Jan-2015
  • (2014)Multivariate Estimation of Resource Utilization Bounds of any Variable Schedule in a Computing SystemBeyond Databases, Architectures, and Structures10.1007/978-3-319-06932-6_30(312-322)Online publication date: 2014
  • (2011)Automated generation of test cases using a performability modelIET Software10.1049/iet-sen.2010.00355:2(113)Online publication date: 2011
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
WOSP '04: Proceedings of the 4th international workshop on Software and performance
January 2004
313 pages
ISBN:1581136730
DOI:10.1145/974044
  • cover image ACM SIGSOFT Software Engineering Notes
    ACM SIGSOFT Software Engineering Notes  Volume 29, Issue 1
    January 2004
    300 pages
    ISSN:0163-5948
    DOI:10.1145/974043
    Issue’s Table of Contents
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 01 January 2004

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. software performance testing
  2. software testing
  3. workload characterization

Qualifiers

  • Article

Conference

WOSP04
WOSP04: Fourth International Workshop on Software and Performance 2004
January 14 - 16, 2004
California, Redwood Shores

Acceptance Rates

WOSP '04 Paper Acceptance Rate 38 of 70 submissions, 54%;
Overall Acceptance Rate 149 of 241 submissions, 62%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)18
  • Downloads (Last 6 weeks)4
Reflects downloads up to 17 Oct 2024

Other Metrics

Citations

Cited By

View all
  • (2015)Enhancing Performance And Reliability of Rule Management PlatformsProceedings of the 6th ACM/SPEC International Conference on Performance Engineering10.1145/2668930.2688035(187-198)Online publication date: 28-Jan-2015
  • (2014)Multivariate Estimation of Resource Utilization Bounds of any Variable Schedule in a Computing SystemBeyond Databases, Architectures, and Structures10.1007/978-3-319-06932-6_30(312-322)Online publication date: 2014
  • (2011)Automated generation of test cases using a performability modelIET Software10.1049/iet-sen.2010.00355:2(113)Online publication date: 2011
  • (2010)Monitoring for security intrusion using performance signaturesProceedings of the first joint WOSP/SIPEW international conference on Performance engineering10.1145/1712605.1712623(93-104)Online publication date: 28-Jan-2010
  • (2007)Ensuring system performance for cluster and single server systemsJournal of Systems and Software10.1016/j.jss.2006.07.02080:4(441-454)Online publication date: 1-Apr-2007
  • (2005)Ensuring stable performance for systems that degradeProceedings of the 5th international workshop on Software and performance10.1145/1071021.1071026(43-51)Online publication date: 12-Jul-2005
  • (2004)The Role of Modeling in the Performance Testing of E-Commerce ApplicationsIEEE Transactions on Software Engineering10.1109/TSE.2004.10730:12(1072-1083)Online publication date: 1-Dec-2004
  • (2004)An Extended Operational Profile ModelProceedings of the 15th International Symposium on Software Reliability Engineering10.1109/ISSRE.2004.8(314-325)Online publication date: 2-Nov-2004
  • (2004)Analysis and prediction of performance for evolving architecturesProceedings. 30th Euromicro Conference, 2004.10.1109/EURMIC.2004.1333352(22-31)Online publication date: 2004
  • (2008)A UML-based quantitative framework for early prediction of resource usage and load in distributed real-time systemsSoftware & Systems Modeling10.1007/s10270-008-0099-78:2(275-302)Online publication date: 26-Aug-2008
  • Show More Cited By

View Options

Get Access

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media