Automated testing of mySAP business processes: efficient usage of the SAP test workbench
Abstract
SAP AG is the world's leading provider of e-business software solutions that integrate the processes within and among enterprises and business communities. SAP's ability to deliver customer-centric, open, personalised, and collaborative e-business software is the foundation of mySAP.com®. Through the mySAP.com e-business platform, people in businesses around the globe are improving relationships with customers and partners, streamlining operations, and achieving significant efficiencies throughout their supply chains.Today, more than 13,000 companies in over 100 countries run more than 30,000 installations of SAP software. SAP employs over 6,500 software developers around the globe. In addition to the main development center at the company's headquarters in Walldorf, Germany, SAP has a network of development labs at locations around the world including: Palo Alto (California); Tokyo (Japan); Bangalore (India); Sophia Antipolis (France); and Tel Aviv (Israel); as well as in the German cities of Berlin, Karlsruhe, and Saarbruecken.From this point of view it becomes obvious that the quality management of the development process is a huge task of enormous importance. This article describes the aspect of the quality assurance that deals with automated testing of the mySAP business scenarios. The methodology and tools, with the focus on functional testing, are explained in detail.
References
[1]
AGIL01 The Agile Alliance: http://www.agilealliance.org
[2]
AKAO90 Y. Akao et.al.: Quality Function Deployment (QFD), Productivity Press, 1990
[3]
AMBL00 S.W. Ambler: Writing Robust Java Code. The AmbySoft Inc. Coding Standards for Java, v. 17.01.d, available at http://www.Ambysoft.com
[4]
ANDE99 M. Anderson: The top 13 mistakes in Load Testing Applications. In: Software Testing and Quality Engineering Magazine, Vol. 1, Issue 5, pp. 30-41, 1999
[5]
BACH00 J. Bach: Session-Based Test Management, In: Software Testing and Quality Engineering magazine, 11/2000
[6]
BACH01 J. Bach: What is Exploratory Testing? And How it Differs from Scripted Testing, column feature at http://www.StickyMinds.com, January 2001
[7]
BACK95 K. Backhaus, M. Voeth, K.B. Bendix: Die Akzeptanz von Multimedia-Diensten - Konzeptionelle Anmerkungen und empirische Ergebnisse, Arbeitspapier Nr. 19 des Betriebswirtschaftlichen Instituts für Anlagen und Systemtechnologie der Universität Münster, Germany 1995
[8]
BALL00 G. Ball, J. Breese: Emotion in personality in a conversational agent, In: {CASS00}
[9]
BALZ98 H. Balzert: Lehrbuch der Software-Technik 2: Software-Management, Software-Qualitätssicherung, Unternehmensmodellierung, Spektrum Akademischer Verlag, Heidelberg/Berlin, 1998
[10]
BALZ98-a H. Balzert: Lehrbuch der Software-Technik: Software-Entwicklung, Spektrum Akademischer Verlag, Heidelberg/Berlin, 1998
[11]
BASK01 R. Baskerville, L. Levine, J. Pries-Heje, B. Ramesch, S. Slaughter: How Internet Software Companies Negotiate Quality, In: IEEE Computer, Vol. 34, No. 5, pp. 51- 57, May 2001
[12]
BAUE00 C. Bauer, A. Scharl: Tool-supported Evolutionary Web Development: Rethinking Traditional Modeling Principles. In: {HANS00} pp. 282-289, 2000
[13]
BECK99 K. Beck: Extreme Programming Explained: Embrace Change. Addison-Wesley, Reading, MA, 1999
[14]
BECK00 K. Beck, M. Fowler: Planning Extreme Programming, Addison-Wesley, Reading, MA, 2000
[15]
BEIZ90 B Beizer: Software Testing Techniques, 2nd Edition, Van Nostrand Reinhold, New York, 1990
[16]
BEVA97 N. Bevan: Quality and usability: a new framework, In: E. van Veenendaal, J. McMullan (Eds.), Achieving Software Product Quality, Tutein Noltehnius, s Hertogenbosch, The Netherlands, 1997
[17]
BIND00 R. Binder: Testing Object-Oriented Systems, Addison-Wesley, Reading, MA, 2000.
[18]
BOOT01 Bootstrap 3.2, Model documentation, http://www.bootstrap-institute.com
[19]
BOS98 R. Bos, E. van Veenendaal: Quality of Multimedia Systems: The MultiSpace approach (in Dutch), In: Information Management, May 1998
[20]
BUSC96 F. Buschmann, R. Meunier, H. Rohnert, P. Sommerlad, M. Stal: Pattern-Oriented Software Architecture, Vol. 1, A System of Patterns, John Wiley & Son Ltd., 1996
[21]
CASS00 J. Cassell (ed.): Embodied Conversational Agents, MIT Press (MIT Media Lab), Cambridge/London, 2000
[22]
CASP99 S. Caspers, D. Meyerhoff: Performance and Robustness Test - Factors of Success for Development and Introduction of Commercial Software, Conquest - Conference on Quality Engineering in Software Technology, ASQF, Nuremberg, Germany, 1999
[23]
CLAR01 D. Clark: Visual Basic and the Future of Web-Application Development. IEEE Computer, Vol. 34, No. 8, pp. 16-18, August 2001
[24]
CLEG99 B. Clegg, P. Birch: Instant Creativity, Kogan Page Ltd., 1999
[25]
COHE95 L. Cohen: Quality Function Deployment, How to Make QFD Work for You, Prentice Hall, Engineering Process Improvement Series, 1995
[26]
DEUB01 Deutsche Bank Web Site, Transaction Systems, http://www.deutsche-bank.de/tx
[27]
DUST99 E. Dustin, J. Rashka, J. Paul: Automated Software Testing, Addison Wesley, Reading, MA, 1999.
[28]
ELTI01 A. Elting, W. Huber: Immer im Plan? Programmieren zwischen Chaos und Plan-wirtschaft, In: c't, pp.184-191, 2001
[29]
ENGE95 E. Engeler: The Combinatory Programme, Birkhäuser, 1995
[30]
ERNI96 K. Erni, C. Lewerentz: Applying Design Metrics to Object-Oriented Frameworks, In: Proceedings of Software Metrics Symposium, IEEE Computer Society Press, pp. 64-74, 1996
[31]
FEHL00-a T. Fehlmann: Measuring Competitiveness in Service Design; Decisions based on Customer's Needs. In: QFD Institute (Ed.): 12th Symposium On Quality Function Deployment, Novi, MI, 2000
[32]
FEHL00-b T. Fehlmann, C. Hauri: Measuring Project Management Excellence. In: 3rd European Conference on Software Measurement and ICT Control, FESMA - AEMES, Madrid, Spain, 2000
[33]
FEHL01 T. Fehlmann: QFD as Algebra of Combinators. In: 7th International Symposium in QFD, Tokyo, Japan, 2001
[34]
FEWS99 M. Fewster, D. Graham: Software Test Automation (Effective use of text execution tools), London, 1999
[35]
FISC01 R. Fischbach: Die im Schatten ... - Programmieren: Stand der Dinge jenseits der Softwarekrise, In: iX-Magazin für professionelle Informationstechnik, pp. 60-65, May 2001
[36]
GAMM95 E. Gamma, R. Helm, R. Johnson, J. Vlissides (The Gang of Four): Design Patterns: Elements of Reusable Object-Oriented Software, Addison Wesley Professional Computing Series, Reading, MA, 1994
[37]
GHEZ91 C. Ghezzi, M. Jazayeri, D. Mandrioli: Fundaments of Software Engineering, Prentice Hall International, London, 1991
[38]
GILB99 T. Gilb und D. Graham: Software Inspection, Addison Wesley, Reading, MA, 1999.
[39]
GRIS01 M.L. Griss, G. Pour: Accelerating Development with Agent Components, In: IEEE Computer, Vol. 34, No. 5, pp. 37-43, May 2001
[40]
HANS00 H. Hansen, M. Bichler, H. Mahrer (Eds.): Proceedings of the 8th European conference on Information Systems (ECIS), Vienna University of Economics and Business Administration, Austria, Vol. 1, 2000
[41]
HENR96 M. Henricson, E. Nyquist: Industrial strength C++: Rules and Recommendations, Prentice Hall, London, 1996
[42]
HERZ97 G. Herzwurm, S. Schockert, W. Mellis: Qualitätssoftware dutch Kundenorientierung. Die Methode Quality Function Deployment (QFD). Grundlagen, Praxisleitfaden, SAP R/3 Fallbeispiel, Vieweg - Verlag, Braunschweig - Wiesbaden, 1997
[43]
HOWC00 D. Howcroft, J. Carroll: A Proposed Methodology for Web Development, In: {HANS00}, pp. 290-297
[44]
HUNT01 A. Hunt, D. Thomas: The Pragmatic Programmer - from journeyman to master, Addison Wesley Longman, Reading, MA, 1999
[45]
IFPU00 International Function Point Users Group: IFPUG Function Point Couting Practices Manual, Release 4.1.1, Troy, Michigan, April 2000
[46]
ISO9126-1 ISO/IEC FCD 9126-1: Information technology - Software product quality - Part 1: Quality model, International Organization of Standardization, 2001
[47]
ISO9126-2 ISO/IEC PDTR 9126-2: Information technology - Software quality characteristics and metrics - Part 2: External metrics, International Organization of Standardization, 1997
[48]
ISO9241-10 ISO 9241-10: Ergonomic Requirements for office work with visual display terminals (VDT's) - Part 10: Dialogue principles, International Organization of Standardization, 1996
[49]
ISO9241-11 ISO 9241-11: Ergonomic Requirements for office work with visual display terminals (VDT's) - Part 11: Guidance on usability, International Organization of Standardization, 1998
[50]
JACO92 I. Jacobson: Object-Oriented Software Engineering: A Use Case Driven Approach, Addison Wesley, Reading, MA, 1992
[51]
JEFF00 R. Jeffries, A. Anderson, C. Hendrickson: Extreme Programming Installed, Addison Wesley, Reading, 2000
[52]
JUNI01 Junit, IBM Public Licence, http://www.junit.org
[53]
JUTI99 U. Jutila, A. Dehnel: Acceptability: Focus on the user/customer, QSDG Magazine, Vol. 2, No. 1, 1999
[54]
JWAM01 The JWAM Framework: http://www.jwam.org
[55]
KANE99 C. Kaner, J. Falk, H.Q. Nguyen: Testing Computer Software, John Wiley & Sons Inc., New York, 1999
[56]
KANE01 C. Kaner, J. Bach: Exploratory Testing in Pairs, STAR East Conference - Software Testing Analysis & Review, Orlando, CA, 2001
[57]
KEES01-a P. Keese: Scalable Acceptance Testing. In: {WIEC00}
[58]
KEES01-b P. Keese, D. Meyerhoff: Experiences from Business Integration Testing in Large Software Projects. In: Proceedings of the 5th Conquest - Conference on Quality Engineering in Software Technology, ASQF, Nuremberg, Germany, 2001
[59]
KIRA93 J. Kirakowski, M. Corbett: SUMI: the Software Usability Measurement Inventory, In: British Journal of Educational Technology, Vol. 24, No, 3, pp. 210-212, 1993
[60]
KIRA96 J. Kirakowski: The Software Usability Measurement Inventory: Background and Usage, In: P. Jordan, B. Thomas, B. Weerdmeester (Eds.), Usability Evaluation in Industry, Taylor and Francis, 1996
[61]
KOOM99 T. Koomen, M. Pol: Test Process Improvement - A Practical Step-By-Step Guide to Structured Testing, Addison Wesley, Reading, MA, 1999
[62]
LEHM85 M.M. Lehmann, L.A. Belady: Programm Evaluation, Academic Press, New York, 1985
[63]
LEON97 A. Leonard: An insightful historica. Overview. The Origin of a new Species, Pinguin book, Computers/Science & Technology, New York, 1997
[64]
LIPP01-a M. Lippert, S. Roock, R. Tunkel, H. Wolf: Stabilizing the XP Process Using Specialized Tools, Proceedings of XP 2001 Conference, Villasimius, Sardinia, Italy, 2001
[65]
LIPP01-b M. Lippert, S. Roock, H. Wolf, H. Züllighoven: XP in Complex Project Settings: Some Extensions, In: Proceedings of XP, 2001 Conference, Villasiumius, Sardinia, Italy, 2001
[66]
LJUN00 J.Ljungberg: Open Source Movements as a Model for Organizing. In: {HANS00}, pp. 501-508
[67]
LOEB01 http://www.loebner.net
[68]
MAZU93 G. Mazur: QFD for Service Organizations, Japan Business Consultants, Ltd., 1993
[69]
MCCA76 T. McCabe: A Complexity measure. In: IEEE Transactions on Software Engineering, Vol. 2, No. 4, pp. 308-320, 1976
[70]
MECK01 C. Mecke: Automated Testing of mySAP.com, In: {MEYE01-a}
[71]
MELI98 R. Meli: SAFE: A method to understand, reduce, and accept project risk, European Software Control and Metric (ESCOM)-ENCRESS 98 - Project Control for 2000 and Beyond, Rome, Italy, May 1998
[72]
MELL01 W. Mellis: Process and Product Orientation in Software Development and their Effect on Software Quality Management. In: {WIEC01}
[73]
MEYE95 S. Meyers: Effective C++: 50 Specific Ways to Improve your Programs and Design, Addison Wesley, Reading, MA, 1995
[74]
MEYE99 D. Meyerhoff, M. Timpe: Vom Entwurfs- bis zum Systemtest: Objektorientierte Anwendungsentwicklung verändert die Testprozesse, In: OBJEKTspektrum, SIGS, Germany, Vol. 1, 1999
[75]
MEYE01-a D. Meyerhoff (Ed.): Proceedings of the 2nd ICSTEST - International Conference on Software Testing 2001, SQS AG, Cologne, Germany, 2001
[76]
MEYE01-b D. Meyerhoff, D. Huberty: Testing Internet Based Home Banking Software, In: {MEYE01-a}
[77]
MIZU88 S. Mizuno (Ed.): Management for Quality Improvement, The 7 New QC Tools, Productivity Press, 1988
[78]
MIZU94 S. Mizuno, Y. Akao (Eds.): QFD: The Customer-Driven Approach to Quality Planning and Deployment, translated by Glenn Mazur, Tokyo, Asian Productivity Organization, 1994
[79]
MKS01 Mortice Kern Sytems Inc.: Changing Application Development Needs, a TechRepublic Survey, Sponsored by MKS, available at http://www.mks.com
[80]
MOOR99 J. Moormann: Umbruch in der Bankinformatik - Status quo und Perspektiven für eine Neugestaltung. In: J. Moormann T. Fischer (Eds.): Handbuch Informationstechnologie in Banken, pp. 3-20, Wiesbaden, 1999
[81]
MOOR00 S. Moore: Application Analysis and Mining Tools: Big Payback Potential. Giga Information Group (www.gigaweb.com), Cambridge, MA, 2000
[82]
MULT97 Multispace: Report on demand oriented survey, Multispace Project {ESPRIT 23066}, CEC, Brussels, 1997
[83]
MYER76 G.J. Myers: Software Reliability: Principles and Practices, John Wiley Publications, 1976
[84]
MYER79 G.J. Myers: The Art of Software Testing, New York, 1997.
[85]
NASS00 C.K. Nass, K. Isbister, E. Lee: Truth is Beauty: Researching Embodied Conversational Agents. In: {CASS00}
[86]
NGUY01 H.Q. Nguyen: Testing Applications on the WEB, John Wiley & Sons Inc., New York, 2001
[87]
NIEL93 J. Nielsen: Usability Engineering, Academic Press, 1993
[88]
NIEL94 J. Nielsen, R.L. Mack: Usability Inspection Methods, John Wiley & Sons Inc., New York, 1994
[89]
NIEL01 J. Nielsen's Website: http://www.useit.com
[90]
NPL95 National Physical Laboratory (NPL): Usability Context Analysis: A Practical Guide, Version 4.0, NPL University Services, UK, 1995
[91]
PARN72 D.L. Parnas: On the criteria to be used in decomposing systems into modules, Communications of the ACM, 1972
[92]
PFEI97 A. Pfeiffer: SniFF+: Eine einheitliche Arbeitsumgebung für große Softwareprojekte. In: OBJEKTspektrum, pp. 30-34, March/April 1997
[93]
PREE94 J. Preece et.al: Human Computer Interaction, Addison Wesley Publishing Company, Readint, MA, 1994
[94]
PUNT97 T. Punter, R. van Solingen, J. Trienekens: Software Product Evaluation. In: Proceedings of the 4th European Conference on Evaluation of Information Technology (EVIT97), Delft, The Netherlands, 1997
[95]
RUBI94 J. Rubin: Handbook of Usability Testing: How to Plan, Design, and Conduct Effective Tests, John Wiley & Sons Inc., 1994
[96]
SACH99 L. Sachs: Angewandte Statistik, 9th Edition, Springer, Berlin, 1999
[97]
SAMU98 P.A. Samuelson, W.D. Nordhaus: Economics, 16th Edition, McGraw Hill, Boston, 1998
[98]
SAND00 G.A. Sanders, J. Scholtz: Measurement and Evaluation of Embodied Conversational Agents. In: {CASS00}
[99]
SCHU92 G. Schulmeyer, J. McManus (Eds.): Handbook of Software Quality Asscurance, 2nd Edition, Van Nostrand Reinhold, pp. 297-319, Zurich, Switzerland, 1992
[100]
SHIL00 M.L. Shillito: Acquiring, Processing, and Deploying Voice of the Customer, CRC Press, 2000
[101]
SHIR01 C. Shirky: What is P2P. And what isn't! The O'Reilly Peer-to-Peer and Web Services Conference, Washington D.C., http://www.conferences.oreilly.com/p2p/
[102]
SIMO98 F. Simon, C. Lewerentz: A product metrics tool integrated into a software development environment. In: Proceedings of the European Measurement Conferences (FESMA), p. 603-608, 1998
[103]
SIMO01 F. Simon: Meßwertbasierte Qualitätssicherung - Ein generisches Distanzmaß zur Erweiterung bisherigeer Softwareproduktmaße, Dissertation at the Institute for Computer Sciences, Brandenburgische Technical University Cottbus, Germany, 2001
[104]
SING01 M.P. Singh: Peering at Peer-to-Peer Computing, IEEE Internet Computing, pp. 4-5, January/February 2001
[105]
STAH99 P. Stahlknecht, U. Hasenkamp: Einführung in die Wirtschaftsinformatik, 9th Edition, Springer, Berlin, 1999
[106]
STAL99 R. Stallmann: The GNU Operating System and the Free Software Movement. In: C. DiBona, S. Ockman, M. Stone (Eds.): Open Sources - Voices from the Open Source Revolution, O'Reilly, 1999
[107]
STAL01 M. Stal: Im Rahmen bleiben, In: iX-Magazin für professionelle Informationstechnik, pp. 72-77, Mai 2001
[108]
TRIE97 J. Trienekens, E. van Veenendaal: Software Quality from a Business Perspective, Kluwer Bedrijfsinformatie, Deventer, The Netherlands, 1997
[109]
TURI50 A.M.Turing: Computing machinery and intelligence. In: Computing machinery and intelligence, Vol. 59, No. 236, pp. 433-560, 1950
[110]
V-MOD01 V-Modell, http://www.v-modell.iabg.de
[111]
WALK97 M.A. Walker, D.J. Litman, C.A. Kamm, A. Abella: PARADISE, A Framework for evaluating spoken dialogue agents. In: Proceedings of the 35th ACL and 8th EACL, Madrid, Spain, San Francisco, Calif., Association for Computational Linguistics and Morgan Kaufmann, pp. 271-280, 1997
[112]
WALL01 E. Wallmüller: Software - Qualitätsmanagement in der Praxis, 2nd Edition, Carl Hanser Verlag, May 2001
[113]
WARG01 M. Warg, G. Scholz: Großprojekte erfolgreich managen (Successful Management of Major Projects), Mit der Informationsfabrik Oskar in die IT Echtzeit (Oskar, the information factory paving the way for real-time IT), FAZ-Verlag, Frankfurt/Main, 2001
[114]
WEBL01 WebLoad, Product of Radview, http://www.radview.com
[115]
WIEC00 M. Wieczorek, D. Meyerhoff (Eds.): Software Quality - State of the Art in Management, Testing, and Tools, Springer, Heidelberg, 2001
[116]
WINR01 WinRunner; Product of Mercury, http://www.mercuryinteractive.de
[117]
WINT01 J.G. Winter: Schnelligkeit und Qualität. In: Bankmagazin, pp. 78-79, No. 10/00, 2000
[118]
WYSS01 C. Wyss: Tief im Osten - Ruby: Objektorientierung aus Japan, In: iX-Magazin für professionelle Informationstechnik, pp. 78-81, May 2001
[119]
YU01 E. Yu: Agent orientation as a modelling paradigm, Wirtschaftsinformatik 43, Vol. 2, pp. 123-132, 2001
[120]
ZAHR98 S. Zahran: Software Process Improvement: Practical Guidelines for Business Success (SEI Series in Software Engineering), Addison Wesley, Reading, MA, 1998
[121]
ZULT92 R.E. Zultner: Quality Function Deployment (QFD) for Software: Structured Requirements Exploration. In: {SCHU92}
Index Terms
- Automated testing of mySAP business processes: efficient usage of the SAP test workbench
Recommendations
Synchronizing Enterprise Resource Planning Systems and Business Processes
Synchronizing Enterprise Resource Planning Systems and Business Processes: A Case of a New ERP Development ApproachA major question in organizations is how to synchronize business processes with ICT in order to get the support they need from the adopted ...
Business value of business intelligence systems lies in improved business processes
ACOS'06: Proceedings of the 5th WSEAS international conference on Applied computer scienceIn today's competitive marketplace, organizations must focus scarce resources on the strategies most likely to yield success. Business intelligence (BI) helps them achieve this focus giving the complete vision to learn from the past, monitor and ...
Integrating SAP in Business School: Outcomes of SAP Hands-on Exercises in Business Information Systems Course
ICEIT 2020: Proceedings of the 2020 9th International Conference on Educational and Information TechnologyIn today's digital transformation era, organizations are integrating their business and operational processes by adapting enterprise systems Enterprise Resource Planning (ERP) such as SAP. As a result, the need for business graduates with knowledge and ...
Comments
Information & Contributors
Information
Published In
January 2002
266 pages
ISBN:3540426329
Publisher
Springer-Verlag
Berlin, Heidelberg
Publication History
Published: 01 January 2002
Author Tags
Qualifiers
- Chapter
Contributors
Other Metrics
Bibliometrics & Citations
Bibliometrics
Article Metrics
- 0Total Citations
- 0Total Downloads
- Downloads (Last 12 months)0
- Downloads (Last 6 weeks)0
Reflects downloads up to 03 Oct 2024
Other Metrics
Citations
View Options
View options
Get Access
Login options
Check if you have access through your login credentials or your institution to get full access on this article.
Sign in