Conference Presentations

Application Performance and Reliability Management - 24x7

Managing system performance and reliability has never been as significantx0151or as challengingx0151as it is now. These days, most organizations have multi-technology, multi-vendor, multi-tier environments. In other words, it’s a world rife with 24-hour, alwaysx0151on complexity. Add to this the need for continual changes to react to shifts in business conditions, technology advances, and mixes of demands and you have a recipe that calls for the highest level of performance and reliability possible. But getting there is next to impossible. However, new concepts emerging from research labs are delivering usable products such as flexible computing, autonomous computing, and self-tuning systems. These possibilities have revolutionary potential for performance management.

  • Examine recommended suites of tools and their limitations
  • Look at the major innovations and trends, such as self-tuning systems
Ross Collard, Collard and Company
Just Enough Software Test Automation

To answer the question ''How much test automation is enough?'' we have to look at the areas of the software testing process that can be automated, followed by the areas that should be automated, as well as what levels and types of tests will be automated.

Daniel Mosley, Daniel Mosley & Associates
Testing Web Services: A Dose of Reality

Web services truly have the potential to change the world! Along with the magic of Web services comes a dose of reality. For Web services to truly be a panacea to the masses, quality is imperative. The old guard of "not enough" resources or processes must be challenged. The testing of Web services is one aspect of ensuring quality, but is it prudent to automate the testing of Web services? In this presentation, Theresa Lanowitz explores answers to these important questions:

  • How are Web services tested today? What is real in 2003? Are we ready for test automation or should we conduct manual testing?
  • What is the future direction of testing Web services? What is the outlook for 2005 and beyond?
  • Who are the vendors making in-roads today? Who is laying the groundwork for the future?
Theresa Lanowitz, Gartner Inc
Adventures in Test Automation of Embedded Systems

Has your organization ever wondered about the various types, levels, and approaches to automation in testing embedded software-systems, and how you "stack up" in using them? Examine both the common test automation practices and unique particular problems by acquiring reference pints to compare against. Receive both introduction material and pointers in areas such as levels of tests (unit, integration, software, and system), techniques for generating inputs and outputs, types of testing (structural, functional, and behavioral), and active research. Focus will be on techniques, tools and approaches that have been successful in a variety of real world industrial settings. A decision flow graph will be included as a road map/checklist that you can take home to guide your organization's quests for excellence.

  • Road map for assessing and improving embedded test automations
Jon Hagar, Jon Hagar Educational Services
Differential Testing: A Cost-Effective Automated Approach for Large, Complex Systems

Differential testing is an automated method you can use in testing large, complex systems. It's especially useful in situations where part or all of an existing production system is being upgraded, and the end-to-end functionality of the new system is expected to be the same as the old one. Rick Hower uses two case studies to provide descriptive examples of this novel and surprisingly effective approach. One case involves the rewrite of a complex business rule processing system for a large financial institution; the second involves the replacement of a critical sub-system in a telecom billing process.

  • Learn how to determine if differential testing will be useful for a project
  • Obtain some useful methods for selecting appropriate automated test data
  • Discover critical factors in the success of differential testing
Rick Hower, Digital Media Group, Inc.
The Journey to Test Automation Maturity

There's a pattern to the way test automation typically emerges within an organization. Since you want your automation projects to excel, considering the possibilities of what could happen based on those patterns can help you successfully prepare yourself and your team for anything. By doing this you'll avoid pitfalls, counteract resistance to automation, and set realistic expectations for what automation can do. From other people's common experiences, you can extract information that will help you at all stages of automation maturity.

  • Explore the patterns from pre-launch to advanced levels of test automation maturity
  • Learn traps to avoid and tips for success
  • Discover ways to sustain the benefits of automation even after the first flush of enthusiasm has passed
Dorothy Graham, Grove Consultants
Home-Brewed Test Automatioin: Approaches from Extreme Programming Projects

Projects that use eXtreme programming (XP) often do not use commercial GUI test tools, finding it more useful to build their own support for test automation. This session explains the strategies they've used, which can actually cross over to any project where developers take responsibility for building support for automated testing. The XP community has already made an impact on the tools and practices for unit testing in the wider development community. The instructor reviews the potential impact on customer-perspective testing.

  • Share experiences in building in-house GUI test tools
  • How and when to build and use test APIs
  • Open-source tools to support these approaches
Bret Pettichord, Pettichord Consulting
Looking Past "The Project" with Open-Source Tools

It is often difficult for testers and test teams to look beyond their current project. However, software test automation works best within frameworks that address all projects not just one. Today many people and organizations are solving some or all of their test automation troubles with open-source tools that share solutions and development resources and support. Carl Nagle will demonstrate how to reap solutions from others solving the same problems and tap into external development and support resources.

  • The benefits of SAFSDEV's open-source test automation
  • Demonstration of STAF and the SAFSDEV framework in action
  • Join the open-source movement and contribute to the industry's testing tools and frameworks
Carl Nagle, SAS Institute Inc
User Community Modeling Language (UCML) for Performance Testing Workloads

Performance testers use various methods to describe user workloads-scenarios, operational profiles, and more. Understanding these workloads and accurately simulating them is one key to developing useful performance tests. Scott Barber introduces a User Community Modeling Language (UCML) that he has used to describe and effectively communicate user workloads. With an interactive example, he shows the usage pattern of a sample application and builds a UCML diagram and supporting information to represent usage in an intuitive, easy-to-understand way. See how you can employ the User Community Modeling Language to supplement your existing workload distributions.

  • Value of representing workload distributions visually for performance testing
  • How to create and use UCML diagrams to aid in data gathering in your organization
Scott Barber, Authentec
A Survey of Test Automation Architectures

How are you going to develop and run 1000 test cases automatically and unattended? Commercial test automation tools often get a bad rap because many organizations never get past the record/playback/fail cycle of frustration. These tools, however, can contribute to your testing needs; first you have to understand what has to be done to make them work. Jamie Mitchell outlines several automation architectures that are being used successfully today and discusses the pros and cons of each. Find out which framework or combination of several frameworks will be successful in your environment.

  • Review of commercial test automation tool categories for functional testing
  • Automation frameworks to support different testing needs
  • What it takes for automated test cases to run robustly
Jamie Mitchell, Test & Automation Consulting LLC

Pages

AgileConnection is a TechWell community.

Through conferences, training, consulting, and online resources, TechWell helps you develop and deliver great software every day.