Web Performance Suite™ New Features

New in 3.5 Release

New Feature Description
Instant Load Engine Now large multi-engine load tests can be run without installing any software. Just boot from an Engine-on-a-disk using Knoppix-like linux boot CD-ROM or a USB memory stick, and the load engine will automatically boot and update itself to the latest version! The load engine will automatically configure itself to use up to 2G of RAM, and can handle multiple-NIC hardware.
New .NET Application Server Monitoring Module The new Advanced Server Analysis™ module for .NET collects and analyzes .NET application server metrics to help locate bottlenecks and improve server performance. 23 important metrics are collected, and the server reports are integrated with the other performance reports. (Note: the .NET server monitoring module is sold separately.)
Major Report Improvements

The newly designed HTML version of the load test report now has a left-hand side index to make it easier to navigate to any part of the report quickly. The enhanced export to HTML feature can now export the entire report for alternate distribution methods, and includes the new table of contents. The reports are now customizable, so you can choose the sub-sections to be included in each section; only view the parts you want. The performance of very large reports has been improved by streaming content instead of caching.

WPL-477 Add number of users to tables/exports for server metric groups (cpu, memory, etc) and add tables to individual server metric sections.
WPL-455 Show page duration min/max durations in report tables and stats view.
WPL-472 Add PPD section to analyze by average page duration.
WPL-484 Add optional report sections for each URL.
WPL-473 Add error details to errors section in load test report
WPL-380 Make the value of server performance checklist thresholds configurable by users.
Test Case Configuration Improvements

Eight separate improvements were made in test case configuration, including dataset generation from pre-built lists of cities and names, regular expression support and scalable think times.

WPA-827 Remember dataset fill options
WPA-833 Dataset generation from lists (first names, last names, cities, etc.)
WPA-839 Show think time column (many users don't know its there)
WPA-812 Regular Expression available for manual extractor and custom detection rules
WPA-834 Change title of web page
WPA-848 Prune quotes when importing dataset
WPA-853 File download fields named for downloaded resource
WPL-320 Scalable think times
Load Testing and Analysis Improvements
WPL-529 Calculate bandwidth at test summary level based on instantaneous I/O rather than completed transactions
WPL-455 Show min and max page duration in summary metrics (stats view)
WPL-583 Increase precision of hits/sec to one decimal place. Calculating as integer can be misleading for small tests.
WPL-617 Add manual section describing server metrics
WPL-517 Allow user to restart testcase on out-of-data error instead of halting
WPL-451 Make collection of URL metrics optional to conserve memory and disk space
WPL-456 Document the use of engine configuration settings to override default user distribution algorithms
WPL-580 Add Average Resource Pending and Current Page Users metrics
WPA-787 Add transaction timeouts with configurable timeout duration
Vista Improvements The underlying software libraries upon which the software is based, Eclipse, was upgraded to version 3.3, which brings Vista fixes, improvement in the text rendering performance, and many cosmetic improvements.
Internationalization The 3.5 release is now ready for internationalization, which will take place in subsequent updates. The first new language to be supported is French.

New in 3.4 Release

New Feature Description
Vista Support

With the release of version 3.4 all of the modules are now Vista-compatible.

New Server Monitoring Module

The new Advanced Server Analysis module collects and analyzes server metrics to help locate bottlenecks and improve server performance. 23 important metrics are collected on each platform, and the server reports are integrated with the other performance reports. The top six most important parameters are analyzed to make sure their fall within normal parameters, and problem spots are highlighted. (Note: the server monitoring modules are priced separately.)

Expert Test Case Config Wizard The parts of configuring a test case that are rarely used have been moved into a "expert" part of the configuration wizard.

New in 3.3 Release

New Feature Description
Advanced Configuration

Web Performance Analyzer™ extensively analyzes your testcase and automatically performs the routine configurations required for most testcases, saving many hours of labor on each testcase. For those testcases that require additional manual configuration, this task has previously required a high level of knowledge of the product and/or help from our support personnel.

For help the user understand the new functionality there is a new tutorial that can help even the novice load-testers understand and configure complex testcases. Many of the new testcase configuration options for this release are addresses specifically in this tutorial.

User-defined Field-detection Rules

The ASM wizard uses an extensive set of default rules for finding and configuring client-state variables in web pages for accurate testcase simulation. With the addition of User-defined Field-detection rules, you can provide the ASM wizard with additional rules for locating and configuring these fields. Previously, this required the user to manually configure extractors and modifiers on each instance of a field. By specifying a detection rule, ASM can perform this work automatically, saving many hours of work for each testcase.

ASM Field-ignore Preferences The run-time performance of Load Tester can be optimized by instructing the ASM wizard to ignore fields that will never change for a particular testcase. Previously, these fields must be selected each time the ASM wizard was executed. Now these fields may be specified in the Ignored Fields preference page and the ASM wizard will automatically ignore them each time.
Dynamically-named Fields support Some application frameworks use groups of fields that are numbered based on the value of another field. In earlier releases, handling these cases was impossible without assistance from our support personnel. Dynamically-named field schemes may now be configured by novice users with relative ease, allowing you to get your tests up and running quickly.
Validation Rules Building a good testcase sometimes requires configuration of validators on every page in a testcase. This can be an arduous and repetitive task consuming valuable testing hours. Validation rules may now be specified to automatically apply validators, as needed, to one or many pages in a testcase. This is especially useful when checking for common error messages that are generated automatically by application frameworks.
Domain and URL Blocking Many testcases can be polluted with URLs that are not useful for load-testing purposes. These include URLs fetched automatically by toolbar plugins (Google, Yahoo, etc) and by advertising or usage-tracking URLs on external sites. Corporate portal pages may also references to many off-site URLs that should not be included in a load test. Previously, these transactions required manual deletion to get the desired load test results. Domains and individual URLs may now be blocked during the recording phase, automatically excluding them from the testcase.
Streaming Media Support Some testcases with large resources, such as streaming media, resulted in metrics on a recorded testcases that was not as accurate as possible. Users may now turn on streaming-media support before recording these testcases to generate more accurate measurements and a more realistic testcase simulation.
Fixed-repeat Load Tests

Previous versions only allowed configuration of a load test with a fixed duration. A load test may now be configured to end after all testcases have completed a fixed number of iterations.

IP Aliasing Configuration Load Tester has supported the use of multiple IP addresses for generating load to your server for many versions. However, using this feature required manually adding a line for each IP address to a text file on each engine. This task may now be accomplished with a few clicks from within the GUI.
Misc. Improvements
  • License version is checked before upgrading - so the software is not accidentally upgraded to a version that cannot be used.
  • Common replay and load test errors generate suggestions on how to fix the problem.
  • Comments may be provided when attaching files to an existing support issues using the Support Request wizard.
  • Copying a testcase to a different repository automatically copies the datasets used by the testcase.
  • Testcase replays may be 'promoted' to the primary testcase so that reports show more recent results.
  • Imported client certificates may be deleted from within the GUI.
  • Files attached to support requests may be made "private".
  • Customizations made to configuration files are now kept in the workspace - so they are not lost when upgrading to a new version.
  • The full URL of a transaction may be copied to the clipboard from a pop-up menu item in the editor.
  • The total number of pages and transactions in a testcase are displayed in the testcase size tooltip in the testcase editor.
  • Validation creation dialog automatically copies selected text to the 'Constant' field.
  • Load test report shows the total number of testcases completed (for each testcase).
  • Load Test initialization progress is updated more granularly - preventing a mis-perception that the process has failed when sending large load tests to engines over slow network connections.
  • Engine configuration data is optimized and compressed to decrease the engine initialization time.
  • Several new Load-test optimizations result in lower CPU and memory usage - resulting a greater load-generating capacity on each engine.
  • Load test reports automatically scale the units on large metrics (such as bytes/sec or bytes transferred) for easier reading.
  • Time-domain charts place tick marks and labels at more natural locations. For example, 0:30, 1:00, 1:30 instead of 0:21, 0:51, 1:21.

New in 3.2 Release

New Feature Description
Customizable Playback Screen

Now you can customize the playback screen by adding real-time display of just the parameters you want to watch, including load times for particular web pages.

Dynamic Field Names

Support for complex frameworks that dynamically change the field names to encode state and session information.

Statistics View A new GUI view has been added to interactively browse statistics outside of reports.
Test Case Report A new printable and exportable report shows everything about a particular test case. This is great for showing baseline web page load times.
URL-level Statistics Statistics for individual URLs can now be viewed and shown in reports.
Test Case Exports The data for a particular test case can now be exported for outside reports or for inclusion in other software.
Custom Extractors While the Automatic State Management™ feature automatically configures 99% of dynamic variables, in rare cases you may need to configure a test case by hand. Now custom extractors can be configured to dynamically parse values at playback.
Actors View The new Actors View shows all of the dynamic logic associated with a page or test case in one place, including modifiers, validators, and extractors.
Command Line Control Replays can now be run from the command-line making it possible to start a test case automatically or from another program.

New in 3.1 Release

The Web Performance Suite™ 3.1 release concentrates on improving support for complicated SOAP architectures and improving quality and stability by implementing dozens of customer suggestions.

In the SOAP/web services world there's no single architecture, but many SOAP and web-services designs use complicated multi-part HTTP POSTS requests to communicate with the web server. Many times the client isn't even a web browser, but an automated process in a corporate datacenter.For those times where the client is especially complicated transactions can now be built by importing the raw transaction files. You can even export recorded transactions, edit them at the binary level, and them import them back into the test case.

Another major feature is improved support for applications which involve lots of uploads of different files. Now you can specify an unlimited number of files to upload, and each virtual use can upload a different file. As with all our data replacement features, this integrates easily into enterprise-level tests by automatic distribution and management of data replacement with the remote engines.

New Feature Description
Faster

Recorded page metrics are even more accurate, especially with large page sizes.

Improved Tooltips

Editor tooltips now show request and response sizes, time to first byte, etc.

Improved Data Generation Dataset generation now has prefix, suffix, and sequential options.
Transaction Import/Export Transactions can be imported and exported for creation/editing in external tools.
Multi-part POST Improved support for multi-part POST content.
File Uploads Extensive support for simulating large numbers of file uploads.
Improved Status Viewer The status viewer has been improved to do a better job of showing what's happening when a test is starting or stopping.
Virtual User Error Handling The virtual user can now restart from the beginning when an error during a load test.
Improved Error Handling The error descriptions are now more user friendly and easier to understand.

New in 3.0 Release

Almost all of the features from Web Performance Trainer™ 2.9 are now available in the Load Tester™ module of the Web Performance Suite™ 3.0. Note only is the user interface improved, but there are also plenty of competely new features as well.

New Feature Description
Reports

The Baseline and Load Test Performance Analysis is now available in report form and available to share via the web or modify in your favorite editor. Now its easy to create a formal report of your load testing efforts.

Improved Monitoring

Multiple web servers can now be monitored for CPU and memory usage.

Easier to Use The new user interface has been completely redesigned to be easier to operate in so many ways its difficult to describe them all.
Save Performance Test Configurations Now you can configure and run separate test configurations, keeping each configuration around so you can exactly run the same test as before.

Satisfied Customers



Products



Copyright © 2008 Web Performance, Inc.

Website design and development by DesignHammer Media Group, LLC (Durham, NC)