Web Site Performance Testing

BadBoy Software updates scripting recorder to improve WatchMouse's Functional testing service (2009-01-07)

The WatchMouse Functional testing service allows you to define multi-step tests through a website and replay them periodically from the WatchMouse monitoring stations. This goes beyond just monitoring site performance and uptime, it allows you to verify that your web applications and back end systems really work.
More information on this service can be found on the Transaction Monitoring & Web Application Testing page.

In a co-operation with BadBoy software, who provide a tailored version of their recoder software which allows you to upload the resulting script directly into your WatchMouse dashboard.

Feedback from our "Functional testing" customers has lead to several essential improvements to the BadBoy recorder. This improved version has now been released and we recommend all our customers to upgrade to this version.
The new - WatchMouse specific - version can be downloaded here: http://www.badboy.com.au/versions/BadboyInstaller-2.0-latest_wm.exe

The most important changes are:

CHANGES IN BADBOY 2.0.7

   #1097: Multipart Forms Incorrectly export Parameters to JMeter Encoded causing Double Encoding

   #1087: Use Follow-Redirect Option in JMeter for More Reliable Export Playback

   #1086: Export Referer and Other Default Headers to JMeter

   #1085: Assertions placed as Children of Requests not Exported to JMeter

CHANGES IN BADBOY 2.0.6.1

   #1075: Security Update (MS08-052 - Critical)

The full release notes can be found here: http://badboy.com.au/versions/ReleaseNotes-2.0.7.txt

WatchMouse and Badboy Software announce partnership (2008-04-03)

Partnership brings easy website transaction monitoring

WatchMouse is pleased to announce a partnership with Australia's Badboy Software. The partnership combines the immensely popular Badboy scripting tool with WatchMouse's market leading website performance monitoring, enabling customers to record complex transaction scripts and run them using a global infrastructure.

Owner and founder of Badboy Software, Simon Sadedin says, "With Badboy Software's in-depth experience in functional testing and WatchMouse's extensive infrastructure, technology and know-how for running enterprise grade monitoring solutions, we have a unique opportunity for collaboration."

The powerful Badboy scripting tool enables customers to professionally record all the actions involved in a web transaction. Designed to aid in the testing and development of complex dynamic applications, the Badboy tool contains dozens of features including a simple yet comprehensive capture/replay interface, load testing support, detailed reports, graphs etc.

WatchMouse CTO, Mark Pors explains, "Having integrated with Badboy, our customers can now upload their Badboy scripts directly into their WatchMouse console. Scripts can then be automatically and periodically run from WatchMouse's global infrastructure of 25+ checkpoints. This new functionality enables our customers to monitor their web applications 24/7 and know how their site behaves when customers access it from locations all around the world."

As a global leader in website performance monitoring, WatchMouse provides many of the world's largest companies with independent verifications of their website performance. With immediate results, automated alerting, simple set up and flexible subscriptions, WatchMouse offers the features, control and quality of service essential for today's online business.

The partnership between WatchMouse and Badboy Software provides customers with a market first: global, easy, powerful, web application testing.

To find out more about this new functionality and sign up for a free trial visit: http://www.watchmouse.com/scripting.php

Mark Pors
CTO
WatchMouse
http://www.watchmouse.com/

WatchMouse Finds Poor Site Performance for UK gambling site - Tote’s site the worst (2008-04-09)

Utrecht, the Netherlands, 9 April 2008 - WatchMouse, a leader in website performance monitoring, tested the sites belonging to the UK’s online gambling companies for errors, availability and performance. The testing was conducted on the Grand National race day and for the 10 days prior. WatchMouse anticipated that the sites of gambling companies would perform well to facilitate their customers placing bets on this important event. Surprisingly, WatchMouse found that Tote’s site had serious user issues with a Site Performance Index (SPI) of 2,854 while the sites belonging to Stan James, William Hill and Blue Square only scraped acceptable SPI scores. Additionally, the sites of SkyBet and Jennings Bet were found to have uptime scores well below accepted industry standards.   

Monitoring was conducted from 26 March - 5 April 2008. During, this period one of WatchMouse’s monitoring stations tried to access the homepage of the sites every five minutes. Sites were expected to download within 4 seconds without any errors. Combining the errors, speed (load time) and availability measurements, WatchMouse calculated a Site Availability Index (SPI) for each of the sites. An SPI of less than 1,000 represents a ‘well performing’ site, 1,001 - 1,999 is regarded as ‘acceptable’, while a score of above 2,000 represents a site with ‘serious user issues’.

By a significant margin, the site of Jennings Bet was found to have the highest number of errors but when combined with a fast load time, resulted in an acceptable overall SPI score of 1,279 and recorded no errors on race day. By contrast, Tote’s site scored a dismal SPI of 2,854 due largely to very long load times. Slow load times were also the main cause of Stan James, William Hill and Blue Square sites’ scoring barely acceptable SPIs of 1,792, 1,655 and 1,615 respectively.

WatchMouse CTO, Mark Pors, said, “As one in three British adults bets on the Grand National*, we anticipated that the UK’s gambling companies would strive to provide their customers with a fast, error free sites. I am therefore surprised that in the lead up to this important betting event, our testing found the sites of some major gambling companies to be operating well below accepted industry standards.”

In line with industry standards, WatchMouse ranks a site’s uptime as good if it is greater than 99.9%, OK if it between 99.89% - 99.01% and poor if it is less than 99%. Mark Pors points out that “99% uptime sounds great but when you calculate it, this means 80+ hours of downtime a year. That’s one working day per month.”

The sites ranking as poor are those belonging to SkyBet and Jennings Bet who scored 98.52% and 95.57% respectively; meaning the Jennings Bet site was unreachable for more than 32 hours, during the 10 days of monitoring.

A complete overview of the SPI monitoring results can be found at: http://www.watchmouse.com/SPI/2008/performance_UKbetting_sites.php

*BBC News, 4 April 2008

Spanish e-tailers not ready for Xmas shopping rush (2005-12-09)

WatchMouse research reveals weaknesses of Spanish online shops

Not a single Spanish webshop has an uptime of 100%, and only one out of 10 meets the regular industry availability standards. This is the conclusion of a research by WatchMouse, one of the fastest growing companies in the Netherlands, and winner of the Deloite Rising Star award in 2005.

WatchMouse has been monitoring the main ten Spanish webshops for 38 days, to find out if they are going to be able to handle the Christmas rush. The results of the WatchMouse Availability Index for Spanish e-tailers are poor. "We predict a long wait for internet customers this Christmas season, as Spanish e-shops don't seem to be ready to handle the increased traffic. In a fairly quiet period the performance has already been below standard. The extra volume of online shoppers before Christmas will definitely cause problems, and may even bring some sites down completely", says Mark Pors, CTO WatchMouse.

"According to recent research by the Asociación Española de Comercio Electrónico, retail e-trade in Spain reached some 1.8 billion euros in 2004. So there are big amounts at stake here. If customers cannot get through on a website, or are experiencing a long wait, they often decide to visit a competitive site, causing webshops to lose deals, and even risk losing loyal customers for good."

WatchMouse monitored the top ten Spanish e-tailers continuously from October 25 until December 2. Every 5 minutes, one of WatchMouse’s test stations tried to access the homepage of the site, which is expected to download within 8 seconds, without any errors. An uptime of 99.9% is seen as the minimum acceptable level. This percentage is also often quoted in service level agreements (SLAs) with hosting providers.

Of the ten websites monitored, there was only one meeting this requirement: Carrefour. Mercadona and AreaPC were the sites with the worst availability, showing a respective downtime of an equivalent of 10 and 16 hours over the 38-day testing period. In comparison: the main US e-tailers, such as eBay and Amazon all have 100% uptime, which shows perfect availability can be achieved.

A complete overview of the monitoring results of the 10 sites can be found on http://www.watchmouse.com/availabilityindex/2005/eshops-es.php
WatchMouse will continue to monitor the performance of the ten Spanish etailers over the Christmas period and will publish its findings in January 2006.

About WatchMouse

Companies can easily monitor their own Internet sites using WatchMouse's monitoring service. WatchMouse has been monitoring Internet sites and e-commerce applications for companies throughout the world since 2002. WatchMouse has thousands of customers in more than 70 countries. The services supplied by WatchMouse are available in eight languages, and analyses are performed from various locations and over numerous networks, using a world-wide monitoring network.

Further information can be found at: www.watchmouse.com.

WatchMouse understood our requirements and provided cost effective Load Testing (2010-01-13)

LECTRIC recently needed to improve the website capability and performance of one of our customers to meet their rapidly developing requirements. Load Testing was a critical component of this website development activity. These Load Tests were complex, especially as some of the user behaviour metrics were unknown. WatchMouse understood our requirements and provided cost effective Load Testing which added considerable value to our business.

General Manager, LECTRIC Webservices

Website performance is the key to customer satisfaction (2007-06-27)

How often have you typed in the Google URL and received a page that will not load? I am willing to bet that this is a rare occurrence. Despite its busy traffic, Google is a textbook example of a web site that has almost perfect performance and therefore serves a great number of satisfied customers. The market share of the search engine is a resounding confirmation of this. You are assisted quickly, so you come back sooner. Research conducted by JupiterResearch has revealed that visitors to a site only have 4 seconds of patience. If the site has not been loaded by that time, they leave. Error messages also prompt potential customers to go to the competition.

Why do organisations still devote so little attention to the effective availability of their site? Performance is the key to satisfied customers. For many companies, their web site is the face of the organisation. Consumers and also business users of the Internet use the wealth of information on the web to compare purchasing options. It is of immeasurable importance that they are also actually able to find what they are looking for. If this is not possible at one company, competitors are straining at the leash to offer their services through a correctly functioning site.

Coming back to the praise that we had for Google, we see that the search engine has made significant investments in the availability of its web site. The page is run by several machines at various sites. If one crashes there are enough back-up servers that can take over the traffic flows to guarantee optimum performance. In addition, the search machine invests a great deal of time and money in the right hardware and people. Although the site has a difficult task – searching through an index of billions of documents – it is almost always available and loads fast.

The actual site is unspectacular in construction. This applies to the majority of sites with a high level of availability. Simple sites such as the news site NU.nl are almost always easy to access. Nevertheless, it is not only the layout of the site that determines how the web page performs. Too many photos, long symbols and frills make web sites slower to respond. The fact that the ‘back end’ of the site is not efficiently programmed also contributes to longer loading times. Frequent consultation of background databases is also detrimental to the speed of the page.

Where it often goes wrong is when different people are working on a site, thereby disturbing the links between the various elements. The different parts of the site will work correctly, but the site as a whole will fail to perform. This means long waiting times for people who want to use the services of a company.

Service providers at the upper end of the market are becoming increasingly aware of this. The contracts that they use frequently include a service level agreement (SLA) for the part for which they are responsible. Nevertheless, they regularly make mistakes due to the fact that the promised performance is not subsequently verified (by an independent party). Although it is now essentially part of the contract, there is insufficient actual verification. Ideally, web site performance should become a permanent component of a contract. In addition, clear internal agreements must be made on who has final responsibility for the efficient loading and availability of a site.

Regular testing is also essential for the facilitation of good availability. This will prevent a great deal of errors, keeping the site up and running at crucial times. The storm that blew over the Netherlands at the end of January was a good opportunity to see which sites were prepared for extreme loads and which were not. The site of the Dutch weather institute, KNMI, was almost unreachable, while some logical thought could have protected them from this eventuality. If you know that a major storm is heading towards the country you can be sure that people will search for information on the weather and roads on the Internet. Sites such as those of KLM and Schiphol were also unreachable, while the specially created site Crisis.nl, which had been kept as simple as possible, was able to serve a large number of people.

Including ‘stress tests’ in a SLA or conducting them regularly in-house is therefore to be recommended. Companies can easily take control by ensuring that their service provider executes this type of test or by putting their own site under pressure. This is the best method of checking whether your web site can handle a sudden increase in visitor numbers. It is also good to know whether the servers on which your site is running actually ensure that your page is always available and loads correctly. For companies, it is crucial to see when they are off air. This can save them a large amount of money every year and will also reduce the number of irritated visitors to the site. This is how you keep customers satisfied and keep the company running.

Mark Pors
Chief Technology Officer at WatchMouse

WatchMouse provides site performance monitoring and stress test services