Website Monitoring

Launching WatchMouse Laboratories: the tech playground for website monitoring (2009-10-08)

We just launched WatchMouse Laboratories (labs.watchmouse.com)

This blog is the experimental outlet of the WatchMouse engineering team. Here we will share our thoughts on website monitoring, publish experimental features, hand out beta-invites and ask for your opinion.

Our first post is "Investigating IPv6 Website Monitoring", explaining about our work to be ready for the IPv6 Internet. As you might know IP addresses are running out, and many efforts are being made to replace the current Internet Protocol (IPv4) with version 6, which allows for an almost unlimited number of IP addresses.

Of course this will also have consequences on Website Monitoring of IPv6 enabled web sites and servers. WatchMouse is currently working to make this part of their standard offering, and some of our thoughts and findings are shared on our new labs blog.

Read more about IPv6 Website Monitoring on our labs site, and feel free to leave a comment!

New feature included in all website monitoring subscriptions: Root Cause Analysis (2009-10-18)

Today we release the Root Cause Analysis feature for all our website monitoring customers, at no additional cost, in all subscriptions.

What is Root Cause Analysis?

Until now, any issues found by WatchMouse were logged in your account and you were alerted according to your settings and preferences. Although the information in the alert tells you what the problem is, a more detailed analysis, or Root Cause Analysis, can be helpful in determining the actual cause of the issue.

How does it work?

When an issue is found and has been confirmed by another monitoring station (if needed), the Root Cause Analysis is triggered. Currently the Root Cause Analysis entails:

• Perform a traceroute from two monitoring stations to find the actual routes that were used in the tests.
• A screen dump (image) of the web page in question (for http(s) rules only) in two sizes
• The source HTML of the web page (for http(s) rules only) if available.
• Relevant checks: results from previous and subsequent checks for the same rule.
• A detailed analysis of your domain name set-up
• DNS analysis from two monitoring stations to see if the host names are resolved properly.

In your logs you will find this icon right next to the (confirmed) error pointing to the Root Cause Analysis report. Note that this icon will be present only for the first confirmed error in a straight sequence of errors. There is another icon that might appear indicating that the log file has additional information (e.g. for http(s), scripting, or dns/domain rules) that looks like this .

Getting started

If you had any errors reported recently there may already be Root Cause Analysis reports available in your account. To check it out go to the logs and select 'Root Cause Analyses' from the 'Display' menu and click [show].
If there are entries in the resulting list, simply click on the Root Cause Analysis icon to inspect the details.

When an alert email is sent, this will now contain a direct link to the Root Cause Analysis report.

Cloud Watching (2009-10-08)

One of our business partners, Peter van Eijk, has used the WatchMouse website monitoring network to measure a number of cloud providers. He has made some interesting observations. You will also love the presentation tool he used. Use any browser to watch it at http://prezi.com/39648. If you twitter you can also follow him @petersgriddle

WatchMouse expands Website Monitoring Infrastructure to 35 Global Monitoring Stations (2008-09-01)

In order to meet customer demand, WatchMouse is proud to announce the expansion of its global infrastructure with another eight monitoring stations being deployed over the past two months. The new stations are in: India, Israel, Japan, New Zealand, Russia, South Africa, Switzerland and the USA. WatchMouse now offers 25 monitoring stations in major European and North American cities, with a further 10 stations spread across Africa, the Middle East, South America and Oceania.

WatchMouse's extensive infrastructure provides the means to accurately monitor sites and web applications from the perspective of users based in different global locations. Such multi-point monitoring is imperative as site performance varies greatly depending on the location of the user (e.g. customers in the USA might quickly access a site, while for users in Germany, the same site has errors or a long load time). WatchMouse CTO, Mark Pors explains that "Even if your site works well from your headquarters, customers may still have trouble reaching it from different external locations. As a slow or faulty site can frustrate users, damage the reputation of a company and result in lost sales, it is essential to monitor from more than one point."

As the vast majority of businesses are aware of the need for global performance monitoring, WatchMouse was surprised to find global performance issues on the sites of some major international organizations, including the social networking site Facebook. In recent research WatchMouse found that facebook.com performs well in the USA but showed serious user issues from many other locations.

WatchMouse’s market leading infrastructure can help international organizations identify performance issues. Equally, WatchMouse supports clients who require performance monitoring within a particular region by allowing monitoring to be restricted to a sub-set of monitoring stations. This feature is useful for companies that only trade within a large country (e.g. USA) or region (e.g. Europe) but still require comprehensive monitoring within their area of operation.

About WatchMouse

WatchMouse provides global performance monitoring to thousands of customers in over 70 countries. In addition to a market leading infrastructure, WatchMouse offers automated alerting and an advanced user interface for complete self-management of all monitoring features and subscription details.

Linux-based website beats Windows-based sites (2007-06-24)

WatchMouse research shows Linux/Apache has less downtime and yields faster websites than Microsoft/IIS

London, June 20, 2007 – Linux websites have better uptime and load faster than Windows-based websites. Research by WatchMouse, a website monitoring company, also shows that web server platform Apache outperforms the Microsoft IIS platform. Therefore, having a Linux website and an Apache webserver platform offers the best choice for professional web pages.

WatchMouse researched the performance of over 1500 websites across different economic sectors in Europe. Most websites in this study are based on either Linux or Windows. Linux offers the best uptime. When looking at web server platforms the overall opinion favours Microsoft IIS and Apache although the latter outperforms the former in this area as well. The research finds that apart from operating system and web server platform, uptime also depends on the country where the server is based.

On average, Windows and Linux are running more than three quarters of all websites. However, there are differences between countries. Poland and Germany favour Linux combined with Apache for their websites while the professional sites in the UK and Sweden rely heavily on Windows/ Microsoft IIS. When looking at the relative performance of the different web server platforms, Linux clearly beats Windows.

One in four of the monitored professional websites have an uptime of 99.9% which suffices for customer satisfaction. Two thirds of the websites have an availability of less than 99.9% which accounts for at least 8 hours downtime per year. According to WatchMouse this is not acceptable.

“Even though the companies in our study seem to prefer Windows over Linux, our research shows they would be better off using Linux/Apache based websites. Research has shown that most web users are very impatient and will wait no longer than four seconds for a webpage to load”, says Mark Pors, Chief Technology Officer at WatchMouse. “Companies need to realise that website uptime is crucial for a healthy customer satisfaction and a solid client base. Organisations need to become more aware of the impact the choice of web server platform can have on their overall availability and performance.”

A complete overview of the monitoring results of the WatchMouse Site Availability Index, listing all the sites monitored, can be found on http://www.watchmouse.com/SPI/

WatchMouse Urges AdWords Advertisers To Act Swiftly To Avoid Costly Mistakes (2008-04-08)

Utrecht, The Netherlands, 12th March 2008, Research has long confirmed that slow websites drive away potential customers. As Google announces changes to the way they score their immensely popular AdWords, it also appears that sites with slow landing pages create issues for online advertising.

Google will soon incorporate landing page load time (the amount of time it takes for a page to show after a user clicks an ad) as an additional factor in determining a site’s ‘quality score.’ Google says they are making this change as “users value ads that bring them to the information they want as efficiently as possible.” Experts warn that failure to demonstrate a fast load time will result in your keywords getting a lower quality score and higher minimum bids.

A post by Google on the WebMasterWorld blog indicates that the new scoring method will be announced shortly, "now that the (landing) page load time initiative has been mentioned in this and other public forums, the Inside AdWords blog post is likely to be posted sooner rather than later - perhaps as early as this week".

The impact of the new AdWords scoring method will be financial. WatchMouse CTO, Mark Pors, advised "when Google introduces the new scoring method, AdWords with slow landing pages will cost more. Slow landing pages will be listed below their faster competitors, thus increasing the cost-per-click (CPC) to get a higher position, or substantially lowering the number of customers visiting the site, as studies show that the top few AdWords obtain the vast majority of the traffic volume". Pors suggested “businesses should do everything possible to prevent a low Google 'quality score' and do so as soon as possible, as the AdWord system will only re-evaluate landing pages on a monthly basis”.

Measuring web site performance, however, is not a straightforward exercise, as many factors influence it. Pors urges Google AdWords customers to “avoid costly mistakes and have independent website monitoring set up to continuously measure load time from different locations worldwide. Once a business has accurate statistics, it can make necessary changes well in advance of Google’s new ’Quality Score’ launch date, and keep a close eye on it after that”.

About WatchMouse

Accurate and independent monitoring of website performance enables businesses to address load time and many other potential user experience issues which might not be apparent when conducting in-house or single point monitoring. WatchMouse’s global infrastructure provides its customers with peace of mind that their site has been tested from the user’s perspective, and external to the organization. As industry leader in website performance monitoring, WatchMouse offers customers a web-based service with features such as SMS/email alerting and extensive reporting. Many of the world’s lead brands depend on WatchMouse to monitor their sites, providing independent confirmation of both in-house and suppliers’ website performance.

Online shops, speed and downtime, getting the facts. (2009-12-07)

These days your website plays an important role in informing potential customers, converting them into customers who want to do business with you, and possibly also conducting the transactions with these customers. In other words: Your business relies ever more on the digital economy, and increasingly on the transactional part of it, the online shop.

These online shops should obviously provide satisfactory performance. Here, both the speed at which they serve pages and their uptime are important. If potential customers cannot reach the online shop, or the online shop is too slow, they are less likely to do business with you now, and in the future. Studies have revealed that half of the people who experience downtime on a website go to its competitor. A majority of online shoppers say performance and uptime influences their choice of online shop.

The amount of revenue that is lost when your website or online shop does not behave properly is hard to quantify. If your website is slow your customers may select a distribution channel that is more costly for you, or they may go to your competitor. Even worse, they may complain about your company to other potential customers. All of this boils down to lost revenue.

A good website is up for at least 99.9% of the time, even though this still represents more than 8 hours in a full year. In a recent survey we found that many websites do not even achieve 99% availability, which corresponds to more than 3 days of downtime a year. As regards speed, if a web page does not load in less than 4 seconds, people start to leave the site, sometimes forever.

How do you make your online shop an efficient experience for your customers? The site must be designed with a strong focus on the customer task. The technology must be no more complex than is relevant. People get annoyed by slow loading Flash intros and complex and slow Flash-based navigation. Take a look at the Google home page; it is one of the fastest websites in the world. On the other hand, you can still use a video clip of a product, if that is relevant to the customer at a particular point in the transaction. You can also use advanced Web 2.0 technology if it makes the user interface more resilient and user-friendly. To experience this, look at Google maps using a dial-up internet connection. It is a really complex user interface, but everything possible has been done to create a positive user experience.

Technology is also important; make sure that you have good service level agreements with all your technology providers. You also want to stress test the site, to see what happens if a lot of people start using it simultaneously. Finally, you should independently monitor the site. When it is time to talk to your hosting company, IT department or website maintainer, it is very helpful to have hard data that reports on the speed and uptime of your online shop.

Peter van Eijk

dr Peter van Eijk is an independent management consultant associated with WatchMouse, the site monitoring experts www.watchmouse.com. He is experienced in setup, management and audits of digital infrastructures. His blog is "Peter's Griddle".

WatchMouse Monitors 26 Popular APIs So You Don't Have To (2010-01-23)

Website monitoring startup WatchMouse is launching a new service dubbed API-status.com today, a website that displays realtime availability and performance of popular, public APIs.

WatchMouse Monitors 26 Popular APIs So You Don’t Have To (2010-01-20)

Website monitoring startup WatchMouse is launching a new service dubbed API-status.com today, a website that displays realtime availability and performance of popular, public APIs.

The lists of monitored APIs consists of 26 of the most heavily trafficked Web services, including Google Search, Google Maps, Bing, Facebook, Twitter, SalesForce, YouTube, Amazon, eBay and others.

4 New APIs: Wine, Whois and Website Monitoring (2010-01-13)

WatchMouse API: The WatchMouse service checks the behavior and availability of websites. WatchMouse "allows site owners to optimize the internet experience of their customers. A worldwide network checks websites from 40 different locations in 25 countries around the globe."