Public API Availability Survey

Introduction and Methodology

WatchMouse monitored the availability of 26 API/cloud web services during the period of December 16th 2009 to January 16th 2010. A real-time status of each of the API's and a seven day history can be found on api-status.com.

The methodology for testing the sites includes one simple API call and check for a valid result. This typically entails an authentication action step for most APIs (e.g. a login) followed by a search or listing action, plus a check of the expected result action. The expected result can immediately return as an error or, if the expected result action is reported after four seconds, it is also logged as an error. These errors are used to count towards the percentage of availability or uptime for each of the sites.

The different API's in this survey use a variety of protocols for authentication, as well as different protocols to send requests and retrieve the response data, like:

• REST with user/pass authentication
• SOAP
• oAuth

Next to the differences in protocol, each API also offers different functionality, like:

• listing your friends in a social networking application
• performing a search
• retrieving a file
• etc.

Most of the API's offer all of the mentioned functionalities, and all API's offer a wide range of function calls. For the sake of this survey we selected just one function (the most simple one that requires authentication) per API. This means that this survey does not cover an in-depth functional test of the full API's, but but provides an estimate of the availability and working functionality of each API.

If the authentication step failes, or if the action after authentication (e.g. "list friends") didn't return the expected result, an error is registered. Also, if the whole interaction takes more then four seconds, and this is confirmed from a second monitoring station, an error is registered.

The API checks were performed every 5 minutes from the 42 WatchMouse monitoring stations worldwide.

The results are presented in the table and graph below.

 

Disponibilidade

O tempo de atividade de cada um dos 26 API's é apresentado abaixo. De acordo com os padrões do setor, a disponibilidade de ≥99,9% é considerada 'boa', enquanto qualquer percentual inferior a 99% é considerado 'insatisfatório'. (Um tempo de atividade de 99% equivale a mais de 80 horas de tempo de inatividade por ano, ou cerca de 1 dia útil por mês).

 

 

 

Performance

Also the performance of each API transaction was measured, of which the result is displayed in the graph below.

Note again that the results cannot be used to compare the relative performance of the API's, as the executed transactions are not comparable.

 

Esta pesquisa de monitoramento de desempenho de sites abrange os sites das seguintes organizações: Amazon AWS S3, Google maps API, Google search API, last.fm API, Yahoo Maps API, bing search API, Digg API, bit.ly shorten API, eBay shopping API, Delicious update API, Facebook API login, Google App Engine API, Wikipedia API, Flickr API, PayPal API, YouTube feeds API, Salesforce Soap API, Twitter friend timeline API, Live Spaces API, Rackspace Cloud API, foursquare API, vimeo Simple API, GeoNames API, Posterous Twitter API, MySpace Open Search API, Yammer oAuth API.

Você pode obter mais informações sobre o WatchMouse em www.watchmouse.com