Public API Availability Survey

Introduction and Methodology

WatchMouse monitored the availability of 26 API/cloud web services during the period of December 16th 2009 to January 16th 2010. A real-time status of each of the API's and a seven day history can be found on api-status.com.

The methodology for testing the sites includes one simple API call and check for a valid result. This typically entails an authentication action step for most APIs (e.g. a login) followed by a search or listing action, plus a check of the expected result action. The expected result can immediately return as an error or, if the expected result action is reported after four seconds, it is also logged as an error. These errors are used to count towards the percentage of availability or uptime for each of the sites.

The different API's in this survey use a variety of protocols for authentication, as well as different protocols to send requests and retrieve the response data, like:

  • REST with user/pass authentication
  • SOAP
  • oAuth
Next to the differences in protocol, each API also offers different functionality, like:
  • listing your friends in a social networking application
  • performing a search
  • retrieving a file
  • etc.

Most of the API's offer all of the mentioned functionalities, and all API's offer a wide range of function calls. For the sake of this survey we selected just one function (the most simple one that requires authentication) per API. This means that this survey does not cover an in-depth functional test of the full API's, but but provides an estimate of the availability and working functionality of each API.

If the authentication step failes, or if the action after authentication (e.g. "list friends") didn't return the expected result, an error is registered. Also, if the whole interaction takes more then four seconds, and this is confirmed from a second monitoring station, an error is registered.

The API checks were performed every 5 minutes from the 42 WatchMouse monitoring stations worldwide.

The results are presented in the table and graph below.

 

Tillgänglighet

Här nedan presenteras drifttiden för alla de 26idorna. I enlighet med branschstandarder ses en tillgänglighet på ≥99,9% som bra, medan allting under 99% ses som dålig drifttid. (99% drifttid är lika med över 80 timmars driftstopp per år, eller cirka 1 arbetsdag per månad).

 

# API Procent upptid Nertid per månad
Amazon AWS S3 100.00 0 minuter
Google maps API 100.00 0 minuter
Google search API 100.00 0 minuter
last.fm API 100.00 0 minuter
Yahoo Maps API 100.00 0 minuter
bing search API 99.98 9 minuter
Digg API 99.98 9 minuter
bit.ly shorten API 99.93 31 minuter
eBay shopping API 99.93 31 minuter
10  Delicious update API 99.91 40 minuter
10  Facebook API login 99.91 40 minuter
12  Google App Engine API 99.89 49 minuter
13  Wikipedia API 99.86 1 timme, 2 minuter
13  Flickr API 99.86 1 timme, 2 minuter
15  PayPal API 99.81 1 timme, 25 minuter
16  YouTube feeds API 99.77 1 timme, 43 minuter
16  Salesforce Soap API 99.77 1 timme, 43 minuter
18  Twitter friend timeline API 99.63 2 timmar, 45 minuter
19  Live Spaces API 99.56 3 timmar, 16 minuter
20  Rackspace Cloud API 99.32 5 timmar, 4 minuter
21  foursquare API 98.76 9 timmar, 14 minuter
22  vimeo Simple API 98.30 12 timmar, 39 minuter
23  GeoNames API 98.29 12 timmar, 43 minuter
24  Posterous Twitter API 98.17 13 timmar, 37 minuter
25  MySpace Open Search API 97.15 21 timmar, 12 minuter
26  Yammer oAuth API 96.09 1 dag, 5 timmar, 5 minuter

 

API Tillgänglighet

 

Performance

Also the performance of each API transaction was measured, of which the result is displayed in the graph below.

Note again that the results cannot be used to compare the relative performance of the API's, as the executed transactions are not comparable.

 

API Performance

I denna undersökning av sajtövervakningar ingår följande organisationers sajter: Amazon AWS S3, Google maps API, Google search API, last.fm API, Yahoo Maps API, bing search API, Digg API, bit.ly shorten API, eBay shopping API, Delicious update API, Facebook API login, Google App Engine API, Wikipedia API, Flickr API, PayPal API, YouTube feeds API, Salesforce Soap API, Twitter friend timeline API, Live Spaces API, Rackspace Cloud API, foursquare API, vimeo Simple API, GeoNames API, Posterous Twitter API, MySpace Open Search API, Yammer oAuth API.

Du kan läsa mer om WatchMouse på www.watchmouse.com