Public API Availability Survey

Introduction and Methodology

WatchMouse monitored the availability of 26 API/cloud web services during the period of December 16th 2009 to January 16th 2010. A real-time status of each of the API's and a seven day history can be found on api-status.com.

The methodology for testing the sites includes one simple API call and check for a valid result. This typically entails an authentication action step for most APIs (e.g. a login) followed by a search or listing action, plus a check of the expected result action. The expected result can immediately return as an error or, if the expected result action is reported after four seconds, it is also logged as an error. These errors are used to count towards the percentage of availability or uptime for each of the sites.

The different API's in this survey use a variety of protocols for authentication, as well as different protocols to send requests and retrieve the response data, like:

  • REST with user/pass authentication
  • SOAP
  • oAuth
Next to the differences in protocol, each API also offers different functionality, like:
  • listing your friends in a social networking application
  • performing a search
  • retrieving a file
  • etc.

Most of the API's offer all of the mentioned functionalities, and all API's offer a wide range of function calls. For the sake of this survey we selected just one function (the most simple one that requires authentication) per API. This means that this survey does not cover an in-depth functional test of the full API's, but but provides an estimate of the availability and working functionality of each API.

If the authentication step failes, or if the action after authentication (e.g. "list friends") didn't return the expected result, an error is registered. Also, if the whole interaction takes more then four seconds, and this is confirmed from a second monitoring station, an error is registered.

The API checks were performed every 5 minutes from the 42 WatchMouse monitoring stations worldwide.

The results are presented in the table and graph below.

 

Verfügbarkeit

Im Folgenden wird die Verfügbarkeit jeder der 26 WebAPI's angegeben. Branchenüblichen Werten entsprechend gilt eine Website-Verfügbarkeit von ≥99,9 % als gut, während Werte niedriger als 99 % als unzureichend gelten. (Eine Verfügbarkeit von 99 % entspricht einer Ausfallzeit von jährlich über 80 Stunden oder einem Arbeitstag pro Monat).

 

# API Prozentuale Verfügbarkeit Ausfallzeit pro Monat
Amazon AWS S3 100.00 0 Minuten
Google maps API 100.00 0 Minuten
Google search API 100.00 0 Minuten
last.fm API 100.00 0 Minuten
Yahoo Maps API 100.00 0 Minuten
bing search API 99.98 9 Minuten
Digg API 99.98 9 Minuten
bit.ly shorten API 99.93 31 Minuten
eBay shopping API 99.93 31 Minuten
10  Delicious update API 99.91 40 Minuten
10  Facebook API login 99.91 40 Minuten
12  Google App Engine API 99.89 49 Minuten
13  Wikipedia API 99.86 1 Stunde, 2 Minuten
13  Flickr API 99.86 1 Stunde, 2 Minuten
15  PayPal API 99.81 1 Stunde, 25 Minuten
16  YouTube feeds API 99.77 1 Stunde, 43 Minuten
16  Salesforce Soap API 99.77 1 Stunde, 43 Minuten
18  Twitter friend timeline API 99.63 2 Stunden, 45 Minuten
19  Live Spaces API 99.56 3 Stunden, 16 Minuten
20  Rackspace Cloud API 99.32 5 Stunden, 4 Minuten
21  foursquare API 98.76 9 Stunden, 14 Minuten
22  vimeo Simple API 98.30 12 Stunden, 39 Minuten
23  GeoNames API 98.29 12 Stunden, 43 Minuten
24  Posterous Twitter API 98.17 13 Stunden, 37 Minuten
25  MySpace Open Search API 97.15 21 Stunden, 12 Minuten
26  Yammer oAuth API 96.09 1 Tag, 5 Stunden, 5 Minuten

 

API Verfügbarkeit

 

Performance

Also the performance of each API transaction was measured, of which the result is displayed in the graph below.

Note again that the results cannot be used to compare the relative performance of the API's, as the executed transactions are not comparable.

 

API Performance

Diese Website-Leistungsuntersuchung umfasst Websites der folgenden Unternehmen: Amazon AWS S3, Google maps API, Google search API, last.fm API, Yahoo Maps API, bing search API, Digg API, bit.ly shorten API, eBay shopping API, Delicious update API, Facebook API login, Google App Engine API, Wikipedia API, Flickr API, PayPal API, YouTube feeds API, Salesforce Soap API, Twitter friend timeline API, Live Spaces API, Rackspace Cloud API, foursquare API, vimeo Simple API, GeoNames API, Posterous Twitter API, MySpace Open Search API, Yammer oAuth API.

Weitere Informationen zu WatchMouse unter www.watchmouse.com