designing a high-scalability, high-availability site
We find that Restlet does scale very well with the right system architecture.
Generally speaking you want to:
- Run a cluster of web server machines, not just one.
- Make sure your application is shared nothing, ie, no application state stored in your web servers, if at all possible.
- Use a load balancer to spread requests to the least loaded web servers.
- Make sure your JSON responses are cacheable.
- Add an HTTP reverse proxy cache (eg, Squid) at the border of your site. As the caches between your site and your clients warm up, most of the inbound traffic will be handled by them, and not your web servers.
- Write your client code to retry requests that fail. This way if a web server dies the next request will be load balanced to a surviving machine.
- And of course you want to automate your site to bring up crashed web servers, etc. (This is the part that is perhaps better asked on ServerFault.com.)
REST is an architectural style that is ideal for this type of setup.
