Here is how some of the biggest areas in the industry, manages their performance figures

  1. Databases – Oracle / MySQL
  2. Internet – Linked In / WikiPedia
  3. Hardware – File system / Disk & Memory Subsystems

Any place where, latency is involved, caching seems to make a huge difference in the results obtained. Caching still is state of the art. When deployed along with parallelization, the combination does make for killer applications. MemCached and Wide Finder comes to mind.