Cluster history

Ancient Mackie diagram of a Tandem NonStop Clusters are a brain child of the 60s and 70s: Back in the 60s collections of small computers (so called compute farms) were used to crack numerical problems faster when money for the expensive big boxes was not available. The first architecture we would call a cluster today was introduced in 1976 with Tandem's Non-Stop system, a single system image ( SSI ) cluster with high availability and scalability out of the box.

The early 80s saw a lot of development effort going into availability clusters as a response to Tandem's huge success and high prices. These clusters were primarily Tandem clones that tried to reduce cost by using standard, off-the-shelf components (Intel or Motorola microprocessors) and some version of Unix as the operating system starting point. Auragen, Sequoia, Synapse and Tolerant all followed this approach with various success.

The introduction of Digital's VAXCluster in 1984 was a turning point for the cluster development: while the start-ups in the early 80s all used custom developed hardware and software the VAXCluster was the first project to build a cluster on regular server hardware (VAX) and software (VMS) beefed up with a shared disk attachment (StarCoupler) and technologies originating from distributed systems. Constant refinement over the years (e.g. cluster file system, cluster virtual IP and cluster management) resulted in one of the most successful cluster products.

The VAXCluster concept became the blueprint for many other cluster products: Pyramid Reliant and IBM HACMP were among the first (around 1990) to cluster their regular server products. Many others followed including Microsoft that introduced the Microsoft Cluster Server (MSCS) for Windows NT in 1997.

In high performance computing it became obvious towards the end of the 80s that the supercomputer development would be increasingly more difficult due to cost and physical limitations. The rediscovery of the power of parallelism lead to several different parallel architectures: