Distributed System Models and Enabling Technologies
Distributed System Models and Enabling Technologies
by KASILINGAM N
Scalability
• It is the ability of a computer application or product(H/W or S/W)
TYPES:
-Horizontal Scalability
-Vertical Scalability
Horizontal Scalability vs Vertical Scalability
-Add or remove resources within a single comp
-Add or remove computer resources(Node)
Example: Example:
Scaling from one to three web servers. Upgrading from one CPU to two CPUs.
Scalable Computing Over
the Internet
Age of Internet Computing
-HPC(High Performance Computing)
2 Complex Calculations
Perform complex calculations at high speed.
3 System Performance
Measures system performance effectively.
4 Tightly Coupled
It is a tightly coupled system.
High-Throughput Computing
(HTC)
Maximize Performance
Maximize overall system performance.
Multiple Applications
Supports many users and applications.
Loosely Coupled
It is a loosely coupled system.
Example
Google search engine.
Evolution of HTC and HPC Systems
Computer Clusters
1 Group of Computers
Group of computers connected through network
and work as a single system.
3 Homogeneous Computers
Collection of homogeneous computers.
Peer-to-
Peer
Networks
• Peers connect via the
Network or Internet.
• Files are shared directly.
No central server is
needed.
• Communicate each
node through message
passing.
New Computing Paradigms
Cloud Computing
4 Distributed Computing
3
Technologies for Network Based System
-Multicore CPUs may increase from the tens of cores to hundreds more .
-Due to the memory wall problem.
-This has triggered the development of many-core GPUs with
hundreds or more thin cores.
-Both IA-32 and IA-64 instruction set architectures are built into
commercial CPUs.
-Now, x-86 processors
Multithreading Technology
GPU Computing To Exascale and Beyond
The world’s first GPU, the GeForce 256, was marketed by NVIDIA in 1999
-The use of a GPU along with a CPU for massively parallel execution in hundreds
or thousands of processing cores.
Memory Storage and Wide Area Networking
System Area Interconnects
Virtual Machines and Virtualization Middleware
Data Centre Virtualization for Cloud Computing