Cloud Architecture and Services

CCA2002

Module 3
 Management of Cloud Services: Reliability, availability and
security of services deployed from the cloud. Performance and
scalability of services, tools and technologies used to manage cloud
services deployment;

Cloud Economics: Cloud Computing infrastructures available for

implementing cloud-based services. Economics of choosing a Cloud
platform for an organization, based on application requirements,
economic constraints and business needs (e.g. Amazon, Microsoft
and Google, Salesforce.com, Ubuntu and Redhat)

2
Management of Cloud Services: Reliability, Availability,
and Security

⚫ Effective cloud service management involves

ensuring reliability, availability, and security of
services.

⚫ These three pillars are critical for businesses to

operate efficiently and securely in a cloud-based
environment.

3
Management of Cloud Services: Reliability
⚫ Effective cloud service management involves ensuring reliability,
availability, and security of services.

1. Reliability
Reliability ensures that cloud services perform consistently and as expected. Key
aspects include:
a) Fault Tolerance
•Implementing redundant systems to ensure service continuity even if individual
components fail.
•Use of failover mechanisms and load balancers.

b) Monitoring and Alerts

•Continuous monitoring of infrastructure using tools like AWS CloudWatch,
Azure Monitor, or Datadog.
•Proactive detection of performance bottlenecks or anomalies.
4
Management of Cloud Services: Reliability
c) Backup and Recovery
•Regular backups of data to geographically dispersed locations.
•Disaster recovery plans

d) Testing and Validation

•Regular testing of system updates and patches in controlled environments to
avoid unexpected failures.

5
Management of Cloud Services: Availability
2. Availability
Availability refers to the uptime of cloud services, ensuring they are accessible
when needed. Strategies to enhance availability include:

a) High Availability Architecture

•Deploying services across multiple regions and availability zones.
•Use of auto-scaling to handle fluctuations in demand.

b) Service Level Agreements (SLAs)

•Cloud providers typically offer SLAs guaranteeing a certain level of uptime
(e.g., 99.9% availability).
•Regularly review and ensure compliance with these agreements.

6
Management of Cloud Services: Availability
c) Content Delivery Networks (CDNs)
•Use CDNs to distribute content closer to users, reducing latency and
improving accessibility.

d) Maintenance and Updates

•Scheduling maintenance during non-peak hours to minimize disruptions.
•Ensuring rolling updates to prevent downtime.

7
Management of Cloud Services: Security
Security
Security in cloud services protects data, applications, and infrastructure from
unauthorized access and cyber threats. Key measures include:

a) Identity and Access Management (IAM)

•Implementing role-based access controls (RBAC) to limit permissions.
•Using multi-factor authentication (MFA) for user accounts.

b) Data Security
•Encrypting data at rest and in transit using strong algorithms.
•Regularly rotating encryption keys and managing them securely.

c) Network Security
•Using firewalls, virtual private clouds (VPCs), and secure access protocols.
•Employing intrusion detection and prevention systems (IDS/IPS).
8
Management of Cloud Services: Security
d) Compliance and Audits
•Adhering to standards like GDPR, HIPAA, or ISO/IEC 27001.
•Regular security audits to identify and mitigate vulnerabilities.

e) Incident Response
•Establishing incident response teams and protocols.

9
Best Practices for Managing Cloud Services
1.Automation: Automate routine tasks such as patching, scaling, and backups
to reduce human error and improve efficiency.

2.Vendor Management: Regularly assess the performance of your cloud

provider and consider multi-cloud strategies for redundancy.

3.Cost Optimization: Continuously monitor and optimize resource

utilization to avoid unnecessary expenses while maintaining service quality.

4.Regular Training: Train staff on cloud management and security to ensure

they are prepared for evolving technologies and threats.

By addressing reliability, availability, and security comprehensively,

organizations can ensure their cloud services meet operational and business
requirements while safeguarding against risks.
10
Performance of Cloud Services
Performance refers to how well a cloud service delivers its intended
functionality in terms of speed, responsiveness, and resource efficiency.

a) Key Metrics to Monitor

•Latency: Time taken to process a request.

•Throughput: Number of operations performed per unit time.

•Resource Utilization: Usage levels of CPU, memory, storage, and

network.

•Response Time: Time taken by the application to respond to user inputs.

11
Performance of Cloud Services
b) Strategies to Optimize Performance
1.Load Balancing:
1. Distribute workloads across multiple servers to prevent any single server
from becoming a bottleneck.
2. Use tools like AWS Elastic Load Balancer or Azure Load Balancer.

2.Content Delivery Networks (CDNs):

1. Cache frequently accessed content in edge locations closer to users.
2. Reduce latency and improve content delivery speeds.

3.Database Optimization:
1. Use indexing, caching (e.g., Redis or Memcached), and query
optimization techniques.
2. Consider distributed databases for better performance under heavy loads.
12
Performance of Cloud Services
4. Caching:
1. Implement caching layers for frequently accessed data to reduce server
load.
2. Examples: Cloudflare, AWS CloudFront.

5. Monitoring Tools:
1. Use tools like AWS CloudWatch, New Relic, or Prometheus to identify
performance bottlenecks in real-time.

13
Scalability of Cloud Services
Scalability ensures that cloud services can handle increasing or decreasing
workloads effectively. It can be categorized into two types:

a) Vertical Scaling (Scaling Up/Down):

•Involves adding more resources (e.g., CPU, RAM) to an existing instance.
•Suitable for applications with predictable and relatively stable workloads.
•Examples: Upgrading an EC2 instance type in AWS.

b) Horizontal Scaling (Scaling Out/In):

•Involves adding or removing instances to distribute the workload.
•Ideal for applications with fluctuating demand or requiring high availability.
•Examples: Adding more virtual machines (VMs) in Azure Virtual Machine
Scale Sets.

14
Strategies for Ensuring Scalability
•Auto-Scaling:
•Automatically adjust the number of resources based on demand.
•Services like AWS Auto Scaling and Google Cloud’s Autoscaler enable
seamless scaling.

•Containerization:
•Use container technologies like Docker and orchestration tools like Kubernetes
to deploy scalable microservices.
•Containers enable lightweight, rapid scaling.

•Microservices Architecture:
•Break monolithic applications into smaller, independent services that can be
scaled individually.

15
Strategies for Ensuring Scalability
•Serverless Computing:
•Use serverless architectures (e.g., AWS Lambda, Azure Functions) to
automatically scale based on event triggers.

16
Tools and technologies used to manage cloud services
deployment
•Infrastructure as Code (IaC) Tools
•Containerization and Orchestration Tools
•Continuous Integration and Continuous Deployment (CI/CD)
Tools
•Cloud Service Management Tools
•Configuration Management Tools
•Monitoring and Logging Tools
•Security and Identity Management
•Networking Tools
•Backup and Disaster Recovery Tools

17
Tools and technologies used to manage cloud services
deployment
•Infrastructure as Code (IaC) Tools- IaC tools automate the
provisioning and management of cloud resources using code.

•Terraform: Cloud-agnostic tool for infrastructure provisioning and

management.

•AWS CloudFormation: Manages AWS resources using templates.

•Azure Resource Manager (ARM) Templates: Native IaC solution for

Azure.

18
 Tools and technologies used to manage cloud services
deployment
Containerization and Orchestration Tools- Containers standardize
application deployment, while orchestration tools manage containerized
workloads.

•Docker: Enables containerization for applications.

•Kubernetes: Orchestrates and scales containers across clusters.
•Amazon ECS/EKS: AWS-native container orchestration services.
•Azure Kubernetes Service (AKS): Managed Kubernetes in Azure.
•Google Kubernetes Engine (GKE): Google’s managed Kubernetes
solution.

19
Tools and technologies used to manage cloud services
deployment
Continuous Integration and Continuous Deployment (CI/CD)
Tools- Automates the process of integrating and deploying code changes.

•Jenkins: Highly customizable CI/CD server.

•GitHub Actions: CI/CD workflows integrated with GitHub repositories.
•GitLab CI/CD: Built into the GitLab ecosystem.
•Azure DevOps: Provides pipelines for CI/CD in Azure.

20
Tools and technologies used to manage cloud services
deployment
Cloud Service Management Tools- These are vendor-specific tools to
manage cloud services.

•AWS Management Console and CLI: AWS-specific service management.

•Azure Portal and CLI: GUI and CLI for Azure services.

•Google Cloud Console and gcloud CLI: Management of GCP services.

21
Tools and technologies used to manage cloud services
deployment
Configuration Management Tools- These tools ensure consistent
configuration across environments.

•Ansible: Agentless configuration management.

•Chef: Code-based configurations for cloud infrastructure.

•Puppet: Automates provisioning and management of cloud services.

22
Tools and technologies used to manage cloud services
deployment
Monitoring and Logging Tools- Enable real-time visibility into application
performance and resource utilization.

•Prometheus and Grafana: Monitoring and visualization for Kubernetes.

•Datadog: Unified monitoring for cloud services and applications.

•AWS CloudWatch: Native monitoring for AWS.

•Azure Monitor: End-to-end monitoring solution for Azure.

23
Tools and technologies used to manage cloud services
deployment
Security and Identity Management- Protects cloud deployments and
ensures compliance.

•AWS Identity and Access Management (IAM): Role-based access

control for AWS.

•HashiCorp Vault: Manages secrets and sensitive data.

24
Tools and technologies used to manage cloud services
deployment
. Networking Tools- Facilitates traffic management and connectivity in cloud
environments.

•Amazon VPC: Configures isolated network environments on AWS.

•Azure Virtual Network (VNet): Networking solution for Azure resources.

•Google Cloud VPC: Private networking in GCP.

25
Tools and technologies used to manage cloud services
deployment
Backup and Disaster Recovery Tools- Ensures data safety and availability
during failures.

•AWS Backup: Centralized backup for AWS services.

•Azure Site Recovery: Disaster recovery service for Azure.

26
Cloud Computing infrastructures available for
implementing cloud-based services
1. Public Cloud Infrastructures
Public clouds are owned and operated by third-party providers, offering on-
demand resources over the internet.

2. Private Cloud Infrastructures

Private clouds are dedicated infrastructures used exclusively by one
organization. These are suitable for sensitive data or compliance needs.

3.Hybrid and Multi-Cloud Infrastructures

These infrastructures integrate public and private clouds, allowing seamless
resource management across environments.

4. Specialized Cloud Infrastructures

These cater to specific use cases like edge computing, high-performance
27
computing (HPC), and more.
Cloud Computing infrastructures available for
implementing cloud-based services
1. Public Cloud Infrastructures
Public clouds are owned and operated by third-party providers, offering on-
demand resources over the internet.

Major Public Cloud Providers:

• Amazon Web Services (AWS)

• Microsoft Azure
• Google Cloud Platform (GCP)
• IBM Cloud
• Oracle Cloud Infrastructure (OCI)

28
Cloud Computing infrastructures available for
implementing cloud-based services
2. Private Cloud Infrastructures
Private clouds are dedicated infrastructures used exclusively by one
organization. These are suitable for sensitive data or compliance needs.

Major Private Cloud Providers:

•VMware vSphere/vCloud Suite

•OpenStack
•HPE GreenLake
•Dell EMC Cloud

29
Cloud Computing infrastructures available for
implementing cloud-based services
3.Hybrid and Multi-Cloud Infrastructures
These infrastructures integrate public and private clouds, allowing seamless
resource management across environments.

Multi-Cloud Management Tools:

•HashiCorp Terraform: Deploys resources across multiple clouds.

•VMware Tanzu: Manages multi-cloud Kubernetes clusters.
•CloudBolt: Automates multi-cloud service management.

30
Cloud Computing infrastructures available for
implementing cloud-based services
4. Specialized Cloud Infrastructures
These cater to specific use cases like edge computing, high-performance
computing (HPC), and more.

Examples:-
AWS HPC Clusters,
AWS CloudFront,
Azure CDN,
Google Cloud CDN

31
 Economics of choosing a Cloud platform
Choosing the right cloud platform for an organization requires a careful analysis
of economic and business factors, aligned with the organization's application
requirements and constraints.

1. Key Factors Influencing the Decision

A. Application Requirements
•Workload Types: The nature of the workload (e.g., compute-intensive,
data-driven, AI/ML).
•Scalability: Does the application require rapid scaling?
•Data Sensitivity: Are there compliance or regulatory requirements for data
handling (e.g., HIPAA, GDPR)?
•Integration Needs: Does the application require integration with existing
tools or services?
32
 Economics of choosing a Cloud platform
B. Economic Constraints
•Budget: Upfront and recurring costs for resources.
•Cost Efficiency: Ability to optimize costs through pay-as-you-go pricing or
reserved instances.
•Long-Term ROI: Evaluating the platform's ability to deliver value over time.

C. Business Needs
•Time to Market: Speed and ease of deployment for applications.
•Global Reach: Availability of data centers in relevant regions.
•Vendor Lock-In: Flexibility to move applications across platforms if
necessary.

33
 Economics of Major Cloud Platforms
Amazon Web Services (AWS)
•Strengths:
• Largest range of services and global reach.
• Pricing flexibility with pay-as-you-go, savings plans, and reserved
instances.
• Strong in big data, AI/ML, IoT, and enterprise applications.
•Economic Considerations:
• Cost: Competitive for startups with low initial needs; scaling can
increase costs.
• ROI: High for compute-heavy or diverse workloads due to specialized
services.
• Pricing Model: Transparent pricing but requires optimization to avoid
overruns.

34
 Economics of Major Cloud Platforms
Microsoft Azure
•Strengths:
• Seamless integration with Microsoft products (e.g., Office 365,
Dynamics, Active Directory).
• Strong hybrid cloud capabilities (Azure Arc).

•Economic Considerations:
• Cost: Cost-effective for Microsoft users due to discounts on software
licenses.
• ROI: High for organizations already invested in Microsoft tools and
infrastructure.
• Pricing Model: Flexible with enterprise-level agreements and hybrid
cloud discounts.

35
 Economics of Major Cloud Platforms
Google Cloud Platform (GCP)

•Strengths:
• Superior in AI/ML (TensorFlow, BigQuery).
• Cost-efficient for data analytics and high-performance compute
workloads.
• Competitive network infrastructure with low latency.

•Economic Considerations:
• Cost: Attractive sustained-use discounts and preemptible VM pricing.
• ROI: Best for data-intensive or AI-driven businesses.
• Pricing Model: Transparent, with unique discounts for sustained
usage.

36
 Economics of Major Cloud Platforms
Salesforce.com

•Strengths:
• Specialized in CRM, customer engagement, and marketing automation.
• Customizable platform with extensive app ecosystem.

•Economic Considerations:
• Cost: Subscription-based pricing, which can grow as user count scales.
• ROI: High for businesses focused on customer relationship management.
• Pricing Model: Tiered pricing; premium features increase costs.

37
 Economics of Major Cloud Platforms
Ubuntu (Canonical)

•Strengths:
• Open-source platform, cost-effective for development.
• Lightweight and efficient for private cloud or hybrid setups.

•Economic Considerations:
• Cost: Lower upfront costs but requires in-house expertise.
• ROI: High for cost-sensitive startups and developers.
• Pricing Model: Free for basic use; paid support and enterprise
features.

38
 Economics of Major Cloud Platforms
Red Hat (IBM)

•Strengths:
• Enterprise-grade open-source solutions.
• Focus on hybrid cloud and container orchestration (OpenShift).

•Economic Considerations:
• Cost: Subscription-based with scalable enterprise solutions.
• ROI: High for businesses seeking hybrid cloud flexibility.
• Pricing Model: Predictable subscription model with enterprise
support.

39
Economic Comparison for Common Scenarios

40