Training Course
Amazon Web Service
8/9/2023 09e-BM/DT/FSOFT - ©FPT SOFTWARE – Fresher Academy - Internal Use 1
Course Schedule
Day Presentations Lab
Day 1 System Operations on AWS
Day 2 Computing on AWS X
Day 3 Networking on AWS X
Day 4 Storage and Archiving in the Cloud X
Day 5 Monitoring in the Cloud X
Day 6 Managing Resource Consumption in the Cloud X
8/9/2023 09e-BM/DT/FSOFT - ©FPT SOFTWARE – Fresher Academy - Internal Use 2
Module 4:
Storage and archiving in
the Cloud (AWS)
8/9/2023 09e-BM/DT/FSOFT - ©FPT SOFTWARE – Fresher Academy - Internal Use 3
Module 4: Storage and Archiving in AWS
Goal: Understanding the format repository at Amazon.
Store how, operate, share data. Distinguishing features and
uses of format storage
EBS
AMI
EC2 Instance Store
EBS Volume Types
Encryption
EFS
Lab 3: Create and configuring Storage
8/9/2023 09e-BM/DT/FSOFT - ©FPT SOFTWARE – Fresher Academy - Internal Use 4
Module 4: Storage and Archiving in AWS
EBS
8/9/2023 09e-BM/DT/FSOFT - ©FPT SOFTWARE – Fresher Academy - Internal Use 5
Module 4: Storage and Archiving in AWS
What’s an EBS Volume?
• An EBS (Elastic Block Store) Volume is a network drive you
can attach to your instances while they run
• It allows your instance to persist data, even after their
termination
• They can only be mouted to one instance at a time
• They are bound to a specific availability zone
8/9/2023 09e-BM/DT/FSOFT - ©FPT SOFTWARE – Fresher Academy - Internal Use 6
Module 4: Storage and Archiving in AWS
What’s an EBS Volume?
• Analogy: Thinks of them as a “network USB stick”
• Free tier: 30GB of free EBS storage of type General
Purpose (SSD) or Magnetic per month
8/9/2023 09e-BM/DT/FSOFT - ©FPT SOFTWARE – Fresher Academy - Internal Use 7
Module 4: Storage and Archiving in AWS
EBS Volume
• It’s a network drive (not a physical drive)
• It uses the network to communicate the instance, which means there
might be a bit of latency
• It can be detached from an EC2 instance and attached to another
one quickly
• It’s locked to an Availability Zone (AZ)
• An EBS Volume in us-east-1a cannot be attached to us-east-1b
• To move a volume across, you first need to snapshot it
8/9/2023 09e-BM/DT/FSOFT - ©FPT SOFTWARE – Fresher Academy - Internal Use 8
Module 4: Storage and Archiving in AWS
EBS Volume
• Have a provisioned capacity (size in GBs, and IOPS)
• You get billed for all the provisioned capacity
• You can increase the capacity of the drive over time
8/9/2023 09e-BM/DT/FSOFT - ©FPT SOFTWARE – Fresher Academy - Internal Use 9
Module 4: Storage and Archiving in AWS
EBS Volume
8/9/2023 09e-BM/DT/FSOFT - ©FPT SOFTWARE – Fresher Academy - Internal Use 10
Module 4: Storage and Archiving in AWS
EBS – Delete on Termination attribute
• Controls the EBS behavior when an EC2 instance
terminates
• By default, the root EBS volume is deleted (attribute enabled)
• By default, any other attached EBS volume is not deleted (attribute
disabled)
• This can be controlled by the AWS console / AWS CLI
• Use case: preserve root volume when instance is
terminated
8/9/2023 09e-BM/DT/FSOFT - ©FPT SOFTWARE – Fresher Academy - Internal Use 11
Module 4: Storage and Archiving in AWS
EBS – Delete on Termination attribute
8/9/2023 09e-BM/DT/FSOFT - ©FPT SOFTWARE – Fresher Academy - Internal Use 12
Module 4: Storage and Archiving in AWS
EBS Snapshots
• Make a backup (snapshot) of your EBS volume at a point in
time
• Not necessary to detach volume to do snapshot (but
recommened)
• Can copy snapshots across AZ or Region
8/9/2023 09e-BM/DT/FSOFT - ©FPT SOFTWARE – Fresher Academy - Internal Use 13
Module 4: Storage and Archiving in AWS
EBS Snapshots
8/9/2023 09e-BM/DT/FSOFT - ©FPT SOFTWARE – Fresher Academy - Internal Use 14
Module 4: Storage and Archiving in AWS
AMI Overview
8/9/2023 09e-BM/DT/FSOFT - ©FPT SOFTWARE – Fresher Academy - Internal Use 15
Module 4: Storage and Archiving in AWS
AMI Overview
• AMI = Amazon Machine Image (!= IAM)
• AMI are a customization of an EC2 instance
• Can add software, configuration, operation system, monitoring…
• Faster boot / configuration time because all software is pre-packaged
• AMI are built for a specific region (and can be copied across regions)
• You can launch EC2 instances from
• A public AMI: AWS provided
• Your own AMI: you make and maintain them yourself
• An AWS Marketplace AMI: an AMI someone else made (and potentially sells)
8/9/2023 09e-BM/DT/FSOFT - ©FPT SOFTWARE – Fresher Academy - Internal Use 16
Module 4: Storage and Archiving in AWS
AMI Process (from an EC2 instance)
• Start an EC2 instance and customize it
• Stop the instance (for data integrity)
• Build an AMI – this will also create EBS snapshots
• Launch instances from other AMIs
8/9/2023 09e-BM/DT/FSOFT - ©FPT SOFTWARE – Fresher Academy - Internal Use 17
Module 4: Storage and Archiving in AWS
EC2 Instance Store
8/9/2023 09e-BM/DT/FSOFT - ©FPT SOFTWARE – Fresher Academy - Internal Use 18
Module 4: Storage and Archiving in AWS
EC2 Instance Store
• EBS volumes are networking drives with good but “limited” performance
• If need a high-performance hardware disk, use EC2 Instance Store
• Better I/O performance
• EC2 Instance Store lose data if stopped (ephemeral)
• Good for buffer/cache/scratch data/temporary content
• Risk of data loss if hardware fails
• Backups and Replicaton are your responsibility
8/9/2023 09e-BM/DT/FSOFT - ©FPT SOFTWARE – Fresher Academy - Internal Use 19
Module 4: Storage and Archiving in AWS
Local EC2 Instance Store
8/9/2023 09e-BM/DT/FSOFT - ©FPT SOFTWARE – Fresher Academy - Internal Use 20
Module 4: Storage and Archiving in AWS
EBS Volume Types
8/9/2023 09e-BM/DT/FSOFT - ©FPT SOFTWARE – Fresher Academy - Internal Use 21
Module 4: Storage and Archiving in AWS
EBS Volume Types
• EBS Volumes come in 6 types
• gp2 / gp3 (SSD): General purpose SSD volume that balances price
and performance for a wide variety of workloads
• io1 / io2 (SSD): Highest-performance SSD volume for mission-
critical low-latency or high-throughput workloads
• st 1 (HDD): Low cost HDD volume designed for frequently
accessed, throughput-intensive workloads
• sc 1 (HDD): Loweset cost HDD volume designed for less frequently
accessed workloads
8/9/2023 09e-BM/DT/FSOFT - ©FPT SOFTWARE – Fresher Academy - Internal Use 22
Module 4: Storage and Archiving in AWS
EBS Volume Types Use cases
• EBS Volumes are characterized in Size | Throughput | IOPS
(I/O Ops Per Sec)
• When in doubt always consult the AWS documentation – it’s
good
• Only gp2/gp3 and io 1/io 2 can be used as boot
volumes
8/9/2023 09e-BM/DT/FSOFT - ©FPT SOFTWARE – Fresher Academy - Internal Use 23
Module 4: Storage and Archiving in AWS
EBS Volume Types Summary
8/9/2023 09e-BM/DT/FSOFT - ©FPT SOFTWARE – Fresher Academy - Internal Use 24
Module 4: Storage and Archiving in AWS
EBS Multi-Attach – io1/io2 family
• Attach the same EBS volume to multiple EC2
instances in the same AZ
• Each instance has full read & write permissions to
the volume
8/9/2023 09e-BM/DT/FSOFT - ©FPT SOFTWARE – Fresher Academy - Internal Use 25
Module 4: Storage and Archiving in AWS
EBS Multi-Attach – io1/io2 family
8/9/2023 09e-BM/DT/FSOFT - ©FPT SOFTWARE – Fresher Academy - Internal Use 26
Module 4: Storage and Archiving in AWS
EBS Multi-Attach – io1/io2 family
• Use case:
• Archive higher application availability in clustered Linux
applications (ex: Teradata)
• Applications must manage concurrent write operations
8/9/2023 09e-BM/DT/FSOFT - ©FPT SOFTWARE – Fresher Academy - Internal Use 27
Module 4: Storage and Archiving in AWS
Encryption
8/9/2023 09e-BM/DT/FSOFT - ©FPT SOFTWARE – Fresher Academy - Internal Use 28
Module 4: Storage and Archiving in AWS
EBS Encryption
• When you create an encrypted EBS volume, you
get the following:
• All the data in flight moving between the instance and the volume is
encrypted
• All snapshots are encrypted
• All volumes created from the snapshot
8/9/2023 09e-BM/DT/FSOFT - ©FPT SOFTWARE – Fresher Academy - Internal Use 29
Module 4: Storage and Archiving in AWS
EBS Encryption
• Encryption and decryption are handled transparently
(have nothing to do)
• Encryption has a minial impact on latency
• EBS Encryption leverages keys from KMS (AES-256)
• Copying an unencrypted snapshot allow encryption
• Snapshots of encrypted volumes are encrypted
8/9/2023 09e-BM/DT/FSOFT - ©FPT SOFTWARE – Fresher Academy - Internal Use 30
Module 4: Storage and Archiving in AWS
Encryption: encrypt an unencrypted EBS volume
• Create an EBS snapshot of the volume
• Encrypt the EBS snapshot (using copy)
• Create new EBS volume from the snapshot (the
volume will also be encrypted)
• Now can attach the encrypted volume to the
original instance
8/9/2023 09e-BM/DT/FSOFT - ©FPT SOFTWARE – Fresher Academy - Internal Use 31
Module 4: Storage and Archiving in AWS
RAID
8/9/2023 09e-BM/DT/FSOFT - ©FPT SOFTWARE – Fresher Academy - Internal Use 32
Module 4: Storage and Archiving in AWS
EBS RAID Options
• EBS is already redundant storage (replicated within an
AZ)
• But if want to increase IOPS to 100 000 IOPS?
• What if you want to mirror your EBS volumes?
• You would mount volumes in parallel in RAID settings!
• RAID is possible as long as your OS supports it
8/9/2023 09e-BM/DT/FSOFT - ©FPT SOFTWARE – Fresher Academy - Internal Use 33
Module 4: Storage and Archiving in AWS
EBS RAID Options
• Some RAID optiones are:
• RAID 0
• RAID 1
• RAID 5 (not recommended for EBS ?)
• RAID 6 (not recommended for EBS ?)
8/9/2023 09e-BM/DT/FSOFT - ©FPT SOFTWARE – Fresher Academy - Internal Use 34
Module 4: Storage and Archiving in AWS
RAID 0 (increase performance)
• Combining 2 or more volumes
and getting the total disk space
and I/O
• But one disk fails , all the data
is failed
8/9/2023 09e-BM/DT/FSOFT - ©FPT SOFTWARE – Fresher Academy - Internal Use 35
Module 4: Storage and Archiving in AWS
RAID 0 (increase performance)
• Use case
• An application needs a lot of
IOPS and doesn’t need fault-
tolerance
• A database that has replication
already built-in
• Using this, we can have a big
disk with a lof of IOPS
8/9/2023 09e-BM/DT/FSOFT - ©FPT SOFTWARE – Fresher Academy - Internal Use 36
Module 4: Storage and Archiving in AWS
RAID 1 (increase fault tolerance)
• RAID 1 = Mirror a volume to
another
• If one disk fails, our logical volume
is still working
• We have to send the data to two
EBS volume at the same time (2x
network)
8/9/2023 09e-BM/DT/FSOFT - ©FPT SOFTWARE – Fresher Academy - Internal Use 37
Module 4: Storage and Archiving in AWS
RAID 1 (increase fault
tolerance)
• Use case:
• Application that need increase
volume fault tolerance
• Application where you need to
service disks
8/9/2023 09e-BM/DT/FSOFT - ©FPT SOFTWARE – Fresher Academy - Internal Use 38
Module 4: Storage and Archiving in AWS
EFS
8/9/2023 09e-BM/DT/FSOFT - ©FPT SOFTWARE – Fresher Academy - Internal Use 39
Module 4: Storage and Archiving in AWS
EFS – Elastic File System
• Managed NFS (network file system) that can be
mounted on many EC2
• EFS works with EC2 instances in multi-AZ
• Highly available, scalable, expensive (3x gp2), par
per use
8/9/2023 09e-BM/DT/FSOFT - ©FPT SOFTWARE – Fresher Academy - Internal Use 40
Module 4: Storage and Archiving in AWS
EFS – Elastic File System
8/9/2023 09e-BM/DT/FSOFT - ©FPT SOFTWARE – Fresher Academy - Internal Use 41
Module 4: Storage and Archiving in AWS
EFS – Performance
• EFS Scale
• 10 GB+ /S throughput
• Grow to Petabyte-scale network file system, automatically
• Performance mode (set at EFS creation time)
• General purpose (default): latency-sensitive use cases (web server,
CMS, etc…)
• Max I/O – higher latency, throughput, highly parallel (big data, media
processing)
8/9/2023 09e-BM/DT/FSOFT - ©FPT SOFTWARE – Fresher Academy - Internal Use 42
Module 4: Storage and Archiving in AWS
EBS vs EFS – Elastic Block Storage
• EBS volumes…
• Can be attached to only one instance at a time
• Are locked at the Availability Zone (AZ) level
• Gp2: IO increases if the disk size increases
• Io 1: can increase IO independently
8/9/2023 09e-BM/DT/FSOFT - ©FPT SOFTWARE – Fresher Academy - Internal Use 43
Module 4: Storage and Archiving in AWS
EBS vs EFS – Elastic Block Storage
• To migrate EBS volumes across AZ…
• Take a snapshot
• Restore the snapshot to another AZ
• EBS backups use IO and you shouldn’t run them while your
application is handling a lot of traffic
• Root EBS Volumes of instances get terminated by
default if the EC2 instanc gets terminated (can disable
that)
8/9/2023 09e-BM/DT/FSOFT - ©FPT SOFTWARE – Fresher Academy - Internal Use 44
Module 4: Storage and Archiving in AWS
EBS vs EFS – Elastic Block
Storage
• EBS volumes
8/9/2023 09e-BM/DT/FSOFT - ©FPT SOFTWARE – Fresher Academy - Internal Use 45
Module 4: Storage and Archiving in AWS
EBS vs EFS – Elastic File
System
• Mouting 100s of instances across AZ
• EFS share websites files (WordPress)
• Only for Linux Instance (POSIX)
• EFS has a higher price point than EBS
• Can leverage EFS-IA for cost savings
8/9/2023 09e-BM/DT/FSOFT - ©FPT SOFTWARE – Fresher Academy - Internal Use 46
Module 4: Storage and Archiving in AWS
Remember: EFS vs EBS vs Instance Store!!
8/9/2023 09e-BM/DT/FSOFT - ©FPT SOFTWARE – Fresher Academy - Internal Use 47
Module 4: Storage and Archiving in AWS
Thank you!!!
8/9/2023 09e-BM/DT/FSOFT - ©FPT SOFTWARE – Fresher Academy - Internal Use 48
