Amazon S3
* S3 is "OBJECT" storage built to store and retrieve data.
* Files can be anywhere from 0 bytes to 5 TB. Files are stored in "buckets".
* Buckets are root level folders. Any subfolder within a bucket is “folder”.
* S3 is a universal namespace so bucket names must be "unique globally".
* Configure a "lifecycle policy" to manage your objects and store
them cost effectively throughout their lifecycle.
* Life cycle policy -You can transition objects to other S3 storage
classes or expire objects that reach the end of their lifetimes.
* S3 Object Lock – Prevent Amazon S3 objects from being deleted or
overwritten for a fixed amount of time or indefinitely
* S3 provides query-in-place - functionality, allowing you to run
powerful analytics directly on your data at rest in S3(Athena)
* S3 Block Public Access – Block public access to S3 buckets and objects.
By default, Block Public Access are turned on at the account and bucket level.
* EBS snapshots are stored in S3.
Cloud watch logs are stored in S3.
Cloud trial logs are send to S3.
* S3 charges are for :
-Storage class
-Storage size
-Requests n data retrievals
-data transfer
-management n replication
When you successfully upload a file to S3 you receive a HTTP 200 code.
A HTTP 200 codes indicates a successful upload.
A HTTP 300 code indicates a redirection.
A HTTP 400 code indicates a client error.
A HTTP 500 code indicates a server error.
S3 is a persistent, highly durable data store.(retain data when powered off.)
S3 use cases:
- Backup storage
- Application hosting
- Media hosting
- Software delivery
- Static website
There are seven S3 storage classes.
S3 Standard = durable, immediately available, frequently accessed
S3 Intelligent-Tiering = automatically moves data to the most cost-effective tier.
S3 Standard-IA = "High Available" immediately available, infrequently accessed
S3 One Zone-IA = lower cost for infrequently accessed data with less "resilience"
S3 Glacier Instant Retrieval = data rarely accessed n requires retrieval in Milisec
S3 Glacier Flexible Retrieval = archived data, retrieval times in minutes or hours
S3 Glacier Deep Archive = lowest cost storage class for long term retention
AWS Snowball Edge (80 TB)
With AWS Snowball (Snowball), you can transfer hundreds of terabytes or petabytes of data between your on-premises data centers and Amazon S3.
They are well suited for large-scale data migrations and recurring transfer
workflows, in addition to local computing with higher capacity needs.
Snowball edge storage optimised - used for recurring transfer workflow
*storage- 80TB HDD capacity for block volumes, 1TB of SATA for block volumes
*compute - 40 vCPUs and 80gb memory to support sbe1 instance(equal to C5)
Snowball edge compute optimised - used for machine learning,full motion video,analytics
*Storage - 42TB HDD, and 7.68 TB of NVMe SSD
_________________________________________________________________________________________
AWS Storage Gateway
AWS Storage Gateway is a hybrid cloud storage service that gives you on-premises
access to virtually unlimited cloud storage.
These include moving backups to the cloud, using on-premises file shares backed by cloud storage, and providing low latency access to data in AWS for on-premises applications.
Storage Gateway Types:
1. File Gateway :On premises file storage backed by s3 objects.
a> S3 File Gateway - Store and access objects in Amazon S3
from NFS or SMB file data with local caching.
b> FSx file Gateway - Access fully managed file shares in Amazon FSx
for Windows File Server using SMB.
2. Tape gateway : on premises Block storage backed by s3 and "EBS snapshot"
Store virtual tapes in Amazon S3 using iSCSI-VTL, and store archived
tapes in Amazon S3 Glacier or Amazon S3 Glacier Deep Archive.
You can also deploy a tape gateway on an AWS Snowball Edge device to
facilitate offline transfer of tape data.
3. Volume gateway: Virtual tape storage in s3 and Glacier with VTL management.
Store and access iSCSI block storage volumes in Amazon S3.
a> Cached volumes – Store your data in AWS and retain a copy of frequently
accessed data subsets locally
b> Stored volume – Store all your data locally and asynchronously
back up point-in-time snapshots to AWS.
----------------------------------------------------------------------------------------
No comments:
Post a Comment