Skip to main content

Command Palette

Search for a command to run...

Day 8 of #100DaysOfCode – Exploring AWS Storage: Block, File, and Object Storage

Published
3 min read

Introduction

On Day 8 of my #100DaysOfCode challenge, I dove deep into AWS storage types, focusing on the core offerings: block storage, file storage, and object storage. I also explored Amazon EC2 Instance Storage, Amazon Elastic Block Store (EBS), and how EBS volumes operate within AWS. In this blog post, I’ll share key takeaways and use cases for each AWS storage service.


AWS Storage Types

AWS offers three main storage categories: block storage, file storage, and object storage.

File Storage

  • Overview: File storage resembles traditional file systems like those found on personal computers (Windows File Explorer, macOS Finder). Files are organized in a hierarchical structure (folders and subfolders).

  • Use Cases: It’s ideal for scenarios where multiple hosts need centralized access to shared files, such as:

    • Large content repositories

    • Development environments

    • User home directories


Block Storage

  • Overview: Block storage breaks files into small blocks of data, each with a unique address, which makes it easy to retrieve and modify. It is known for its low-latency operations, making it an optimal choice for high-performance workloads.

  • Use Cases:

    • Databases

    • Enterprise workloads requiring fast, efficient access to data


Object Storage

  • Overview: In object storage, data is stored in a flat structure. Unlike file storage, objects are stored with a unique identifier and can store vast amounts of unstructured data (e.g., media assets, static assets like images).

  • Use Cases:

    • Storing large datasets

    • Media assets

    • Big data analysis


Amazon EC2 Instance Store and Amazon Elastic Block Store (EBS)

Amazon EC2 Instance Store

  • Overview: EC2 Instance Store provides temporary block-level storage that is tied to the lifecycle of an EC2 instance. When the instance is terminated, the data is lost. This is perfect for temporary storage solutions like caches or scratch data.

  • Use Cases:

    • Temporary data storage

    • High-performance workloads like Hadoop clusters


Amazon Elastic Block Store (Amazon EBS)

  • Overview: Amazon EBS offers persistent block-level storage that can be attached to EC2 instances. Unlike Instance Store, EBS volumes persist even after an EC2 instance is terminated, making it ideal for long-term data storage.

  • EBS Volume Types:

    • EBS Provisioned IOPS SSD: High-performance, low-latency storage for databases.

    • EBS General Purpose SSD: Balanced performance and cost, suitable for most workloads.

    • Throughput Optimized HDD: Low-cost storage for frequently accessed data.

    • Cold HDD: Storage for rarely accessed data.

  • EBS Benefits:

    • High availability and durability

    • Data encryption

    • Scalability

    • Flexibility in modifying volumes without downtime

    • Backup capabilities via EBS Snapshots

EBS Snapshots

  • Snapshots: EBS Snapshots provide incremental backups of your volumes, ensuring your data is securely stored in Amazon S3. This enables you to recover and create new volumes quickly from any snapshot, across different Availability Zones.

Conclusion

AWS offers a variety of storage solutions to fit specific use cases, from temporary high-performance block storage to scalable and persistent object storage. Understanding when to use each type of storage, especially Amazon EBS and EC2 Instance Store, can help you build more efficient, scalable applications in the cloud.

I’m looking forward to diving deeper into AWS storage services in the coming days!