GCPAWS Deep Dive
Data Lake & Object Storage

Google Cloud Storage (GCS) Amazon Simple Storage Service (Amazon S3)

From Google Cloud Storage (GCS) to Amazon Simple Storage Service (S3).

The 30-Second Mental Model Shift

GCS and S3 are conceptual siblings! Both are flat object stores with 11 Nines durability where slashes represent key prefixes. The key differences in AWS are: 1) S3 has many more specialized storage tiers (including Intelligent-Tiering and Glacier Deep Archive), and 2) S3 security is controlled via two distinct layers: IAM User Policies AND S3 Bucket Resource Policies.

1. Architectural Mechanism Comparison

GCP (What You Know)
Source

Google Cloud Storage (GCS)

Flat object store using bucket-level IAM policies (`gs://`). Supports 4 storage classes (Standard, Nearline, Coldline, Archive) and uniform sub-second multi-region replication.

Key Architecture Strengths:
  • Uniform global bucket namespace (`gs://bucket-name`).
  • Single unified IAM policy model with Uniform Bucket-Level Access.
  • Sub-second object availability across multi-regions.
AWS (How It Works)
Mastery Target

Amazon Simple Storage Service (Amazon S3)

The cloud benchmark for object storage (`s3://`). Offers 11 Nines durability, S3 Intelligent-Tiering (automated ML cost optimization), S3 Bucket Policies + IAM, and granular S3 Glacier tiers.

Why AWS Built It This Way:
  • S3 Intelligent-Tiering: Automatically moves data between frequent and infrequent tiers with zero operational overhead.
  • S3 Glacier Deep Archive: Lowest cost cold storage in the cloud ($0.00099/GB/mo).
  • Rich ecosystem of S3 Event Notifications, S3 Lifecycle Rules, and S3 Select.

2. Interactive Terminology & Concept Bridge

Interactive Concept Bridge: Terminology & Architectural Mapping

Click any concept below to see how your GCP knowledge directly maps into AWS.

Mapping Deep Dive
Exact Concept Match
⚡ Direct cognitive shortcut
GCP (What You Know)

GCS Bucket (`gs://my-bucket`)

Top-level globally unique object namespace in GCP.

AWS (How It Works)

S3 Bucket (`s3://my-bucket`)

Top-level globally unique object container in AWS.

The Architectural Mental Shortcut:

Exact 1-to-1 concept match: both are global names tied to a specific geographic region.

3. Visual Architecture Pipeline (Amazon Simple Storage Service (Amazon S3))

Amazon S3 3-Stage Architecture: Ingress ➔ Bucket Security & KMS ➔ Lifecycle Tiering

Click any section below or run the simulation to see how Amazon S3 provides 11 Nines data lake storage.

1. Ingress Gate
2. Security & KMS
3. Tiering & Serving
Durability
11 Nines
Deep Archive
$0.00099/GB
Auto-Tiering
No Retrieval Fee
Query Engine
Amazon Athena
The Security Engine
Stage Details

2. S3 Bucket Security & Object Prefix Architecture

S3 stores objects within globally unique bucket namespaces. Security is enforced via IAM policies, S3 Bucket Policies (with explicit deny rules), AWS KMS Customer Managed Keys (SSE-KMS), and Bucket Owner Enforced access control.

Real-World Analogy

Like a secure biometric bank vault with dual-key locks: you need both personal security clearance (IAM) and room authorization (Bucket Policy).

Key Mechanics
  • BucketOwnerEnforced: Disables legacy ACLs, centralizing ownership in the bucket owner account.
  • Server-Side Encryption: Default SSE-S3 or customer-managed SSE-KMS with auto-rotation.
  • Prefix Partitioning: Structures data by date/category for high-speed parallel reads.
Encryption
SSE-KMS / SSE-S3
Access Layers
IAM + Bucket Policy

4. Side-by-Side Code, CLI & Terraform Translator

Side-by-Side Code & Syntax Translator

GCP Syntax
# GCP Cloud Storage CLI
gcloud storage cp data.parquet gs://my-lake-bucket/curated/
gcloud storage rsync ./local_dir gs://my-lake-bucket/backup/
AWS Equivalent
# AWS S3 CLI
aws s3 cp data.parquet s3://my-lake-bucket/curated/
aws s3 sync ./local_dir s3://my-lake-bucket/backup/
Code Translation Notes:`gcloud storage cp/rsync` translates directly to `aws s3 cp/sync` with identical syntax semantics.

5. Paradigm Shift Gotchas: Traps to Avoid in AWS

Gotcha #1
high

S3 Bucket Policy vs. IAM Policy Overrides

The Trap:

If an AWS IAM user has `AdministratorAccess`, but the S3 Bucket Policy has a Deny rule (e.g. enforcing HTTPS only), the user will still be blocked with 403 Access Denied!

How to Avoid It:

Remember AWS's authorization rule: Explicit Deny > Explicit Allow > Default Deny.

6. Test Your Mental Model

Quick Knowledge Check: Test Your AWS Mental Model

Solidify your cross-cloud understanding with instant feedback.

1Which Amazon S3 storage class automatically moves objects between frequent and infrequent access tiers without retrieval fees when access patterns change?