Re:Invent 2024

Re:Invent 2024 Interview Guide

EKS Auto, Aurora DSQL, S3 Tables, and other AWS announcements.

3Topics
Intermediate

EKS Auto (Re:Invent 2024)

Amazon EKS Auto Mode was announced at Re:Invent 2024 to deliver a fully managed Kubernetes experience:

What EKS Auto Manages For You

  • Automatic Compute β€” No node groups to configure. EKS Auto provisions the right EC2 instances (powered by Karpenter) based on pod requirements. Supports Spot, On-Demand, and Graviton automatically.
  • Automatic Networking β€” VPC CNI, CoreDNS, and kube-proxy are managed and upgraded automatically. Load balancer integration is built in.
  • Automatic Storage β€” EBS CSI driver is pre-installed. PersistentVolumeClaims just work.
  • Automatic Upgrades β€” K8s version, AMIs, and add-ons are upgraded automatically with minimal disruption.

EKS Auto vs Standard EKS

Aspect EKS Auto Mode Standard EKS
Node Management Fully automated (Karpenter built-in) You manage node groups or install Karpenter
Add-on Management CNI, DNS, proxy auto-managed You install, configure, and upgrade add-ons
Upgrades Automatic, zero-downtime Manual or semi-automated
Cost Optimization Auto Spot/Graviton selection You configure instance types and purchase options
Control Opinionated, less control Full control over all components
Best For Teams wanting K8s without ops Teams needing custom configurations

🎯 Key Takeaway

Interview tip: Say: "EKS Auto Mode is AWS's answer to 'Kubernetes is too complex.' It's Karpenter + managed add-ons + auto-upgrades baked into a single mode. For new clusters where the team doesn't need custom networking or GPU scheduling, I'd start with Auto Mode. For existing clusters with specific requirements, Standard mode gives full control."

Advanced

Aurora DSQL (Re:Invent 2024)

Amazon Aurora DSQL (Distributed SQL) β€” the first serverless, multi-region distributed SQL database on AWS:

  • Distributed & Multi-Region β€” Active-active writes across multiple AWS regions with strong consistency.
  • PostgreSQL Compatible β€” Standard PostgreSQL interface, existing apps work without modification.
  • Serverless β€” No capacity planning, no instances. Scales automatically.
  • Serializable Isolation β€” Unlike DynamoDB Global Tables (eventual consistency), DSQL provides serializable isolation across regions.

Aurora DSQL vs Alternatives

Feature Aurora DSQL DynamoDB Global Tables Aurora Global Database
Data Model Relational (SQL) Key-value / Document (NoSQL) Relational (SQL)
Multi-Region Writes βœ… Active-active βœ… Active-active ❌ Single-writer, read replicas
Consistency Strong (serializable) Eventual (last-writer-wins) Eventual for reads in secondary
Serverless βœ… Fully serverless βœ… On-demand mode ❌ Provisioned instances
Cross-Region Latency Higher (consistency guarantee) Lower (eventual) ~1 second replication lag
Best For Global apps needing SQL + ACID globally Global apps with simple access patterns Read scaling, DR for SQL workloads

🎯 Key Takeaway

Interview tip: Say: "Aurora DSQL fills the gap where you need global SQL with strong consistency β€” something that was previously impossible on AWS without CockroachDB or Google Spanner. For eventually-consistent NoSQL, DynamoDB Global Tables is still the best choice. For single-region SQL with disaster recovery, Aurora Global Database works fine."

Intermediate

S3 Tables (Re:Invent 2024)

Amazon S3 Tables β€” native Apache Iceberg table support in S3, announced at Re:Invent 2024:

  • Structured Data in S3 β€” Store tabular data directly in S3 with built-in table format support. No separate metastore needed.
  • Apache Iceberg Format β€” Native Iceberg support with schema evolution, time travel, partition evolution, and ACID transactions.
  • Query with Standard Tools β€” Query from Athena, EMR, Redshift, and any Iceberg-compatible tool.
  • Auto-Optimization β€” S3 manages compaction, snapshot management, and orphaned file cleanup automatically.

S3 Tables vs Traditional Lakehouse

Aspect S3 Tables (New) Traditional (S3 + Glue + Manual Iceberg)
Metastore Built into S3 AWS Glue Data Catalog (separate service)
Compaction Automatic Manual Spark/EMR jobs
Snapshot Cleanup Automatic Manual expire_snapshots
Performance 3x faster query, 10x more TPS (AWS claims) Baseline
Complexity Low β€” create table, write data High β€” manage catalog, write compaction jobs

🎯 Key Takeaway

Interview tip: Say: "S3 Tables turns S3 from an object store into a data platform. Previously, building a lakehouse required S3 + Glue Catalog + manual Iceberg management + Spark compaction jobs. Now S3 handles the table format natively with auto-compaction, which reduces operational complexity dramatically while maintaining open-format compatibility with Iceberg."

Advanced

Interview Questions β€” Re:Invent 2024 & What's New

Interviewers ask about recent AWS launches to test if you stay current. Knowing these services and when to use them signals a growth mindset.

  1. Answer Guide
    EKS Auto Mode manages compute, networking, and storage automatically (no node groups, no Karpenter config, no add-ons). NOT ideal when: you need custom AMIs, specific kernel configurations, GPU workloads with custom drivers, or fine-grained node control. Trade-off: simplicity vs control.
  2. Answer Guide
    DSQL = distributed SQL with strong consistency across regions (fills the gap between Aurora Global DB's single-writer and DynamoDB's eventual consistency). Choose DSQL when: you need multi-region active-active writes WITH SQL and strong consistency β€” previously impossible on AWS without third-party (CockroachDB, Spanner).
  3. Answer Guide
    S3 Tables are built-in Apache Iceberg tables managed natively by S3. Eliminates Glue Crawler, Glue Catalog management, manual compaction, and metadata management. Up to 3x faster query performance and 10x more transactions/sec. Simplifies the data lakehouse stack from 4-5 services to S3 + Athena.
  4. Answer Guide
    Structure your answer: "I'd pick [service] because it solves [problem] that previously required [workaround]. For example, Aurora DSQL solves multi-region strong consistency for SQL β€” previously you needed CockroachDB or accepted eventual consistency with DynamoDB. This changes how we architect global applications." Show you evaluate launches by architectural impact, not just hype.
  5. Answer Guide
    Probably not β€” EKS Auto Mode doesn't support custom AMIs or GPU-specific node configurations (at launch). If you need: custom Karpenter NodePools, GPU workloads, specific instance type constraints, or Bottlerocket customization β€” stay with standard EKS + Karpenter. Auto Mode is best for standard compute workloads where simplicity outweighs control.
  6. Answer Guide
    Ask: 1) Do you use Apache Iceberg already? (S3 Tables is Iceberg-native). 2) Do other tools query your data (Spark, Trino)? Iceberg format ensures compatibility. 3) How much operational overhead is Glue Crawler + Catalog? 4) What's the query performance requirement? 5) Is your data mostly structured tabular data? (S3 Tables is for tabular, not unstructured).
  7. Answer Guide
    Re:Invent keynotes and breakout sessions. AWS What's New feed (subscribe by category). AWS blogs (Architecture Blog, Database Blog). Follow AWS heroes and community builders. Hands-on: spin up new services in a sandbox account. The key: don't just read about services β€” evaluate them against your current architecture decisions.
  8. Answer Guide
    Strong consistency across regions requires cross-region coordination (consensus protocol), adding latency (potentially 100-300ms for cross-region writes vs single-digit ms for single-region Aurora). Poor choice for: latency-sensitive applications where all writes can be single-region, high-throughput write-heavy workloads, or when eventual consistency is acceptable (DynamoDB Global Tables would be faster and cheaper).

Preparation Strategy

When discussing new services in interviews, use the comparative framework: "Service X solves [problem]. Before this, the alternatives were [A] and [B], each with [trade-offs]. X fills the gap by [specific value]." This shows you evaluate services architecturally, not just follow hype.