Tagged
Kinesis Data Streams and Amazon MSK both handle real-time streaming on AWS, but they serve different architectures. Here is how to choose between them for your workload.
Glue 5.1 (Spark 3.5.6, Iceberg 1.10.0) for lakehouse ETL. July 2026 refresh — Iceberg v2 vs v3, Lake Formation writes, compaction, Athena compatibility.
Palaniappan PGlue does EL; dbt does T. July 2026 refresh — Glue 5.1 DPU economics, dbt-athena/Redshift, and the combined stack most teams converge on.
Palaniappan PAthena still bills ~$5/TB scanned (or Capacity Reservations by DPU). July 2026 refresh — partitions, Parquet/Iceberg, workgroups, and when provisioned capacity wins.
Palaniappan PManaged Flink for stateful streaming. July 2026 refresh — KDA name EOL, KPU + orchestration KPU, per-second billing, Flink vs Lambda decision matrix.
Palaniappan PWe use cookies and similar technologies to analyze site traffic, personalize content, and provide social media features. By clicking “Accept,” you consent to our use of cookies. You can adjust your preferences at any time.
