Posts
All the articles I've posted.
- 31 MIN READ•Aug 25, 2026
Agent-Driven Storage Tiering for Apache Iceberg: Moving Cold Data Without Breaking Queries
A background agent can move cold Iceberg partitions to cheaper tiers without breaking live queries. Heatmaps, path-safe moves, and restore paths.
Apache Icebergstorage tieringcost optimization - 31 MIN READ•Aug 25, 2026
Securing the Agentic Lakehouse Gateway: Preventing Prompt Injection and Data Exfiltration
Agentic lakehouse gateways face prompt injection and exfiltration through query results. A threat model and defenses for the layer in front of data.
AI agentssecurityMCP - 31 MIN READ•Aug 25, 2026
Apache Ossie and Apache Polaris: Putting Semantic Models in the Open Catalog
Apache Ossie and Polaris put metric definitions in the open catalog. What the spec covers, what Polaris stores, and what is still unfinished.
Apache OssieApache Polarissemantic layer - 31 MIN READ•Aug 25, 2026
Arrow Flight SQL and ADBC: Why the Database Driver Is the Slowest Part of Your Query
JDBC and ODBC often dominate large-result time. Flight SQL and ADBC keep data columnar from server to client, with Python, Go, and Rust examples.
Apache ArrowFlight SQLADBC - 31 MIN READ•Aug 25, 2026
DataFusion Comet 1.0 and What Native Rust Scans Change for Spark on Iceberg
DataFusion Comet 1.0 replaces Spark Iceberg scans with native Rust. What speeds up, what still falls back to the JVM, and how to deploy it.
Apache IcebergApache SparkDataFusion Comet - 31 MIN READ•Aug 25, 2026
FSST and ALP: The Two Encodings Fixing Parquet's Weakest Compression Cases
ALP and FSST target Parquet's worst cases: floats and high-cardinality strings. How they work and what they change for Iceberg tables.
Apache ParquetencodingsALP - 33 MIN READ•Aug 25, 2026
Governance-as-Code for the Lakehouse: Managing REST Catalog RBAC and Masking in Git
Put REST catalog RBAC and masking in Git. How to review grants, apply them safely, and keep lakehouse access from drifting.
governanceREST catalogRBAC - 31 MIN READ•Aug 25, 2026
Metric Contracts in Code: Testing, Versioning, and Serving Business Logic to Multi-Agent Systems
Metric contracts in code let teams test, version, and serve business logic to multi-agent systems without each agent inventing its own SQL.
metricsAI agentssemantic layer - 31 MIN READ•Aug 25, 2026
High-Throughput Branch Merging: Automating Concurrency and Conflict Resolution in Multi-Branch Iceberg Pipelines
High-throughput Iceberg branch merges need conflict detection and automation. How to reconcile concurrent writes without stalling pipelines.
Apache Icebergbranchesconcurrency - 31 MIN READ•Aug 25, 2026
Multi-Cloud REST Catalog Topologies: Running Apache Polaris Across AWS, Azure, and GCP
Polaris can catalog Iceberg tables across AWS, Azure, and GCP. Four topologies, credential vending, and the tradeoffs of each design.
Apache PolarisREST catalogmulti-cloud - 32 MIN READ•Aug 25, 2026
Parquet-Only Manifests in Iceberg v4: Why the Metadata Layer Is Going Columnar
Iceberg v4 is moving manifests from Avro to Parquet so planners can read only the stats they need. Why the metadata layer is going columnar.
Apache IcebergIceberg v4Parquet - 31 MIN READ•Aug 25, 2026
Query Routing at Machine Scale: Dynamic Workload Distribution Across Lakehouse Engines
Route each lakehouse query by shape, not by sender. Signals, rules, and how to keep dashboards, batch jobs, and agents from sharing one engine.
query engineslakehouserouting