Tag: Data

Ephemeral containers (small floating cubes or boxes) dynamically appear and disappear along the pipeline, symbolising on-demand dbt execution.

On-Demand dbt Execution: Rethinking Analytics Engineering in Secure Cloud Environments 

In secure enterprise cloud environments, traditional dbt deployment models can introduce unnecessary cost, security risk, and operational friction. This blog explores an on-demand, containerised dbt execution model that treats dbt as an ephemeral workload rather than a long-running service. Orchestrated with AWS MWAA and backed by ECS Fargate, the approach enables scalable, secure analytics transformations while improving cost efficiency, data quality observability, and CI/CD integration in modern enterprise data lakes.

Read more
Agentic AI From Hidden Tool to Trusted Partner

Agentic AI: From Hidden Tool to Trusted Partner

Agentic AI is transforming the way we work, evolving from hidden tools in the shadows to trusted collaborators. In this blog, we explore the four stages of agentic AI, the key risks of data, hallucination, and context drift, and why human-in-the-loop governance is essential for building trust and maximising productivity.

Read more
A photo of a confidential document with sensitive data that has been censored.

How PII redaction in the cloud prevents data breaches

As data breaches surge across Australia, protecting Personally Identifiable Information (PII) has never been more urgent. In this practical guide, I share why PII redaction in the cloud is essential for both compliance and resilience and how AWS-native tools can help you detect, redact, and govern sensitive data at scale. Whether you’re just starting out or refining an existing approach, this article offers real-world strategies to reduce breach impact and build customer trust.

Read more