DevOps Archives

Transforming Data Engineering with DevOps on the Databricks Platform

The role of the Data Engineer is rapidly changing, from writing ETL scripts to engineering production-grade data products. On the Databricks Lakehouse Platform, this shift demands more than technical know-how; it requires a DevOps mindset. By embracing software engineering best practices, automated testing, and CI/CD pipelines, data teams can deliver scalable, reliable, and secure solutions. This blog explores how DevOps principles and tools like Git Folders and Databricks Asset Bundles are transforming data engineering into a discipline of continuous innovation and delivery.

How AI Became My Coding Assistant (And Why It Should Be Yours Too)

AI coding assistants are changing how developers work. In this blog, Ian Ng shares how Amazon Q Developer became a powerful coding partner, helping automate routine tasks so developers can focus on architecture, problem-solving, and building better solutions faster.

A human sat in front of a laptop surrounded stacks of files and fire against a backdrop of code.

The hidden cost of underinvesting in Infrastructure as Code maintenance

Many teams treat Infrastructure as Code maintenance as a “nice to have” until outdated tools bring productivity to a standstill. This blog explores the hidden costs of standing still, why small, continuous updates matter, and how smarter maintenance leads to real cost optimisation and long-term resilience.

How to master Cross-Account messaging in AWS without compromising on security

Struggling with cross-account messaging in AWS? This blog walks through a real-world solution using Amazon MQ, EKS, and Lambda to securely sync application data across accounts. Learn how to design a scalable relay architecture, overcome Lambda’s cross-account limitations, and keep your systems integrated and up to date without compromising on speed or security.

Tag: DevOps

Transforming Data Engineering with DevOps on the Databricks Platform

The hidden cost of underinvesting in Infrastructure as Code maintenance

Enhancing DevSecOps maturity with the OWASP Software Assurance Maturity Model