Struggling with cross-account messaging in AWS? This blog walks through a real-world solution using Amazon MQ, EKS, and Lambda to securely sync application data across accounts. Learn how to design a scalable relay architecture, overcome Lambda’s cross-account limitations, and keep your systems integrated and up to date without compromising on speed or security.
Saisha Hardikar covers real-world examples of how startups have harnessed the power of data analytics, machine learning (ML), and AWS as a Software-as-a-Service (SaaS) platform to maximise their potential.
This blog explores continual compliance in line with Center of Internet Security (CIS) benchmarks within an EKS release pipeline.
The data build tool (dbt) is an effective data transformation tool and it supports key AWS analytics services – Redshift, Glue, EMR and Athena. In part 4 of the dbt on AWS series, we discuss data transformation pipelines using dbt on Amazon EMR on EKS. Subsets of IMDb data are used as source and data models are developed in multiple layers according to the dbt best practices.
We’ll discuss how to provision and manage Spark jobs on EMR on EKS with Terraform. Amazon EKS Blueprints for Terraform will be used for provisioning EKS, EMR virtual cluster and related resources. Also Spark job autoscaling will be managed by Karpenter where two Spark jobs with and without Dynamic Resource Allocation (DRA) will be compared.
Cevo trades as Cevo (VIC) Pty Ltd and Cevo (NSW) Pty Ltd | © All Rights Reserved CevoTM
Cevo acknowledges the Traditional Owners of the land on which our offices are situated, and pay our respects to their Elders past, present and emerging.
