Tag: Terraform

Monitoring Solution for AWS ECS Fargate Applications with New Relic Integration

Learn about the benefits of using New Relic to monitor your AWS ECS-Fargate applications in this comprehensive blog post. Discover how it compares to AWS CloudWatch, the different types of monitoring and alerting that can be integrated, and get practical guidance on implementation with code samples. Plus, understand how New Relic aligns with the AWS Well-Architected Framework.Learn about the benefits of using New Relic to monitor your AWS ECS-Fargate applications in this comprehensive blog post. Discover how it compares to AWS CloudWatch, the different types of monitoring and alerting that can be integrated, and get practical guidance on implementation with code samples. Plus, understand how New Relic aligns with the AWS Well-Architected Framework.

Read More »

Integrate Glue Schema Registry with Your Python Kafka App – Part 2

Glue Schema Registry provides a centralized repository for managing and validating schemas for topic message data and it can be utilized by many AWS services when building streaming apps. In this series, we discuss how to integrate Python Kafka producer and consumer apps In AWS Lambda with the Glue Schema Registry. In part 2, Kafka apps are deployed and their behaviour is discussed.

Read More »

Integrate Glue Schema Registry with Your Python Kafka App – Part 1

Glue Schema Registry provides a centralized repository for managing and validating schemas for topic message data and it can be utilized by many AWS services when building streaming apps. In this series, we discuss how to integrate Python Kafka producer and consumer apps In AWS Lambda with the Glue Schema Registry. In part 1, I illustrate the infrastructure and Kafka apps.

Read More »

Simplify Streaming Ingestion on AWS – Part 2 MSK and Athena

Streaming ingestion from Kafka (MSK) into Redshift and Athena can be much simpler as they now support direct integration. In part 2, we discuss an end-to-end streaming ingestion solution using EventBridge, Lambda, MSK and Athena. We also use AWS SAM integrated with Terraform for developing a Lambda function locally.

Read More »

Simplify Streaming Ingestion on AWS – Part 1 MSK and Redshift

Streaming ingestion from Kafka (MSK) into Redshift and Athena can be much simpler as they now support direct integration. In part 1 of the simplify streaming ingestion on AWS series, we discuss an end-to-end streaming ingestion solution using EventBridge, Lambda, MSK and Redshift. We also use AWS SAM integrated with Terraform for developing a Lambda function locally.

Read More »

Manage EMR on EKS with Terraform

We’ll discuss how to provision and manage Spark jobs on EMR on EKS with Terraform. Amazon EKS Blueprints for Terraform will be used for provisioning EKS, EMR virtual cluster and related resources. Also Spark job autoscaling will be managed by Karpenter where two Spark jobs with and without Dynamic Resource Allocation (DRA) will be compared.

Read More »

Simplify Your Development on AWS with Terraform

In this post, we’ll discuss how to set up a development infrastructure on AWS with Terraform. Terraform is used as an effective way of managing resources on AWS. An Aurora PostgreSQL cluster is created in a private subnet and SoftEther VPN is configured to access the database from the developer machine.

Read More »