Private Host React App in AWS
This post takes you through the steps required to privately host the React application in AWS, including design architecture, installation of dependencies, a link to Git repository, creating React app, Dockerfile and Nginx configuration, creating necessary AWS services, login to AWS and creating the Makerfile.
Revisit AWS Lambda Invoke Function Operator of Apache Airflow
We’ll discuss limitations of the Lambda invoke function operator of Apache Airflow and create a custom Lambda operator. The custom operator extends the existing one and it reports the invocation result of a function correctly and records the exact error message from failure.
Serverless Application Model (SAM) for Data Professionals
We’ll discuss how to build a serverless data processing application using the Serverless Application Model (SAM). A Lambda function is developed, which is triggered whenever an object is created in a S3 bucket. 3rd party packages are necessary for data processing and they are made available by Lambda layers.
Inside The Hive with Roopa Venkatesh
Learn more about Roopa Venkatesh’s career journey, her proudest moments, and what she loves about being a woman working in tech.
Data Warehousing ETL Demo with Apache Iceberg on EMR Local Environment
We’ll discuss how to implement data warehousing ETL using Iceberg for data storage/management and Spark for data processing. A Pyspark ETL app will be used for demonstration in an EMR local environment. Finally the ETL results will be queried by Athena for verification.
Must watch Sessions from AWS Australia and New Zealand Summit 2022
In today’s article we are moving on from our recent series on CloudFormation (at least for the moment) and taking a look at AWS CodePipeline. CodePipeline is an AWS managed service focused on providing a continuous delivery mechanism to help automate your releases and deployments into your AWS environment.
Automating Knowledge Sharing at Cevo: Part one Revisited, Trading API Gateway for Lambda “Function URL”
In today’s article we are moving on from our recent series on CloudFormation (at least for the moment) and taking a look at AWS CodePipeline. CodePipeline is an AWS managed service focused on providing a continuous delivery mechanism to help automate your releases and deployments into your AWS environment.
Develop and Test Apache Spark Apps for EMR Locally Using Docker
We’ll discuss how to create a Spark local dev environment for EMR using Docker and/or VSCode. A range of Spark development examples are demonstrated and Glue Catalog integration is illustrated as well.
Cevo Achieves AWS DevOps Competency Status
Cevo has achieved Amazon Web Services (AWS) DevOps Competency status. This designation recognises the deep expertise that Cevo possesses to help its customers implement continuous integration and continuous delivery practices, and help them automate infrastructure provisioning and management with configuration management tools on AWS.
Use External Schema Registry with MSK Connect – Part 2 MSK Deployment
We’ll contunue the discussion of a Change Data Capture (CDC) solution with a schema registry and its deployment to AWS. All major resources are deployed in private subnets and VPN is used to access them in order to improve developer experience. The Apicurio registry is used as the schema registry service and it is deployed as an ECS service. In order for the connectors to have access to the registry, the Confluent Avro Converter is packaged together with the connector sources. The post ends with illustrating how schema evolution is managed by the schema registry.