Automating Knowledge Sharing at Cevo: Part one Revisited, Trading API Gateway for Lambda “Function URL”
In today’s article we are moving on from our recent series on CloudFormation (at least for the moment) and taking a look at AWS CodePipeline. CodePipeline is an AWS managed service focused on providing a continuous delivery mechanism to help automate your releases and deployments into your AWS environment.
Develop and Test Apache Spark Apps for EMR Locally Using Docker
We’ll discuss how to create a Spark local dev environment for EMR using Docker and/or VSCode. A range of Spark development examples are demonstrated and Glue Catalog integration is illustrated as well.
Cevo Achieves AWS DevOps Competency Status
Cevo has achieved Amazon Web Services (AWS) DevOps Competency status. This designation recognises the deep expertise that Cevo possesses to help its customers implement continuous integration and continuous delivery practices, and help them automate infrastructure provisioning and management with configuration management tools on AWS.
Use External Schema Registry with MSK Connect – Part 2 MSK Deployment
We’ll contunue the discussion of a Change Data Capture (CDC) solution with a schema registry and its deployment to AWS. All major resources are deployed in private subnets and VPN is used to access them in order to improve developer experience. The Apicurio registry is used as the schema registry service and it is deployed as an ECS service. In order for the connectors to have access to the registry, the Confluent Avro Converter is packaged together with the connector sources. The post ends with illustrating how schema evolution is managed by the schema registry.
Use External Schema Registry with MSK Connect – Part 1 Local Development
We’ll discuss a Change Data Capture (CDC) architecture with a schema registry. As a starting point, a local development environment is set up using Docker Compose. The Debezium and Confluent S3 connectors are deployed with the Confluent Avro converter and the Apicurio registry is used as the schema registry service. A quick example is shown to illustrate how schema evolution can be managed by the schema registry.
Automating Knowledge Sharing at Cevo: Part one, problem statement and POC
In today’s article we are moving on from our recent series on CloudFormation (at least for the moment) and taking a look at AWS CodePipeline. CodePipeline is an AWS managed service focused on providing a continuous delivery mechanism to help automate your releases and deployments into your AWS environment.
Structuring your AWS Organisation for Security and Operability
Aside from hitting all the buzzwords in the title, this is a short (?) exploration of setting up X-Ray to understand the behaviour and performance of a fully serverless integration application on AWS.
Simplify Your Development on AWS with Terraform
In this post, we’ll discuss how to set up a development infrastructure on AWS with Terraform. Terraform is used as an effective way of managing resources on AWS. An Aurora PostgreSQL cluster is created in a private subnet and SoftEther VPN is configured to access the database from the developer machine.
How to “Build Once and Deploy Many” for React App in CI/CD
Aside from hitting all the buzzwords in the title, this is a short (?) exploration of setting up X-Ray to understand the behaviour and performance of a fully serverless integration application on AWS.
Encoding best practices with IAM policy conditions
Aside from hitting all the buzzwords in the title, this is a short (?) exploration of setting up X-Ray to understand the behaviour and performance of a fully serverless integration application on AWS.
