Generative AI: Building systems, not just chatbots
Explore how using GenAI for systems beyond chatbots, focusing on the Instructor library and Claude 3 models in AWS Bedrock.
Explore how using GenAI for systems beyond chatbots, focusing on the Instructor library and Claude 3 models in AWS Bedrock.
Glue Schema Registry provides a centralized repository for managing and validating schemas for topic message data and it can be utilized by many AWS services when building streaming apps. In this series, we discuss how to integrate Python Kafka producer and consumer apps In AWS Lambda with the Glue Schema Registry. In part 2, Kafka apps are deployed and their behaviour is discussed.
Glue Schema Registry provides a centralized repository for managing and validating schemas for topic message data and it can be utilized by many AWS services when building streaming apps. In this series, we discuss how to integrate Python Kafka producer and consumer apps In AWS Lambda with the Glue Schema Registry. In part 1, I illustrate the infrastructure and Kafka apps.
We will discuss how to configure the Kafka consumer to seek offsets by timestamp where topic partitions are dynamically assigned by subscription. Docker Compose is used for building a single node Kafka cluster and running multiple consumer instances.
We’ll discuss limitations of the Lambda invoke function operator of Apache Airflow and create a custom Lambda operator. The custom operator extends the existing one and it reports the invocation result of a function correctly and records the exact error message from failure.
Yet another serverless solution for invoking AWS Lambda at a sub-minute frequency
As described in the product page, AWS Glue is a serverless data integration service that makes it easy to discover, prepare, and combine data for analytics, machine learning, and application development. For development, a development endpoint is recommended but it can be costly, inconvenient or unavailable (for Glue 2.0). The AWS Glue team published a Docker image that includes the AWS Glue binaries and all the dependencies packaged together. After inspecting it, I find some modifications are necessary in order to build a development environment on it. In this post, I’ll demonstrate how to build development environments for AWS Glue 1.0 and 2.0 using the Docker image and the Visual Studio Code Remote – Containers extension.
In this post we explore how to set up a flexible and secure way to access the AWS CLI using the Open Source tool `aws-google-auth` developed and maintained by the team at Cevo.
Let’s look at adding Python to your cloud development toolbox to increase reliability and dependability of your development and operations practices.
Our team wanted to validate the Application Load Balancers (ALBs) in our environment after a deployment – the problem was they were lost amongst all the other ones in there. They were tagged, but we couldn’t work out how to find them – until we saw the Resource Tagging API.
Cevo trades as Cevo (VIC) Pty Ltd and Cevo (NSW) Pty Ltd | © All Rights Reserved CevoTM
Cevo acknowledges the Traditional Owners of the land on which our offices are situated, and pay our respects to their Elders past, present and emerging.
