Streamlining file transfers for digital marketplace with AWS for cost and performance gains
Cevo partnered with an Australian fresh food marketplace platform to implement a fully serverless, AWS-native SFTP solution to replace an expensive, third-party service. The solution is projected to reduce costs by 68%, improved security, and automated workflows using S3 notifications.
68% cost reduction
Projected
Independent Software Vendor
Industry
Business challenge
The platform, used by multiple suppliers and vendors to manage fresh produce operations, faced inefficiencies in updating product prices. Vendors were manually uploading files using a third-party secure file transfer protocol (SFTP) service, which was both costly and complex. Since the platform was already hosted on AWS, the organisation sought to streamline operations, reduce costs and improve performance by leveraging AWS Transfer Family for efficient file transfers.
However, the existing system relied on traditional username and password authentication, which AWS SFTP does not natively support. The organisation also required improved administrative controls, including folder-level permissions, to better manage operations. The solution had to address both the authentication challenges while boosting overall efficiency and security of the platform.
Solution
Cevo partnered with the SaaS provider to design a fully serverless, AWS-native SFTP solution using AWS Transfer Family. Recognising the platform’s reliance on traditional username and password authentication the team conducted a requirements workshop to understand the platform’s needs and craft a tailored solution.
The new architecture uses Amazon S3 for file storage, with KMS encryption securing data at rest. To overcome authentication limitations, our team developed a custom identity store using API Gateway and AWS Lambda, while AWS Secrets Manager securely manages user credentials.
To enhance administrative control, the Cevo team implemented a structured folder permission system, allowing a Super Admin full access to all files and folders. Individual suppliers are assigned their own admin folders with access limited to related files and subfolders. This setup ensures that each supplier’s data remains confidential and compliant. Additionally, S3 lifecycle policies were applied to automatically delete files after a set period, optimising cost-efficiency.
To automate internal workflows, S3 notifications were enabled to trigger workflows upon file uploads, reducing manual intervention.
Cevo’s experts provided comprehensive guidance and training throughout the implementation to ensure the organisation’s team could effectively operate and manage the new solution moving forward.
Outcomes
The AWS Transfer Family SFTP solution will allow the marketplace platform to transition from its expensive third-party service to a cost-efficient, scalable and secure AWS-native solution. This new system meets all security and functionality requirements while seamlessly integrating with the existing AWS infrastructure. As a result, the platform will be set up to manage file transfers more efficiently, with improved performance, control and automation. Key benefits include:
- Cost efficiency: The new solution is projected to reduce file transfer costs by 68%, while S3 lifecycle policies further optimise storage costs by automatically deleting files after a defined retention period.
- Improved security: Files are encrypted at rest using AWS Key Management Service (KMS), ensuring robust data protection.
- Seamless AWS integration: Hosting both the application and files within AWS boosts performance and leverages services like Amazon S3 and AWS Lambda.
- Custom authentication: A tailored identity store using API Gateway and Lambda enables the continued use of username/password authentication.
- Automated workflows: The solution automatically triggers internal processes when files are uploaded to S3, significantly enhancing operational efficiency
“Cevo was a fantastic partner throughout the implementation of our SFTP solution. They took the time to fully understand our requirements and delivered a tailored solution quickly and efficiently. Their clear communication and guidance empowered our team to easily grasp the new system, making the entire process smooth and straightforward. We truly value their expertise and support.”
Enjoyed this customer story?
Share it with your network!
You may also like
