Amazon RDS - Reviews | Why developers use Amazon RDS.

Punith Ganadinni

Senior Product Engineer ·Nov 13, 2020

Needs advice

AWS Data Pipeline

and

AWS Glue

My Stack

Hey all, I need some suggestions in creating a replica of our RDS DB for reporting and analytical purposes. Cost is a major factor. I was thinking of using AWS Glue to move data from Amazon RDS to Amazon S3 and use Amazon Athena to run queries on it. Any other suggestions would be appreciable.

2 upvotes·60.8K views

Replies (1)

Louis Guitton

VP Engineering at Onefootball·Nov 28, 2020

Recommends

AWS Database Migration Service

Singer

If cost is a major factor, I suggest to either A) look at open source tools that you can run on compute you already pay for or B) use AWS services within the free tier.

For option A), check out singer taps and targets. For option B) check out the AWS DBMS (Database Migration Service). It's make for replicating data and your use case is described here https://docs.aws.amazon.com/dms/latest/userguide/CHAP_Target.S3.html

Using Amazon S3 as a target for AWS Database Migration Service - AWS Database Migration Service (docs.aws.amazon.com)

3 upvotes·719 views

Praveen Mooli

Engineering Manager at Taylor and Francis·Jul 29, 2019

Shared insights

We are in the process of building a modern content platform to deliver our content through various channels. We decided to go with Microservices architecture as we wanted scale. Microservice architecture style is an approach to developing an application as a suite of small independently deployable services built around specific business capabilities. You can gain modularity, extensive parallelism and cost-effective scaling by deploying services across many distributed servers. Microservices modularity facilitates independent updates/deployments, and helps to avoid single point of failure, which can help prevent large-scale outages. We also decided to use Event Driven Architecture pattern which is a popular distributed asynchronous architecture pattern used to produce highly scalable applications. The event-driven architecture is made up of highly decoupled, single-purpose event processing components that asynchronously receive and process events.

To build our #Backend capabilities we decided to use the following: 1. #Microservices - Java with Spring Boot , Node.js with ExpressJS and Python with Flask 2. #Eventsourcingframework - Amazon Kinesis , Amazon Kinesis Firehose , Amazon SNS , Amazon SQS, AWS Lambda 3. #Data - Amazon RDS , Amazon DynamoDB , Amazon S3 , MongoDB Atlas