Aurora MySQL – Export data to S3

Posted Leave a commentPosted in AWS, AWS Aurora

Using SELECT INTO OUTFILE S3 you can query data from an Aurora MySQL DB cluster and save it directly into text files stored in S3 bucket. 1. Create an IAM policy for S3. { “Version”: “2012-10-17”, “Statement”: [ { “Sid”: “VisualEditor0”, “Effect”: “Allow”, “Action”: [ “s3:DeleteObject”, “s3:GetBucketLocation”, “s3:GetObject”, “s3:ListBucket”, “s3:ListBucketMultipartUploads”, “s3:PutObject” ], “Resource”: [ “arn:aws:s3:::bucket-name”, […]

AWS DMS – Target TableName Differs

Posted Leave a commentPosted in AWS, DMS

AWS DMS is a tool that supports both homogenous and heterogeneous migration, helping to migrate to aws cloud. During most of the migrations, the source and target table names remain the same, in which case the Mappings.json file is pretty simple. As an example (Oracle to PostgreSQL)  { “rules”: [ { “rule-type”: “selection”, “rule-id”: “1”, […]

Oracle to Postgres — Index Skip Scan

Posted 2 CommentsPosted in AWS, AWS Aurora

I have been working on Oracle to Postgres migration and it has been a fun ride. One of the recent encounters during migration was performance issue in Postgres for a query, actually quite a simple query. SELECT count(*) AS num_incidents FROM audit_cs acs INNER JOIN audit_changes ac ON acs.audit_change_id = ac.audit_change_set WHERE acs.object_id=$1 AND ac.path […]