Skip to content

Anand's Data Stories

Learn. Share. Repeat.

  • AWS
  • Coding
  • DataScience
  • Oracle

Tag: Dynamodb

Reading Parquet files with AWS Lambda

Posted April 14, 2020September 24, 2020 AnandLeave a commentPosted in AWS, AWSDataWrangler

I had a use case to read data (few columns) from parquet file stored in S3, and write to DynamoDB table, every time a file was uploaded. Thinking to use AWS Lambda, I was looking at options of how to read parquet files within lambda until I stumbled upon AWS Data Wrangler. From the document […]

Scan Dynamodb table from AWS Glue in different account

Posted March 28, 2020September 24, 2020 Anand1 CommentPosted in AWS, AWS Glue

In this blog post I will list down the steps required to setup the AWS Glue job to scan the dynamodb table in another account. In my setup, I scan the dynamodb table in Account A (us-west-2), perform glue transformations in Account B (us-east-1) and write it to S3 in Account B. Account A – […]

Proudly powered by WordPress | Theme: Sydney by aThemes.