John Doyle | Cloud Blog

Article

Building a Modern Data Pipeline on AWS - Part 4

Article

Building a Modern Data Pipeline on AWS - Part 3

Article

Building a Modern Data Pipeline on AWS - Part 2

Article

Building a Modern Data Pipeline on AWS - Part 1

Article

AWS Google SSO - Part 1

Article

Building a Modern Data Pipeline on AWS - Part 4

By Part 4 of this series the data is in decent shape - raw JSON landing in S3, picked up by Redshift Spectrum, transformed through dbt into gold tables.

Article

Building a Modern Data Pipeline on AWS - Part 3

Raw JSON landing in S3 is only useful if you can actually query it cleanly.

Article

Building a Modern Data Pipeline on AWS - Part 2

After Part 1 we have raw JSON landing in S3, partitioned by date.

Article

Building a Modern Data Pipeline on AWS - Part 1

I kept putting off building a proper data pipeline because it felt like overkill.

Article

AWS Google SSO - Part 1

If you manage multiple AWS accounts and use Google Workspace as your identity provider (IdP), ensuring that users have the correct access can become complex.

Tech

Building a Multi-Region app with AWS CDK - Part 1

There are lots of tutorials of deploying basic CRUD applications with AWS CDK using API Gateway, and Lambda connecting to a DynamoDB table.