Hi there 👋, I am Subhamay Bhattacharyya, 6x AWS, 1x Azure, 2x GitHub and 1x HashiCorp Terraform, 2 x Snowflake and 1 x Databricks Certified Data Engineer and a AWS Cloud Enthusiast
I'm a Senior Manager & Cloud Data Engineer with a strong focus on multi-cloud architecture, DevOps automation, and data platforms. I build production-grade cloud systems across AWS, Azure, and GCP using Terraform, GitHub Actions, Ansible, and serverless services, with a deep emphasis on security, observability, and cost-efficient design.
My work blends hands-on engineering with architectural leadership—from designing event-driven data pipelines and cloud-native analytics platforms to building enterprise-ready CI/CD pipelines using OIDC-based zero-trust authentication and infrastructure-as-code.
I’m currently developing a multi-cloud Cloud Resume Challenge platform, where the same production-grade architecture is deployed on:
- AWS — S3, CloudFront, Route 53, Lambda, DynamoDB, Kinesis, RDS, VPC, EC2, Athena, API Gateway, Glue, Step Functions, SNS, SQS, EventBridge, CloudWatch, IAM, KMS, Secrets Manager
- GCP — Cloud Storage, Cloud CDN, Cloud DNS, Workload Identity Federation
- Azure — Storage Static Website, Azure Front Door, Azure DNS
Everything is provisioned using Terraform modules, deployed via GitHub Actions with OIDC, and validated with Ansible-driven configuration management—mirroring how real-world cloud platforms are built and operated.
Alongside this, I build reusable GitHub Actions, Terraform modules, and data engineering pipelines for AWS Glue, Snowflake, BigQuery, and Azure Data Factory.
- Multi-cloud Infrastructure as Code (Terraform, HCP Terraform, GitHub OIDC)
- Serverless & Event-Driven Architectures (Lambda, Glue, Kinesis, Pub/Sub, Dataflow)
- Data Engineering Platforms (Snowflake, BigQuery, Athena, Glue, DMS)
- CI/CD & Platform Engineering (GitHub Actions, reusable workflows, DevContainers)
- Security & Observability (OIDC, IAM federation, Honeycomb, Splunk, lineage tracking)
I actively maintain a broad certification portfolio across AWS, Azure, GCP, Snowflake, GitHub, and Terraform, using them as a way to validate and deepen real-world engineering skills—not just theory.
To design and operate cloud platforms that are secure, automated, observable, and scalable by default—and to build public, open-source projects that demonstrate what modern cloud engineering really looks like in practice.
Legend: ⚪ Initialized 🟡 In Progress 🟢 Complete 🔴 Blocked
Update Age: 
| Repository | Description | Status | Stats |
|---|---|---|---|
image-labeling |
This project demonstrates how to build a simple image labeling pipeline using AW... Current - Stack created. Next - Fix the S3 notification |
🟡 |  4 •  3 •  0 •  177 KB |
event-driven-etl-automation |
Event-driven, serverless ETL pipeline on AWS that automates data ingestion, tran... Current - Repository Initialized. Next - Create the entire stack. |
⚪ | 4 • 3 • 0 • 166 KB |
aws-snowflake-e2e-project |
End-to-end Snowflake data engineering project: layered stage/raw/curated design,... Need to progress further with the Udemy course resource. |
🟢 | 3 • 3 • 0 • 185 KB |
| Repository | Description | Status | Stats |
|---|---|---|---|
aws-athena-iceberg-demo |
A hands-on demo showcasing Apache Iceberg tables on Amazon S3 queried using Amaz... Done - S3 bucket created. Next - Create Athena tables |
🟡 | 4 • 3 • 0 • 172 KB |
| Repository | Description | Status | Stats |
|---|---|---|---|
databricks-terraform-bootstrap |
Terraform-based bootstrap for provisioning a Databricks workspace, clusters, and... Not Available |
⚪ | 3 • 3 • 0 • 198 KB |
| Repository | Description | Status | Stats |
|---|---|---|---|
gcp-webhook-to-slack-function |
Provision a Google Cloud project and deploy a Python HTTP Cloud Function with Te... Not Available |
⚪ | 3 • 3 • 0 • 166 KB |
| Repository | Description | Status | Stats |
|---|---|---|---|
snowflake-de-environment-setup |
Environment setup demo for Snowflake Data Engineering labs, including roles, war... Not Available |
⚪ | 2 • 1 • 0 • 61 KB |
snowflake-de-semi-structured-json |
Demo project showcasing querying, flattening, and transforming semi-structured J... Not Available |
⚪ | 2 • 1 • 0 • 62 KB |
| snowflake-de-iceberg-tables |
Hands-on demo for creating and querying Apache Iceberg tables in Snowflake, incl... Not Available |
⚪ | 2 • 2 • 0 • 61 KB |
| snowflake-de-external-data-lake |
Demonstrates Snowflake data lake patterns using external stages, external tables... Not Available |
⚪ | 2 • 1 • 0 • 61 KB |
| snowflake-de-snowpipe-ingestion |
End-to-end Snowpipe demo showing automated file ingestion from stages into Snowf... Not Available |
⚪ | 2 • 2 • 0 • 61 KB |
| snowflake-de-json-loading |
Demo focused on loading semi-structured JSON files into Snowflake using stages, ... Not Available |
⚪ | 2 • 1 • 0 • 61 KB |
| snowflake-de-batch-ingestion |
Batch ingestion and ELT demo covering file loading, JSON parsing, schema detecti... Not Available |
⚪ | 2 • 1 • 0 • 61 KB |
| snowflake-de-scripting-procedures |
Snowflake Scripting demo showcasing stored procedures, loops, exception handling... Not Available |
⚪ | 2 • 1 • 0 • 61 KB |
| snowflake-de-udf-extensibility |
Demonstrates Snowflake extensibility features including SQL UDFs, Python UDFs, a... Not Available |
⚪ | 2 • 1 • 0 • 61 KB |
| snowflake-de-data-exchange |
Demo exploring Snowflake Marketplace and Data Exchange, including querying and d... Not Available |
⚪ | 2 • 1 • 0 • 61 KB |
| snowflake-de-snowpark-notebooks |
Introduction to Snowpark using notebooks, showing data processing and transforma... Not Available |
⚪ | 2 • 1 • 0 • 61 KB |
| snowflake-de-unstructured-data |
Demo for working with unstructured data using directory-enabled stages, scoped U... Not Available |
⚪ | 2 • 1 • 0 • 61 KB |
| snowflake-de-llm-functions |
Hands-on demo using Snowflake Large Language Model functions for text analysis, ... Not Available |
⚪ | 2 • 1 • 0 • 61 KB |
| snowflake-de-unstructured-pipelines |
Pipeline automation demo combining unstructured data processing with Snowflake t... Not Available |
⚪ | 2 • 1 • 0 • 61 KB |
snowflake-de-dynamic-tables |
Comprehensive demo of Snowflake Dynamic Tables including chaining, joins, refres... Not Available |
⚪ | 2 • 2 • 0 • 61 KB |
| snowflake-de-lakehouse-pipeline |
End-to-end Snowflake Lakehouse pipeline demo covering bronze, silver, and gold l... Not Available |
⚪ | 2 • 1 • 0 • 61 KB |
| snowflake-de-query-optimization |
Demo highlighting Snowflake SQL best practices for high-performance queries, pru... Not Available |
⚪ | 2 • 1 • 0 • 61 KB |
| snowflake-de-performance-toolkit |
Performance analysis demo using Snowflake query history, tuning metrics, and wor... Not Available |
⚪ | 2 • 1 • 0 • 61 KB |
| snowflake-de-performance-scenarios |
Scenario-based performance troubleshooting demo covering investigation, optimiza... Not Available |
⚪ | 2 • 1 • 0 • 61 KB |
| snowflake-de-clustering-mv |
Demo showcasing table clustering strategies and materialized views for query per... Not Available |
⚪ | 2 • 1 • 0 • 61 KB |
| snowflake-de-data-unload |
Demonstrates unloading structured Snowflake data into JSON files using internal ... Not Available |
⚪ | 2 • 1 • 0 • 61 KB |
| snowflake-de-observability-alerts |
Management and observability demo using alerts, notifications, and monitoring pa... Not Available |
⚪ | 2 • 1 • 0 • 61 KB |
| snowflake-de-alerting-framework |
Advanced metadata-driven alerting framework demo using tables, alerts, tasks, an... Not Available |
⚪ | 2 • 1 • 0 • 61 KB |
| snowflake-de-data-metrics |
Demo for creating and using Data Metric Functions (DMFs) to measure data quality... Not Available |
⚪ | 2 • 2 • 0 • 61 KB |
snowflake-de-azure-iceberg-tables |
Terraform-based reference implementation for building Snowflake Data Engineering... Not Available |
⚪ | 1 • 1 • 0 • 125 KB |
| snowflake-de-dynamic-table-basic |
🎯Dynamic Table Lab 1: Implement Basic Dynamic Table with Incremental Refresh Not Available |
⚪ | 2 • 1 • 0 • 60 KB |
snowflake-de-basic-snowpipe |
Terraform-first implementation of Snowflake Basic Snowpipe, demonstrating infras... Not Available |
⚪ | 2 • 1 • 0 • 113 KB |
| Repository | Description | Status | Stats |
|---|---|---|---|
terraform-gcp-lab-01-gce |
This repository is part of a hands-on Terraform learning series for Google Cloud... Not Available |
⚪ | 3 • 2 • 0 • 274 KB |
| Repository | Description | Status | Stats |
|---|---|---|---|
s3-storage-best-practice |
S3 Security Best Practices using Terraform. Terraform test not added to CI pipeline |
🟡 | 1 • 1 • 0 • 233 KB |
| Repository | Description | Status | Stats |
|---|---|---|---|
snowflake-dynamic-table-tutorial |
Hands-on tutorial demonstrating Snowflake Dynamic Tables with incremental refres... CI/CD Failing. |
🟠 | 1 • 0 • 0 • 87 KB |
| snowflake-dynamic-table-pipeline |
🎯 End-to-end Snowflake Dynamic Table pipeline showcasing automated ingestion, tr... Not Available |
🟡 | 2 • 1 • 0 • 25 KB |
snowflake-iceberg-table-tutorial |
🎯 Hands-on tutorial repository demonstrating how to create and manage Snowflake ... Not Available |
⚪ | 3 • 0 • 0 • 185 KB |
| snowflake-external-table-csv-tutorial |
🎯 This repository provides a step-by-step guide to implementing Snowflake Extern... S3 bucket,Database, Schama, File Format and External Stage created. |
🟡 | 2 • 0 • 0 • 209 KB |
| snowflake-external-table-json-tutorial |
🎯 This tutorial demonstrates how to implement Snowflake External Tables on semi-... Ready to start working on this repo. |
🟡 | 2 • 0 • 0 • 209 KB |
| snowflake-external-table-partition-tutorial |
🎯 Hands-on tutorial repository demonstrating how to create and manage Snowflake ... Not Available |
⚪ | 2 • 0 • 0 • 209 KB |
snowflake-external-table-parquet-tutorial |
🎯 This repository provides a step-by-step guide to implementing Snowflake Extern... Not Available |
⚪ | 2 • 0 • 0 • 29 KB |
| snowflake-snowpipe-dynamic-table-pipeline |
🎯 End-to-end Snowflake data pipeline using External Stage and Snowpipe for autom... This is the pipeline of DE Simplified Dynamic Table masterclass - section 5 |
⚪ | 2 • 0 • 0 • 35 KB |
| Repository | Description | Status | Stats |
|---|---|---|---|
checkov-report-action |
✅ GitHub JavaScript Action - Print Checkov Scan Report Not Available |
🟡 | 3 • 1 • 0 • 465 KB |
| tf-validate-action |
GitHub Composite Action - Terraform Format Check and Validation. Not Available |
🟢 | 2 • 1 • 0 • 385 KB |
| branch-issue-action |
✅ GitHub Composite Action - Check Branch Issue, to prevent pushing the code to a...  Not Available |
🟢 | 1 • 0 • 0 • 152 KB |
| tf-lint-action |
✅ GitHub Composite Action - Terraform Lint. Not Available |
🟢 | 3 • 2 • 0 • 158 KB |
| tf-plan-action |
✅ GitHub Composite Action - Terraform Plan. Current - Working for AWS,Azure, GCP, Databricks. Next-Test for Snowflake |
🟢 | 5 • 5 • 0 • 402 KB |
| tf-apply-action |
✅ GitHub Composite Action - Terraform Apply. Not Available |
🟢 | 4 • 2 • 0 • 183 KB |
| tf-destroy-action |
GitHub Composite Action - Terraform Destroy. Not Available |
🟢 | 6 • 5 • 0 • 221 KB |
tf-yor-action |
GitHub Composite Action - Add Git metadata tags . Not Available |
🟡 | 7 • 6 • 0 • 224 KB |
create-release-action |
GitHub Composite Action - Create Draft Release with a clickable link to create t... Not Available |
🟢 | 4 • 3 • 0 • 215 KB |
| Repository | Description | Status | Stats |
|---|---|---|---|
| github-action-template |
✅ GitHub Composite Action: A Starter Template for GitHub Composite Action Not Available |
🟢 | 1 • 0 • 0 • 316 KB |
| Repository | Description | Status | Stats |
|---|---|---|---|
terraform-destroy-wf |
GitHub Reusable Workflow to tear down a stack using Terraform Destroy Not Available |
🟢 | 5 • 4 • 0 • 145 KB |
| tf-ci-reusable-wf |
GitHub Reusable Workflow: CI Pipeline using Terraform as IaC Current - Working for AWS,Azure, GCP, Databricks. Next-Test for Snowflake |
🟢 | 1 • 0 • 0 • 244 KB |
slack-notification-wf |
GitHub Reusable Workflow : Send Slack Notification on opening an issue of pull r... Not Available |
🟢 | 2 • 1 • 0 • 418 KB |
| tf-release-wf |
GitHub Reusable Workflow: Terraform Release Not Available |
🟢 | 8 • 7 • 0 • 273 KB |
| tf-deploy-multi-reusable-wf |
GitHub Reusable workflow to deploy a stack using Terraform multi-cloud environme... Not Available |
🔵 | 4 • 3 • 0 • 283 KB |
| Repository | Description | Status | Stats |
|---|---|---|---|
terraform-snowflake-warehouse |
✅ Terraform module to manage Snowflake warehouses with configurable sizing, scal... Working as expected. |
🟢 | 3 • 2 • 0 • 291 KB |
terraform-snowflake-external-volume |
Terraform module to manage Snowflake external volume. Not Available |
⚪ | 4 • 3 • 0 • 132 KB |
| terraform-snowflake-dynamic-table |
✅ Terraform module to manage Snowflake dynamic table. Working as expected. |
🟢 | 3 • 2 • 0 • 237 KB |
| terraform-snowflake-database-schema |
✅ Terraform module to create and manage Snowflake databases and schemas using in... Working as expected. |
🟢 | 3 • 2 • 0 • 174 KB |
terraform-snowflake-file-format |
✅ Terraform module to manage Snowflake file format (CSV / JSON / Parquet) Working as expected. |
🟢 | 3 • 2 • 0 • 152 KB |
| terraform-snowflake-storage-integration |
✅ Terraform module to manage Snowflake storage integration. Working as expected. |
🟢 | 3 • 2 • 0 • 183 KB |
| terraform-snowflake-pipe |
✅ Terraform module to manage Snowflake pipe. Working as expected. |
🟢 | 3 • 2 • 0 • 160 KB |
| terraform-snowflake-task |
✅ Terraform module to manage Snowflake task. Not Available |
🟡 | 2 • 0 • 0 • 280 KB |
| terraform-snowflake-stage |
✅ Terraform module to manage Snowflake internal and external stage. Working as expected. |
🟢 | 3 • 2 • 0 • 160 KB |
| terraform-snowflake-stream |
🎯 Terraform module to manage Snowflake stream. Need to start working on this repository. |
⚪ | 2 • 1 • 0 • 184 KB |
| terraform-snowflake-table |
✅ Terraform module to manage Snowflake table. Working as expected. |
🟢 | 3 • 2 • 0 • 175 KB |
| terraform-snowflake-seed-data |
✅ Terraform Snowflake module to execute controlled SQL (INSERT, UPDATE, MERGE) f... Working as expected. |
🟢 | 1 • 0 • 0 • 127 KB |
| Repository | Description | Status | Stats |
|---|---|---|---|
terraform-snowflake-module-template |
✅ Terraform Snowflake module GitHub repository template Not Available |
🟢 | 3 • 2 • 0 • 372 KB |
terraform-aws-module-template |
Terraform AWS Module Template Not Available |
🟢 | 5 • 4 • 0 • 258 KB |
| Repository | Description | Status | Stats |
|---|---|---|---|
| terraform-aws-s3 |
✅ Terraform AWS Module for S3 Bucket Not Available |
🟢 | 3 • 2 • 0 • 233 KB |
| terraform-aws-iam |
✅ Terraform AWS Module for IAM Working as expected |
🟢 | 3 • 2 • 0 • 161 KB |
| terraform-aws-sns-topic |
Terraform AWS Module for SNS Topic Not Available |
⚪ | 5 • 4 • 0 • 133 KB |
Last generated: 2026-03-03 04:14:15 EST
Total repositories: 75