Automating RDS to S3 ETL Pipelines with Jenkins: Build a Scalable AWS Data Lake
Automate RDS exports to S3 with Jenkins, Glue Crawlers, and Athena for fast ETL, schema detection, and cost-efficient analytics.
Writing & analysis
Longer-form writing about operational trade-offs, lessons from implementation, and the decisions that make systems easier to trust.
Automate RDS exports to S3 with Jenkins, Glue Crawlers, and Athena for fast ETL, schema detection, and cost-efficient analytics.
Enhance EKS application security by integrating ALB with AWS WAF for real-time threat protection.
Deploy Loki on Amazon EKS with S3 storage for scalable, reliable, and cost-effective centralized logging.
Set up single sign-on for Apache Airflow with Keycloak to enhance security and streamline user authentication.
Securely deploy Keycloak on Kubernetes for enterprise identity management, SSO, and centralized authentication.
The challenge is managing dynamic IPs from domains.