Week 9 Worklog

Week 9 Objectives:

  • Connect and get acquainted with members of First Cloud AI Journey.
  • Understand basic AWS services, how to use the console & CLI.

Tasks to be carried out this week:

Day Task Start Date Completion Date Reference Material
2 - Learn Introduction to Kubernetes and container orchestration
- Master Amazon EKS (Elastic Kubernetes Service) fundamentals
- Understand CI/CD pipelines with AWS CodePipeline for EKS
- Practice:
  + Introduction to Kubernetes:
   - Understand Kubernetes architecture and components
   - Learn about pods, deployments, and services
   - Configure kubectl CLI tool
   - Deploy sample applications to Kubernetes
   - Manage Kubernetes resources and namespaces
   - Understand ConfigMaps and Secrets
   - Implement health checks and readiness probes
   - Monitor Kubernetes cluster and workloads
  + Amazon EKS CI/CD with CodePipeline:
   - Prepare EKS cluster prerequisites
   - Create IAM roles for CodePipeline and CodeBuild
   - Modify aws-auth ConfigMap for permissions
   - Fork sample repository for deployment
   - Generate GitHub access tokens
   - Set up AWS CodePipeline for EKS deployments
   - Configure CodeBuild for container image builds
   - Trigger automated releases via GitHub commits
   - Monitor pipeline executions and deployments
   - Implement GitOps workflows for Kubernetes
11/03/2025 11/03/2025 Introduction to Kubernetes
Container orchestration


EKS CI/CD with CodePipeline
Automated deployments
3 - Learn Introduction to Amazon EKS Blueprints
- Master infrastructure-as-code patterns for EKS
- Understand EKS cluster provisioning with Terraform and CDK
- Practice:
  + Introduction to EKS Blueprints:
   - Understand EKS Blueprints architecture and concepts
   - Learn about add-ons and team management
   - Configure VPC for EKS clusters
   - Set up Application Load Balancer (ALB)
   - Deploy EC2 Kubernetes workers
   - Understand EKS control plane and data plane
   - Implement cluster autoscaling
   - Configure storage classes and persistent volumes
   - Set up monitoring and logging with CloudWatch
   - Implement RBAC and IAM for EKS
   - Deploy common EKS add-ons (metrics-server, cluster-autoscaler)
   - Understand GitOps patterns with ArgoCD/Flux
   - Implement multi-tenancy with namespaces
   - Apply security best practices for EKS
11/04/2025 11/04/2025 Introduction to EKS Blueprints
Infrastructure patterns
4 - Learn CI/CD on Amazon EKS with CodePipeline and GitHub
- Master AWS Lambda serverless computing
- Understand serverless application deployment patterns
- Practice:
  + CI/CD on EKS with CodePipeline:
   - Set up prerequisites for EKS CI/CD
   - Create CodePipeline for EKS deployments
   - Integrate GitHub with CodePipeline
   - Configure CodeBuild for container builds
   - Implement automated testing in pipeline
   - Deploy applications to EKS via pipeline
   - Set up pipeline notifications and monitoring
   - Implement rollback strategies
   - Monitor deployment health and logs
  + AWS Lambda Workshop:
   - Understand Lambda function fundamentals
   - Create and deploy Lambda functions
   - Configure triggers and event sources
   - Implement Lambda with API Gateway
   - Set up Lambda layers for dependencies
   - Configure environment variables and secrets
   - Implement error handling and retries
   - Monitor Lambda with CloudWatch Logs
   - Optimize Lambda performance and costs
   - Apply serverless best practices
11/05/2025 11/05/2025 CI/CD on EKS
CodePipeline and GitHub


AWS Lambda Workshop
Serverless computing
5 - Learn Red Hat OpenShift Service on AWS (ROSA)
- Master AWS Data Lake architecture and implementation
- Understand container orchestration with OpenShift
- Practice:
  + Red Hat OpenShift Service on AWS:
   - Understand ROSA architecture and benefits
   - Set up prerequisites for ROSA deployment
   - Deploy ROSA cluster on AWS
   - Configure cluster networking and security
   - Deploy applications on OpenShift
   - Implement OpenShift operators
   - Configure persistent storage
   - Set up monitoring and logging
   - Manage cluster scaling and upgrades
  + AWS Data Lake Implementation:
   - Understand Data Lake architecture and concepts
   - Design S3-based Data Lake structure
   - Implement S3 security best practices
   - Configure S3 bucket policies and ACLs
   - Set up data cataloging with AWS Glue
   - Implement data partitioning strategies
   - Configure Amazon Athena for querying
   - Set up AWS Lake Formation for governance
   - Implement data encryption and access control
   - Monitor and optimize Data Lake performance
11/06/2025 11/06/2025 Red Hat OpenShift on AWS
ROSA deployment


AWS Data Lake
S3 security practices
6 - Learn building advanced Data Lakes with AWS
- Master Analytics on AWS with comprehensive data pipeline
- Understand end-to-end data analytics architecture
- Practice:
  + Building Data Lake with Your Data:
   - Design scalable Data Lake architecture
   - Implement data ingestion pipelines
   - Configure S3 storage tiers and lifecycle policies
   - Set up data cataloging and metadata management
   - Implement data quality and validation
   - Configure AWS Glue ETL jobs
   - Apply data transformation workflows
   - Implement data lineage tracking
   - Set up data access patterns
  + Analytics on AWS Workshop:
   - Build end-to-end analytics pipeline
   - Configure Amazon RDS for transactional data
   - Set up Amazon Redshift for data warehousing
   - Implement Amazon EMR for big data processing
   - Configure Amazon Kinesis for streaming analytics
   - Set up Amazon QuickSight for visualization
   - Implement real-time and batch analytics
   - Configure data pipeline orchestration
   - Optimize query performance
   - Apply analytics best practices
11/07/2025 11/07/2025 Building Data Lake
Advanced implementation


Analytics on AWS
Comprehensive pipeline

Week 9 Achievements:

  • Introduction to Kubernetes Mastery:

    • Mastered Kubernetes architecture and core components
    • Successfully understood pods, deployments, and services
    • Configured and used kubectl CLI tool effectively
    • Deployed sample applications to Kubernetes clusters
    • Managed Kubernetes resources and namespaces
    • Implemented ConfigMaps and Secrets for configuration
    • Set up health checks and readiness probes
    • Monitored Kubernetes cluster and workload performance
    • Applied best practices for container orchestration
  • Amazon EKS CI/CD Pipeline Expertise:

    • Mastered Amazon EKS cluster setup and configuration
    • Successfully created IAM roles for CodePipeline and CodeBuild
    • Modified aws-auth ConfigMap for proper RBAC permissions
    • Forked and configured GitHub repositories for deployments
    • Generated GitHub access tokens for pipeline integration
    • Set up AWS CodePipeline for automated EKS deployments
    • Configured CodeBuild for containerized application builds
    • Triggered automated releases via GitHub commits
    • Monitored pipeline executions and deployment status
    • Implemented GitOps workflows for Kubernetes deployments
    • Applied best practices for CI/CD on Kubernetes
  • Amazon EKS Blueprints Infrastructure Mastery:

    • Mastered EKS Blueprints architecture and patterns
    • Successfully understood add-ons and team management concepts
    • Configured VPC networking for EKS clusters
    • Set up Application Load Balancer for ingress
    • Deployed and managed EC2 Kubernetes worker nodes
    • Understood EKS control plane and data plane separation
    • Implemented cluster autoscaling for dynamic workloads
    • Configured storage classes and persistent volumes
    • Set up monitoring and logging with CloudWatch integration
    • Implemented RBAC and IAM roles for secure access
    • Deployed essential EKS add-ons (metrics-server, cluster-autoscaler)
    • Understood GitOps deployment patterns
    • Implemented multi-tenancy using namespaces
  • CI/CD on Amazon EKS Expertise:

    • Mastered CI/CD setup for EKS with CodePipeline
    • Successfully created automated deployment pipelines
    • Integrated GitHub with AWS CodePipeline
    • Configured CodeBuild for containerized builds
    • Implemented automated testing in CI/CD pipeline
    • Deployed applications to EKS via automated pipelines
    • Set up pipeline notifications and monitoring
    • Implemented rollback strategies for deployments
    • Monitored deployment health and logs
  • AWS Lambda Serverless Computing Mastery:

    • Mastered Lambda function fundamentals and architecture
    • Successfully created and deployed Lambda functions
    • Configured event triggers and sources
    • Integrated Lambda with API Gateway
    • Implemented Lambda layers for shared dependencies
    • Configured environment variables and secrets management
    • Implemented error handling and retry mechanisms
    • Monitored Lambda functions with CloudWatch Logs
    • Optimized Lambda performance and cost efficiency
  • Red Hat OpenShift Service on AWS (ROSA) Expertise:

    • Mastered ROSA architecture and benefits
    • Successfully set up ROSA deployment prerequisites
    • Deployed ROSA clusters on AWS infrastructure
    • Configured cluster networking and security
    • Deployed containerized applications on OpenShift
    • Implemented OpenShift operators for application management
    • Configured persistent storage for stateful applications
    • Set up monitoring and logging for OpenShift clusters
    • Managed cluster scaling and version upgrades
  • AWS Data Lake Implementation Mastery:

    • Mastered Data Lake architecture and design patterns
    • Successfully designed S3-based Data Lake structures
    • Implemented S3 security best practices
    • Configured S3 bucket policies and access controls
    • Set up data cataloging with AWS Glue
    • Implemented data partitioning for query optimization
    • Configured Amazon Athena for SQL-based querying
    • Implemented AWS Lake Formation for data governance
    • Applied data encryption and access control mechanisms
    • Monitored and optimized Data Lake performance
  • Advanced Data Lake Building Expertise:

    • Mastered scalable Data Lake architecture design
    • Successfully implemented data ingestion pipelines
    • Configured S3 storage tiers and lifecycle policies
    • Set up comprehensive data cataloging and metadata management
    • Implemented data quality and validation frameworks
    • Configured AWS Glue ETL jobs for transformation
    • Applied complex data transformation workflows
    • Implemented data lineage tracking
    • Set up efficient data access patterns
    • Applied performance optimization techniques
  • Analytics on AWS Comprehensive Mastery:

    • Mastered end-to-end analytics pipeline architecture
    • Successfully configured Amazon RDS for transactional data
    • Set up Amazon Redshift for data warehousing
    • Implemented Amazon EMR for big data processing
    • Configured Amazon Kinesis for streaming analytics
    • Set up Amazon QuickSight for data visualization
    • Implemented both real-time and batch analytics
    • Configured data pipeline orchestration
    • Optimized query performance across analytics stack