Setting Up CI/CD with AWS CodePipeline and GitHub

Continuous Integration and Continuous Deployment (CI/CD) has become a core part of modern DevOps practices. AWS offers a powerful, fully managed CI/CD service called AWS CodePipeline that automates the entire software release process, from source code retrieval to testing and deployment. When integrated with GitHub, the workflow becomes seamless and efficient, allowing teams to deliver updates faster with fewer manual tasks.

This guide walks you through how to set up a complete CI/CD pipeline using AWS CodePipeline + GitHub, suitable for beginners and intermediate DevOps practitioners.

What is AWS CodePipeline?

AWS CodePipeline is a fully managed CI/CD service that automates software release processes. Each time you push code to GitHub, CodePipeline can automatically:

• Pull the latest code

• Build and test the application

• Deploy it to AWS services such as EC2, S3, Lambda, or ECS

It supports integrations with CodeBuild, CodeDeploy, and third-party tools like Jenkins, GitHub Actions, SonarQube, and Slack.

Benefits of Using CodePipeline with GitHub

Architecture Overview

A common CI/CD setup using CodePipeline and GitHub looks like this:

GitHub Repo 
 ↓ (code commit) 
AWS CodePipeline 
 ↓ 
AWS CodeBuild (build & test) 
 ↓ 
AWS CodeDeploy or Lambda/ECS/EC2/S3 (deployment)

Prerequisites

Before you set up the pipeline, ensure you have:

• An AWS Account

• IAM permissions for CodePipeline, CodeBuild, and CodeDeploy

• A GitHub repository with your application code

• AWS CLI configured (optional but recommended)

Step-by-Step Guide to Setting Up CodePipeline with GitHub

Step 1: Create or Connect Your GitHub Repository

1. Log in to GitHub

2. Create a new repository or use an existing one

3. Push your application code to the main or develop branch

Your folder structure could look like this:

/app
/buildspec.yml

A buildspec.yml file is required for CodeBuild instructions.

Step 2: Create an S3 Bucket for Artifact Storage

1. Go to S3 > Create bucket

2. Give it a unique name

3. Enable versioning

4. Click Create

This bucket stores build artifacts generated during the pipeline execution.

Step 3: Create a CodeBuild Project

1. Go to CodeBuild → Create build project

2. Choose GitHub as the source provider

3. Connect GitHub with OAuth or personal access token

4. Choose environment:

   • Managed image: Ubuntu

   • Runtime: Node.js, PHP, Python, or any supported runtime

5. Add buildspec.yml inside your GitHub repo with build instructions.

Example buildspec.yml for Node.js app:

version: 0.2
phases:
  install:
    commands:
      - npm install
  build:
    commands:
      - npm run build
artifacts:
  files:
    - '**/*'

6. Create the CodeBuild project

Step 4: Create a Deployment Environment

Depending on your application type, choose a deployment target:

For example, if deploying to EC2:

• Install CodeDeploy agent on EC2

• Create IAM roles for CodeDeploy

Step 5: Create Your CodePipeline

1. Go to CodePipeline

2. Click Create Pipeline

3. Enter name and choose the S3 artifact bucket

4. Add Source stage:

   • Source Provider: GitHub

   • Connect to repo and branch

5. Add Build stage:

   • Select previously created CodeBuild project

6. Add Deploy stage:

   • Select deployment service (EC2/CodeDeploy/Lambda/ECS)

7. Review and create

Your CI/CD pipeline is now ready. AWS will start an automated pipeline every time you push changes to GitHub.

Testing the CI/CD Pipeline

1. Open your GitHub repository

2. Edit any file (e.g., README.md or application code)

3. Commit and push changes

4. Go to AWS CodePipeline

5. Observe pipeline execution across Source → Build → Deploy

If all stages succeed, your updated application is deployed automatically.

Best Practices for CI/CD with CodePipeline

• Use separate pipelines for Dev, Staging, and Production

• Enable manual approval for production deploys

• Add notifications with SNS or Slack

• Store secrets securely using AWS Secrets Manager or Parameter Store

• Add automated tests in CodeBuild for every build

Common Challenges and How to Avoid Them

Conclusion

Setting up a CI/CD pipeline using AWS CodePipeline and GitHub is one of the most efficient ways to automate application delivery. It eliminates manual deployment steps, accelerates releases, and ensures consistent build and deployment cycles. Whether you're managing small projects or large-scale enterprise applications, CodePipeline provides a scalable, secure, and fully automated DevOps workflow.