ETL Unit Test Setup

Getting Started

This repository contains strucrure to setup ETL Unit Test environment To setup the project you can follow the following steps

Prerequisites

To install the pre-requisites, install the requirements.

• python 3.7+
• requirements

  pip install -r requirements.txt

Unit Testing

1. Start LocalStack Docker Container

docker compose up

2. Run Test

pytest test/

3. List Bucket

aws --endpoint-url=http://localhost:4566 s3api list-buckets

4. List Objects

aws --endpoint-url=http://localhost:4566 s3api list-objects --bucket raw