Skip to content

Ta8 duomind: Data Engineering (ETL)#253

Open
abhi7b wants to merge 2 commits intoetl-ta8from
ta8-duomind
Open

Ta8 duomind: Data Engineering (ETL)#253
abhi7b wants to merge 2 commits intoetl-ta8from
ta8-duomind

Conversation

@abhi7b
Copy link
Collaborator

@abhi7b abhi7b commented Nov 19, 2024

Demonstration of the ETL process.

a. Source S3 Bucket: Stores csv file.

b. AWS Lambda Functions:

  1. Extract: Reads files from the source bucket.
  2. Transform: Processes and formats the data - appends word "transformed".
  3. Load: Writes the transformed data to the destination bucket.

c. Destination S3 Bucket: Stores the processed output csv.

Abhishek Bhatnagar added 2 commits November 17, 2024 02:10
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant