About 3 years of experince in Data Engineering/ Analytics
Arizona State University
Data Engineer
Aug 2022 - Present
Orchestrated ETL operations on data from S3 data lake using Python scripts and loaded the transformed data.
Automated metadata migration from Salesforce and Google Sheets to S3, bypassing Collibra, reducing storage cost by 30%.
Developed ETL operations leveraging Python and AWS services (S3, Glue, Kinesis) for efficient data processing.
Orchestrated and scheduled data pipelines using Prefect Cloud, Jenkins, and Git, leading to a 10% increase in productivity.
Improved user engagement by 25% by developing insightful data visualizations and dashboards using ReactJS and PowerBI.
Axtria Pvt. Ltd., India (Remote, India)
Data Engineer
Aug 2021 – May 2022
Built Snowflake data warehouse using ETL pipeline. Ingested data from S3 buckets of AWS using Snowpipe, using data streams.
Executed data ingestion from Salesforce, SQL, and Redshift, facilitating the setup of Snowflake data warehouses, resulting in a 40% improvement in data accessibility and query performance.
Automated data loads and QA using Python and Airflow, replacing the manual daily data loads, improving efficiency by 70%.
Enhanced data warehousing and modeling practices, leading to optimized database structures and improved data architecture.
Generated documentation for automation of daily data load processes, including associated quality assurance for healthcare data.
Maintained and optimized Tableau dashboards, providing critical business insights to over 50 internal users.
Designed and maintained PowerBI dashboards for healthcare sales data, leading to a 40% increase in sales through KPI tracking.
Conducted data-driven client requirement analysis, recommended relevant metrics, built large data sets, achieved in-depth data analysis and data modelling, and received positive client feedback.
Implemented a new UI for a healthcare web application using MVC pattern with ReactJS from scratch, improving usability by 30%.
Developed REST APIs using JavaScript promises and Express JS, contributing to a 20% improvement in data retrieval.