MK
MAHENDRAKOLHE

Data Engineer

Innovating Tomorrow, Today

Results-driven Data Engineer with over 3.5+ years of experience designing scalable data pipelines, automating ETL/ELT workflows, and enabling data-driven analytics. Proficient in SQL, Python, PySpark, Azure Data Factory, Databricks, and ADLS, with expertise in real-time data processing, data quality, and data governance. Delivered high-impact cloud and on-premises solutions, achieving 40% faster pipelines and 99.9% data accuracy.

Portfolio

Creative & Professional

Experience

Data Engineer

Xcaliber Infotech
May 2023 – Present

Developed and optimized 30+ ETL pipelines using Azure Data Factory (ADF) and SSIS, integrating structured and unstructured data from multiple sources into Azure Data Lake.

Improved data processing efficiency by 30% through PySpark-based workflows in Azure Databricks, reducing transformation time and accelerating analytics readiness.

Optimized SQL queries and ETL processes, achieving up to 40% faster data retrieval via indexing, partitioning, and query performance tuning in Azure SQL Database.

Automated cloud-based data solutions using Azure Functions and Python, reducing manual intervention and improving pipeline reliability by 30%.

Collaborated with cross-functional teams to translate complex business requirements into efficient data solutions, improving report generation speed by 40% and enabling faster decision-making.

Automated file validation and reconciliation for 400K+ daily transactions, achieving 99.9% accuracy and reducing investigation time by 60% with a custom-built data lineage dashboard.

Software Developer

TeamLease
January 2021 – February 2022

Developed and maintained SSIS-based ETL pipelines and SQL Server workflows for internal products, automating data ingestion from multiple sources and improving integration efficiency.

Optimized SQL queries and implemented indexing strategies to enhance data processing performance and ensure high system uptime.

Skills

Programming & Big Data

SQL
Python
PySpark
Apache Spark
Spark SQL

Cloud & Data Platforms

Azure Data Factory
Azure Databricks
Azure Data Lake Storage

ETL & Automation

SSIS
Custom ETL/ELT Pipelines
Workflow Orchestration
Data Reconciliation

Projects

WalletWatcher

PythonSQLPandasWhatsApp API

Built WalletWatcher using Python and SQL to automatically fetch transaction-related emails, parse financial details, and store data in a structured SQL database.

Education

PG Diploma in Advanced Computing

IACSD, Pune

April 2023

Bachelor of Technology (B.Tech.)

Amravati University

June 2018

Certifications

SQL Basic and Advanced

Python Intermediate (HackerRank)

Lakehouse Fundamentals (Databricks)

Microsoft Azure Fundamentals (DP-900)

Problem Solving Profile (LeetCode)

Thank you for viewing my portfolio!

Built with passion and modern web technologies