Jaya Ganesh Kumar - Portfolio

About Me

As a dedicated data engineer, I thrive on the challenge of turning raw, complex datasets into valuable insights that drive business decisions. Experienced with a range of data tools and platforms, including Apache Spark, Hadoop, AWS, Apache Airflow, and SQL Server.

Proficient in data modeling, ETL processes, and modern data warehousing techniques. I leverage cloud-based platforms and big data technologies to deliver scalable, efficient data solutions that support data-driven decision making.

My Experience Download Resume

Professional Experience

May 2025 - Present

Bengaluru, Karnataka

Data Engineer

Leading data engineering initiatives at Visa, focusing on scalable data solutions
Working with large-scale data processing and analytics platforms
Implementing modern data warehousing and ETL solutions
Collaborating on cross-functional projects to drive data-driven decision making

Jul 2023 - May 2025

Bengaluru, Karnataka

Data Analyst / Data Engineer 1

Designed & implemented web scraping solutions to extract data from 5+ websites, ensuring 98% data accuracy and reliability
Integrated scraped data into a database, reducing manual effort by 75%
Wrote and optimized 30+ SQL transformations to streamline the calculation of 10+ financial metrics, reducing manual intervention and error rates by 80%
Designed and implemented scalable data pipelines using Airflow and PySpark to extract, transform, and load data into Redshift for efficient analysis
Collaborated with four cross-functional teams to assess data needs and ensure that transformations provided accurate and relevant insights
Advanced data engineering role with increased responsibilities, leading complex data pipeline implementations and optimizations
Mentored junior team members on data engineering best practices
Implemented advanced ETL processes and data modeling techniques

Aug 2022 - Jan 2023

Remote

Data Analyst Intern

Developed an interactive dashboard using Tableau to monitor losses on day level and included filters for a deeper understanding of loss trends
Employed PySpark to optimize data processing, leading to a 40% increase in efficiency and timely data integration with Tableau
Worked on a User-experience Analytic project which predicts the number of good users blocked for a bad user
Utilized statistical models to forecast risks and guide strategic planning

Skills & Technologies

Python

Pandas, NumPy, Matplotlib, PySpark

SQL

Redshift, MySQL, BigQuery

Apache Spark

Distributed computing

Apache Airflow

Pipeline orchestration

PySpark

Large-scale data processing

ETL Processes

Extraction, Transformation, Loading

Certifications

Build a Face Recognition Application using Python

Python Certification

Advanced Python programming with focus on computer vision and face recognition algorithms

Python Crash Course

Programming Fundamentals

Comprehensive Python programming course covering core concepts and best practices

Machine Learning with Python: Zero to GBMs

Jovian

Complete machine learning course covering algorithms, model training, and deployment

Problem Solving (Basic)

Algorithmic Thinking

Fundamental problem-solving skills and algorithmic thinking for programming challenges

My Projects

Driver Alertness Prediction

An ML model to predict driver alertness using computer vision and Python libraries like OpenCV.

View Project

Airline Price Prediction

An ML model to predict airline ticket prices using Python, scikit-learn, and historical data.

View Project

Crypto Tracker

A web scraper built with Python and BeautifulSoup to track cryptocurrency data from CoinMarketCap.

View Project

Phishing Detection

An ML model using Python and machine learning algorithms to detect phishing websites based on URL features.

View Project

Farmer's Portal

A web application built with HTML, CSS, and JavaScript to provide resources and information for farmers.

View Project

Realtime Currency Converter

A Python application using APIs to provide real-time currency conversion rates.

View Project