Vivek Warkade's Linkedin Analytics

A passionate Data Engineer with a solid background in software development, experienced in building full-stack web applications and now focused on developing robust data pipelines and scalable data platforms. Over the years, I’ve worked on a variety of real-world projects—ranging from backend APIs to cloud deployments—and have naturally transitioned into the world of data engineering to solve problems at scale using data. Work & Experience: * Developed an online food ordering system with QR code-based menu access, real-time order updates, and payment integration; currently extending this with data pipelines to analyze user behavior and sales trends. * Created an email subscription system with automated campaign tracking and data storage, enhancing the ability to segment and analyze engagement metrics. * Built and deployed a Django + React e-commerce platform with real-time product updates, authentication, and API-based payment handling. * Deployed full-stack applications on AWS (EC2, S3, RDS) using Docker, Nginx, and Gunicorn—now repurposing this infrastructure for building ETL workflows and data lakes. Key Expertise: Data Engineering: * Designing and managing ETL/ELT pipelines using Python and SQL * Data processing with Pandas, NumPy, and scripting for automation * Building and orchestrating workflows using Apache Airflow (or similar) * Data integration from APIs, CSVs, databases, and cloud sources * Managing structured and semi-structured data in PostgreSQL, MySQL, MongoDB * Deploying data solutions on AWS (EC2, S3, Lambda, RDS) 🛠 Tech Stack Overview Languages: Python, SQL, JavaScript Backend: Django, FastAPI Frontend: React, Tailwind CSS Data Tools: Pandas, NumPy, Airflow, REST APIs Databases: PostgreSQL, MySQL, MongoDB Cloud & Deployment: AWS (EC2, RDS, S3, Lambda),AZURE, Docker, GitHub Actions, Vercel