Wavicle Data Solutions

Lead Data Engineer

LinkedIn

LinkedIn Learning Instructor

Globant

Senior Data Engineer

CRISIL Limited

Senior Analyst - Data Engineer

Quantiphi

Data Engineer

Tata Consultancy Services

System Engineer

Assistant System Engineer

Assistant System Engineer - Trainee

InsideSherpa

KPMG Data Analytics Consulting Virtual Internship

Monisha Enterprises

•	Data mining and Extraction Transformation Loading using R programming.
•	Data cleaning and processing for Data analysis done using Python using NumPy, pandas, SciPy, Scikit. Data modelling and prediction was done using algorithms – Logistic Regression, Time Series Forecasting, Clustering and Classification.
•	Data Visualization done using Tableau for generating reports to enhance the productivity of the products.
•	Built a Data Warehouse on MSSQL Server for ERP System of the enterprise to organize the data for future processing.

Data Analyst Intern

Open to Collaborate | Storyteller | Lead Data Engineer@Wavicle| Linkedin Top Voice 2024 | Globant | Linkedin Learning Instructor | 2xGCP & AWS Certified | LICAP'2022

Data Engineer with 7+ years of experience working on data engineering, analysis, and modelling projects for various domains, such as banking, healthcare, sales, and e-commerce. I leverage my strong statistical and analytical ability to explore business ideas and provide innovative solutions. 

Skilled with technologies and strong intellect with enthusiasm as an avid learner with challenging opportunities. I’m working as a LinkedIn Learning Instructor to bring change as a data evangelist.

Post Graduated in Master of Technology in Data Science and Engineering from Birla Institute of Technology and Science, Pilani in 2023, where I learned advanced concepts and techniques in data science and engineering, machine learning, cloud computing, and visualization. 

I hold multiple certifications in GCP, AWS, and Azure, and I enjoy working with cloud technologies and big data platforms.

I am passionate about data science and women empowerment, and I have been recognized as the 
- Linkedin Top Voice 2024 
- Data Science and Women Empowerment Thought Leader by Global AI Hub. 

I am also a proud participant of the LinkedIn Creator Accelerator Program 2022, where I share my insights and experiences with the data science community. 

I am open to collaborate and share ideas, or explore various opportunities in the data field.

Pooja Jain

73% of data pipeline failures happen because of dependency issues, not bad code.
Cron jobs don't care if yesterday's data never arrived. They'll happily run on empty tables and produce garbage.

Airflow? It checks, retries, alerts, and refuses to cascade your failure downstream.

→ Beyond scheduling Airflow gives an important feature of 𝗗𝗔𝗚𝘀(𝗗𝗶𝗿𝗲𝗰𝘁 𝗔𝗰𝘆𝗰𝗹𝗶𝗰 𝗚𝗿𝗮𝗽𝗵𝘀), that helps to monitor, retry and gives flexibility to organize pipelines with minimum/less code.

🤔 Data Engineers often misinterpret Airflow just as an orchestration tool.

Apache Airflow is an open-source platform designed to programmatically author, schedule, retry and monitor workflows. 

🎼Think of it as the "conductor of an orchestra", where each musician (your data tasks, like data extraction, transformation, loading, or model training) knows when to play, what to play, and what happens if they make a mistake.

Most data engineers automate the wrong things at the wrong time.

Here's the framework I use after 8 years of building production systems:
✅ AUTOMATE WHEN: 
→ Task runs daily/weekly 
→ Human errors cause outages 
→ Work blocks other priorities
→ Team growth = more manual work
Examples: Reports, schema checks, alerts

❌ DON'T AUTOMATE WHEN: 
→ Task happens quarterly 
→ Requirements change weekly 
→ Process isn't understood yet 
→ Manual steps reveal insights

My rule: If it’s done 3+ times, script it; 10+ times, automate it; fails 5+ times, redesign it.
Automate what matters, when it matters—not everything!

Airflow isn’t just about running tasks.

🕑 It’s about building trustworthy, scalable, and observable pipelines that run reliably at 2am — even when you’re not watching.

Airflow gives structure to your chaos.
DAGs give clarity to your pipelines. 
That’s why DEs love them ❤️

Real Example: 
Instead of: 
❌ Cron jobs that fail silently 
❌ Manual dependency management
❌ No visibility into failures
You get: 
✅ Visual workflow monitoring 
✅ Automatic failure notifications
✅ Smart task scheduling 
✅ Easy debugging & restarting

Here's an amazing Airflow cheatsheet with some fundamentals concepts and interview questions to prepare for data engineers. 👇

Carousel Credits -  Futurense.com

Willing to learn more, here's the link to Astronomer free learning path - https://lnkd.in/g8-EWBda

Also, level up with Marc Lamberti's Udemy course on Airflow 3 - https://lnkd.in/gwArwaME

Airflow

Software Prain

- Experience with Jakarta EE and Java SE version 8, 11, 17
- Experience with MySQL, PostgreSQL, SQL Server, Oracle and Mongo DB Databases.
- Experience with Spring MVC Web applications and Spring Boot with Microservices.
- Web services software architecture and design (REST/SOAP).
- Maintain and create new API's to deliver data models.
- Experience in configuration platforms (Maven, Gradle, Jenkins).
- Requirements analysis and application design. 
- Unit testing of applications with JUnit
- Revamping various Java applications developed with Spring, Hibernate and J2EE.
- Release and deployment including Docker and Kubernetes.
- Analyze data storage needs and design relevant databases.
- Interactive and custom web applications in Angular, JavaScript, HTML, CSS, Bootstrap , Angular
- Technical support and application maintenance.
- Experience with AWS and Azure cloud platforms. 
- Experience with the serverless paradigm and with tools like Serverless and AWS Lambda.
- Refactoring and designing the system to migrate to a service-based architecture in preparation for scaling and increasing data flow.
- Improving cloud storage configuration to provide scalability for integration services.
- Optimizing application performance and security and implementing test loads to ensure performance during workload changes.

Java Developer

Data Engineering LATAM

- Coordinate the activities of the Python and Azure Groups: getting Speakers for the study sessions; Establish the agenda for the study sessions, promote each session with its advertising pieces and update the Community's GitHub repository.
- Create content on everything related to Data Science to upload to the different social networks of the Community.

Volunteer

I'm a Back-End Developer, I present custom application solutions focused on different platforms.

I started doing an E-commerce course and ended up writing my first lines of code in C++ 💜.

#𝚒𝚗𝚌𝚕𝚞𝚍𝚎𝚎<𝚒𝚘𝚜𝚝𝚛𝚎𝚊𝚖>

𝚒𝚗𝚝 𝚖𝚊𝚒𝚗(){
    𝚜𝚝𝚍::𝚌𝚘𝚞𝚝 << "𝙷𝚎𝚕𝚕𝚘 𝚆𝚘𝚛𝚕𝚍!" << 𝚜𝚝𝚍::𝚎𝚗𝚍𝚕;
    𝚛𝚎𝚞𝚝𝚞𝚞𝚛𝚗 0;
}

Every project involves an analysis of what is required, followed by the consolidation of the tools among them the main one such as Documentation; to reach the result according to the established needs. This is my step by step in the creation of each project I have developed.

𝗔𝗹𝘄𝗮𝘆𝘀 𝗱𝗲𝘃𝗲𝗹𝗼𝗽𝗶𝗻𝗴 𝗮𝗻𝗱 𝗶𝗺𝗽𝗿𝗼𝘃𝗶𝗻𝗴 𝘁𝗼 𝗲𝘃𝗼𝗹𝘃𝗲.

For Consulting, Speaker, Freelance contact me through: 

E-mail: 📩 paulabad76@gmail.com 

Or Send me a DM 🗣️

taplio

The Battle

Pooja Jain

Paula Abad

Followers

Posts

Engagements

Likes

Performance ScorePooja Jain's LinkedIn Performance

Ready to grow your LinkedIn presence?

taplio

The Battle

Pooja Jain

Paula Abad

Followers

Posts

Engagements

Likes

Performance Score.css-goub6s{font-size:var(--chakra-fontSizes-md);font-weight:500;color:var(--chakra-colors-gray-600);display:block;margin-top:var(--chakra-space-1);}Pooja Jain's LinkedIn Performance

Ready to grow your LinkedIn presence?

Performance ScorePooja Jain's LinkedIn Performance