Wavicle Data Solutions

Lead Data Engineer

LinkedIn

LinkedIn Learning Instructor

Globant

Senior Data Engineer

CRISIL Limited

Senior Analyst - Data Engineer

Quantiphi

Data Engineer

Tata Consultancy Services

System Engineer

Assistant System Engineer

Assistant System Engineer - Trainee

InsideSherpa

KPMG Data Analytics Consulting Virtual Internship

Monisha Enterprises

•	Data mining and Extraction Transformation Loading using R programming.
•	Data cleaning and processing for Data analysis done using Python using NumPy, pandas, SciPy, Scikit. Data modelling and prediction was done using algorithms – Logistic Regression, Time Series Forecasting, Clustering and Classification.
•	Data Visualization done using Tableau for generating reports to enhance the productivity of the products.
•	Built a Data Warehouse on MSSQL Server for ERP System of the enterprise to organize the data for future processing.

Data Analyst Intern

Open to Collaborate | Storyteller | Lead Data Engineer@Wavicle| Linkedin Top Voice 2024 | Globant | Linkedin Learning Instructor | 2xGCP & AWS Certified | LICAP'2022

Data Engineer with 7+ years of experience working on data engineering, analysis, and modelling projects for various domains, such as banking, healthcare, sales, and e-commerce. I leverage my strong statistical and analytical ability to explore business ideas and provide innovative solutions. 

Skilled with technologies and strong intellect with enthusiasm as an avid learner with challenging opportunities. I’m working as a LinkedIn Learning Instructor to bring change as a data evangelist.

Post Graduated in Master of Technology in Data Science and Engineering from Birla Institute of Technology and Science, Pilani in 2023, where I learned advanced concepts and techniques in data science and engineering, machine learning, cloud computing, and visualization. 

I hold multiple certifications in GCP, AWS, and Azure, and I enjoy working with cloud technologies and big data platforms.

I am passionate about data science and women empowerment, and I have been recognized as the 
- Linkedin Top Voice 2024 
- Data Science and Women Empowerment Thought Leader by Global AI Hub. 

I am also a proud participant of the LinkedIn Creator Accelerator Program 2022, where I share my insights and experiences with the data science community. 

I am open to collaborate and share ideas, or explore various opportunities in the data field.

Pooja Jain

73% of data pipeline failures happen because of dependency issues, not bad code.
Cron jobs don't care if yesterday's data never arrived. They'll happily run on empty tables and produce garbage.

Airflow? It checks, retries, alerts, and refuses to cascade your failure downstream.

→ Beyond scheduling Airflow gives an important feature of 𝗗𝗔𝗚𝘀(𝗗𝗶𝗿𝗲𝗰𝘁 𝗔𝗰𝘆𝗰𝗹𝗶𝗰 𝗚𝗿𝗮𝗽𝗵𝘀), that helps to monitor, retry and gives flexibility to organize pipelines with minimum/less code.

🤔 Data Engineers often misinterpret Airflow just as an orchestration tool.

Apache Airflow is an open-source platform designed to programmatically author, schedule, retry and monitor workflows. 

🎼Think of it as the "conductor of an orchestra", where each musician (your data tasks, like data extraction, transformation, loading, or model training) knows when to play, what to play, and what happens if they make a mistake.

Most data engineers automate the wrong things at the wrong time.

Here's the framework I use after 8 years of building production systems:
✅ AUTOMATE WHEN: 
→ Task runs daily/weekly 
→ Human errors cause outages 
→ Work blocks other priorities
→ Team growth = more manual work
Examples: Reports, schema checks, alerts

❌ DON'T AUTOMATE WHEN: 
→ Task happens quarterly 
→ Requirements change weekly 
→ Process isn't understood yet 
→ Manual steps reveal insights

My rule: If it’s done 3+ times, script it; 10+ times, automate it; fails 5+ times, redesign it.
Automate what matters, when it matters—not everything!

Airflow isn’t just about running tasks.

🕑 It’s about building trustworthy, scalable, and observable pipelines that run reliably at 2am — even when you’re not watching.

Airflow gives structure to your chaos.
DAGs give clarity to your pipelines. 
That’s why DEs love them ❤️

Real Example: 
Instead of: 
❌ Cron jobs that fail silently 
❌ Manual dependency management
❌ No visibility into failures
You get: 
✅ Visual workflow monitoring 
✅ Automatic failure notifications
✅ Smart task scheduling 
✅ Easy debugging & restarting

Here's an amazing Airflow cheatsheet with some fundamentals concepts and interview questions to prepare for data engineers. 👇

Carousel Credits -  Futurense.com

Willing to learn more, here's the link to Astronomer free learning path - https://lnkd.in/g8-EWBda

Also, level up with Marc Lamberti's Udemy course on Airflow 3 - https://lnkd.in/gwArwaME

Airflow

Standard Carpets Ind LLC

Business Intelligence Analysis.
Programming.
Technical design document.
ERP Consultant

Information Technology Consultant

Cezcon Solutions LLC

•	Data injection using power bi connector.
•	Data exploration using SQL.
•	Manipulation using Power Query.
•	Analysed and processed the data using Power BI.
•	Generating Additional Measures using DAX.
•	Visualization using Power BI
•	Automated the dashboard using Power BI gateway in
Power BI services.
•	Maintained databases and perform updates as necessary to ensure accuracy
•	Created and prepared monthly variance analysis, and gap analysis to annual budget ,including graphs,charts and root cause analysis

Senior Data Analyst

Crudx Technologies

 Performed data analysis on complicated network data 
to build risk framework based on NIST standards.
 Exposure in Hadoop hive, druid, splunk , s3, sql,sftp 
etc.
 Data collection / ingestion by ETL tool.
 Data wrangling and data pre-processing.
 Data modeling and data preparation.
 Pattern & Trend identification and analysis.
 Data visualisation by Power BI.
 Adhered to Agile methodology
 Ingestion of Big data from S3 to Data Frames, Datasets 
and rdds
 Designed , analyzed and deployed algorithms using 
Scala and Spark

Data Analyst

DrLAB - KARADAN INFINITY TECH PRIVATE LIMITED

*Researched and prepared presentations for C-level suite regarding profitability reports, policies, internal operating inefficiencies, and industry trends
Participated in product development planning, providing key insights based on predictive modeling,
*Traveled 3 of 5 days in a week to work with clients, observing business processes, interviewing staff, and documenting practices
*Conducted research, analyzed business operations, and problem solved operating inefficiencies, 
*Worked with stakeholders and clients to model and document goals, communicating transparently to meet 98% of deadlines
Modeled data to generate reports, comparing business process evolution, assisting C-level staff with appropriate KPIs based on improved operations.
*After beta launch,identified operating improvements from internal data with SQL, 
Tracked, extrapolated, and interpreted customer data using Python, SQL, and Excel to report customer behaviors.
*Analyzed financial data ,dedicated Microsoft power bi analyst with over 2 years of experience.
*Researched macroeconomic and  microeconomic conditions.
*Created dashboards that shows various business scenarios

Data analyst with 4+ years of commendable expertise.Successfully led teams in delivering appropriate technologysolutions for data analytics and data management.Comprehensive knowledge of data analysis,data wrangling,data modeling,pattern,and trend identification.Excellent knowledge in network security,telecom,utilities and insurance domains.Innovative change agent with a unique mix of high-leveltechnology direction and deep technical expertise

taplio

The Battle

Pooja Jain

Muhammad Jasin N K

Followers

Posts

Engagements

Likes

Performance ScorePooja Jain's LinkedIn Performance

Ready to grow your LinkedIn presence?

taplio

The Battle

Pooja Jain

Muhammad Jasin N K

Followers

Posts

Engagements

Likes

Performance Score.css-goub6s{font-size:var(--chakra-fontSizes-md);font-weight:500;color:var(--chakra-colors-gray-600);display:block;margin-top:var(--chakra-space-1);}Pooja Jain's LinkedIn Performance

Ready to grow your LinkedIn presence?

Performance ScorePooja Jain's LinkedIn Performance