I love to teach. I post about #dataengineering and #mentalhealth daily. 

Many years of data engineering experience doing growth analytics at Facebook, security infrastructure at Netflix, and pricing and availability infrastructure at Airbnb. 

You can find me by looking up EcZachly on all social networks 

Join my Data Learning Platform https://www.dataexpert.io

Zach Wilson

Databricks is going to win “data” the same way that Meta won “social media” 

They are uniquely positioned because of the convergence of a few trends:

- the death of the data analyst
We are moving away from analytical architectures and towards action-oriented architectures. Instead of “the data engineer does ETL so analysts can look at it” it will be “the data engineer creates context for AI agents to do something” Actions will reduce timelines and speed up business velocity. Humans will no longer be the analytical bottleneck. 

- the crushing of data siloes 
Open table formats like delta and iceberg will make business able to do things that were previously though impossible! We’ll finally have all the context for our AI in one place. Entire business context + Agents = a waterfall of business value! 


I’m launching a paid Databricks boot camp on February 9th. Send me a DM with the word Databricks and I’ll get you the details!

Founder @ DataExpert.io | ADHD | 500k+ followers | Angel Investor

No alternative text description for this image

My perception of tech that nobody asked for:

- Postgres: extremely positive 
- SQL Server: you’re a boomer and slow 
- Spark: extremely positive 
- MongoDB: painfully neutral 
- NextJS: positive but only for solopreneurs 
- Microsoft Fabric: very negative, quality concerns
- Databricks: extremely positive after a war 
- Snowflake: surprisingly neutral after struggle 
- Trino: extremely positive 
- Presto: angry at Facebook for the divorce 
- Airflow: very positive, need Maxime’s autograph 
- Prefect: positive, Dr Pepper vibes 
- Iceberg: the most positive vibes
- Delta: Databricks PR approved positive vibes 
- Hudi: extremely fast and speedy vibes
- OpenAI: evil vibes 
- Anthropic: friendly vibes 
- Gemini: boomer AI vibes 

What tech would you add?

The first speaker lineup for the analytics engineering boot camp is going to be so amazing! 

These sessions are what truly separates my boot camp from “just another data course”

Data modeling is far from dead! It’s actually more relevant than ever. 

There’s been an interesting shift in the seas with AI. Some people saying we don’t need to do facts and dimensions anymore. This is a wild take because product analytics don’t suddenly disappear because LLM has arrived.

It seems like to me that multi-modal LLM is bringing together the three types of data:

- structured

- semi-structured

- unstructured

Dimensional modeling is still very relevant but will need to be augmented to include semi-structured outputs from the parsing of text and image data.

The necessity for complex types like VARIANT and STRUCT seems to be rising. Which is increasing the need for data modeling not decreasing it.

It feels like some company leaders now believe you can just point an LLM at a Kafka queue and have a perfect data warehouse which is still SO far from the actual reality of where data engineering sits today

Am I missing something or is the hype train just really loud right now?

Partitions no longer being immutable in formats like Iceberg and Delta is a good thing. This new power invites a lot of bad practices:

	•	Duplicates creeping in from sloppy upserts
	•	Non-deterministic reprocessing that silently rewrites history
	•	“Fix it in place” mentalities instead of fixing upstream contracts
	•	Broken idempotency assumptions across pipelines
	•	Hidden backfills that invalidate downstream aggregates
	•	Debugging nightmares when yesterday’s data isn’t actually yesterday’s data
	•	Teams treating tables like mutable OLTP systems instead of analytical logs

This is exactly why functional data engineering still matters.

Pipelines should behave like pure functions:
	•	same inputs → same outputs
	•	explicit side effects
	•	time and state modeled, not implied

Mutable partitions don’t remove the need for discipline. They raise the bar for it.

Iceberg and Delta give you scalpels.
Functional thinking is what keeps you from using them like chainsaws

DataExpert.io got on the banned list for Outlook and Hotmail a few months ago. 

Microsoft has a "Delisting service" that you submit your IP through to get unbanned. 

They email you a link to "confirm" 

Google says "this link looks dangerous"

IT IS FROM MICROSOFT (see the no-reply at microsoft)

Email in 2026 is a cursed protocol that I will never understand

I'm doing a live with Karan Dwivedi to talk about a cybersecurity boot camp that is launching on January 9th! 

This boot camp has an amazing capstone project where you do all of these on a company server!
- threat modeling
- detection engineering
- preventative controls 

Don't miss this webinar tomorrow!

January 9th Cybersecurity Boot Camp Webinar

My ex in 2018 broke up with me because “video games are for losers” 

Video games are consistently ranked as the least attractive hobby from a woman perspective.  

This reality of the world sits so weirdly with my lived reality.  

In 2017, I was 15th in the world in Halo 5. 15th out of 10 million players or the top 0.000015% of that video game. 

In 2026, my LinkedIn account sits at about the same percentile standing as my Halo 5 account did and makes me millions per year. 

My strategy to achieve both of these results was exactly the same. Relentless obsession every single day for 3-4 years. 

I want to be the very best at whatever I put my mind to. Video games are an amazing training ground for competition.

Using video games as a tool to build your competitive or creative drive is a powerful thing. 

Using video games as an escape from reality can be damaging over the long term and this is what women are picking up on 

Becoming a winner in a low stakes environment makes it easier to become one in a high stakes environment

The number one thing holding people back is thinking they need to "be ready" to start. Great post Mike Pinckney!

A simple truth most people avoid:

Results follow belief, not the other way around.

A few reminders worth sitting with:
• Belief precedes action
• Doubt often wears the mask of logic
• You already have power to move
• Responsibility can’t be outsourced
• Information without belief doesn’t execute

You don’t need certainty to start.
You need enough belief to take the next step.

Sigmoid

- Built scalable, real-time and batch data pipelines on AWS using Lambda, Kinesis, S3, and CloudWatch with integrated alerting, reducing incident resolution time by 90%.

- Migrated 6TB+ of third-party vendor data to Snowflake using Airflow and dbt; improved reporting latency from weekly to daily with zero data loss.

- Modelled Snowflake warehouse schemas and implemented dbt tests and documentation for robust transformation workflows, ensuring >98% data quality.

- Led cross-functional Agile teams in delivery of analytics-ready datasets; collaborated with BI and product teams to integrate with Power BI dashboards.

SDE 2 - Data Engineering

Data With Danny

Community Data Mentor

Cotiviti

Senior Data Engineer

Data Analyst

Accenture

Application Development Analyst

Alphaa AI

-> Created a Sales dashboard for the Superstore chain 
-> Designed a strategy to increase sales of the superstore by X% using Goal-seek and what-if Analysis
-> Validated the strategy which was proposed using the forecasting method like Monte Carlo simulation
-> Did some data storytelling to leadership on sales of 2 months between n teams.
-> Developed a strategy to increase the sales by 40% on average and validated it using Monte Carlo simulation

Fellowship

The Sparks Foundation

Tasks were assigned which needs to be completed within the stipulated time. These tasks helped me in understanding how a data science project will be solved in the outside world.

Data Science and Business Analysis

Research Centre Imarat (Rci), A Part Of Drdo

RCI is a sister concern for DRDO. As a student Intern for RCI, I assisted the team in developing a software that enhances security features to the data files belonging to the organization. Developed software using Java, and used SHA1 encryption algorithm. The software is being used to secure the data in the server as well during transmission of file

Student Intern

Hi there! 👋 
I'm a seasoned Data Engineer with a passion for transforming raw data into meaningful insights. 💼 I'm currently on the lookout for exciting opportunities and I'm ready to hit the ground running!

🔧 Skills:
- ETL Processes
- Data Warehousing 
- SQL, Python, and Spark
- Data Modeling
- Cloud Platforms (AWS, Azure)
- Big Data Technologies
- Airflow 

💡 What I Bring:
- Proven track record in designing and implementing robust data solutions.
- Expertise in optimizing and improving data pipelines for efficiency.
- Strong problem-solving skills with a keen eye for detail.

👨‍💻 Why Me:
- I'm results-driven and thrive in dynamic environments.
- Excellent communication skills for effective collaboration.
- Adaptable and quick to learn new technologies.

🌟 Ready to Contribute:
I'm eager to contribute my skills to a team that values innovation and efficiency. If you have a challenging project or an exciting opportunity, I'm ready to make an immediate impact.

📬 Let's Connect:
If you know of any opportunities or would like to discuss how I can bring value to your team.
Please reach out to me on LinkedIn or mail me on vikramkrishna725@gmail.com

taplio

The Battle

Zach Wilson

Vikram K.

Followers

Posts

Engagements

Likes

Performance ScoreZach Wilson's LinkedIn Performance

Ready to grow your LinkedIn presence?

taplio

The Battle

Zach Wilson

Vikram K.

Followers

Posts

Engagements

Likes

Performance Score.css-goub6s{font-size:var(--chakra-fontSizes-md);font-weight:500;color:var(--chakra-colors-gray-600);display:block;margin-top:var(--chakra-space-1);}Zach Wilson's LinkedIn Performance

Ready to grow your LinkedIn presence?

Performance ScoreZach Wilson's LinkedIn Performance