Yelp

Building Yelp’s next-gen AI agent platform: enabling users to discover businesses and take actions like requesting price quotes through generative interfaces. I lead the end-to-end vision, GTM, and execution for exposing these capabilities via our open-source MCP server and enterprise APIs, allowing external developers to build on top of Yelp’s data with agentic systems.

Alongside platform strategy, I own building the right eval systems to measure agent response quality.

Head of Product - AI Data Products

I led a team of PMs driving the vision, roadmap, and execution for Yelp’s internal data, analytics, and experimentation platforms (used by thousands of developers and analysts.) Our work powered high-scale telemetry, observability, and experimentation across mobile and web, enabling faster product decisions and more reliable infrastructure.

During this time, I improved signal quality and reduced incident volume through a company-wide observability strategy, and partnered with the C-suite to strengthen telemetry for exec-reporting. I was also responsible for driving buy-vs-build decisions for analytics tooling.

Head of Product - Experimentation and Analytics

Led product strategy for Yelp’s Ad Experiences team and launching new formats to boost ROI for enterprise advertisers. Spearheaded privacy-first attribution post-IDFA. Also led strategy and execution of robust reporting infrastructure, enabling self-serve and enterprise level Ads reporting for customers of all sizes—from medium businesses to large enterprises.

Product Lead - Ad Formats

JustAnotherPM

JustAnotherPM (JAPM) is the home for modern builders. A global brand for those who want to create lasting products, solve tough problems, and build thriving careers in tech. We serve the people behind the roadmap: the operators, thinkers, and doers who are shaping how the world works.

Our mission is to equip ambitious builders with the clarity, systems, and insight to lead, not just in their teams, but across industries. Through content, communities, and education, we’re building a trusted institution that helps you grow your impact, compound your skills, and build with intention. 

This isn’t just about product management. It’s about building a life and career that compounds.

Founder

Zomato

Led a cross-functional team of 15 focused on user growth, personalisation, and retention. Owned end-to-end user communication across push notifications, SMS, email, and in-app. Designed user journeys that prioritised relevance, timing, and value for the user. Collaborated with Data Science to build predictive segmentation models, enabling personalised communication based on user behavior and preferences. Scaled loyalty and retention systems across multiple countries, with a focus on driving repeat usage and long-term user value.

Head of Product - Retention and Growth

RateGain

Associate Vice President - Product

Senior Product Manager

Turannt

Co-Founder and CPO

Snapdeal

Product Manager

Play Games24x7 Private Limited

American Express

Led and delivered end-to-end acquisition campaigns for UK with 100% accuracy and timeliness.

Systems Analyst

Provided technical support and customized MIS to corporate clients for implementing AMEX expense management tools.

Business Analyst

Purdue University

Mentored and motivated 45 residents from diverse backgrounds, helping them create a cooperative and amiable environment.
Effectively applied advanced communication skills toward unbiased troubleshooting and resolving resident conflict issues.
Built and established a collaborative learning community, demonstrating exceptional interpersonal relations and organizational abilities in achieving goals.

Resident Assistant

Designed, developed, customized and administered Remedy-based system aligning with Incident, Problem, Change and Knowledge Management.
Customized and created Remedy workflows according to customer requirements. Followed up with customers to ensure resolution and closure of remedies. 
Advanced analysis and troubleshooting. 
Created and maintained technical documentation with respect to system design. 
LEADERSHIP

Customer Support Representative

Identified and documented customer requirements.
Collaborated resources and acted as a central point of contact for project management.
Established clear deliverables and timelines and created weekly reports on status and progress.
Developed execution strategy and devised control document on an ongoing basis.

Intern

A computer engineer and an MBA by education, Product Manager by experience, and entrepreneur by heart.

I have worked as a PM across industries for B2C, B2B and SaaS companies. In my experience, I have created products used by millions of users all over the world. 

As a Product leader, I have experience in leading product vision and strategy from ideation to execution.

My interest in data analytics, user research, and UX has helped me fuel my passion for creating world-class products. 



Two years ago, I helped a startup launch a new conversational AI feature. At launch, every metric looked good: DAUs and engagement up, longer sessions, ‘Helpfulness’ was scoring 4.2/5.

But four weeks later, we discovered the problem:  
14D and 30D 𝗿𝗲𝘁𝗲𝗻𝘁𝗶𝗼𝗻 was <5%

𝗧𝗵𝗲 𝗽𝗿𝗼𝗯𝗹𝗲𝗺? 
While, the product answered ALL of the users’ questions. And the answers 𝘴𝘰𝘶𝘯𝘥𝘦𝘥 correct. But they weren’t accurate enough to be useful. 

As a result, users never came back.

We had spent six figures and four months building a feature that users abandoned immediately.

That’s when we realised what went wrong: 
We focused on 𝗽𝗿𝗼𝗺𝗽𝘁𝗶𝗻𝗴, did “𝙫𝙞𝙗𝙚 𝙘𝙝𝙚𝙘𝙠𝙨”, and thought metrics like “𝗵𝗮𝗹𝗹𝘂𝗰𝗶𝗻𝗮𝘁𝗶𝗼𝗻” and “𝘁𝗼𝘅𝗶𝗰𝗶𝘁𝘆” were enough.

But the real challenge was not prompting. It was 𝗲𝘃𝗮𝗹𝘀 

We didn’t have an evaluation strategy. We didn’t even know how to build one.

That’s when I took Hamel H. and Shreya Shankar's course, "𝗔𝗜 𝗘𝘃𝗮𝗹𝘀 𝗳𝗼𝗿 𝗘𝗻𝗴𝗶𝗻𝗲𝗲𝗿𝘀 & 𝗣𝗠𝘀."

What I learned in that course shaped how I build AI products.

Here are my top learnings:

1. Top 1% of AI teams master one skill: 𝗔𝗽𝗽𝗹𝗶𝗰𝗮𝘁𝗶𝗼𝗻-𝗖𝗲𝗻𝘁𝗿𝗶𝗰 𝗘𝘃𝗮𝗹𝘀.
   
2. They build systems that tell them exactly WHERE the product fails to meet user needs.
   
3. Asking "Is it good?" is not enough. 
   
4. Use 𝗘𝗿𝗿𝗼𝗿 𝗔𝗻𝗮𝗹𝘆𝘀𝗶𝘀 to find the 20% of failures causing 80% of churn.
   
5. You need to 𝗱𝗲𝗳𝗶𝗻𝗲 𝘄𝗵𝗮𝘁 “𝗴𝗼𝗼𝗱” 𝗺𝗲𝗮𝗻𝘀. And then align your whole team on the definition.
   
6. 𝗕𝘂𝗶𝗹𝗱 𝗮𝘂𝘁𝗼𝗺𝗮𝘁𝗲𝗱 𝗟𝗟𝗠-𝗮𝘀-𝗷𝘂𝗱𝗴𝗲 𝗲𝘃𝗮𝗹𝘂𝗮𝘁𝗼𝗿𝘀 𝘆𝗼𝘂 𝗰𝗮𝗻 𝘁𝗿𝘂𝘀𝘁. Then validate them against human judgment to correct for bias. This enables testing at scale.

Every AI feature you ship without evals is a 𝗴𝗮𝗺𝗯𝗹𝗲. 
One failed feature can cost you 𝘀𝗶𝘅 𝗳𝗶𝗴𝘂𝗿𝗲𝘀. 
This course costs $𝟮,𝟱𝟬𝟬.

Even if it saves you from just one failure, the ROI is great.

That’s the tradeoff. And it’s obvious.

Link in comments.

P.S. Get a 𝟯𝟱% 𝗱𝗶𝘀𝗰𝗼𝘂𝗻𝘁 on the course with the link below
P.P.S Attached: cheat sheet with top my top learnings

Sid Arora

AI Product Leader. I build AI products at scale. I share what it takes to be an AI PM. Only practical, real-world advice from my experience. No-fluff, no theory.

Taplio

Sid Arora's Linkedin Analytics

What is Sid talking about?

's Best Posts (last 30 days)

Want to drive more opportunities from LinkedIn?

Taplio

.css-1jgreyo{background-image:linear-gradient(284deg, rgba(39,43,72,1) 0%, rgba(33,47,183,1) 100%);color:transparent;-webkit-background-clip:text;background-clip:text;}Sid Arora's Linkedin Analytics

What is Sid talking about?

's Best Posts .css-qqfgvy{font-size:var(--chakra-fontSizes-md);}(last 30 days)

Want to drive more opportunities from LinkedIn?

Sid Arora's Linkedin Analytics

's Best Posts (last 30 days)