As the founder of LLM Watch, my goal is to curate the most relevant Large Language Model (LLM) research and make it accessible to a broad audience. 

I distill complex technical topics into summaries that respect your time. 

Before embarking on this journey, I led Deep Learning R&D at one of Europe's largest telecom companies. There, I spearheaded numerous AI projects with a focus on Natural Language Processing (NLP) and Automatic Speech Recognition (ASR). 

With more than 6 years of experience in AI, I was there before the hype. 

I try to offer a healthy balance between shiny new things and what really matters.

Pascal Biese

Data scientists spend up to 80% of their time manually crafting features. What if an agent could do it for you?

FAMOSE is a new framework that uses the ReAct paradigm to automatically discover, generate, and select features for tabular data.

Think of it like giving an ML engineer a reasoning loop: the agent observes the data, thinks about what features might help, acts by generating them, then evaluates whether they actually improved performance.

The key insight: instead of brute-forcing through an exponentially large feature space, FAMOSE explores strategically. It generates candidate features, tests them against model performance, and iteratively refines its approach based on what works.

This matters because feature engineering has always required deep domain expertise. You needed to know that "time since last purchase" matters for churn prediction, or that "ratio of income to debt" predicts loan defaults.
FAMOSE shifts that burden from human intuition to autonomous exploration.

For practitioners working with tabular data, this could dramatically reduce the manual iteration cycle. 

The question worth asking: how well does automated feature discovery generalize across domains where human intuition currently dominates?
↓ 
𝐖𝐚𝐧𝐭 𝐭𝐨 𝐤𝐞𝐞𝐩 𝐮𝐩? Join my newsletter with 50k+ readers and be the first to learn about the latest AI research: llmwatch.com 💡

AI Lead at PwC <​/​> Daily AI highlights for 80k+ experts 📲🤗

FAMOSE: A ReAct Approach to Automated Feature Discovery

19.5 FPS video generation on a single H100.

That's real-time. From a 14B parameter model.

Conventional wisdom said you needed KV-cache, sparse attention, or quantization to hit these speeds. You also needed anti-drifting heuristics like self-forcing or keyframe sampling to prevent long videos from degrading into visual noise. 

Helios throws out both assumptions. The team built a 14B autoregressive diffusion model that generates minute-scale videos without the standard acceleration toolkit. Instead of bolting on complexity, they went the opposite direction: heavy compression of historical context, fewer sampling steps, and infrastructure-level optimizations that cut memory so aggressively you can fit four 14B models in 80 GB of VRAM.

For the drifting problem, they characterized exactly how videos fall apart over time and built training strategies that simulate drift explicitly. The model learns to recover from its own mistakes rather than relying on runtime heuristics to mask them.

The computational cost ends up comparable to 1.3B models - roughly 10x smaller architectures.

On both short and long video benchmarks, Helios outperforms prior methods while running at speeds that actually matter for production. Code, base model, and distilled model are all coming.

Real-time, minute-scale video generation without the usual engineering overhead. The tradeoffs just shifted.
↓ 
𝐖𝐚𝐧𝐭 𝐭𝐨 𝐤𝐞𝐞𝐩 𝐮𝐩? Join my newsletter with 50k+ readers and be the first to learn about the latest AI research: llmwatch.com 💡

 Helios: Real Real-Time Long Video Generation Model

Simple factual questions don't need chain-of-thought reasoning.

That's been the assumption. Why would a model need to "think step by step" to recall a single fact?

New research indicates that this assumption is wrong.

Enabling reasoning on simple, single-hop factual questions substantially expands what a model can recall from its own parameters. Facts that are effectively unreachable through direct answering become accessible when the model reasons first.

The researchers identified two mechanisms driving this:

First, a computational buffer effect. The model uses generated reasoning tokens to perform latent computation - regardless of what those tokens actually say. The extra token generation acts as processing room, giving the model more compute to locate the right answer.

Second, factual priming. When the model generates topically related facts during reasoning, those facts act as a semantic bridge to the correct answer. It's self-retrieval: the model primes itself by producing nearby knowledge, then follows that trail to what it actually needs.

The big problem? When the model hallucinates intermediate facts during reasoning, the final answer becomes more likely to hallucinate too. The same priming mechanism that helps retrieval can poison it.

Filtering reasoning trajectories for hallucination-free intermediate statements directly improved accuracy. If you're using reasoning-enabled models for knowledge-intensive tasks, the quality of the chain-of-thought matters - not just its presence.
↓ 
𝐖𝐚𝐧𝐭 𝐭𝐨 𝐤𝐞𝐞𝐩 𝐮𝐩? Join my newsletter with 50k+ readers and be the first to learn about the latest AI research: llmwatch.com 💡

How Reasoning Unlocks Parametric Knowledge in LLMs

Machine Learning Engineer | Data Scientist | Gen AI | Women TechMaker @Google | ExploreML CrowdSource Facilitator @Google | GCP | AWS | Artificial Intelligence | GSSoC '22 |

Hey there! 👋 I’m Vedant Pandya (He/Him) - an AI and Generative AI Researcher, visionary team leader, and Generative AI Developer driven by innovation and impact. With over four years of expertise spanning Machine Learning, Generative Artificial Intelligence, Data Science, and Cloud Computing (AWS & GCP), I navigate the evolving landscape of Industry 4.0 with purpose and passion.

As a trailblazing Machine Learning Engineer and Data Scientist, I specialize in turning complex ideas into transformative solutions. My journey has encompassed consulting, tech, and industry domains, where I’ve spearheaded groundbreaking open-source projects and delivered measurable outcomes. A champion for continuous learning, I empower individuals and teams to exceed their potential through impactful mentorship and education.

Certified in Google Cloud Machine Learning and Data Science and a proud Google Women TechMaker, I also thrive as a content creator and blogger, simplifying cutting-edge tech concepts. My expertise spans AI model development, NLP, computer vision, multi-modal learning, and deploying next-generation AI solutions in real-world contexts.

Rooted in resilience and values from my upbringing as the child of a single parent, I embrace challenges with dignity and determination. Let’s connect to explore AI, Machine Learning, Quantum Computing, or the expansive universe of technology—and unlock the latent potential within. 🚀

===================================================================
Key Words: AI Researcher • Generative AI Innovator • AI Developer • Tech Leadership • Mentorship in Innovation • AI Model Architect • Cloud Computing Pioneer • NLP Virtuoso • Cutting-Edge ML Solutions • Industry 4.0 Leader • Generative Pre-Trained Transformers (GPTs) • Multi-Modal AI Expert • Quantum Computing Visionary • Cloud Native Architect • Data Science Mentor • Strategic Collaboration in AI

taplio

The Battle

Pascal Biese

Vedant Pandya

Followers

Posts

Engagements

Likes

Performance ScorePascal Biese's LinkedIn Performance

Ready to grow your LinkedIn presence?

taplio

The Battle

Pascal Biese

Vedant Pandya

Followers

Posts

Engagements

Likes

Performance Score.css-goub6s{font-size:var(--chakra-fontSizes-md);font-weight:500;color:var(--chakra-colors-gray-600);display:block;margin-top:var(--chakra-space-1);}Pascal Biese's LinkedIn Performance

Ready to grow your LinkedIn presence?

Performance ScorePascal Biese's LinkedIn Performance