I make learning Data Science effortless for you | Data Science @ Bosch

Hi 👋🏻
I'm Banias, AI Engineer at Netze BW.

Applying new technologies and methods in Data Science & AI is my passion.

Through my experience and continual learning, I've gained valuable insights and tips that I love sharing with Data Scientists, Machine Learning Engineers and builders like you.

If you're looking for practical advice, helpful resources, and articles on the latest trends or best practices in the field, you're in the right place.

Let's connect and stay updated on the exciting world of Data Science together. Feel free to reach out, read my articles, and let's grow our knowledge and network. :)


Note: My views are my own and don‘t represent my employer.

Banias Baabe

How do you hit 98.7% accuracy with RAG on complex documents?

You don't use vector search.

Traditional RAG often fails because semantic similarity isn't true relevance. For tough domains, you need a system that reasons.

This is where 𝗣𝗮𝗴𝗲𝗜𝗻𝗱𝗲𝘅 shines.

It's a new, vectorless RAG framework that mimics how a human expert analyzes a document.

Instead of chunking and embedding, 𝗣𝗮𝗴𝗲𝗜𝗻𝗱𝗲𝘅 builds a "table-of-contents" tree and uses tree search to find the most relevant information.

Why is this better?
✅ 𝗛𝘂𝗺𝗮𝗻-𝗹𝗶𝗸𝗲 𝗥𝗲𝘁𝗿𝗶𝗲𝘃𝗮𝗹: It simulates how experts navigate complex information.
✅ 𝗧𝗿𝗮𝗻𝘀𝗽𝗮𝗿𝗲𝗻𝘁 𝗣𝗿𝗼𝗰𝗲𝘀𝘀: The reasoning is traceable and interpretable. No more "vibe retrieval."
✅ 𝗡𝗼 𝗔𝗿𝗯𝗶𝘁𝗿𝗮𝗿𝘆 𝗖𝗵𝘂𝗻𝗸𝗶𝗻𝗴: It respects the document's natural structure.
✅ 𝗡𝗼 𝗩𝗲𝗰𝘁𝗼𝗿 𝗗𝗕: The system relies purely on LLM reasoning and document hierarchy.

This approach achieved state-of-the-art results on the FinanceBench benchmark.

🔗 Check it out: github(.)com/VectifyAI/PageIndex


---
♻️ Found this useful? Share it with another builder.
➕ For daily practical AI and Python posts, follow Banias Baabe.

I teach AI Engineers the concepts and tools they need to stay ahead | AI Engineer @ Netze BW

Running a 70B LLM on a single 4GB GPU is possible with 𝗔𝗶𝗿𝗟𝗟𝗠.

𝗔𝗶𝗿𝗟𝗟𝗠 optimizes inference memory usage so you can run big models without quantization, distillation, or pruning.

It runs inference layer by layer, loading only the layer that is needed for the next compute step, then freeing that memory before moving on.​

To make that practical, it first preprocesses the original Hugging Face weights and re-shards them by transformer layer (instead of giant multi‑GB shards), so each load is focused and smaller.​

This matters because disk I/O becomes the bottleneck when you stream weights.

The main thing that still sits in GPU memory is the KV cache for attention, which is much smaller than full model weights for typical context lengths.​

𝗔𝗶𝗿𝗟𝗟𝗠 also adds prefetching so it can overlap loading the next chunk of weights with the current compute, which helps claw back some speed.

And if you want more throughput, it supports an optional “model compression” mode using block-wise quantization of weights to shrink what needs to be loaded from disk, with the project claiming up to ~3x speedup and minimal accuracy loss.

🔗 Link to repo: github(.)com/lyogavin/airllm


---
♻️ Found this useful? Share it with another builder.
➕ For daily practical AI and Python posts, follow Banias Baabe.

Stop destroying your documents with 512-token chunks.

Traditional RAG is breaking your tables, splitting your diagrams, and mixing up your model specifications.

I just read a great article from Alex Vesa about a working data modeling approach for complex technical documents.

The problem? Most RAG systems treat a 500-page service manual like a blog post. They chunk blindly. A table that spans three pages gets shredded into meaningless fragments.

Here's what actually works:

✅ Pages, not chunks
Use full pages as your retrieval unit. That's how humans read technical docs anyway.
✅ Three-page sliding windows
Process each page with its neighbors (N-1, N, N+1). Now your system knows when content continues across boundaries.
✅ Treat tables like they matter
Extract structure. Generate metadata. Flatten for search. Keep all three representations.
✅ Multi-vector indexing
Dense embeddings for semantic search. Sparse vectors for exact matches. ColBERT for precision. Combine them.
✅ Domain-specific metadata
Model applicability, component types, cross-page relationships. Not just title and date.

Link ➙ https://lnkd.in/dJ9aJKAB

Thinking about using 𝗽𝗴𝘃𝗲𝗰𝘁𝗼𝗿 for your next project?

You might want to think again.

Here's the reality of using it in production:
1️⃣ 𝗜𝗩𝗙𝗙𝗹𝗮𝘁 𝗶𝗻𝗱𝗲𝘅𝗲𝘀 𝗻𝗲𝗲𝗱 𝗰𝗼𝗻𝘀𝘁𝗮𝗻𝘁 𝗿𝗲𝗯𝘂𝗶𝗹𝗱𝘀. New vectors throw off your cluster distribution over time.
2️⃣ 𝗛𝗡𝗦𝗪 𝗶𝗻𝗱𝗲𝘅𝗲𝘀 𝗮𝗿𝗲 𝗺𝗲𝗺𝗼𝗿𝘆 𝗵𝗼𝗴𝘀. We're talking 10GB of memory for hours just to build an index for millions of vectors.
3️⃣ 𝗜𝗻𝘀𝗲𝗿𝘁𝗶𝗻𝗴 𝗻𝗲𝘄 𝘃𝗲𝗰𝘁𝗼𝗿𝘀 𝗶𝘀 𝗮 𝗽𝗮𝗶𝗻. With IVFFlat, you have to reindex preiodically. With HNSW, you're looking at graph traversals and memory allocation for every new vector.
4️⃣ 𝗠𝗲𝘁𝗮𝗱𝗮𝘁𝗮 𝗳𝗶𝗹𝘁𝗲𝗿𝗶𝗻𝗴 𝗶𝘀𝗻'𝘁 𝗰𝗹𝗲𝗮𝗿-𝗰𝘂𝘁. Pre-filtering is great for selective filters, but post-filtering can give you incomplete results, and it only gets worse with more filters.
5️⃣ 𝗡𝗼 𝗯𝘂𝗶𝗹𝘁-𝗶𝗻 𝗵𝘆𝗯𝗿𝗶𝗱 𝘀𝗲𝗮𝗿𝗰𝗵. You'll have to figure out how to balance vector similarity with text relevance and normalize scores on your own.

A new extension, pgvectorscale, does fix some of these problems with more memory-efficient indexing and better filter performance. But it isn't supported out-of-the-box on Azure and AWS, so you'd have to manage your own Postgres instance.

𝗽𝗴𝘃𝗲𝗰𝘁𝗼𝗿 is a great tool, but it's not a silver bullet. Make sure you're ready for the operational overhead before you commit.

🔗 Link to article: https://lnkd.in/d6jSRy2y


---
♻️ Found this useful? Share it with another builder.
➕ For daily practical AI and Python posts, follow Banias Baabe.

Tired of blocking I/O messing up your async Python apps?

Try 𝗮𝗶𝗼𝗳𝗶𝗹𝗲𝘀 - the game-changer for handling files in asyncio without the headaches.

It's an Apache-licensed library that wraps standard file ops into async magic.

Why you should use it:
• Mirrors Python's built-in file API, so it's super familiar.
• Supports buffered text, binary files, and even tempfiles asynchronously.
• Delegates to a thread pool to keep your event loop flying.


🔗 Link to repo: github(dot)com/Tinche/aiofiles

---
♻️ Found this useful? Share it with another builder.
➕ For daily practical AI and Python posts, follow Banias Baabe.

Vector databases are bloated.

What if you could get the same power with 97% less space?

Try 𝗟𝗘𝗔𝗡𝗡, the world's smallest vector index.

It transforms your laptop into a private and powerful RAG system.

You can finally RAG on everything.
-> Your entire file system
-> Millions of local emails
-> 💻 Your entire codebase
-> 💬 All your chat histories

Why is 𝗟𝗘𝗔𝗡𝗡 interesting?
✅ 𝗜𝘁'𝘀 𝗶𝗻𝗰𝗿𝗲𝗱𝗶𝗯𝗹𝘆 𝗹𝗶𝗴𝗵𝘁𝘄𝗲𝗶𝗴𝗵𝘁: Index 60 million documents in just 6GB instead of 201GB.
✅ 𝗜𝘁'𝘀 𝟭𝟬𝟬% 𝗽𝗿𝗶𝘃𝗮𝘁𝗲: Your data never leaves your laptop. No cloud costs, period.
✅ 𝗧𝗵𝗲𝗿𝗲 𝗶𝘀 𝗻𝗼 𝗮𝗰𝗰𝘂𝗿𝗮𝗰𝘆 𝗹𝗼𝘀𝘀: Get the same search quality as heavyweight solutions.

🔗 Link to repo: github(dot)com/yichuan-w/LEANN


---
♻️ Found this useful? Share it with another builder.
➕ For daily practical AI and Python posts, follow Banias Baabe.

Do you want to identify which lines use the most amount of memory in your Python script?

Try 𝗺𝗲𝗺𝗼𝗿𝘆_𝗽𝗿𝗼𝗳𝗶𝗹𝗲𝗿.

𝗺𝗲𝗺𝗼𝗿𝘆_𝗽𝗿𝗼𝗳𝗶𝗹𝗲𝗿 is a Python module to make a line-by-line analysis of memory consumption for Python functions.

Below you can see how to use memory_profiler within your Python script:

• Decorate the function you want to profile with @𝗽𝗿𝗼𝗳𝗶𝗹𝗲.
• Run the script by passing the option -𝗺 𝗺𝗲𝗺𝗼𝗿𝘆_𝗽𝗿𝗼𝗳𝗶𝗹𝗲𝗿 to load the 𝗺𝗲𝗺𝗼𝗿𝘆_𝗽𝗿𝗼𝗳𝗶𝗹𝗲𝗿 module.

Link to project: pypi(dot)org/project/memory-profiler


---
♻️ Found this useful? Share it with another builder.
➕ For daily practical AI and Python posts, follow Banias Baabe.

What, if an API call in your program fails?

Because of, let’s say, an instable internet connection?

This is not so uncommon.

You usually should have some retry mechanism in your program.

With 𝐭𝐞𝐧𝐚𝐜𝐢𝐭𝐲 in Python, this isn’t a problem anymore.

𝐭𝐞𝐧𝐚𝐜𝐢𝐭𝐲 offers a retrying behavior with a decorator with powerful features like:

- Define Stop Conditions
- Define Wait Conditions
- Customize retrying on Exception
- Retry on Coroutines

One of my favorite libraries!

Check it out: github(dot)com/jd/tenacity


---
♻️ Found this useful? Share it with another builder.
➕ For daily practical AI and Python posts, follow Banias Baabe.

OpenAI's Responses API isn't what they're telling you it is.

They are talking about how it's "faster, more flexible, easier" than the old chat completions API.

But here's what's really going on.

OpenAI hides their reasoning traces.

Unlike Claude, DeepSeek, or Qwen, you can't see GPT-5's chain of thought.

This creates a massive problem for developers using the stateless chat completions API.

Without access to reasoning traces, you can't pass them back into the conversation.

Result? GPT-5 performs worse than it should in your applications.

The Responses API is the workaround.

✅ It's stateful (OpenAI stores conversation history on their servers)
✅ They maintain the hidden reasoning traces in the backend
✅ They plug it into conversations automatically
✅ They strip it out before sending responses back to you

You get full model capability without ever seeing the reasoning.

Here's the uncomfortable truth:

The old stateless API is actually simpler.

Prefix caching works in both. Parallel tool calling works in both.

There's nothing inherently better about stateful architecture here.

The Responses API only exists because OpenAI won't show you what their models are thinking.

Meanwhile, Anthropic keeps their reasoning traces completely transparent.

If you're building with AI APIs in 2026, this matters.

The question is whether you're comfortable with your provider hiding critical information from you.

Link to article: https://lnkd.in/drZjD9Xj


---
♻️ Found this useful? Share it with another builder.
➕ For daily practical AI and Python posts, follow Banias Baabe.

AI makes your team faster.

But it also puts your data at risk.

Files are moving to new tools constantly.

AI models are training on things they shouldn't see.

And old security tools just can't see what is happening.

They are blind to the context that actually matters.

That is why I'm watching Cyberhaven’s launch on February 3.

They are revealing a new platform that combines data security and protection into one tool.

It's built to handle how messy and fast data moves today.

Join the live event to see:
📍 A live demo of this new AI-native platform.
📍 How to spot the few dangerous actions hidden inside millions of normal ones.
📍 Real stories from leaders on why old rules don't work anymore.

Don't wait for a data leak to find the holes in your security.

Grab your spot here: https://lnkd.in/dC-aGjjM

Struggling with slow data processing for AI training?

Try 𝗹𝗶𝘁𝗱𝗮𝘁𝗮, the Python library that transforms and optimizes datasets at scale!

𝗹𝗶𝘁𝗱𝗮𝘁𝗮 offers:
🟢 Streaming large cloud datasets without local downloads
🟢 Accelerating training by 20x with optimized data
🟢 Parallelizing tasks across multiple machines effortlessly
🟢 Securely handling sensitive data with advanced encryption

Perfect for images, text, video, and more.

Check it out: github(dot)com/Lightning-AI/litdata


---
♻️ Found this useful? Share it with another builder.
➕ For daily practical AI and Python posts, follow Banias Baabe.

Energy Skills Queensland

I lead tech in ESQ

What do we do?
Energy Skills Queensland is the leading, independent, not-for-profit organisation providing innovative solutions to enable a skilled and safe energy industry. Supporting the electricity, oil and gas, mining, renewable and telecommunications sectors, Energy Skills Queensland engages, researches and develops products and services that align to the current and future needs of our stakeholders.

IT lead

Junior Engineers

Junior Engineers delivers fun, engaging and educational programs in coding and robotics for kids aged 7 – 15 to promote positive harmony of STEM.

A safe place to work for female

Instructor (coding and robotics)

Expect A Star

Casual Educator and support worker.
Supporting children's growth has been rewarding.

Educator (OSHC)

SpaceTimeNoise

My role as a principle consultant at SpaceTimeNoise is to help tech startups and organizations leverage modern C++ effectively to develop high performance, reliable and maintainable software solutions. I have worked with clients from audio, music tech，FinTech, logistics, soft robotics. 
All services provided at the basis of legacy development, include but not limited to
- Code review and optimization
- Custom software development, including derive solutions from scratch, design architecture, coding, testing
- Debugging and troubleshoot
- Consultation and guidance
- Performance tuning
- Porting and migration
- Security vulnerability assessment
- Documentation
- Project management
- Code standardlization
- Code Migration
- Direction and Strategy
- Structural Enhancement
- Expert Advice, architectural scaling 
- Skill Development
- Code review 
Past:
Audio detection (completed 2022, scaler 2.5 audio detection)
Data driven infrastructure of plugin emulation ;
3D printer coding (algorithm, 2022)
Code review and C++ language specifications (completed 2023)
Current: Fully devoted to https://isocpp.github.io/CppCoreGuidelines

C++ specialist/architect/engineer/IT support

Volmex Labs

Backend C++ Development
Builder of implied volatility index with C++

C++ Backend Consultant 

Tonicbits

Audio Detection - Test, Development & Support
Linux build, cross platform development
I work as a C++ contractor under my own ABN

C++ Audio Linux contractor

Freelance C++ fintech

As a hobby outside my postdoc appointment, I collaborate with a team of Physicists and computer scientists with an aim to build the next gen, HFT-friendly Financial Derivatives Exchange. My role is a code developer and the API designer at the C++ end. Specifically,
I built a C++17 *Asynchronous SDK with callback that connect with Bitwyre's REST API. Currently I'm implementing a couple of trading bots (sync, async).

C++ Open Source Freelancer (Remote)

Concordia University

Principal investigator for 
1) Generalized Optimal Sparse tree optimization : Interpretable ML (Corporate partners::Thales) ; 
2) Compiler development for domain specific languages; Graph theoretic approach to district heating and cooling (Canada Excellence Research Chairs::Next Generation Cities);
Scientific computing (Implement graph theoretics concepts and build thermal-hydraulic-electrical solver in C++);
Supervise PhD students (Mechanical Engineering)

C++ Developer

Robotic Company (Arrival)

Software Engineer C++

University of Technology Sydney

Implement an explicit algorithm of the Hawkes intensity function in C++ (ongoing); 

Compute the conditional expectation of the future intensity having observed past counts (discontinued);

VC dimensions and Radamacher/sample complexivty of deep neural network (ongoing).

Honorary research associate at FEIT

Main theme: Computational Social Science
I was responsible for two projects:
1. Theoretical development/prototype implementation of Stochastic Information Diffusion models for modelling online behaviour, based on an exogenously-driven Hawkes self-exciting processes. (Lead Mathematical Component)
2. Adaptative Skills Taxonomy to Labor economics: Spatial-temporal dependency modelling of Australian Labor Market. Completed temporal dependency modelling with copulas)
Worked with a group of over 10 scientists and engineers (UTS-Data61). Lead mathematical /statistical modelling and algorithm development

Postdoctoral Research Associate

Courses taught:
Mathematical Methods for Physical Science
Linear Algebra 
Quantum Physics 
Mathematical Modelling to Sciences 
Advanced Mathematics and Physics (Lead)
Linear Dynamical Systems 
Mathematical Modelling 2 
Statistics and Mathematics for Science 
Intro to Mathematical analysis&Modelling 
Mathematical Modelling to Sciences 
Mathematical Modelling 1 
Mathematical Analysis (35102, Spring 2012)
Foundation Mathematics 
Computational Linear Algebra 
Mathematics Study Centre (2011, 2012, 2017,2018, help students with a wide range of problems from MATHS, EE, STAT, QFIN&ECON)
Experienced Final Exam markers of a variety of junior and advanced mathematics subjects

Senior Tutor

Leanne provides strategic technical leadership at ESQ. She primarily focuses on building a scalable efficient low latency energy database for Queensland. She is a software/infrastructure oriented developer with a passion in community. She received her PhD in Mathematics from USYD specialised in stochastic Atmospheric fluid dynamics. She completed Postdoc fellowships in computational social media and environmental system engineering. In the past, she has worked as a C++ developer in robotic, audio, fintech, engineering and logistic. She has a background in art.
She enjoy building performance-critical server-side applications and services. A frequent contributor to open-source projects.She work with many languages including Python, C++, and C under Linux/Unix environment. 
Subscribe Coursera annually to keen up to date with my past experience in development and regularly conduct self-training under my community LinkedIn learning account provided by local libraries.
Over the weekend she is completing her Diploma in IT at TAFE Queensland full time.
Australian citizen
Follow tech stack at
github.com/leannejdong

Outside computers Leanne enjoy swimming, climbing, jogging, eating and tidying my home.

taplio

The Battle

Banias Baabe

Leanne Dong Ph.D

Followers

Posts

Engagements

Likes

Performance ScoreBanias Baabe's LinkedIn Performance

Ready to grow your LinkedIn presence?

taplio

The Battle

Banias Baabe

Leanne Dong Ph.D

Followers

Posts

Engagements

Likes

Performance Score.css-goub6s{font-size:var(--chakra-fontSizes-md);font-weight:500;color:var(--chakra-colors-gray-600);display:block;margin-top:var(--chakra-space-1);}Banias Baabe's LinkedIn Performance

Ready to grow your LinkedIn presence?

Performance ScoreBanias Baabe's LinkedIn Performance