Voxel51

• Explore, tinker with, and push the boundaries of the latest AI and machine learning technologies to showcase what's possible with open-source tools and frameworks

• Build inspiring prototypes, proof-of-concepts, and example applications that demonstrate creative and impactful uses of AI to the developer community

• Contribute meaningfully to the open source ecosystem by creating and maintaining libraries, tools, datasets, tutorials and guides that enable developers to more easily leverage AI capabilities

• Curate, clean, annotate and publish unique multimodal datasets spanning text, images, audio, video, 3D and other emerging data types to facilitate novel machine learning research and applications

• Create engaging technical blog posts, social media content, videos, and presentations that educate and inspire developers and data scientists to build with AI

•  Collaborate openly with our internal teams and the broader AI/ML community to cross-pollinate ideas, share knowledge, and collectively advance the state-of-the-art

• Evangelize our technology and vision by representing the company at hackathons, conferences, meetups, universities, and other developer-focused events

•  Influence the product roadmap by providing input on the developer experience, uncovering opportunities for new features and improvements based on community feedback and your work

• Continuously learn, experiment with, and provide feedback on beta versions of our latest models and capabilities to help shape the future of our platform

Hacker in Residence/ Machine Learning Engineer / Developer Advocate

Deci AI

DevRel Advisor

LinkedIn

1) Introductory computer vision course for LinkedIn Learning

2) Prompt Engineering with LangChain (releasing March 2024)

3) RetrievalAugemnted Generation with LlamaIndex (releasing Q2 2024)

4) Fine-tuning LLMs with Hugging Face TRL (est release Q3 2024)

5) Text Generation with Hugging Face Transformers (est release Q3 2024)

LinkedIn Learning Instructor

The Artists of Data Science

The ONLY personal growth and development podcast for Data Scientists

Host

Pachyderm Inc.

Senior Developer Advocate

Comet

ML Developer Advocate

Data Science Dream Job

Principal Data Science Educator

Price Industries

Lead Data Scientist

Bold Commerce

Senior Data Scientist

Emergent BioSolutions

Biostatistician

I create content about deep learning | The DevRel and Deep Learning Dude

Hacking on LLMs, curating multimodal datasets, and writing a book about RAG.

It's finally here!

My second course on LinkedIn Learning, Prompt Engineering with LangChain, is LIVE!

I enjoyed creating this course, even though I had to rewrite the code three times due to the version changes...

But, it was worth it! This is current for v0.1.x and will teach you the fundaments of working with LangChain, focusing on using prompts,  prompt templates, and some agentic workflows.

It's the perfect introductory course to LangChain and working with LLM orchestration frameworks.

Enjoy!

#generativeai #artificialintelligence

Harpreet Sahota 🥑

🤖 Generative AI Hacker | 👨🏽‍💻 AI Engineer | 👷🏽‍♀️ Developer Advocate | Building🏗️-Shipping🚢-Sharing🚀

Yesterday, at our virtual meetup, I gave my first lightning talk as a Hacker-in-Residence at Voxel 51!

One of the coolest parts about working at Voxel 51 is that I get to explore things I'm most interested in. Recently, my topic of interest has been Vision Language Models (VLMs).

Now, y'all know I love vibe-checking foundation models. 

And that's precisely what I did in this talk. I ran inference on a small subset of the TextVQA dataset using two Llava-Next models (with the Mistral-7b and Vicuna-7b backbones) and vibe-checked their output using fiftyone as my medium of exploration.

During this exploration, I uncovered some interesting findings!

Watch this short video and see for yourself 👇🏼 (oh, and definitely subscribe to the channel...I'll be pushing out some cool tutorials soon)

Link to the notebook in the comments.

#generativeai #deeplearning #genai #artificialintelligence

In this session, you’ll get hands-on with the newest LlaVa model, LlaVa-next! You’ll learn how to use fiftyone to visually vibe check the performance of both the Vicuna-7B and Mistral-7B backbones models on the TextQA dataset. Speaker: Harpreet Sahota...

Open video: Computer Vision Meetup: Exploring Multimodal Models: Llava-Next and TextQA Dataset on youtube.com

Computer Vision Meetup: Exploring Multimodal Models: Llava-Next and TextQA Dataset

The level of openness in AI research is unlike any other discipline. 

Other fields have their research paywalled, but in AI, we have arXiv and awesome conferences like CVPR where researchers can openly share their work.

In preparation for CVPR, I looked at many (many, many, many) papers.  I've been interested in vision-language models lately, and five papers from this year's conference caught my attention. 

I was fortunate enough to be able to spend reading the papers and writing a blog to summarize them for you.

Each paper touches on an interesting research direction, from automatically generating natural language descriptions of image sets to enhancing the creative abilities of language models to a more controllable version of CLIP that can focus on specific regions of an image.

I walk through the key aspects of each paper using the PACES method, which will give you a good understanding of what these papers present and why they're important:

🔍 Identifying the (P)roblem

💡 Describing the (A)pproach

📣 Stating the (C)laim

🔬 Explaining the (E)valuation

✅ Assessing if the results (S)ubstantiate the claim

All the papers I covered include links to the code, models, and datasets, giving you everything you need to explore for yourself. 

Let me know what you think! 

And if you're attending CVPR 2024, be sure to stop by the Voxel51 booth and say hello.

🔗 : https://lnkd.in/eYeymNby

#artificialintelligence #genai #deeplearning #ai

CVPR is right around the corner.

This year, the conference received 11,532 valid paper submissions, and only 2,719 were accepted, with an overall acceptance rate of about 23.6%.

I curated a repo with the papers, posters, challenges, workshops, and datasets I'm most excited about!

Check it out here 👉🏼 https://lnkd.in/gjZBSZQJ

#artificialintelligence #computervision #genai #deeplearning

It's been a big week! I'm not talking about the happenings in AI and open source...but the awesome things me and my crew at fiftyone have been up to!

Jacob published this awesome blog about small object detection with SAHI. 👉🏼 Check it out: https://lnkd.in/gd56nbQW

Daniel updated our text-to-image plugin to include support for Stable Diffusion 3.
👉🏼 Check it out here: https://lnkd.in/g3HTgTAf

Harpreet published a blog about awesome datasets at CVPR.
👉🏼  Check it out here: https://lnkd.in/gafDFTZx

And this week's edition of the Voxel 51 Community Newsletter, Filtered Views.
👉🏼 Check it out here: https://lnkd.in/g2vJsSw9

And, of course, Jimmy behind the scenes steering the ship and keeping us on course!

Aaaaand, my LinkedIn Learning Course "Prompt Engineering with LangChain" passed 1,000 learners! Interestingly enough, though, it has no reviews. I take that to mean people either hated it or were so blown away by the content and what they learned that they wanted to give 6/5 stars but couldn't...so they just didn't review it? 

I dunno, only one way to find out, though. Go and take the course for yourself!

More to come next week, guaranteed!

#artificialintelligence #deeplearning #computervision #generativeai

Anyone wanna build, ship, and share with us?

Chief Community Officer @ Voxel51 | Startup Advisor

Voxel51 is hiring a Machine Learning DevRel Engineer to join our team as we build and expand our open-source library - https://lnkd.in/gX5jTbR7

You'll create content, engage with our audience, and help us establish wider recognition. 

Come join our world-class team as we craft the future of data-centric AI and solve complicated problems!

Are you a builder? Now is the best time to join!

#computervision #ai #artificialintelligence #machinevision #machinelearning #datascience

It’s time for another bi-weekly digest of the latest trending AI, machine learning and computer vision news, events and resources! - https://lnkd.in/dD7_kT8A

In this digest Harpreet Sahota 🥑 dives into:

* The Industry Pulse - including Ubisoft, Apple and Suno

* GitHub Gems - including LLaVA-NeXT, plus a notebook to try it out!

* Good Reads - including a summary of Chip Huyen’s “Multimodality and Large Multimodal Models (LMMs)”

* Good Listens - including an interview with Kate Park on “Data Engines for Vision and Language”

* Good Research - including articles from Prof Jason Corso and the "The Role of Data Curation in Image Captioning" paper

* Upcoming Events - including workshops, Meetups and webinars

#computervision #ai #artificialintelligence #machinevision #machinelearning #datascience Wenyan Li  Jonas F. Lotz Desmond Elliott

Author: Harpreet Sahota (Hacker in Residence at Voxel51) Welcome to Voxel51's bi-weekly digest of the latest trending AI, machine learning and compute

Open article: Voxel51 Filtered Views Newsletter - March 29, 2024 by Voxel51 • 11 min read

Voxel51 Filtered Views Newsletter - March 29, 2024

It’s time for another bi-weekly digest of the latest trending AI, machine learning and computer vision news, events and resources! - https://lnkd.in/dD7_kT8A

In this digest Harpreet Sahota 🥑 dives into:

* The Industry Pulse - including Ubisoft, Apple and Suno

* GitHub Gems - including LLaVA-NeXT, plus a notebook to try it out!

* Good Reads - including a summary of Chip Huyen’s “Multimodality and Large Multimodal Models (LMMs)”

* Good Listens - including an interview with Kate Park on “Data Engines for Vision and Language”

* Good Research - including articles from Prof Jason Corso and the "The Role of Data Curation in Image Captioning" paper

* Upcoming Events - including workshops, Meetups and webinars


#computervision #ai #artificialintelligence #machinevision #machinelearning #datascience Wenyan Li Jonas F. Lotz Desmond Elliott

Taplio

Harpreet Sahota 🥑's Linkedin Analytics

Harpreet Sahota 🥑

What is Harpreet talking about?

Who is engaging with Harpreet

Harpreet Sahota 🥑's Best Posts (last 30 days)

Want to drive more opportunities from LinkedIn?

Taplio

.css-1jgreyo{background-image:linear-gradient(284deg, rgba(39,43,72,1) 0%, rgba(33,47,183,1) 100%);color:transparent;-webkit-background-clip:text;background-clip:text;}Harpreet Sahota 🥑's Linkedin Analytics

Harpreet Sahota 🥑

What is Harpreet talking about?

Who is engaging with Harpreet

Harpreet Sahota 🥑's Best Posts .css-qqfgvy{font-size:var(--chakra-fontSizes-md);}(last 30 days)

Want to drive more opportunities from LinkedIn?

Harpreet Sahota 🥑's Linkedin Analytics

Harpreet Sahota 🥑's Best Posts (last 30 days)