Linkedin User LinkedIn Posts

Gemma is making waves in the AI community! According to Sebastian Raschka, PhD, the 7B model is a strong contender that could potentially

If you are looking for something to read this weekend, I am happy to share that Chapter 7 on instruction finetuning LLMs is

If you are looking for something to read this weekend, I am happy to share that Chapter 7 on instruction finetuning LLMs is

A lot has happened last month: Apple announced the integration of on-device LLMs, Nvidia shared their large Nemotron model, FlashAttention-3 was announced, Google's

Yesterday's Llama 3.1 release marked a big milestone for LLM researchers and practitioners. Llama 3.1 405B is the biggest and most capable LLM

If you are looking for something to play with this weekend, all Llama 3.1 models are now supported in our LitGPT open-source LLM

One of the advantages of Meta AI's updated Llama 3.1 license is that it now permits using Llama 3.1 models to improve other

I don't post tutorials (that) often, but hey, I just saw that I got 30k subscribers on YouTube! If you're looking to learn

There are hundreds of LLM papers each month proposing new techniques and approaches. However, one of the best ways to see what actually

If you're looking for a new open-source library to explore this upcoming weekend, my team at Lightning AI recently launched LitServe, a Python-based

If you're looking for a new open-source library to explore this upcoming weekend, my team at Lightning AI recently launched LitServe, a Python-based

If you’d like to spend a few hours this weekend to dive into Large Language Models (LLMs) and understand how they work, I've

If you’d like to spend a few hours this weekend to dive into Large Language Models (LLMs) and understand how they work, I've

There are many ways to implement the multi-head attention mechanism used in LLMs. I recently added an implementation based on torch.einsum for the

Einstein summation

Last week, there was a discussion about a new LLM that was said to be "the world's top open-source model." The name of

I'm excited to announce that after 1.5 years of hard work, the final version of "Build A Large Language Model From Scratch" has

I’m happy to confirm that the physical copies have started shipping. Happy weekend, everyone!

P.S. I’ll be at the PyTorch Conference in SF

I’m happy to confirm that the physical copies have started shipping. Happy weekend, everyone!

P.S. I’ll be at the PyTorch Conference in SF

Previously, RAG systems were the standard method for retrieving information from documents. However, if you are not repeatedly querying the same document, it

I just put together a short Jupyter notebook with tips and tricks for reducing memory usage when loading larger and larger models (like