PinnedPublished inGenerative AIComplete Summary of Absolute, Relative And Rotary Position Embeddings!Position embeddings have been used a lot in recent LLMs. In this article, I explore the concept behind them and discuss the different types…Mar 313Mar 313
PinnedPublished inGenerative AIBehind Falcon-40B’s Rise: The Story of Dominating the Open Source LLM Board!In a compelling turn of events, Falcon now dominates the open LLM leaderboard by HuggingFace. This new generation of LLM is available in a…Jun 17, 2023Jun 17, 2023
PinnedPublished inGenerative AIReAct, Reasoning and Acting augments LLMs with Tools!IntroductionMar 25, 2023Mar 25, 2023
Published inGenerative AIChameleon, Meta’s Mixed-Modal Foundation ModelRecently, Meta released a new family of mixed-modal foundation models. Unlike previous models, which modeled each modality separately and…Jun 23Jun 23
Published inGenerative AIPhi-3, your Pocket LLM!Microsoft recently introduced Phi-3 family of models that is at the same time highly performant but also small enough to run on your phone…Apr 29Apr 29
Published inGenerative AIDoRA Is The New LoRA!The true strength of LLMs lies in how we can employ them for our own needs using our specific data. Various challenges arise when…Apr 7Apr 7
Published inGenerative AIIs Step Back Prompting The Best Prompting Strategy?Despite the proficiency of LLMs in conversations and information retrieval, they still struggle with multi-step reasoning tasks. To address…Mar 20Mar 20
Published inPython in Plain EnglishWhat Is SwiGLU? How to Implement It? And Why Does it Work?If you have been in the AI space lately specifically in Large Language Models, you might have seen the word “SwiGLU” thrown around here and…Mar 13Mar 13
Published inGenerative AIDissecting OLMo, The Most Open Source LLM Paper!Over the course of the last year, since the wave of LLMs started, many companies and organizations have released numerous models and…Mar 6Mar 6
Published inGenerative AIHow ZEPHYR 7B Outperforms 70B LLama-2 ChatZephyr 7B is a model released by HuggingFace. According to the technical report Zephyr-7B outperforms LLama2-Chat on MT-Bench dataset.Dec 13, 2023Dec 13, 2023