PinnedAziz BelaweidinGenerative AIComplete Summary of Absolute, Relative And Rotary Position Embeddings!Position embeddings have been used a lot in recent LLMs. In this article, I explore the concept behind them and discuss the different types…Mar 313Mar 313
PinnedAziz BelaweidinGenerative AIBehind Falcon-40B’s Rise: The Story of Dominating the Open Source LLM Board!In a compelling turn of events, Falcon now dominates the open LLM leaderboard by HuggingFace. This new generation of LLM is available in a…Jun 17, 2023Jun 17, 2023
PinnedAziz BelaweidinGenerative AIReAct, Reasoning and Acting augments LLMs with Tools!IntroductionMar 25, 2023Mar 25, 2023
Aziz BelaweidinGenerative AIChameleon, Meta’s Mixed-Modal Foundation ModelRecently, Meta released a new family of mixed-modal foundation models. Unlike previous models, which modeled each modality separately and…Jun 22Jun 22
Aziz BelaweidinGenerative AIPhi-3, your Pocket LLM!Microsoft recently introduced Phi-3 family of models that is at the same time highly performant but also small enough to run on your phone…Apr 29Apr 29
Aziz BelaweidinGenerative AIDoRA Is The New LoRA!The true strength of LLMs lies in how we can employ them for our own needs using our specific data. Various challenges arise when…Apr 7Apr 7
Aziz BelaweidinGenerative AIIs Step Back Prompting The Best Prompting Strategy?Despite the proficiency of LLMs in conversations and information retrieval, they still struggle with multi-step reasoning tasks. To address…Mar 20Mar 20
Aziz BelaweidinPython in Plain EnglishWhat Is SwiGLU? How to Implement It? And Why Does it Work?If you have been in the AI space lately specifically in Large Language Models, you might have seen the word “SwiGLU” thrown around here and…Mar 13Mar 13
Aziz BelaweidinGenerative AIDissecting OLMo, The Most Open Source LLM Paper!Over the course of the last year, since the wave of LLMs started, many companies and organizations have released numerous models and…Mar 6Mar 6
Aziz BelaweidinGenerative AIHow ZEPHYR 7B Outperforms 70B LLama-2 ChatZephyr 7B is a model released by HuggingFace. According to the technical report Zephyr-7B outperforms LLama2-Chat on MT-Bench dataset.Dec 13, 2023Dec 13, 2023