In this article, we will get to the heart of the matter. Read it, play around with the proposed code and the different parameters. And you'll become a pro at training neural networks.
LLM from scratch PyTorch
Discovering PyTorch
Because Pytorch isn't just for building neural networks, this article shows you how to use the library for tensor manipulation. This knowledge is necessary to implement the attention mechanism within LLMs (transformers).
Thoughts on AI
Why generative AI doesn't plagiarize
Many people who are not deeply familiar with the subject think that generative AI is plagiarism. In this article, you will find out why the problem is not there.
Benchmarks PyTorch
How to use PyTorch to measure your memory bandwidth
With this article, you will learn how to measure your memory bandwidth with PyTorch, host => GPU, GPU => host, and intra GPU.
Software engineering
Why software engineering sucks
Discover the shocking truth about developer happiness. Learn how poor communication is causing this issue and find out the simple solution to unlocking your engineering team's full potential. Read on to learn how to end the cycle of frustration and unleash your team's creativity.
Thoughts on AI
The stupidity of the AI trend
Discover the truth behind the AI hype. While many are caught up in the excitement of AI chatbots and generative models, the reality is that the most valuable advancements in AI have been happening behind the scenes for years. Learn how to separate fact from fiction and uncover the hidden potential of AI. Read on to find out how you can harness the power of AI without getting caught up in the hype.
Thoughts on AI
How to become an elite vibe coder
The vibe coding trend may have annoyed you. Or on the contrary, you have decided to ride this wave. In any case, find out how to move beyond this trend and how the full adoption of coding AI tools can revolutionize today the way we create code and practice software engineering.
Benchmarks
SMS spam microservice, Python vs Golang
This time, I decided to compare two languages in real conditions. To do this, I created a spam detection microservice in Golang and Python. Who will win? Read the article and you will see that it may not be that simple.
AI Fundamentals PyTorch
Hello PyTorch
Discover how to create a simple neural network using PyTorch. Learn how to implement a network, define layers, and train your model with ease.
Inspirational thoughts
How the Hacker Manifesto change my life
Discover how in the ancient days of the internet, the Hacker Manifesto changed my life, and how I discovered cybersecurity maybe not for the right reasons. I share my early days as a grey hat, my risky experiments with network sniffers, and how my passion for cybersecurity led me deep into the mechanics of the digital realm. Now, two decades later, I’m decoding AI and LLMs with the same relentless curiosity. And I want to share that with you.
AI Fundamentals
Hello World neural networks (part 2)
Want to create your own neural network from scratch? Learn how to build a multi-layer perceptron and train it using backpropagation and gradient descent. Discover the logic behind the sigmoid activation function and its derivative, and explore the code to implement it all.
Benchmarks
An honest memory management benchmark
Discover how your favorite programming languages stack up in terms of memory management. From C++ to PHP, and Node.js to Rust, find out which languages come out on top in this comprehensive benchmark test.