#gradient-descent

3 items tagged “gradient-descent”

TILs (3)

What is Keras, and how is a single neuron different from OLS?

**TL;DR:** Keras is the high-level API for building and training neural networks — not a universal machine-learning API. Regression is a *task type*, not a model kind: the same Keras machinery does it…

Why cross-entropy, and what −1/m is really doing

While building a single neuron from scratch in NumPy for the DLH machine-learning curriculum (classifying MNIST handwritten digits), I had to answer the question every ML beginner meets: how do you sc…

Gradient descent is just walking downhill — and why (A − Y) is enough

The DLH machine-learning curriculum had me build a single neuron from scratch in NumPy — classifying MNIST handwritten digits, the same project as my [training loop](/til/ai/training-a-single-neuron-l…