In this tutorial you can learn how the gradient descent algorithm works and implement it from scratch in python. First we look at what linear regression is, then we define the loss function. We learn ...

A linear function approximator is a function y=f(x,w) that is linear in the weights, though not necessarily linear in the input x: Linear function approximators have several nice properties. For ...

This is a collection of scripts (now converted to notebooks) that I developed back in 2013 to understand apllication of linear regression techniques in side channel analysis. There are definitely more ...

Finding the slope of a linear function is straightforward. Furthermore the slope is the same at each point on the function. However this is not the case with non-linear functions. A non-linear ...