I had been searching for the answer to what is linear and what is non-linear, and the article on The Minitab Blog is the best in my opinion: It gives the exact definition what is a linear model / equation / function. However, I believe that the official definition of linear should be found in some […]

# Month: May 2016

## Inductive Bias

The definition of “Inductive Bias” can be found in Machine Learning by Tom M. Mitchell (the book is crazily expensive, I know it) the section 2.7, page 39. You may need to make reference to other sections in Chapter 2. Tom M. Mitchell did give a powerful insight to overfitting problem. My only concern is that the […]

## Lukas Graham – 7 Years

Vocabulary and Lukas’ explanations to this song.

## Learning From Data – A Short Course: Exercise 4.11

Page 152: In this particular experiment, the black curve () is sometimes below and sometimes above the red curve (). If we repeated this experiment many times, and plotted the average black and red curves, would you expect the black curve to lie above or below the red curve? It is written on the page […]

## Learning From Data – A Short Course: Exercise 4.10

Page 144: (a) From Figure 4.12, is initially decreasing. How can this be, if is increasing in for each ? Because is the hypothesis with smallest among hypotheses, and we have already known that is close to for small and large , hence the initial decrease. As we set out more data for validating, we […]

## Learning From Data – A Short Course: Exercise 4.9

Page 142: Referring to Figure 4.10, why are both curves increasing with ? Why do they converge to each other with increasing ? For the first question, as we use more data to validate, we use less data to train. Less data to train will output worse final hypothesis, hence the increase of both curves. […]

## Learning From Data – A Short Course: Exercise 4.8

Page 142: Is an unbiased estimate for the out-of-sample error ? Yes, it is. Because (“unbiased estimate” and “biased estimate” are statistics’ definitions).