Skip to main content

Something

Month: October 2016

Why do the eigenvalues of a triangular matrix lie on its diagonal?

October 25, 2016October 25, 2016 vynguyen Leave a comment

Suppose is a triangular matrix, so is invertible. Now with eigenvalues finding process, we can only shift each ‘s diagonal entry for a to make non-invertible. And the only possible way is to shift each ‘s diagonal entry for a that is also an ‘s diagonal entry, so after that one diagonal entry of will equal […]

Read More

Pictorial proof that Reflection(v) = 2*Projection(v) – Identity(v)

October 24, 2016October 24, 2016 vynguyen Leave a comment

Hyperplane here is a 1-D line, I don’t know if this visual proof holds for n-dimensional space haha…

Read More

Proof that unless projection matrix P = I, P is singular

October 24, 2016October 24, 2016 vynguyen Leave a comment

We have: , first we need to prove that : Set , hence each column vector of is a linear combination of column vectors of , so . Here is an by matrix while is an by matrix and column vectors of must be linearly indepedent (so ), hence . If then it’s trivial to show that is […]

Read More

Learning From Data – A Short Course: Problem 7.1

October 5, 2016October 5, 2016 vynguyen Leave a comment

Page 43 Implement the decision function below using a 3-layer perceptron. First I’ll construct a rectangle like this: It’s easy to see how: Consider the four lines , , , and what we want is the hypothesis . The corresponding MLP: Next I’ll try to construct a cooler shape: Now consider the three lines , and […]

Read More

Learning From Data – A Short Course: Exercise 8.17

October 5, 2016October 5, 2016 vynguyen Leave a comment

Page 45 Show that is an upper bound on the , where  is the classification error. We consider the error and on data point . (correct classification):     (wrong classification): We have:     Hence:     So the statement follows.

Read More

Learning From Data – A Short Course: Exercise 8.12

October 5, 2016October 5, 2016 vynguyen Leave a comment

Page 29 If all the data is from one class, then for . (a) What is ? (b) What is ? From (8.23) we have . As all the data is from one class, we also have: . Hence:      

Read More

Archives

  • October 2019
  • September 2019
  • August 2019
  • July 2019
  • June 2019
  • May 2019
  • April 2019
  • March 2019
  • February 2019
  • April 2018
  • March 2018
  • October 2017
  • June 2017
  • March 2017
  • February 2017
  • December 2016
  • November 2016
  • October 2016
  • September 2016
  • August 2016
  • July 2016
  • June 2016
  • May 2016
  • April 2016
  • March 2016
  • February 2016
  • January 2016
  • December 2015
  • November 2015
  • October 2015
  • July 2015

Meta

  • Log in
sparkling Theme by Colorlib Powered by WordPress