MATH 304-6 Spring 2020 SYLLABUS for Prof. Feingold's Section 6

Extra topics if time allows (usually not enough time for these in the elementary linear course) :

Topics which may be covered on each exam

These paragraphs will be updated before each exam is given.

Topics which may be covered on Exam 1, Feb. 19, 2020

Here is a list of topics covered in lectures which may be covered on Exam 1, Feb. 19, 2020.

Linear Systems, solving by row reduction of the augmented matrix [A|B] and interpretation in terms of free and dependent variables.

Consistent vs. inconsistent systems. Homogeneous systems AX=O.

Elementary row operations and reduction to Reduced Row Echelon Form (RREF).

Matrices, the set of all mxn real matrices, R^m_n, addition of matrices, multiplication of a matrix by a real number (scalar).

The span of a set of vectors in R^m_n as the set of all linear combinations from that set.

Matrix shapes, names of special patterns.

Rank of a matrix.

How an mxn matrix A determines a function L_A: Rⁿ --> R^m by L_A(X) = AX.

Linearity properties of the function L_A, that is, L_A(X+Y) = L_A(X) + L_A(Y) for any X, Y in Rⁿ, and L_A(rX) = r L_A(X) for any X in Rⁿ and any r in R.

Definition of Ker(L_A) and of Range(L_A) = Im(L_A) and how to find them by row reduction methods.

Properties of general functions: one-to-one (injective), onto (surjective), both (bijective), invertible.

Connection between properties of matrix A and function L_A.

Defintion of matrix multiplication AB through the definition L_A composed with L_B equals L_AB. Lemma that L_A = L_B iff A=B.

Formula for the matrix product of an mxn matrix A with an nxp matrix B giving an mxp matrix C = AB whose columns are A(Col_k(B)) for k = 1, ..., p.

Defintion of standard basis vectors e₁, ... , e_n in Rⁿ and lemma that Ae_j = Col_j(A), so AX is the sum of x_j Col_j(A).

Definition and properties of the standard dot product in Rⁿ: bilinear, symmetric, positive definite.

Definition of length of a vector, ||v||, for v in Rⁿ.

Definition of distance between two vectors, ||u-v||.

Definition of the angle a between two vectors u and v in Rⁿ given by the formula cos(a) = u.v/(||u||)(||v||).

Definition of two vectors in Rⁿ being orthogonal (perpendicular) when the angle between them is a right angle (90 degrees = pi/2 radians), so u.v = 0.

The Cauchy-Schwarz inequality |u.v| <= (||u||)(||v||) and the triangle inequality ||u+v|| <= ||u||+||v||.

Topics which may be covered on Exam 2

Topics that have been covered since Exam 1 and which may appear on Exam 2, March 18, 2020, are listed below.

Abstract definition of a real vector space, V. Examples, R^m_n is a vector space. For any set S, the set F = {f : S ---> R} of all functions from S to the reals R, is a vector space.

Definition of a linear transformation L : V ---> W from a vector space to a vector space. Ker(L), Range(L) = Im(L).

Basic facts about vector spaces and about linear transformations (maps), and examples.

Definition and some examples of subspaces.

Definition of when a square matrix is invertible, uniqueness of the inverse when it exists, and an algorithm to decide and find it by row reduction of [A | I_n].

Definition of transpose of a matrix, of symmetric and anti-symmetric matrices.

Elementary matrices and how they can be used to achieve elementary row or column operations.

The rules of matrix algebra.

The span of a set of vectors S in a vector space V, and why it forms a subspace of V.

How to check that a subset W in V is a subspace of V.

Linear indepdendence or dependence of a subset of V, definition and method of determining that.

Theorems and examples about spanning and independence, connection with rank of a matrix.

Definition of a basis for a vector space, and how to decide if a subset is a basis of V.

Finding a basis for important examples of subspaces, Ker(L), Range(L), where L:V---> W is a linear map.

Dimension of V as the number of vectors in any basis for V.

The standard basis for several examples of vector spaces, including all the R^m_n examples and the vector space of polynomials with degree at most k.

Row-space and Column-space of a matrix, and their dimension related to the rank of the matrix.

Information about the linear transformation L_A: Rⁿ--> R^m associated with rank(A).

The relationship between the dimensions of Ker(L), Range(L) and V for L:V---> W.

Extending an independent set to a basis, cutting down a spanning set to a basis.

Topics which may be covered on Exam 3, April 24, 2020

How to represent a general linear map L:V---> W with respect to a choice of basis S in V and basis T in W by a matrix, that is,

using coordinates with respect to S, [ . ]_S, and coordinates with respect to T, [ . ]_T, to find a matrix _T[L]_S, such that _T[L]_S [v]_S = [L(v)]_T.

The algorithm for finding that matrix by a row reduction of [T | L(S)].

If S and S' are two bases of V, and T and T' are two bases of W, and L:V---> W then there is a relationship between _T[L]_S, the matrix representing L from S to T, and _T'[L]_S', the matrix representing L from S' to T'.

That relationship is _T'[L]_S' = _T'Q_{T T}[L]_{S S}P_S' where _SP_S' is the transition matrix from S' to S, and _T'Q_T is the transition matrix from T to T'.

The concept of isomorphism (bijective linear map) and its properties.

Material on determinants, their definition using permutations or by cofactor expansion, their properties, and methods of calculating them (definition by permutations or by cofactor expansions, crosshatching method for matrices of size n = 2 or n = 3 ONLY, using row operations).

The use of determinant to get the characteristic polynomial, det(tI_n - A), whose roots give the eigenvalues of A, and whose expression as a product of powers of distinct linear factors gives the algebraic multiplicities.

Eigenspaces, their properties, and how to decide if a matrix can be diagonalized or not. Theorems about eigenspaces and diagonalizability.

Independence of the union of bases for distinct eigenspaces.

Geometric multiplicity and its relationship to algebraic multiplicity for each eigenvalue.

Use of a basis S of V to give coordinates with respect to S for each vector v in V. How that coordinate function, [v]_S, is a linear map from V to Rⁿ when a basis S for V consists of n vectors.

Transition matrices which give the relationship between the coordinates of a vector v with respect to different bases. If S and T are two bases of the same vector space, V, then the transition matrix from S to T is the square invertible matrix _TP_S such that [v]_T = _TP_S [v]_S.

Topics which may be covered on the comprehensive Final Exam

Definition of positive powers of a square matrix A, and positive powers of L: V ---> V.

Orthogonal and orthonormal subsets, projection of a vector onto another vector, Proj_v(u) = (u.v)/(v.v) v. The geometrical meaning of projection may be helpful but I would not test it on an exam. Skip decomposing forces.

The projection ṽ = Proj_W(v) of vector v into subspace W of Rⁿ defined to be a vector in W such that v - ṽ is orthogonal to W. If T = {w₁, ..., w_m} is any basis of W, then ṽ = ∑_i=1^m x_i w_i must satisfy (v - ṽ).w_j = 0 for j = 1,..., m, that is the linear system ∑_i=1^m x_i (w_i.w_j) = v.w_j for j = 1,..., m. Define the mxm symmetric matrix A = [w_i.w_j] and the mx1 column matrix B = [v.w_j]. This system is just AX = B, and it can be shown that A is invertible, so it always has unique solution X = A^-1 B which gives the projection. When basis T is orthogonal, the matrix A is diagonal and the solution is easy giving an explicit formula Proj_W(v) = ∑_i=1^m (v.w_i)/(w_i.w_i) w_i which is even simpler with T orthonormal. The Best Approximation Theorem, which says that ṽ = Proj_W(v) is the unique vector in W such that ||v - ṽ|| < ||v - w|| for any w in W distinct from ṽ.

Anything covered after the cutoff date for Exam 3 material.

Anything from any part of the course.

This page last modified on 8-23-2021.