Matrices
Matrix
A matrix is a collection of numbers that can be indexed in a particular way, this indexing mimics a two dimensional grid. The dimensions of a matrix are stated as where when it has rows and columns.
Suppose that is a matrix, then we can access the value at the -th row and -th column by writing , we can graphically represent this information by introducing variables for the coefficients and writing them like this:
Matrices are denoted by capital letters such as .
Set of Matrices
Suppose that then we denote the set of all matrices with cofficients from the set as
Row Matrix
Any matrix for some is known as a row matrix.
Row of a Matrix
Suppose that is a matrix, then if we want to extract the row of we can write .
Note that this is a function of the form
The notation intends to mimic freezing at a certain row and then sweeping over all columns.
Row Matrix Representation
Given a matrix
, there is an associated
row matrix representation, of the following form
Where the arrows are there to remind you that they expand horizontally. Also observe that this matrix is an element of
Column Matrix
Any matrix for some is known as a row matrix.
We will denote column or row matrices with a lower case boldfaced character, like
Column of a Matrix
Suppose that is a matrix, then if we want to extract the -th row of we can write .
Note that this is a function of the form
The denotes that the row variable may be varied vertically, while the column index is fixed in place. If we want to represent the matrix as columns graphically, we may do so like this
Column Matrix Representation
Given a matrix
, there is an associated
column matrix representation, of the following form
Where the arrows are there to remind you that they expand graphically expand vertically. Also observe that this matrix is an element of .
We can connect some of the previous definitions here to say that is a column matrix whose entries are row matrices.
Matrix Rank
Let
. The
rank of
, denoted
, is the
dimension of the
span of the columns of
, considered as vectors in
.
Determinant
The determinant is a function defined recursively as follows. If , then
If , let be the matrix obtained from by deleting the first row and the -th column. Then
Nonzero Determinant iff Invertible
A square matrix
is an
invertible matrix if and only if
.
The determinant measures the signed volume-scaling factor of the linear map
. This factor is nonzero exactly when
sends the standard basis to a
basis of
. By the
matrix with basis columns is invertible theorem, this is exactly the condition that
be invertible.
Matrix with Basis Columns is Invertible
Let
. If the columns of
form a
basis of
, then
is an
invertible matrix.
Write the columns of
as
. For any
,
matrix multiplication gives
Since
form a basis of
, every vector
has a unique representation
by
basis implies unique representation. Therefore there is a unique
such that
. Thus
is bijective, so it is invertible. Hence
is an invertible matrix.
Matrix Multiplication
Suppose such that and that we have two matrices , defined as
Then we define the matrix multiplication of and as the matrix
Where:
Matrix Times Standard Basis Vector is a Column
Let
, and let
be the
-th vector in the
standard basis of
. Then
where
denotes the
-th
column of , viewed as a vector in
.
Write
. By the
definition of matrix multiplication, the
-th coordinate of
is
Since
for
and
, this sum is
. Therefore every coordinate of
equals the corresponding coordinate of the
-th column of
, so
.
Matrix Addition and Scalar Multiplication
Let and . We define:
We also define .
Identity Matrix
For , the identity matrix is:
Block Matrices
Block Matrix
A
block matrix is a
matrix written as a rectangular array of smaller matrices, called blocks. For example, if the block sizes fit together, then
denotes the ordinary matrix obtained by placing
and
side by side, placing
and
side by side, and then stacking the two block rows.
The block notation is valid only when blocks in the same block row have the same number of rows, and blocks in the same block column have the same number of columns.
Two by Two Block Matrix Multiplication
Suppose the block sizes are compatible for
matrix multiplication. Then
Each entry of the product is computed by taking a row of the first matrix and a column of the second matrix. If the rows and columns are grouped into blocks, the same calculation groups the resulting sums into blocks. The upper-left block receives the contributions and , the upper-right block receives and , the lower-left block receives and , and the lower-right block receives and . This is exactly the displayed block product.
Matrix Transpose
Let . The transpose of is the matrix defined by:
Reflection Matrix About a Line Through the Origin
Let , and let be the line through the origin in the direction . The matrix which reflects vectors across is:
Let , and write in polar form:
Suppose is the reflection of across the line , and write:
Let . Since reflection across places on the other side of the line by the same angle, , and hence:
Therefore:
Using the trigonometric angle addition formulas:
By the fact that sine is odd and cosine is even:
Since and , we have:
Equivalently, using matrix multiplication:
Therefore the reflection matrix about is:
Two Dimensional Rotation Matrix
For , the matrix which rotates vectors in counterclockwise by angle is:
Composition of Two Reflections is a Rotation
Let and be lines through the origin in , where has direction , has direction , and . Reflecting first across , and then across , is the same as rotating by :
Composition of Two Plane Reflections is a Rotation
Let be planes through the origin, and suppose that
is a line. Let be the plane perpendicular to . Then and are lines through the origin in .
If the oriented angle from to is , then reflecting first across , and then across , is the same as rotating around the axis by .
Every vector can be written uniquely as
where and .
Since and , reflection across either plane fixes every vector in . Thus the component is unchanged by both reflections.
It remains to understand what happens to . Inside the plane , the intersections
are lines through the origin. Reflection across restricts on to reflection across , and reflection across restricts on to reflection across .
By the two-dimensional composition of reflections theorem, reflecting first across , and then across , rotates by . Therefore the composition fixes the component along and rotates the perpendicular component by , which is exactly rotation around the axis by .
Vector as a Column Matrix
For each , define a function by:
Vector as a Row Matrix
For each , define a function by:
The notation and is overloaded across dimensions: if , then the dimension determines which function is being used and what size matrix is produced.
Matrix Functions
Suppose that and that is a function, then we augment this function to as follows:
Packing Function
Suppose that , then we define the following function as
Unpacking Function
We define by:
The Packing and Unpacking Functions are Inverses
TODO
One by one Matrices are Isomorphic to R
and are isomorphic.
Row and Column Matrices are Isomorphic to
Suppose that , then and are isomorphic to
Nested Matrix Multiplication Unpacking
Given two matrices then product is equal to
With and is being used as a matrix function
Matrix Multiplication with Rows and Columns
Suppose that are matrices, and that are their row matrix and column matrix representations, then
where
is being used as a
matrix function
column matrix multiplication
suppose that
is a column matrix and
, then
By the definition of matrix multiplication the answer should be equal to
unit column matrix
is a column matrix who's i-th row is and the rest are
column extraction
suppose then the -th column of is given by multiplied by (where )
Due to the way that column matrix multiplication works, we can see that this is clear since only the -th component of is and the rest are .
Complex Transpose
We denote the complex transpose of a matrix as
Hermitian Matrix
A matrix
is said to be
hermitian diff
where we've applied the
complex-transpose
Note that the a Hermitian Matrix is also called symmetric or self-adjoint.
Normal
We say that a matrix is normal if