Eigenvalues and eigenvectors of matrices

Terms:

An eigenvector of a mapping is a vector that is only changed in magnitude but not in direction by the mapping. The factor by which the magnitude changes is the associated eigenvalue. The set of eigenvectors to an eigenvalue is called eigenspace. The set of eigenvalues of an image is the spectrum of the image. The spectral radius is the eigenvalue with the largest amount. The dimension of the eigenspace is the geometric multiplicity of the eigenvalue. The algebraic multiplicity is defined by the multiplicity of zeros of the characteristic polynomial.

Definition:

For a square matrix A, each vector v is an eigenvector if the following condition is met:

$Av=\lambda v$

$\text{with}\lambda \in \mathbb{C}\text{und}v\ne 0$

The factor λ is the eigenvalue belonging to the eigenvector v. The eigenvalues can be real or complex.

Illustrative interpretation:

In general, a matrix A maps a vector a into another vector b. The eigenvectors v are distinguished by the fact that they are only stretched or compressed by a factor. In the diagram is the vector v a eigenvector streched by the factor λ. The vector a is not a eigenvector because the matrix changes also the direction.

Two-dimensional example

Using this example, the eigenvalue and eigenvector are explained clearly in the plane.

$A=\left(\begin{array}{cc}3& -1\\ 1& 1\end{array}\right)$

This matrix maps the vector (1,1) as follows.

$\left(\begin{array}{cc}3& -1\\ 1& 1\end{array}\right)\left(\begin{array}{c}1\\ 1\end{array}\right)=\left(\begin{array}{c}2\\ 2\end{array}\right)=2\left(\begin{array}{c}1\\ 1\end{array}\right)$

This the vector is an eigenvector of A, which is stretched by the factor of 2. Thus, the eigenvalue belongs to the eigenvector (1,1).

For another vector, e.g., (2,3), this is not true.

$\left(\begin{array}{cc}3& -1\\ 1& 1\end{array}\right)\left(\begin{array}{c}2\\ 3\end{array}\right)=\left(\begin{array}{c}3\\ 5\end{array}\right)$

However, the matrix does not just have one eigenvector. For example, the vector (2,2) is also an eigenvector.

$\left(\begin{array}{cc}3& -1\\ 1& 1\end{array}\right)\left(\begin{array}{c}2\\ 2\end{array}\right)=\left(\begin{array}{c}4\\ 4\end{array}\right)=2\left(\begin{array}{c}2\\ 2\end{array}\right)$

Eigenvalue Calculation

The equation

$Av=\lambda v$

can be transformed into the homogeneous equation system

$(A-\lambda E)v=0$

The system of equations has a non-trivial solution if and only if the determinant disappears. That if applicable

$\det (A-\lambda E)=0$

The polynomial is called the characteristic polynomial of A and the equation is the characteristic equation of A. If λ_i is an eigenvalue of A then the solutions of the characteristic equation are the eigenvectors of A to the eigenvalue λ_i.

Two-dimensional example part 2

In the second part of the example eigenvalue and eigenvector are calculated. First, the characteristic polynomial is determined.

$\det \left(A-\lambda E\right)=$

$\left(\left(\begin{array}{cc}3& -1\\ 1& 1\end{array}\right)-\mathrm{\lambda }\left(\begin{array}{cc}1& 0\\ 0& 1\end{array}\right)\right)=\left(\begin{array}{cc}3-\lambda & -1\\ 1& 1-\lambda \end{array}\right)={\lambda }^2-4\lambda +4$

The zeros of the characteristic polynomial are the eigenvalues of A.

${\lambda }^2-4\lambda +4=0$

So the eigenvalue of A is:

${\lambda }_i=2$

The solutions of the characteristic equation system provide the eigenvectors.

$\left(A-{\lambda }_{i}E\right)v=\left(\left(\begin{array}{cc}3& -1\\ 1& 1\end{array}\right)-2\left(\begin{array}{cc}1& 0\\ 0& 1\end{array}\right)\right)v=\left(\begin{array}{cc}1& -1\\ 1& -1\end{array}\right)\left(\begin{array}{c}x\\ y\end{array}\right)=0$

That results in the following two equations.

$x-y=0$

$x-y=0$

That means all vectors v_i where both components are equal, are eigenvectors to eigenvalue λ_i = 2.

$v_i=\left(\begin{array}{c}x\\ x\end{array}\right)$

Calculator for the calculation of the characteristic polynomial p(λ) of matrix A

Input matrix elements: a₁₁, a₁₂, ...

Matrix dimension N =

↹#.000

Calculator for calculating the eigenvalues

The calculator uses the QR-Algorithm to approximate the eigenvalues. Starting from a matrix A, a sequence of orthogonal or unitary matrices is determined so that the recursive matrix sequence converges as far as possible against an upper triangular matrix. Since all transformations in the recursion are similarity transformations, all matrices of the matrix sequence have the same eigenvalues with the same multiples. If an upper triangular matrix is reached in the limit value, a shear shape of A, the eigenvalues can be read from the diagonal elements.

Input matrix elements: a₁₁, a₁₂, ...

Matrix dimension N =

↹#.000

Accuracy digits =

Max number of iterations =

Calculator for Eigenvector-eigenvalue identity

The following referenced calculator uses the QR decomposition and the eigenvector-eigenvalue identity to compute the eigenvalues and the magnitudes of the eigenvectors: Eigenvector-eigenvalue identity

Related sites

Here is a list of of further useful sites: