The Simplex Algorithm

Basic Concepts and Principles

The Simplex Algorithm whose invention is due to George Dantzig in 1947 and in 1975 earned him the National Medal of Science is the main method for solving linear programming problems.
The simplex algorithm performs iterations into the extreme points set of feasible region, checking for each one if Optimalit criterion holds.


Given a linnear programming standard problem P,

Minimize \( C^t x \)

Subject to

\( \begin{matrix} Ax=b \\ x\geqslant 0 \end{matrix} \)

Donde

\( A \in \mathbb M _{mxn}, \, rnk(A)=m ,\,\, b \in R^{m}, \, C \in R^{n}, \,\, n \geqslant m \)
Thus, m is the number of constraits (files of matrix A or dimension of vector b) and n is the number of variables (columns of matriz A or dimension of vector C).

If P has any optimal solution xk finite, we know from Linear Programming Theory that xk is contained into the extreme points subset of feasible points set, S.

Simplex Algorithm basic idea is to perform iterations into extreme points set until a condition called "optimality criterion" holds.

If it holds at a certain extreme point xk, then this xk then such point is the solution that we are looking for.

Extended Theory

Lets suppose that x, extreme point of S.

Because the extreme points set is conformed by solutions of Ax=b subsystems, x can be write as

\( x=\begin{bmatrix} B^{-1}b \\ 0\end{bmatrix} \).

with B mxm-square A submatrix with rank m.

We can decompose A in two B and N sub-matrices in following mode

\( A=\begin{bmatrix} B \\ N\end{bmatrix} \)

B as said, is an mxm submatrix with rank m corresponding to solution of system Bx=b and N is the matrix formed with the remaining columns from A.(Remember that n≥m).

Lets w another point from the feasible region S. Then

Aw = b, ie

\(Bw_{B} + Nw_{N} = b \)

Because B is invertible

\(w_{B} = B^{-1}b - B^{-1}Nw_{N} \)

Applying Ct to w we obtain

\( C^{t}w = C_{B}^{t}w_{B} + C_{N}^{t}w_{N} \)\( = C_{B}^{t}(B^{-1}b - B^{-1}Nw_{N}) + C_{N}^{t}w_{N} \)\( = C_B^tx_B + C_{N}^{t}w_{N} - C^tB^{-1}Nw_{N} \)


Because w belongs to feasible region, we know that

wN ≥ 0, so, if x were the optimal solution, then it must holds

\((1) \,\,\,\,\,\,\,\,\,\,\,\,\,\,\,\,C_{N}^{t}-C^t_{B}B^{-1}N\, \geq \, 0\)

This is the basic idea from the Simplex Algorithm that we were refering before, and it is call Optimality Criterion

The Simplex Algorithm Optimality Condition

$$ C_{N}^{t}-C^t_{B}B^{-1}N\, \geq\, 0 $$
If this condition holds, then x is the optimal solution of P.

The optimallity condition equation has as coordinates

\(c_{j} - C^t_{B}B^{-1}a_{j} = c_{j} - X_{B}a_{j} = c_{j} - z_{j} \)

Being aj, column vector of N.

In resume, optimality criteria is

$$ c_{j} - z_{j} \geq 0 $$

Lets suposse now than (1) does't holds, ie

\( C_{N}^{t}-C_{B}B^{-1}N\, < 0 \)

them there are two possible cases ...

Case 1



\( y_{j} = B^{-1}a_{j} \leqslant 0, \; \forall j \) then we can build

\( x= w+\lambda d_{j} \) siendo \( d_{j}=\begin{bmatrix} -B^{-1}a_{j} \\ e_{j} \end{bmatrix} \)

we know that dj is an extreme direction of feasible set S, in particular

\( Ad_{j} = 0 \)

so \( x= w+\lambda d_{j} \) is also feasible solution \( \forall \lambda d_{j} \geqslant 0 \)

In another way

\( C^{t}x = C^{t} (w+\lambda d_{j} ) = \)\( C^{t}w + \lambda(-C^{t}B^{-1}a_{j})d_{j} = \)\( C^{t}w - \lambda(z_{j}-c_{j}) \mapsto - \infty \) when \( \lambda \mapsto \infty \)

This means that we'd can to make solution as small as we'd want without leaving the feasible set S and so this is a Unbounded case solution

Case 2



Vector\( y_{j} \) has someone positive component

We determine the index s that meets $$ s = min \{ k: \,\ c_{k} - z_{k} < 0 \} $$ Ei, take the minimum of negative in \( c_{k} - z_{k} \)

Them it is possible to build any other feasible solution (it's going to be into the extreme point of S) where the function is smaller

The new solutions it is build as follows

\( x= w+\lambda d_{s} \)

being\( d_{s}=\begin{bmatrix} -B^{-1}a_{s} \\ e_{s} \end{bmatrix} \) and \( \lambda = min \{ \frac {x_i}{y_{is}}, y_{is} \geqslant 0, x = B^{-1}b \} \).

With this value λ, x is feasible solution and if for example for any r

\( \lambda = \frac {x_r}{y_{rs}} \)

Then x is the basic solution associed to matrix

\( B' = (a_1, a_2, ..., a_{r-1},a_s,a_{r+1},...,a_m) \)

Ie:

s: index entering into basis.

r: index leaving from basis.

That is, we changed a vector by another (we have substituted the vector in r position for which is in place s).

In resume we're going to built a solution from other.

Now we have to do the change of basis to obtain the matrix A and the new \( c_j-z_j \). We will see that in the section Simplex Calculations.

Overview of the Simplex Method


The extreme points x0, ..., xs, are the solutions for the systms

     Bx=b, with B mxm submatrix of initial matrix A.

Optimal solution, if there, should be one of these points...

Given an extreme point xi in the feasible set, we check if the Optimality condition holds for it, if does then xi is the optimal solution founded.

Otherwise, one of these two situations can happen:
    1) Unbouded Solution.
    2) It is possible to iterate to next extreme point and test the optimality condition for it.
This is the simplex algorithm basic idea, iterating between the extreme points of feasible set, which are solutions of linear systems equations taken from square submatrices of constraints matrix A, and make this until one of them meets the optimality condition, let's say x, and in such case optimal solution it's reached at x.





Was useful? want add anything?



Post here

Post from other users

arun:

2012-12-11 11:27:51
Thanks for this theory and worked samples.

It was very heplfull for me!!!

Rudra Prakash:

2013-02-04 13:49:36
thnks a lot.its very very very useful to me...

bashir:

2013-12-12 22:25:24
it was very benefit for me... thank you... could you post it to my Email?!

Malli:

2015-01-29 10:39:14
z= 3x1 + 2X2 - x3

min(Z)
Subject to
x1 + 2X2 - 3x3 = 4
4x1 - x3 =7
2x1 - 3x2 + x3 <=5

Admin:

2015-01-29 12:49:1
Hi Malli. You can insert your problem in "the simplex algorithm" in this same web at
http://www.mathstools.com/section/main/simplex_online
To obtain

X1= 7/4, X2=9/8, X3=0
after 4 iterations

Ayodeji Omoboye:

2015-11-27 11:37:03
Max P = 3x + 2y

Subject To
   2x + y ≤ 18
   2x + 3y ≤ 42
   3x + y ≤ 24

   x ≥ 0, y ≥ 0

Solve the problem using the simplex method in linear programming

Admin:

2015-11-27 12:39:55
Hi, Ayodeji Omoboye.
You can use our tool in.

Simplex Algorithm online
to solve this problem.

Aparently problem has infinte possible solutions.

Regards.
Carlos




Post here
Update cookies preferences