For the system of equations a1x+b1y+c1z=d1,a2x+b2y+c2z=d2 and a3x+b3y+c3z=d3,
We have D=∣a1a2a3b1b2b3c1c2c3∣,Dx=∣d1d2d3b1b2b3c1c2c3∣,Dy=∣a1a2a3d1d2d3c1c2c3∣ and Dz=∣a1a2a3b1b2b3d1d2d3∣.
And, the system has no solution, if D=0 and atleast one of {D}_{x},{D}_{y}&{D}_{z} is non-zero.
Thus, for the given system of equations,
x+y+z=6, 3x+5y+5z=26 and x+2y+λz=μ
We have D=∣13115215λ∣=0
⇒1(5λ−10)−1(3λ−5)+1(6−5)=0
⇒5λ−10−3λ+5+1=0
⇒2λ=4
⇒λ=2.
And, Dz=∣131152626μ∣=0
⇒1(5μ−52)−1(3μ−26)+6(6−5)=0
⇒5μ−52−3μ+26+6=0
⇒2μ=20
⇒μ=10.
∴ For no solution λ=2 and μ=10.