If, β=x→0lim(cosx)cotx (1∞form)
β=ex→0limcotx[cosx−1]
β=ex→0limsinx−cosx[1−1+2sin22x]
β=ex→0lim2sin2x.cos2x−cosx[1−1+2sin22x]
β=ex→0limcos2x−cosx.sin2x
β=e0
β=1
α=x→π/4limcos(x+4π)tan3x−tanx
=x→π/4limcos(x+4π)tanx(tanx+1)(tanx−1)
α=x→π/4limtanx×x→π/4lim(tanx+1)×x→π/4limcos(x+4π)(tanx−1)
α=1×(1+1)×x→π/4limcos(x+4π)(tanx−1)
=2x→π/4limcos(x+4π)tanx−1
=2x→π/4limcosx.cos(x+4π)sinx−cosx
=−22x→π/4limcosx.cos(x+4π)(21cosx−21sinx)
α=−22x→π/4limcosx.cos(x+4π)cos(x+4π)
α=−4
So, the equation whose roots are α and β is
x2+3x−4=0
Hence, a=1,b=3