\(\sqrt{3}.M\)=\(a\sqrt{3b\left(a+2b\right)}+b\sqrt{3a\left(b+2a\right)}\)
Ap dụng bđt cosi :
\(\sqrt{3}\)M≤\(a.\left(\dfrac{5b+a}{2}\right)+b.\left(\dfrac{5a+b}{2}\right)=\dfrac{10ab+a^2+b^2}{2}\)
ta có a^2+b^2≥2ab. mà a^2+b^2≤2=>10ab≤10
=>\(\sqrt{3}\)M≤6=>M≤2\(\sqrt{3}\)