Sửa: \(M=\frac{6}{20x^6-\left(8-40y\right)x^2+25y^2-5}\)
Đặt \(N=20x^6-\left(8-40y\right)x^2+25y^2+5\)
\(=20\left[x^6-2x^3\frac{1-5y}{5}+\left(\frac{1-5y}{5}\right)^2\right]+25y^2-20\left(\frac{1-5y}{5}\right)^2=5\)
\(=20\left(x^3-\frac{1-5y}{5}\right)^2+25y^2-\frac{4}{5}+8y-20y^2+5=20\left(x^3-\frac{1-5y}{2}\right)^2+5\left(y+\frac{4}{5}\right)^2+1\ge1\)
Dấu "=" xảy ra <=> \(\hept{\begin{cases}y=\frac{-4}{5}\\x=1\end{cases}\Rightarrow M=\frac{6}{N}\le\frac{6}{1}=6}\)
Vậy Max M=6 đạt được khi x=1; y=-4/5