Ta có \(\frac{1}{P}=\frac{\left(x+yz\right)\left(y+zx\right)\left(z+xy\right)^2}{x^3y^3}=\frac{x+yz}{y}\cdot\frac{y+zx}{x}\cdot\frac{\left(z+xy\right)^2}{x^2y^2}\)
\(=\left(\frac{x}{y}+z\right)\left(\frac{y}{x}+z\right)\left(\frac{z}{xy}+1\right)^2=\left[1+\left(\frac{x}{y}+\frac{x}{y}\right)z+x^2\right]\left(\frac{z}{xy}+1\right)^2\ge\left(1+2x+x^2\right)\)\(\left[\frac{4x}{\left(x+y\right)^2}+1\right]^2\)\(=\left(z+1\right)^2\left[\frac{4z}{\left(z-1\right)^2}+1\right]^2=\left[\frac{4z\left(z+1\right)}{\left(z-1\right)^2}+1\right]^2=\left[6+\frac{12}{z-1}+\frac{8}{\left(z-1\right)^2}+z-1\right]^2\)
\(=\left[6+\frac{12}{z-1}+\frac{3\left(z-1\right)}{4}+\frac{8}{\left(z-1\right)^2}+\frac{z-1}{8}+\frac{z-1}{8}\right]\)
Áp dụng BĐT Cosi ta có:
\(\frac{1}{P}\ge\left[6+2\sqrt{\frac{12}{z-1}\cdot\frac{3\left(z-1\right)}{3}}+3\sqrt[3]{\frac{8}{\left(z-1\right)^2}\cdot\frac{z-1}{8}\cdot\frac{z-1}{8}}\right]^2=\frac{729}{4}\)
\(\Rightarrow P\le\frac{4}{729}\). dấu "=" xảy ra <=> \(\hept{\begin{cases}x=y=2\\z=5\end{cases}}\)
