Theo giả thiết ta có : \(x+yz=yz-z-1=\left(z-1\right)\left(y+1\right)=\left(x+y\right)\left(y+1\right)\)

Tương tự : \(y+zx=\left(x+y\right)\left(x+1\right)\)

Và \(z+xy=\left(x+1\right)\left(y+1\right)\)

Nên \(P=\frac{x}{\left(x+y\right)\left(y+1\right)}+\frac{y}{\left(x+y\right)\left(x+1\right)}+\frac{z^2+2}{\left(x+1\right)\left(y+1\right)}\)

            \(=\frac{x^2+y^2+x+y}{\left(x+y\right)\left(x+1\right)\left(y+1\right)}+\frac{z^2+2}{\left(x+1\right)\left(y+1\right)}\)

Ta có \(x^2+y^2\ge\frac{\left(x+y\right)^2}{2};\left(x+1\right)\left(y+1\right)\le\frac{\left(x+y+2\right)^2}{4}\)

nên \(P\ge\frac{2\left(x+y\right)^2+4\left(x+y\right)}{\left(x+y+2\right)^2\left(x+y\right)}+\frac{4\left(z^2+2\right)}{\left(x+y+2\right)^2}=\frac{2\left(x+y\right)+4}{\left(x+y+2\right)^2}+\frac{4\left(z^2+2\right)}{\left(x+y+2\right)^2}\)

                                                       \(=\frac{2}{z+1}+\frac{4\left(z^2+2\right)}{\left(z+1\right)^2}=f\left(z\right);z>1\)

Lập bảng biến thiên ta được \(f\left(z\right)\ge\frac{13}{4}\) hay min \(P=\frac{13}{4}\) khi \(\begin{cases}z=3\\x=y=1\end{cases}\)

\(xy+yz+zx-xyz=1-x-y-z+xy+yz+zx-xyz\)

\(=\left(1-x\right)-y\left(1-x\right)-z\left(1-x\right)+yz\left(1-x\right)\)

\(=\left(1-x\right)\left(1-y-z+yz\right)=\left(1-x\right)\left(1-y\right)\left(1-z\right)\)

\(xy+yz+zx+xyz+2=1+x+y+z+xy+yz+zx+xyz\)

\(=\left(1+x\right)+y\left(1+x\right)+z\left(1+x\right)+yz\left(1+x\right)\)

\(=\left(1+x\right)\left(1+y\right)\left(1+z\right)\)

\(1+x+y+z=1+1\Rightarrow1+x=\left(1-y\right)+\left(1-z\right)\ge2\sqrt{\left(1-y\right)\left(1-z\right)}\)

Tương tự ta cũng có: \(1+y\ge2\sqrt{\left(1-z\right)\left(1-x\right)}\)

\(1+z\ge2\sqrt{\left(1-x\right)\left(1-y\right)}\)

Vậy \(S\le\frac{\left(1-x\right)\left(1-y\right)\left(1-z\right)}{8\left(1-x\right)\left(1-y\right)\left(1-z\right)}=\frac{1}{8}\)

Áp dụng bất đẳng thức Cauchy 

\(\frac{1}{xy}+\frac{1}{yz}+\frac{1}{zx}\ge\frac{9}{xy+yz+zx}\)

\(M\ge\frac{1}{x^2+y^2+z^2}+\frac{9}{xy+yz+zx}=\frac{1}{x^2+y^2+z^2}+\frac{4}{2\left(xy+yz+xz\right)}+\frac{7}{xy+yz+zx}\)

Áp dụng BĐT Cauchy - Schwarz :

\(\frac{1}{x^2+y^2+z^2}+\frac{4}{2\left(xy+yz+zx\right)}\ge\frac{\left(1+2\right)^2}{\left(x+y+z\right)^2}=9\)

và \(\frac{7}{xy+yz+xz}\ge\frac{7}{\frac{1}{3}\left(x+y+z\right)^2}=21\)

\(\Rightarrow M\ge9+21=30\)

Dấu " = " xảy ra khi \(x=y=z=\frac{1}{3}\)

Áp dụng BĐT Cauchy schwarz ta có:

\(M=\frac{1}{x^2+y^2+z^2}+\frac{1}{xy}+\frac{1}{yz}+\frac{1}{zx}\)

\(\ge\frac{1}{x^2+y^2+z^2}+\frac{9}{xy+yz+zx}\)

\(=\frac{1}{x^2+y^2+z^2}+\frac{4}{2\left(xy+yz+zx\right)}+\frac{7}{2\left(xy+yz+zx\right)}\)

\(\ge\frac{9}{\left(x+y+z\right)^2}+\frac{7}{\frac{2\left(x+y+z\right)^2}{3}}=30\)

Đẳng thức xảy ra tại x=y=z=¹/₃

Ta có \(\sqrt{xy}+\sqrt{yz}+\sqrt{zx}=\sqrt{xyz}\left(x,y,z>0\right)\).

\(\Leftrightarrow\frac{1}{\sqrt{x}}+\frac{1}{\sqrt{y}}+\frac{1}{\sqrt{z}}=1\).

\(P=\frac{1}{xyz}\left(x\sqrt{2y^2+yz+2z^2}+y\sqrt{2z^2+xz+2x^2}+z\sqrt{2x^2+xy+y^2}\right)\)\(\left(x,y,z>0\right)\).

Ta có: 

\(\sqrt{2y^2+2yz+2z^2}=\sqrt{\frac{5}{4}\left(y^2+2yz+z^2\right)+\frac{3}{4}\left(y^2-2yz+z^2\right)}\)

\(=\sqrt{\frac{5}{4}\left(y+z\right)^2+\frac{3}{4}\left(y-z\right)^2}\).

Ta có:

\(\frac{3}{4}\left(y-z\right)^2\ge0\forall y;z>0\).

\(\Leftrightarrow\frac{3}{4}\left(y-z\right)^2+\frac{5}{4}\left(y+z\right)^2\ge\frac{5}{4}\left(y+z\right)^2\forall y;z>0\).

\(\Rightarrow\sqrt{\frac{3}{4}\left(y-z\right)^2+\frac{5}{4}\left(y+z\right)^2}\ge\frac{\sqrt{5}}{2}\left(y+z\right)\forall y,z>0\).

\(\Leftrightarrow\sqrt{2y^2+yz+2z^2}\ge\frac{\sqrt{5}}{2}\left(y+z\right)\forall y;z>0\).

\(\Leftrightarrow x\sqrt{2y^2+yz+2z^2}\ge\frac{\sqrt{5}}{2}x\left(y+z\right)\forall x;y;z>0\left(1\right)\).

Chứng minh tương tự, ta được:

\(y\sqrt{2x^2+xz+2z^2}\ge\frac{\sqrt{5}}{2}y\left(x+z\right)\forall x;y;z>0\left(2\right)\).

Chứng minh tương tự, ta được:

\(z\sqrt{2x^2+xy+2y^2}\ge\frac{\sqrt{5}}{2}z\left(x+y\right)\forall x;y;z>0\left(3\right)\).

Từ \(\left(1\right),\left(2\right),\left(3\right)\), ta được:

\(x\sqrt{2y^2+yz+2z^2}+y\sqrt{2z^2+xz+2x^2}+z\sqrt{2x^2+xy+2y^2}\)\(\ge\)\(\frac{\sqrt{5}}{2}\left[x\left(y+z\right)+y\left(x+z\right)+z\left(x+y\right)\right]=\sqrt{5}\left(xy+yz+zx\right)\).

\(\Leftrightarrow\frac{1}{xyz}\left(x\sqrt{2y^2+yz+z^2}+y\sqrt{2z^2+zx+2x^2}+z\sqrt{2x^2+xy+2y^2}\right)\)\(\ge\)\(\frac{\sqrt{5}\left(xy+yz+zx\right)}{xyz}=\sqrt{5}\left(\frac{1}{x}+\frac{1}{y}+\frac{1}{z}\right)\).

\(\Leftrightarrow P\ge\frac{\sqrt{5}}{3}.3\left(\frac{1}{x}+\frac{1}{y}+\frac{1}{z}\right)=\frac{\sqrt{5}}{3}\left(1^2+1^2+1^2\right)\left[\left(\frac{1}{\sqrt{x}}\right)^2+\left(\frac{1}{\sqrt{y}}\right)^2+\left(\frac{1}{\sqrt{z}}\right)^2\right]\)

\(\left(4\right)\).

Vì \(x,y,z>0\)nên áp dụng bất đẳng thức Bu-nhi-a-cốp-xki, ta được:
\(\left(1^2+1^2+1^2\right)\left[\left(\frac{1}{\sqrt{x}}\right)^2+\left(\frac{1}{\sqrt{y}}\right)^2+\left(\frac{1}{\sqrt{z}}\right)^2\right]\ge\)\(\left(1.\frac{1}{\sqrt{x}}+1.\frac{1}{\sqrt{y}}+1.\frac{1}{\sqrt{z}}\right)^2\).

\(\Leftrightarrow\left(1^2+1^2+1^2\right)\left[\left(\frac{1}{\sqrt{x}}\right)^2+\left(\frac{1}{\sqrt{y}}\right)^2+\left(\frac{1}{\sqrt{z}}\right)^2\right]\ge\left(\frac{1}{\sqrt{x}}+\frac{1}{\sqrt{y}}+\frac{1}{\sqrt{z}}\right)^2=1^2=1\)

(vì\(\frac{1}{\sqrt{x}}+\frac{1}{\sqrt{y}}+\frac{1}{\sqrt{z}}=1\)).

\(\Leftrightarrow\frac{\sqrt{5}}{3}\left(1^2+1^2+1^2\right)\left[\left(\frac{1}{\sqrt{x}}\right)^2+\left(\frac{1}{\sqrt{y}}\right)^2+\left(\frac{1}{\sqrt{z}}\right)^2\right]\ge\frac{\sqrt{5}}{3}\)\(\left(5\right)\).

Từ \(\left(4\right)\)và \(\left(5\right)\), ta được:

\(P\ge\frac{\sqrt{5}}{3}\).

Dấu bằng xảy ra.

\(\Leftrightarrow\hept{\begin{cases}x=y=z>0\\\sqrt{xy}+\sqrt{yz}+\sqrt{zx}=\sqrt{xyz}\end{cases}}\Leftrightarrow x=y=z=9\).

Vậy \(minP=\frac{\sqrt{5}}{3}\Leftrightarrow x=y=z=9\).