Lời giải:

$P=(xy+yz+xz)^2+(x^2-yz)^2+(y^2-zx)^2+(z^2-xy)^2$
$=x^2y^2+y^2z^2+z^2x^2+2x^2yz+2xy^2z+2xyz^2+x^4+y^2z^2-2x^2yz+y^4+z^2x^2-2xzy^2+z^4+x^2y^2-2xyz^2$

$=x^4+y^4+z^4+2x^2y^2+2y^2z^2+2z^2x^2$

$=(x^2+y^2+z^2)^2=10^2=100$

ta có xy+yz+zx=0=> \(\frac{xy+yz+zx}{xyz}=0\)

\(\Rightarrow\frac{1}{x}+\frac{1}{y}+\frac{1}{z}=0\)

đặt \(\frac{1}{x}=a,\frac{1}{y}=b,\frac{1}{z}=c\Rightarrow a+b+c=0\)

ta xét \(a^3+b^3+c^3-3abc=a^3+b^3+3ab\left(a+b\right)+c^3-3ab-3abc\)

           \(=\left(a+b\right)^3+c^3-3ab\left(a+b+c\right)=\left(a+b+c\right)\left(a^2+b^2+c^2-ab-bc-ac\right)=0\)

=> \(a^3+b^3+c^3=3abc\) \(\Rightarrow\frac{1}{x^3}+\frac{1}{y^3}+\frac{1}{z^3}=\frac{3}{xyz}\)

=> \(M=\frac{yz}{x^2}+\frac{zx}{y^2}+\frac{xy}{z^2}=\frac{xyz}{x^3}+\frac{xyz}{y^3}+\frac{xyz}{z^3}=xyz\left(\frac{1}{x^3}+\frac{1}{y^3}+\frac{1}{z^3}\right)=xyz.\frac{3}{xyz}=3\)

=> M=3

Ta có:

\(\dfrac{1}{x}+\dfrac{1}{y}+\dfrac{1}{z}=0\)

\(\Rightarrow\dfrac{1}{z}=-\left(\dfrac{1}{x}+\dfrac{1}{y}\right)\)

\(\Rightarrow\left(\dfrac{1}{z}\right)^3=-\left(\dfrac{1}{x}+\dfrac{1}{y}\right)^3\)

\(\Rightarrow\dfrac{1}{z^3}=-\left(\dfrac{1}{x^3}+3\cdot\dfrac{1}{x^2}\cdot\dfrac{1}{y}+3\cdot\dfrac{1}{x}\cdot\dfrac{1}{y^2}+\dfrac{1}{y^3}\right)\)

\(\Rightarrow\dfrac{1}{z^3}=-\dfrac{1}{x^3}-\dfrac{3}{x^2y}-\dfrac{3}{xy^2}-\dfrac{1}{y^3}\)

\(\Rightarrow\dfrac{1}{z^3}+\dfrac{1}{x^3}+\dfrac{1}{y^3}=-3\cdot\dfrac{1}{x}\cdot\dfrac{1}{y}\cdot\left(\dfrac{1}{x}+\dfrac{1}{y}\right)\)

\(\Rightarrow\dfrac{1}{z^3}+\dfrac{1}{x^3}+\dfrac{1}{y^3}=-3\cdot\dfrac{1}{x}\cdot\dfrac{1}{y}\cdot-\dfrac{1}{z}\)

\(\Rightarrow\dfrac{1}{z^3}+\dfrac{1}{x^3}+\dfrac{1}{y^3}=3\cdot\dfrac{1}{xyz}\)

\(\Rightarrow xyz\cdot\left(\dfrac{1}{x^3}+\dfrac{1}{y^3}+\dfrac{1}{z^3}\right)=3\)

\(\Rightarrow\dfrac{xyz}{x^3}+\dfrac{xyz}{y^3}+\dfrac{xyz}{z^3}=3\)

\(\Rightarrow\dfrac{yz}{x^2}+\dfrac{xz}{y^2}+\dfrac{xy}{z^2}=3\)

Vậy \(A=3\)