\(\frac{xy}{x^2+y^2}=\frac{5}{8}\)
\(\Rightarrow5\left(x^2+y^2\right)=8xy\)
Ta có : \(P=\frac{x^2-2xy+y^2}{x^2+2xy+y^2}=\frac{5\left(x^2+y^2-2xy\right)}{5\left(x^2+y^2+2xy\right)}\)
\(=\frac{5\left(x^2+y^2\right)-10xy}{5\left(x^2+y^2\right)+10xy}=\frac{8xy-10xy}{8xy+10xy}=\frac{-2xy}{18xy}=\frac{-1}{9}\)
Ta có: \(P=\frac{x^2-2xy+y^2}{x^2+2xy+y^2}=\frac{\frac{x^2+y^2-2xy}{x^2+y^2}}{\frac{x^2+y^2+2xy}{x^2+y^2}}=\frac{\frac{x^2+y^2}{x^2+y^2}-\frac{2xy}{x^2+y^2}}{\frac{x^2+y^2}{x^2+y^2}+\frac{2xy}{x^2+y^2}}\)
\(=\frac{1-\frac{2xy}{x^2+y^2}}{1+\frac{2xy}{x^2+y^2}}=\frac{1-\frac{2.5}{8}}{1+\frac{2.5}{8}}=\frac{-1}{9}\)
Vậy \(P=\frac{-1}{9}\)