\(\left(x^2;y^2\right)=\left(a;b\right)\Rightarrow P=\dfrac{\left(a-b\right)\left(1-ab\right)}{\left(1+a\right)^2\left(1+b\right)^2}\)
Ta có:
\(\left(a+b\right)\left(1+ab\right)-\left(a-b\right)\left(1-ab\right)=2b\left(a^2+1\right)\ge0;\forall a;b\ge0\)
\(\Rightarrow\left(a+b\right)\left(1+ab\right)\ge\left(a-b\right)\left(1-ab\right)\)
\(\Rightarrow P\le\dfrac{\left(a+b\right)\left(1+ab\right)}{\left(1+a\right)^2\left(1+b\right)^2}\le\dfrac{\left(a+b+1+ab\right)^2}{4\left(1+a\right)^2\left(1+b\right)^2}=\dfrac{1}{4}\)
\(P_{max}=\dfrac{1}{4}\) khi \(\left(a;b\right)=\left(1;0\right)\) hay \(\left(x;y\right)=\left(1;0\right)\)
\(P=\dfrac{\left[\left(x-y\right)\left(1+xy\right)\right]\left[\left(x+y\right)\left(1-xy\right)\right]}{\left(1+x^2\right)^2\left(1+y^2\right)^2}\)
Áp dụng BĐT Cosi ta có:
\(\left(x-y\right)\left(1+xy\right)\le\dfrac{\left(x-y\right)^2+\left(1+xy\right)^2}{2}=\dfrac{\left(1+x^2\right)\left(1+y^2\right)}{2}\\ \left(x+y\right)\left(1-xy\right)\le\dfrac{\left(x+y\right)^2+\left(1-xy\right)^2}{2}=\dfrac{\left(1+x^2\right)\left(1+y^2\right)}{2}\)
\(\to P\le\dfrac{\left(1+x^2\right)^2\left(1+y^2\right)^2}{4\left(1+x^2\right)^2\left(1+y^2\right)^2}=\dfrac{1}{4}\)
Dấu \("="\Leftrightarrow\left(x;y\right)=\left(1;0\right)\)