Biến đổi được:  x = 2 ( a + b ) 3 ( a 3 − b 3 ) ; y = 9 ( a − b ) 2 4 ( a + b )

⇒ P = x . y = 2 ( a + b ) 3 ( a 3 − b 3 ) . 9 ( a − b ) 2 4 ( a + b ) = 3 ( a − b ) 2 ( a 2 + ab + b 2 )

\(P=\dfrac{a^2}{ab+b^2}+\dfrac{b^2}{ab-a^2}-\dfrac{a^2+b^2}{ab}\) (\(a\ne b;a\ne0;a\ne-b;b\ne0\))

\(=\dfrac{a^2}{b\left(a+b\right)}+\dfrac{b^2}{a\left(b-a\right)}-\dfrac{a^2+b^2}{ab}\)

\(=\dfrac{a^3\left(a-b\right)-b^3\left(a+b\right)-\left(a^2+b^2\right)\left(a+b\right)\left(a-b\right)}{ab\left(a+b\right)\left(a-b\right)}\)

\(=\dfrac{a^4-a^3b-b^3a-b^4-\left(a^2+b^2\right)\left(a^2-b^2\right)}{ab\left(a+b\right)\left(a-b\right)}\)

\(=\dfrac{a^4-a^3b-b^3a-b^4-\left(a^4-b^4\right)}{ab\left(a+b\right)\left(a-b\right)}\)

\(=\dfrac{-a^3b-b^3a}{ab\left(a+b\right)\left(a-b\right)}\)

\(=\dfrac{-ab\left(a^2+b^2\right)}{ab\left(a+b\right)\left(a-b\right)}=-\dfrac{a^2+b^2}{a^2-b^2}\).

b) -Ta có: \(P=0\)

\(\Leftrightarrow-\dfrac{a^2+b^2}{a^2-b^2}=0\)

\(\Leftrightarrow a^2+b^2=0\)

-Vì \(a^2\ge0;b^2\ge0\)

\(\Rightarrow a=0;b=0\) (không thỏa mãn điều kiện).

-Vậy không có giá trị nào của a,b để \(P=0\).

c) 

Ta có : \(3a^2+3b^2=10ab\)

\(\Leftrightarrow3a^2-ab-9ab+3b^2=0\)

\(\Leftrightarrow a\left(3a-b\right)-3b\left(3a-b\right)=0\)

\(\Leftrightarrow\left(3a-b\right)\left(a-3b\right)=0\)

\(\Leftrightarrow\left[{}\begin{matrix}3a-b=0\\a-3b=0\end{matrix}\right.\Leftrightarrow\left[{}\begin{matrix}b=3a\left(L\right)\\a=3b\left(N\right)\end{matrix}\right.\)

Thế \(a=3b\) vào P ta được :

\(P=\dfrac{3b-b}{3b+b}=\dfrac{2b}{4b}=\dfrac{1}{2}\)

\(3a^2+3b^2=10ab\)

\(\Leftrightarrow3a^2-10ab+3b^2=0\)

\(\Rightarrow3a^2-9ab-ab+3b^2=0\)

\(\Leftrightarrow3a\left(a-3b\right)-b\left(a-3b\right)=0\)

\(\Leftrightarrow\left(a-3b\right)\left(3a-b\right)=0\)

Trường hợp 1: a=3b

\(A=\dfrac{a-b}{a+b}=\dfrac{3b-b}{3b+b}=\dfrac{2}{4}=\dfrac{1}{2}\)

Trường hợp 2: b=3a

\(A=\dfrac{a-b}{a+b}=\dfrac{a-3a}{a+3a}=\dfrac{-2}{4}=-\dfrac{1}{2}\)

3(a^2+b^2)=10ab

=>3a^2-10ab+3b^2=0

=>3a^2-9ab-ab+3b^2=0

=>3a(a-3b)-b(a-3b)=0

=>(a-3b)(3a-b)=0

=>b=3a(loại) hoặc a=3b(nhận)

\(K=\dfrac{3b+b}{3b-b}=2\) 

Ta có : \(3a^2+3b^2=10ab\Rightarrow3a^2+3b^2-10ab=0\)

\(\Rightarrow\left(4a^2-8ab+4a^2\right)-\left(a^2+2ab+b^2\right)=0\)

\(\Rightarrow\left(2a-2b\right)^2=\left(a+b\right)^2\Rightarrow2a-2b=a+b\Rightarrow a=3b\)

\(\Rightarrow D=\dfrac{a-b}{a+b}=\dfrac{3b-b}{3b+b}=\dfrac{1}{2}\)

\(3a^2+3b^2=10ab\)

\(\Leftrightarrow\left(3a^2-9ab\right)+\left(3b^2-ab\right)=0\)

\(\Leftrightarrow3a\left(a-3b\right)+b\left(3b-a\right)=0\)

\(\Leftrightarrow\left(a-3b\right)\left(3a-b\right)=0\)

\(\Leftrightarrow\left[{}\begin{matrix}a=3b\\a=\dfrac{1}{3}b\end{matrix}\right.\)

Vì a>b>0 nên a=3b

\(\Rightarrow P=\dfrac{a-b}{a+b}=\dfrac{3b-b}{3b+b}=\dfrac{2b}{4b}=\dfrac{1}{2}\)

Xét: P² = \(\dfrac{\left(a-b\right)^2}{\left(a+b\right)^2}=\dfrac{a^2-2ab+b^2}{a^2+2ab+b^2}=\dfrac{3a^2+3b^2-6ab}{3a^2+3b^2+6ab}=\dfrac{10ab-6ab}{10ab+6ab}=\dfrac{4ab}{16ab}=\dfrac{1}{4}\)

=> P = \(\dfrac{1}{2}\)