\(a^3-3ab^2=2\)
=>\(\left(a^3-3ab^2\right)^2=2^2=4\)
=>\(a^6-6a^4b^2+9a^2b^4=4\)
\(b^3-3a^2b=-11\)
=>\(\left(b^3-3a^2b\right)^2=\left(-11\right)^2=121\)
=>\(b^6-6a^2b^4+9a^4b^2=121\)
Do đó: \(a^6-6a^4b^2+9a^2b^4+b^6-6a^2b^4+9a^4b^2=121+4=125\)
=>\(a^6+3a^4b^2+3a^2b^4+b^6=125\)
=>\(\left(a^2+b^2\right)^3=125=5^3\)
=>\(a^2+b^2=5\)


