đặt \(t=a+b\) từ GT => \(3=t^2-ab\ge\frac{3}{4}t^2\)\(\Leftrightarrow\)\(-2\le t\le2\)
\(P=-4t^3-3t^2+18t+9=\hept{\begin{cases}\frac{-1}{4}\left(2t+3\right)^2\left(4t-9\right)-\frac{45}{4}\ge\frac{-45}{4}\left(dungvoit\le2\right)\\-\left(t-1\right)^2\left(4t+11\right)+20\le20\left(dungvoit\ge-2\right)\end{cases}}\)
\(P_{min}=\frac{-45}{4}\) tại
\(\hept{\begin{cases}a^2+b^2+ab=3\\a+b=\frac{-3}{2}\end{cases}}\Leftrightarrow\left(a;b\right)=\left\{\left(\frac{-3-\sqrt{21}}{4};\frac{-3+\sqrt{21}}{4}\right);\left(\frac{-3+\sqrt{21}}{4};\frac{-3-\sqrt{21}}{4}\right)\right\}\)
\(P_{max}=20\) tại \(\hept{\begin{cases}a^2+b^2+ab=3\\a+b=1\end{cases}}\Leftrightarrow\left(a;b\right)=\left\{\left(2;-1\right);\left(-1;2\right)\right\}\)