\(a+b=5\Rightarrow b=5-a\)
\(a^3-\left(5-a\right)^3-3a\left(5-a\right)=1\)
\(\Leftrightarrow a^3-\left(125-75a+15a^2-a^3\right)-15a+3a^2-1=0\)
\(\Leftrightarrow2a^3-12a^2+60a-126=0\)
\(\Leftrightarrow2\left(a-3\right)\left(a^2-3a+21\right)=0\)
\(\Rightarrow\left\{{}\begin{matrix}a=3\\b=2\end{matrix}\right.\)