\(x^2-2x-m^2-1=0\)
Theo Vi-ét, ta có :
\(\left\{{}\begin{matrix}x_1+x_2=-\dfrac{b}{a}=2\\x_1x_2=\dfrac{c}{a}=-m^2-1\end{matrix}\right.\)
Ta có :
\(x_1^2+x_2^2=20\)
\(\Leftrightarrow\left(x_1+x_2\right)^2-2x_1x_2=20\)
\(\Leftrightarrow2^2-2.\left(-m^2-1\right)=20\)
\(\Leftrightarrow4+2m^2+2-20=0\)
\(\Leftrightarrow2m^2=14\)
\(\Leftrightarrow m=7\)
\(\Leftrightarrow m=\pm\sqrt{7}\)