\(x-3=y\left(x+1\right)\Rightarrow y=\frac{x-3}{x+1}\)
\(A=x^2+\left(\frac{x-3}{x+1}\right)^2=x^2+\left(1-\frac{4}{x+1}\right)^2=x^2+1-\frac{8}{x+1}+\frac{16}{\left(x+1\right)^2}\)
\(=\left(x+1\right)^2-2x-\frac{8}{x+1}+\frac{16}{\left(x+1\right)^2}=\left(x+1\right)^2+\frac{16}{\left(x+1\right)^2}-2\left(x+1+\frac{4}{x+1}\right)+2\)
Đặt \(x+1+\frac{4}{x+1}=a\Rightarrow a^2=\left(x+1\right)^2+\frac{16}{\left(x+1\right)^2}+8\) (\(\left|a\right|\ge4\))
\(\Rightarrow A=a^2-8-2a+2=a^2-2a-6\)
- Nếu \(a\le-4\Rightarrow A=\left(a+4\right)^2-10a-22\ge-10a-22\ge40-22=18\)
- Nếu \(a\ge4\Rightarrow A=\left(a-4\right)^2+6a-22\ge6a-22\ge24-22=2\)
\(\Rightarrow A_{min}=2\) khi \(a=4\Rightarrow x+1+\frac{4}{x+1}=4\Rightarrow\left\{{}\begin{matrix}x=1\\y=-1\end{matrix}\right.\)