\(\hept{\begin{cases}2x+\left(3-2xy\right)y^2=3\left(1\right)\\2x^2-x^3y=2x^2y^2-7xy+6\left(2\right)\end{cases}}\)
Biến đổi (2), ta được: \(\left(xy-2\right)\left(2xy-3+x^2\right)=0\)
TH1: \(\hept{\begin{cases}xy-2=0\\2x+\left(3-2xy\right)y^2=3\Leftrightarrow\end{cases}\hept{\begin{cases}xy=2\\2x-y^2-3=0\end{cases}}}\)
\(\Leftrightarrow\hept{\begin{cases}x=\frac{y^2+3}{2}\\\frac{\left(y^2+3\right)y}{2}=2\end{cases}}\Leftrightarrow\hept{\begin{cases}x=\frac{y^2+3}{2}\\y^3+3y-4=0\end{cases}}\)
\(\Leftrightarrow\hept{\begin{cases}x=\frac{y^2+3}{2}\\\left(y-1\right)\left(y^2+y+4\right)=0\end{cases}}\Leftrightarrow\hept{\begin{cases}x=2\\y=1\end{cases}}\)
TH2: \(\hept{\begin{cases}2xy-3+x^2=0\\2x+\left(3-2xy\right)y^2=3\end{cases}}\Leftrightarrow\hept{\begin{cases}3-2xy=x^2\\2x+x^2y^2=3\end{cases}}\)
\(\Leftrightarrow\hept{\begin{cases}xy=\frac{3-x^2}{2}\\2x+\frac{\left(3-x^2\right)^2}{4}-3=0\end{cases}\Leftrightarrow}\hept{\begin{cases}xy=\frac{3-x^2}{2}\\x^4-6x^2+8x-3=0\end{cases}}\)
\(\Leftrightarrow\hept{\begin{cases}xy=\frac{3-x^2}{2}\\\left(x-1\right)^3\left(x+3\right)=0\end{cases}}\Leftrightarrow\hept{\begin{cases}x=1\\y=1\end{cases}\left(h\right)\hept{\begin{cases}x=-3\\y=1\end{cases}}}\)
Vậy \(S=\left\{\left(2;1\right);\left(1;1\right);\left(-3;1\right)\right\}\)