`5sinx(sinx-1)-cos^2x=3`
`<=>5sin^2x-5sinx-(1-sin^2x)-3=0`
`<=>6sin^2x-5sinx-2=0`
`<=>` \(\left[{}\begin{matrix}sinx=\dfrac{5+\sqrt{73}}{12}\left(L\right)\\sinx=\dfrac{5-\sqrt{73}}{12}\end{matrix}\right.\)
`<=>` \(\left[{}\begin{matrix}x=arcsin\left(\dfrac{5-\sqrt{73}}{12}\right)+k2\pi\\x=\pi-arcsin\left(\dfrac{5-\sqrt{73}}{12}\right)+k2\pi\end{matrix}\right.\)
Vậy PT có 2 họ nghiệm như trên.