\(\Leftrightarrow-3x^3-5x^2+4x+4+m\left(x^3+4x^2+5x+2\right)=0\)
\(\Leftrightarrow\left(x+2\right)\left(1-x\right)\left(3x+2\right)+m\left(x+2\right)\left(x+1\right)^2=0\)
\(\Leftrightarrow\left(x+2\right)\left(-3x^2+x+2+mx^2+2mx+m\right)=0\)
\(\Leftrightarrow\left(x+2\right)\left[\left(m-3\right)x^2+\left(2m+1\right)x+m+2\right]=0\)
\(\Leftrightarrow\left[{}\begin{matrix}x=-2\\\left(m-3\right)x^2+\left(2m+1\right)x+m+2=0\left(1\right)\end{matrix}\right.\)
Để pt đã cho có 3 nghiệm pb nhỏ hơn 1 \(\Leftrightarrow\left(1\right)\) có 2 nghiệm pb khác -2 và nhỏ hơn 1
\(f\left(-2\right)=m-12\ne0\Rightarrow m\ne12\)
\(m\ne3\) ; \(\Delta=\left(2m+1\right)^2-4\left(m-3\right)\left(m+2\right)=8m+25>0\Rightarrow m>-\frac{25}{8}\)
Để (1) có 2 nghiệm pb thỏa mãn \(x_1< x_2< 1\)
\(\Rightarrow\left\{{}\begin{matrix}\left(x_1-1\right)\left(x_2-1\right)>0\\\frac{x_1+x_2}{2}< 1\end{matrix}\right.\) \(\Leftrightarrow\left\{{}\begin{matrix}x_1x_2-\left(x_1+x_2\right)+1>0\\x_1+x_2< 2\end{matrix}\right.\)
\(\Leftrightarrow\left\{{}\begin{matrix}\frac{m+2}{m-3}+\frac{2m+1}{m-3}+1>0\\\frac{2m+1}{m-3}< 2\end{matrix}\right.\) \(\Leftrightarrow\left\{{}\begin{matrix}\frac{4m}{m-3}>0\\\frac{7}{m-3}< 0\end{matrix}\right.\)
\(\Leftrightarrow\left\{{}\begin{matrix}\left[{}\begin{matrix}m< 0\\m>3\end{matrix}\right.\\m< 3\end{matrix}\right.\) \(\Rightarrow m< 0\)
Kết hợp lại ta được: \(-\frac{25}{8}< m< 0\)