a: \(4x^2-12x+9-3\left(2x-3\right)\left(x+1\right)\)
\(=\left(2x-3\right)^2-\left(2x-3\right)\left(3x+3\right)\)
\(=\left(2x-3\right)\left(2x-3-3x-3\right)\)
\(=-\left(x+6\right)\left(2x-3\right)\)
b: \(25-4x^2+8xy-4y^2\)
\(=25-\left(2x-2y\right)^2\)
\(=\left(5-2x+2y\right)\left(5+2x-2y\right)\)