Đặt \(\hept{\begin{cases}a+b-c=x\\a+c-b=y\\b+c-a=z\end{cases}}\Leftrightarrow\hept{\begin{cases}a=\frac{x+y}{2}\\b=\frac{x+z}{2}\\c=\frac{y+z}{2}\end{cases}}\)
\(M=\frac{\left(a+b-c\right)\left(a+c-b\right)\left(b+c-a\right)}{3abc}\)
\(\Leftrightarrow M=\frac{xyz}{\frac{3\left(x+y\right)\left(y+z\right)\left(z+x\right)}{2.2.2}}=\frac{8xyz}{3.\left(x+y\right)\left(y+z\right)\left(z+x\right)}\)
Áp dụng BĐT AM-GM ta có:
\(M\le\frac{8xyz}{3.2\sqrt{xy}.2\sqrt{yz}.2\sqrt{zx}}=\frac{8xyz}{3.8xyz}=\frac{1}{3}\)
Dấu " = " xảy ra \(\Leftrightarrow\hept{\begin{cases}x=y\\y=z\\z=x\end{cases}}\Leftrightarrow\hept{\begin{cases}a+b-c=a+c-b\\a+c-b=b+c-a\\a+b-c=b+c-a\end{cases}\Leftrightarrow\hept{\begin{cases}b=c\\a=b\\c=a\end{cases}}}\)
Vậy \(M_{max}=\frac{1}{3}\Leftrightarrow a=b=c\)
