Đặt \(a+b=x,b+c=y,c+a=z\) với \(x,y,z>0\). Ta có:
\(\dfrac{1}{x+1}+\dfrac{1}{y+1}+\dfrac{1}{z+1}=2\)
\(\Rightarrow\dfrac{1}{x+1}=2-\dfrac{1}{y+1}-\dfrac{1}{z+1}\) \(=1-\dfrac{1}{y+1}+1-\dfrac{1}{z+1}\) \(=\dfrac{y}{y+1}+\dfrac{z}{z+1}\)
\(\Rightarrow\dfrac{1}{x+1}\ge2\sqrt{\dfrac{y}{y+1}.\dfrac{z}{z+1}}\)
Tương tự, ta có: \(\dfrac{1}{y+1}\ge2\sqrt{\dfrac{z}{z+1}.\dfrac{x}{x+1}}\) và \(\dfrac{1}{z+1}\ge2\sqrt{\dfrac{x}{x+1}.\dfrac{y}{y+1}}\)
Nhân theo vế 3 BĐT vừa tìm được, ta có:
\(\dfrac{1}{x+1}.\dfrac{1}{y+1}.\dfrac{1}{z+1}\ge2\sqrt{\dfrac{y}{y+1}.\dfrac{z}{z+1}}.2\sqrt{\dfrac{z}{z+1}.\dfrac{x}{x+1}}.2\sqrt{\dfrac{x}{x+1}.\dfrac{y}{y+1}}\)
\(\Leftrightarrow\dfrac{1}{\left(x+1\right)\left(y+1\right)\left(z+1\right)}\ge8.\dfrac{xyz}{\left(x+1\right)\left(y+1\right)\left(z+1\right)}\)
\(\Leftrightarrow xyz\le\dfrac{1}{8}\)
\(\Leftrightarrow\left(a+b\right)\left(b+c\right)\left(c+a\right)\le\dfrac{1}{8}\)
Dấu "=" xảy ra \(\Leftrightarrow a=b=c=\dfrac{1}{4}\)
Vậy GTLN của \(\left(a+b\right)\left(b+c\right)\left(c+a\right)\) là \(\dfrac{1}{8}\), xảy ra khi \(a=b=c=\dfrac{1}{4}\)
