Đặt \(\left(\sqrt{a};\sqrt{b};\sqrt{c}\right)=\left(x;y;z\right)\Rightarrow x+y+z=1\)

BĐT trở thành: \(\dfrac{xy}{\sqrt{x^2+y^2+2z^2}}+\dfrac{yz}{\sqrt{y^2+z^2+2x^2}}+\dfrac{zx}{\sqrt{x^2+z^2+2y^2}}\le\dfrac{1}{2}\)

Ta có:

\(x^2+z^2+y^2+z^2\ge\dfrac{1}{2}\left(x+z\right)^2+\dfrac{1}{2}\left(y+z\right)^2\ge\left(x+z\right)\left(y+z\right)\)

\(\Rightarrow\dfrac{xy}{\sqrt{x^2+y^2+2z^2}}\le\dfrac{xy}{\sqrt{\left(x+z\right)\left(y+z\right)}}\le\dfrac{1}{2}\left(\dfrac{xy}{x+z}+\dfrac{xy}{y+z}\right)\)

Tương tự: \(\dfrac{yz}{\sqrt{y^2+z^2+2x^2}}\le\dfrac{1}{2}\left(\dfrac{yz}{x+y}+\dfrac{yz}{x+z}\right)\)

\(\dfrac{zx}{\sqrt{z^2+x^2+2y^2}}\le\dfrac{1}{2}\left(\dfrac{zx}{x+y}+\dfrac{zx}{y+z}\right)\)

Cộng vế với vế:

\(VT\le\dfrac{1}{2}\left(\dfrac{zx+yz}{x+y}+\dfrac{xy+zx}{y+z}+\dfrac{yz+xy}{z+x}\right)=\dfrac{1}{2}\left(x+y+z\right)=\dfrac{1}{2}\) (đpcm)

Dấu "=" xảy ra khi \(x=y=z\) hay \(a=b=c\)

\(\dfrac{1}{\left(a+b+a+c\right)^2}\le\dfrac{1}{4\left(a+b\right)\left(a+c\right)}=\dfrac{1}{4\left(a^2+ab+bc+ca\right)}\le\dfrac{1}{64}\left(\dfrac{1}{a^2}+\dfrac{1}{ab}+\dfrac{1}{bc}+\dfrac{1}{ca}\right)\)

\(\le\dfrac{1}{64}\left(\dfrac{1}{a^2}+\dfrac{1}{a^2}+\dfrac{1}{b^2}+\dfrac{1}{c^2}\right)=\dfrac{1}{64}\left(\dfrac{2}{a^2}+\dfrac{1}{b^2}+\dfrac{1}{c^2}\right)\)

Tương tự và cộng lại:

\(P\le\dfrac{1}{64}\left(\dfrac{4}{a^2}+\dfrac{4}{b^2}+\dfrac{4}{c^2}\right)=\dfrac{1}{16}.3=\dfrac{3}{16}\)

Dấu "=" xảy ra khi \(a=b=c=1\)

Áp dụng bđt: \(\dfrac{1}{x+y}\le\dfrac{1}{4}\left(\dfrac{1}{x}+\dfrac{1}{y}\right)\left(1\right)\)

\(\dfrac{1}{2a+b+c}=\dfrac{1}{\left(a+b\right)+\left(a+c\right)}\le\dfrac{1}{4}\left(\dfrac{1}{a+b}+\dfrac{1}{a+c}\right)\)

\(\Rightarrow P\le\dfrac{1}{16}\left[\left(\dfrac{1}{a+b}+\dfrac{1}{a+c}\right)^2+\left(\dfrac{1}{a+b}+\dfrac{1}{b+c}\right)^2+\left(\dfrac{1}{b+c}+\dfrac{1}{a+c}\right)^2\right]\)\(\Rightarrow16P\le\dfrac{2}{\left(a+b\right)^2}+\dfrac{2}{\left(b+c\right)^2}+\dfrac{2}{\left(a+c\right)^2}+\dfrac{2}{\left(a+b\right)\left(b+c\right)}+\dfrac{2}{\left(a+b\right)\left(b+c\right)}+\dfrac{2}{\left(b+c\right)\left(c+a\right)}\)

Áp dụng: \(x^2+y^2+z^2\ge xy+yz+xz\left(2\right)\) với a+b=x,b+c=y,c+a=z

\(\Rightarrow16P\le\dfrac{4}{\left(a+b\right)^2}+\dfrac{4}{\left(b+c\right)^2}+\dfrac{4}{\left(c+a\right)^2}\)

Ta có: \(\dfrac{1}{\left(a+b\right)^2}\le4.16.\left(\dfrac{1}{a}+\dfrac{1}{b}\right)^2\)(do (1))

\(\Rightarrow16P\le\dfrac{1}{4}.16\left[\left(\dfrac{1}{a}+\dfrac{1}{b}\right)^2+\left(\dfrac{1}{b}+\dfrac{1}{c}\right)^2+\left(\dfrac{1}{c}+\dfrac{1}{a}\right)^2\right]=\dfrac{1}{4}\left(\dfrac{1}{a^2}+\dfrac{1}{b^2}+\dfrac{1}{c^2}+\dfrac{2}{ab}+\dfrac{2}{bc}+\dfrac{2}{ca}\right)\le\dfrac{1}{4}.4.\left(\dfrac{1}{a^2}+\dfrac{1}{b^2}+\dfrac{1}{c^2}\right)=3\)(do(2) và \(\dfrac{1}{a^2}+\dfrac{1}{b^2}+\dfrac{1}{c^2}=3\))

\(\Rightarrow P\le\dfrac{3}{16}\)

\(ĐTXR\Leftrightarrow a=b=c=1\)

\(Áp\ dụng\ BĐT\ AM - GM,\ ta\ có: \\\sum\dfrac{1}{a^2+2b^2+3}=\sum\dfrac{1}{(a^2+b^2)+(b^2+1)+2}\le\sum\dfrac{1}{2ab+2b+2} \\=\dfrac{1}{2}\sum\dfrac{1}{ab+b+1}=\dfrac{1}{2}.1=\dfrac{1}{2} \\Đẳng\ thức\ xảy\ ra\ khi\ a=b=c=1.\)