a) \(\sqrt{28}+\sqrt{125}-3\sqrt{343}-\frac{3}{8}\sqrt{396}=2\sqrt{7}+5\sqrt{5}-21\sqrt{7}-\frac{9\sqrt{11}}{4}\)
\(=-19\sqrt{7}+5\sqrt{5}-\frac{9\sqrt{11}}{4}\)
b) \(\sqrt{17-3\sqrt{32}}+\sqrt{17+3\sqrt{32}}=\sqrt{17-12\sqrt{2}}+\sqrt{17+12\sqrt{2}}\)
\(=\sqrt{\left(2\sqrt{2}-3\right)^2}+\sqrt{\left(2\sqrt{2}+3\right)^2}=\left(3-2\sqrt{2}\right)+2\sqrt{2}+3=6\)