If you're already in the middle of the healthy BMI range and not having trouble keeping a healthy weight, I don't think there's been a demonstrated harm.
It’s worse for people attempting to lose weight because it apparently doesn’t work for that either, and this is the main reason sweeteners are used.