> I haven't had any of those problems in moderately sized on-prem k8s clusters.

Just out of curiosity, how are you managing your on-prem k8s clusters? (Is there a toolkit you'd recommend using? Kubespray?)