The best thing you can do is look at that chart as a "speed limit sign". You don't want to go over it, but anything less is fair game. (Even if people are honking, not your problem. In a production shop, on heavy machines, and where production rate can justify reduced tool life, that speed limit is where you want to be.
In practice, your best bet is going to be to put something in the machine, and see what speed works with YOUR tools, YOUR workpiece, and YOUR lathe. That will be the best speed to run at. Surface speed, depth of cut, feed per rev, the rigidity of the machine, the rigidity of the material are ALL going to play into what's going to work out best. They're all interrelated, and they all are going to take some "try it and see" to find out what really works.
There's a dozen reasons why carbide tools don't always get along with lighter lathes. Don't forget that "carbide" isn't a type of tool, there's approximately twelve billion different types, geometries, grades, shapes, sizes, chip breakers, coatings.... But in general, I agree. Small lathes like (reasonably) well ground high speed steel bits better than they do insert tools. Yes, inserts can work, and sometimes work well. And some modern materials weren't even invented when some of our slow "hss" lathes were built... So there's compromises to be made no matter what approach you take. It need not be an exclusive decision to go with one or the other, but being able to hand grind a tool is a great skill to have on a small lathe. Or any lathe really. You never know when you're gonna want too make up something for some odd thing you thought would be a good idea until you were half done and realized you're stuck and you've to have some special thing for some situation you made that nobody's ever thought of before,,,,