Suggestion - base text resizing on how it's aligned

If the text is centered, fix the center of the object on the page and move both sides to resize.

If the text is right justtified, then fix the right edge when resizing. (i.e when grabbing the left edge)

If the text is left justified, then fix the right edge when resizing (e.g. when grab the left edge)

Somehow make it work for horizontal and verticle. You could use modifiers like control click to resize.