It seems you dont need to grab the border but can do this, well, according to google.
I dont use linux so its not tested by me.
“Simply hold the Alt key, right-click somewhere inside the window and drag to resize. It works well and complements the Alt-key method of moving windows: holding Alt and left-click drag on anywhere in the window”
Edit. Source. Mslinux.org wiki xfce