Like others said, you can adapt to using most keybinds on colemak. I had a tough adapting to positional keybinds such as the home arrows. It just was in very weird places on colemak.

Eventually I started using Extend layer from BigBagTrix which provides many useful keys near home. It uses caps as a modifier but you could possibly add dual behavior for tap and hold to have backspace function if you want.

Now I am used to a mix of extend and vim bindings.