Funnily enough, I had tried several online tutorials and none of them worked, what finally did was something I figured out by just messing around.
If at any point edge reinstalls itself (for example, you forgot to spam any key while booting), repeat steps 2 to 6.
Additional thing I did, not sure how necessary it is: Set up a Scheduled Task in Task Scheduler to run a .bat script by BugsyMalone_ getting rid of Webview2 (run on login of any user, run with highest privileges, retry every 1 minute if failed, do not stop after a set amount of time, start regardless of whether the computer is on AC power, allow task to be run on demand, all those settings).
Normally one would just go into Settings, set a default browser, and that would be the end of it, but I use Tor Browser and it normally does not show up as an option in Settings. I followed this tutorial and successfully set Tor as my default browser.
It should be obvious that the Search function in the bottom left next to the Start Menu will stop working. I never used it anyway.
This feels more like suppressing edge than really getting rid of it, but it is the closest I have gotten.