So, I spent hours testing plugins, moving plugins around and other things. I was getting really mad, was about to give up then.... I noticed something. EVERYTIME it froze, I noticed it was the battle with a singular Goblin.
Long story short, there's an event that plays after every battle. The span when it happens was somehow set wrong. I was happy, but pissed off I spent so many hours only to notice by chance how easy the fix was.
https://i.ibb.co/QmQLNCp/error-fix.png