There were multiple things wrong. Thanks for pointing me in the correct direction.
Reinstalled updated display drivers manually with the ones from last month.
In services.msc, disabled the service "superfetch"
In regedit, disabled Ndu HKEY_LOCAL_MACHINE\SYSTEM\ControlSet001\Services\Ndu changed "start" modify to "4"
Those steps fixed the issues, now there is no more memory leak!