Should I run ESXi without ECC memory?

No. Non-ECC memory on a host with 20 VMs is asking for trouble. ECC isn’t optional—it’s a standard feature for servers running any virtualization workload. Without it, a single bit flip in RAM can silently corrupt data or crash the entire host.