Will adding more RAM speed up Plex transcoding?

No, more RAM won’t speed up Plex transcoding because transcoding is a CPU/GPU job, not a memory bottleneck. It will only reduce swapping if your server is running out of memory. If you’re not seeing swap usage at 8GB, you’re fine; if you are, 16GB is cheap insurance for smoother multitasking, not faster transcoding.