Should I use 4x32GB or 8x16GB for deep learning?

Go with 4x32GB. Eight sticks stress the memory controller and force lower speeds, while deep learning is GPU-bound anyway. For typical dual-channel builds, 4 sticks hit rated speeds easier, offer a better upgrade path, and run cooler.