Do I need to ground myself before touching RAM?

Yes, you can damage RAM with static electricity, but the risk is small if you touch the metal case of your computer (with the power supply switched off but plugged in) before handling the module, and hold it by the edges only. You don’t need a wrist strap for home use if you keep one hand on the case while working. Also avoid bending the gold pins on the bottom.