Is Cave of the Winds worth visiting in winter?

No, save it for summer or early fall. The wooden walkway is often closed or partially open due to ice, and even if open, it’s slick and unpleasant. You’ll spend more time watching your feet than the scenery, and the park runs reduced hours with possible last-minute closures.