Is it worth leaving a pool heater on all night?

Probably not. For gas or propane heaters, you’re just burning money heating water that loses most of its heat overnight. Heat pumps are efficient but still wasteful unless you need the pool hot first thing in the morning. A timer set to kick on a few hours before swimming is better. Save the money for chemicals instead.