Servicing solar water heaters involves inspecting and maintaining components like the collector, tank, and pipes to ensure optimal performance. This includes cleaning, part replacement, and diagnostics to fix any issues.