It’s a bit hard to get out to the temple, but it’s definitely worth it. Take the train from Victoria to Lingfield (about 50 minutes), then you can either walk to the temple (about an hour) or, if you plan ahead, arrange for a cab to pick you up. Don’t walk in the dark, though – the street’s a bit dangerous.