I think cold, but good to remember that Budapest is crowded with hot spas, e.g. Gellert is really great. I think most of the spas are open also winter time due being thermal-based.