Gamle Oslo

Visit the Munch museum and see The Scream

Take a walk in Middelalderparken (The Medieval park or something?) or botanical gardens. Drink a beer at some of the cheaper pubs in the area. Have a meal at a cafe/resturant in the Grønland area.
In the summertime you should take a boat trip to one of the islands!