I visited Howe Caverns a few years ago, and it was quite an enjoyable experience. You can take a walking/boat tour, during which your guide will point out some of the interesting geological features. It’s not the most adventuresome experience (there are handrails, lamps, and electrical outlets clearly visible on the main path), but it’s a safe place to bring the kids.