I fish Silver Lake all the time. You won't catch anything to brag about, but there are bass. I haven't tried cat fishing yet. Been going for about three years now. You can generally catch one or two any given day, and I've rounded up 6 on one trip. No boats with motors. Kayak fishing is where it's at on this body of water. The opposite shore line from the campgrounds is the best for shore fishing. I've always had the best luck with black jigs and dark trailer. Bass range all around 10-12 inches, 1lbs to 1 1/2lbs, but they put up a good little fight.
Its perfect if you're getting that itch and need the fix, and don't have time to get the boat out on the river, lake Anna, or travel. Highly suggest fishing it from a sit on top fishing kayak.