Should I even try this winter?

Yes - depending.  I am right up the road from you in Chapel Hill.  They still bite in the winter around here - just not as hard or frequent - gotta work for it and be extra patient - that's the depending part - gotta have the patience to fish extra slow.  If think you are going too slow, slow it down even more.  I like craw bugs drug across the bottom on a 3/8 or 1/2 oz roundball jig head.