got the problem resolved for most part. i put the brakes up to 10 on the right side brakes. i started gettign them again occasionally when i turned the other brake on left down to get better casting difference. went back to were it was before with no problem and I'm happy now. it will still do a sort of birds nest/backspin after a certain point when the line goes out about 10 yards or so then just before the line hits water when its dropping the birds nest goes away and fixes it self.

If you are still having occasional birdsnest even with full or all brakes on, add a drop or two of oil on the spool bearings. This will slow down the bearings and will result to less chance of overruns.

You don't need a new reel. The sx is a great reel (and I'm a shimano guy). You have to adjust the tension cap on the right. Hold your rod at a 45' angle, release the spool, and tighten the tension cap until your lure falls very slow.

What size lure are you using and what's the rod specs