Disabling the mouse swipe option

I find that if my mouse is hovering over an adjustment slider and my finger slides on the mouse, I accidentally change an adjustment. Does anyone know of a way to disable this? I don't see a way either in CO or System Preferences.

Thank you.