"Another thing I noticed when the spike happens, it's like my game alt-tabs, I see my mouse cursor for the half second, then game returns to normal. Like another program loaded or an action was done off game."
Based on this, another application seems to be running and coming to the forefront...