Yeah I get this too but no history of Raynaud's.
It's funny though because now that I think about it, I haven't had that feeling nearly as bad since I started doing more manual labor outdoors a few years ago? No idea what to make of that. My feet still stay pretty cold though.
But yeah I know that exact feeling of wearing gloves even to work on the computer.