I ride year round with full heated gear in the winter. I don't care how cold it gets. As long as there is no chance for ice on the road (morning dew can freeze to the road, so be careful!) I'm on the bike. My bike is outside under a cover. I only work about 10 minutes from home, all slower (45mph max) back roads.
My advice is to REALLY let that bike warm up. 2 minutes is not long enough of a warm up. I go out and uncover the bike and get her started up. I take the cover inside and start the process of suiting up in the gear. After gearing up I head outside and lock the front door behind me. Once the bags are loaded up with my EDC and lunch, keys and phone securely zipped in a pocket, I plug the gear in and mount the bike.
It's about a half mile of riding to get out of my section. I take it very slowly, typically in first gear so that all the moving parts have a good chance to start warming up as well. This is not summer time, I do not crank on that throttle, no matter how much fun it would be to break that cold rear tire free. Remember that the tires on your bike were probably not designed for extreme cold. They will never warm up to their designed operating temperature and will not grip that cold road like intended. As long as you think safe, you'll be safe. Take it a little slower, especially in the turns. Avoid riding with any type of moisture in the air. Even if it's not foggy in the morning, the dew can come up off of rivers and streams that are close to the road. Be safe out there.
Bucks County, PA
2011 Victory Cross Country
Lloydz Timing Wheel +4
Lloydz Air Filter
Decored Stock Exhaust