I am a Harley convert, and you couldn't pay me enough to switch back. I came from a 2010 Road Glide, and before that was an Ultra Classic. Now I'm on a '13 Cross Country and been on it since July.
There are a hundred reasons why I can tell you why Victory is so much better then Harley, but one thing I can tell you is to youtube Harley vs. Victory. There is a 4 or 5 part video series done by Arizona Victory that explains why Harley is still stuck in the 1940's technology engine wise. Keep in mind it is a dealer, but nothing he says is a lie,.. its all true.
My dealer gutted my mufflers, put in a stage 1 filter and a tune on my bike before I took delivery. I've got 109 HP and something like 120 ft lbs of torque just from that (I didn't get the dyno sheet, but saw it). To do that with a Harley, either 96, 103, or even a 110 screamin eagle you would have to shell out some big bucks. It only cost me $700, even thought the stock XCs have something like 109 tq. and 100HP. My wife just sold her CVO Road Glide, but it couldn't keep up with my Cross Country, and these 103's Harley is putting out now suck my exhaust fumes from the get go.
handling is miles ahead of H-D, and comfort,.. well I was never comfortable on a Harley. I'm 6'3" and the floorboards were always to small, I felt cramped and anything more then 300-400 miles a day was difficult. On my Victory, I can ride on the stock seat, stock floorboards all day with no complaints or discomfort. Just the usual getting off to stretch at gas stops and I'm good. I changed out my bars, but that's because I like apes.
maintenance is easy, 1 hole for all 3. Because of that, the engine is cooler and riding across Arizona in July was hot, but not as hot as sitting on top of a Harley roasting. You have more storage in the saddlebags and even though the stereo controls looks like an afterthought hanging down, after some miles on the bike I prefer them that way.
One thing I did right away, was buy the Ness lower fork deflectors, and that took away any buffeting I had (which every bike I have ever rode had buffeting,.. its just something that comes with motorcycling and my build I guess). That's something you might look into.
I know its hard switching. It took me a few weeks to muster up the courage once I sat on one, to actually test ride it. After 2 blocks I was sold and converted. After 2500 miles and the bike broke in good, the seat broke in, I was happy as a pig in $#!t. If you listen to your friends that drink the H-D koolaide, you will never know what your missing. I may own a Harley again in the future, but it will be a bar hopper or something for fun around town. My Victory will take me on trips with no worries on breaking down or how bad my body is gonna hurt once Im there. I couldn't be happier, and that's my story.. lol