HD is the American Standard when it comes to motorcycles. I really don't see that ever changing during our life time. From a very young age, kids learn the name Harley Davidson due to their branding of everything under the sun. In my opinion, the marketing of the Harley Davidson name over the past 10-15 years is what keeps Harley the #1 name in motorcycling in the United States. How many people do you know who may ride a Honda (or any other bike for that mater), or may not even ride at all, but have HD logo shirts? It's great advertising for the HD brand, and the consumer actually pays for that advertising when they purchase the shirt, cap or jacket. If you lined up ten baggers/touring bikes other than a Goldwing or Victory and asked the average person what kind of bike it was, I'd bet that 90% of those asked would say Harley. When they see a motorcycle, that's the name that comes to mind.
One thing that may hurt the Victory line for the next couple of years is, styling. To me, Victory/Polaris has always been ahead of the rest of the brands when it comes to styling. Most of their current line up is very futuristic looking, and that takes a while to grow on some folks; I know it did me. They don't have the traditional "Harley look" like most of the other brands, so it's not attractive to most riders, especially the newer rider.
Victory motorcycles aren't for everybody, and never will be. But that's ok, we know which is the better American brand.