X% will love it.
Y% will hate it.
Z% will be indifferent to it.
(X+Y+Z=1)
If you change it, the percentages will change, but there will always be people who love it, hate it, and are indifferent to it, just maybe different people. So do something that at least you will love.