Results are the main factor but they are not the only thing the manager will be judged on, at least by the fans. A lot of people will not pay to watch dull, negative football, even if the results are not too bad. Since the quality of football influences results, the brand of football served up is hardly likely to produce fantastic results. Football is an entertainment industry, and despite results being kind of okay so far, people are already voting with their feet.
Villa fans do seem rather insipid when it comes to protests. Fair play to Blackburn fans for trying to safeguard the long term future of their club, and to those Man Yoo fans who wear the Newton Heath green and yellow in protest at the Glazers. The latter doesn't seem to have affected their team's performances.