The pitch has hardly "come back to haunt us"... this season, at least, we made extensive (and expensive) efforts to rectify it, so it's not as if the club had been ignoring it, or tried to fix it on the cheap.
In all that time, Saturday was the first time I would be inclined to say the pitch had a direct influence on the result. And if we do fail to qualify for Europe, it won't be down to that one game-- we've dropped plenty of other points home and away that we shouldn't have.