It started going downhill from the Oujou match because that match is what should've been the final. How many sports manga's have the team facing off against the #1 team in their first game and get demolished only to play them in the championship and beat them. That's why it's been going down, we had an expectation that it would end with Oujou (not that we didn't know way before then that it wouldn't) and after they beat their arch-rivals it just kept going.