I wouldn't say arrogant, if anything I'd say he's the opposite. He had among the lowest self-esteem of any competitor I've ever seen.
He fixated himself far too much on achieving Total Victory to the point that he alienated his family and sacrificed his career to train for Sasuke. Yet tournament after tournament, he would come up short and see other competitors surpass him while also maintaining functioning family lives (like Nagano and Takeda). This caused his infamous mental blockade which was a function of a LACK OF confidence rather than arrogance and resulted in so many of his failures being attributable to mental errors (i.e. his numerous Soritatsu Kabe failures, each consecutive failure being contributed to by the mental demons caused by his past issues with the obstacle). Arrogance by that regard would be that he continuously failed but never let those failures get to his head because he still believed in himself, when in fact it was the opposite; those failures ruined his career from a mental and hence performance perspective as we saw from SASUKE 14 onwards
The reason why he appeared arrogant at times is that his lack of success despite (or as mentioned above, partially exacerbated by his) severe obsession led him to lose any sense of competitive spirit, and display his jealousy and dislike for competitors who were surpassing his performances. You'd often see him be the last to smile or applaud his comrades when one of them clears Stage 3 (e.g. when Yuuji cleared Stage 3 in SASUKE 22, he looked borderline angry until he realized the camera was on him and then let out a fake smile). This is also part of his inherent nature; even before Sasuke, he claimed Akiyama cheated on Quick Muscle just so he could win. Again though, this isn't arrogance. The fact that he's even relied on cheating (i.e. SASUKE 12, as well as the example I just mentioned) means that he fundamentally doubts his own potential yet obsessive nature still drives him to try and realise his dream by any means necessary, even when he doesn't think he can do it fair and square. I'm not sure I could live with myself if I achieved Total Victory as a result of lying about disqualification or time-out, but that just shows how his fixation on Kanzenseiha led to downright delusion at times.