Don't look too much into it. It would have been more annoying to deal with you if I'd said no.

[He'd turned his gaze back to her to answer that, but mere seconds later he's looking away again, fiddling with his tie as he adds in a mumbled undertone:]

...but thanks for inviting me anyway, I guess.