It's difficult to determine who's at fault without fully understanding the personalities of the individuals involved. If you were true friends than it should be reflected in how you communicate to one another.
I personally would not have considered his text an invite and would have politely declined due to the short notice.