Don’t overthink it:
Were there any deal breakers? If yes, no second date
If not, date two is for figuring out if you are compatible on a subtler level
Dates 3-5 are, Do I like this person and how they communicate?
Do I want to invest time and effort getting to know them and allowing them to know me?