Chances are that your partner has been told that they're a commitment - phobe before — or they'll at least have some awareness of the fact that they prefer to keep things casual.
The fact that he has been married before shows he is not a complete commitment - phobe, so instead of being intimidated by his ex or previous marriage, view his past in a positive light and as a signal he is comfortable with settling down.