I would just let her calm down. If she reads your response with a clear head she’ll probably realize that he was the instigator and you were just being polite.

You did nothing wrong. Your sister is just mad at her husband and incorrectly directing her anger at you too. He probably shouldn’t be flirting with you unless everyone involved (including spouses) is fine with that. Your response was not flirtatious or inappropriate in my opinion.