obviously I don't know your coworkers, but many people (especially woman) have a really weird attitude toward food - especially treats/desserts. it's often couched as "being naughty" if they indulge, and that can sometimes translate into a semi-teasing 'blaming' of the person who provides said treat. this may (or may not) be part of what was going on.

I think if you're inspired to make something and take it in at some point in the future, go ahead - if there are any actual issues, I'm sure someone will mention it. otherwise, their inability to resist temptation isn't on you