Echoing the others: I'm 99% certain that they were just making a clumsy joke. Kinda in a way shifting the responsibility of doing something 'bad' to you, and at the same time asking you to continue giving them the excuse to indulge. So I'd say those comments were more their way of saying that you should do it again than asking you not to do it.