I don't see anything funny in describing a family as crazy.
If you had meant what you now say you mean I think you should have said that as I doubt that too many people would have gained that meaning from saying the family is crazy.
People take this family stuff too seriously. I am hardly the first person to describe them jokingly as crazy.
As for the rest I will say what I want...Less not get nasty with one another now. We can all voice are opinions negative or positive. Lets not forget that. We don't all have to agree and if that is not the case well news to me.