Red ants are blaming me for everything.

So I personally haven't been aggressive towards them, intentionally just leaving them alone after getting just enough from them to make the armor. I was wearing it exploring the nest just taking rocks and the various special items, didn't take eggs or food, when I came out a stinkbug attacked the nest, I stood back with my gas mask and took carefully aimed shots with the bow, it killed a lot of ants, easily 20+ I got a warning saying they are annoyed with me, then I gathered up the corpses, immediately got another warning, they want me gone. I just helped them take that thing down, teamwork man, why the eviction notice?