Switch to multimap, no idea wtf I was thinking.