I think they look more like baby cockroaches. Especially when a piece of food lands on the the bottom of the tank at night. But does it bother me? Nahhhh.
Different when I set up my first reef tank ten years ago. I'd have bad dreams about finding especially creepy things in it.