Those look like water louse to me, or gammarus as you suspected. They are harmless enough and a sign of good clean water!
I had them once, I used to take leaves from the pond and put them in the tank and they must have hitched a ride - I don't do that any more! I emptied the tank and set it up again and haven't seen any since (that was yers ago), though I probably caught it quite quickly/early. I have not seen them swim like yours though, only walk, but I only had a few? I wanted rid of them as I thought they were a bit creepy. I doubt there is any treatment you could use to kill them without killing the shrimp at the same time as they are so similar to shrimps in so many ways.
The chances are you didn't get rid of them all when you re-did the tank, may be they were on a plant etc that you re-used, or, if you have been getting things from a pond or steam you have re-introduced them, or they were hiding in the substrate if you didn't change that etc?
You will probably have to re-do the tank again and use as much new stuff (substrate especially) etc as you can and anything you do re-use keep in a container for a few days in tapwater so you can check it frequently and clean it well to see if there are any unwanted hitchhikers before putting it back in the tank. It looks like you have too many to catch them all!
Simon