Thanks for the replies. I don't really want to deal with having fish also, but if so, which one do you suggest? I briefly looked into microrasbora, but they suggest you buy a school of 8+, and I didn't really want to deal with that.
These don't seem to be the red water mites as they aren't red, nor as large, nor as fast moving, but could very well be one of the many species of water mites.
I think they originally came with my pet store Marimo, so there are probably a bunch still inside anyway. Thus, I need some way to nuke them without killing the plants. The shrimp and filter with bacteria I can remove.
I just found a few in the new thank that I set up (almost done cycling), so I will need to nuke them from there also.