Can I get a replacement for the small piece that holds the pump in place?

Yes, but it ain't easy. Katadyn does not price or sell small accessories like that. They are stocked at Katadyn North-America in MN, MN. Some dealers have some spares around. Call 1-800-755-6701 and be patient--they are a small company and have two customer service people or e-mail
http://www.katadyn.us/service/customer-service.html

Please be patient, they are good MN people, but have a lot to do.
View Details: Katadyn Hiker Water Microfilter >