being a member is a problem even without any interest to/from you
Why? How is this worse than a bank?
With a bank, I lend money to the bank, have no say, and they lend out my money along with other money.
With a CU, I invest my money in the CU, and they lend it out. But what if I am the one borrowing back all the money that I invested? How is my membership an issue? Why is it any more of an issue than stock ownership in a bank?