How do I get rid of old users?

At the bottom of the screen it shows a list of current users, old users and temporary users. Is there a way to get rid of the ones who aren’t really users of my channel any longer?

Yes there is. As the owner of a room go into the room settings (icon top right), scroll down to the user list and delete the users you want.