Not them' refers to a group of people or things that are not included in the group being discussed. It is used to contrast the group being discussed with OTHERS that are not part of the conversation. For example, if someone were talking about their friends, they might say, 'I spent time with my friends, but not them.' In this case, 'not them' would refer to anyone who was not part of the group of friends being discussed.