Yes, they can – if you add a new participant to an existing conversation, he/she can see all the messages that had been added to the conversation beforehand.

Take this into account when you add new participants and check whether there is no information in the group chat that the new participant(s) is not allowed to see. When in doubt, it is better to create an entirely new group chat.