Do we need to purchase Microsoft Remote Desktop Services CALs for our system administrators?

No, there is no license requirement for RDS CAL for up to two users as long as they are only accessing the server and the installed software for administrative purposes. This access may also be simultaneous.

Source: Licensing brief_Windows Server RDS and Desktop Apps for RDS_as is 2018-08-23