Do I need a separate Oracle Database 12c (or older) license to run a failover server?

No, as long as the otherwise passive(!) failover server is not going to be active for more than 10 calendar days for any given year and the failover server uses the same technical setup as compared to the productive system.

Source: Oracle Data Recovery Policy 2016