Ensure that you have added a South African geo-zone. Go to System > Localisation > Geo Zones.
Edit the tax options to include the geo-zone. Go to System > Localisation > Taxes > Tax Rates. Click 'Edit' for VAT or 'Insert'. South African VAT is currently 14%, be sure to set the Geo Zone setting to the one you created in the previous step.