You cannot Delete Tax Rates, but you can Archive them. Go to:

• Menu > Company Settings > Financial Tab > Tax Rates Action Column > Select Edit (To edit Tax Name & let to Archive or Active) or (Select the Orange Circle to make it Inactive)