exec.Command
isn't a shell, so you don't need to escape special characters in your command. Pass each argument in exactly how you want it processed by the command.
exec.Command("find", dir, "-type", "f", "(", "-iname", "*.zip", "-o", "-iname", "*.tar", "-o", "-iname", "*.rar", ")")