Season the swordfish steaks with salt and pepper and set aside.
Heat half of the oil and butter in a large skillet or sauté pan over high heat until hot and sizzling. Add half the garlic and cook, stirring constantly, until it softens, 1 to 2 minutes. Add two of the swordfish steaks and cook for 2 minutes on each side. Remove from the pan. Repeat with the remaining ingredients.