Can I have my customer pay an invoice directly without going through the portal?

Yes! Your customer can simply click on the link received in the email and he would be directed to the portal page. He can pay for the invoice without logging into the portal.