Am I polyamorous if I'm only interested in two people?

Am I poly if I’m only interested in two specific people? I’m interested in a relationship with them, but the thought of being in a non-monogamous relationship with anyone else just feels wrong.

Of course! I answered a nearly identical question here. To quote from that answer:

Monogamous people don't think "hm, I can't see myself in a monogamous person with my hairdresser or my coworker - maybe I'm not really mono!" Straight men don't think "oh no, there are women out there who I don't want to date - do I count as a straight man?"

Of course you only want to date the people you want to date. Of course you can only see yourself being polyamorous with the people you want to date polyamorously. That's totally fine. You're in love with the people you're in love with - and it happens to be multiple people - so you're polyamorous. It doesn't matter how you feel about anyone else!