Bad Starter or Starter Solenoid?

No. If the bendix is engaging then the starter may not be spinning over. Might be a problem with the starter or maybe something to do with how the gear on the starter is trying to engage with the teeth on the converter or flywheel.

I know this is not the case because when I try and start the car, absolutely nothing happens. All I get is a click which sounds like the relay, but I can't be for sure since I can't start the car and listen in the engine bay at the same time.