Unable to connect to the remote server

I'm trying to do two things that give me the same error:

1. Trying to use PowerShell on the CRM server. Expample command Get-CrmSetting TraceSettings
2. Trying to call the WebApi from a remote server

Both give the same error: Unable to connect to the remote server.

Any ideas on why this is happening?