You are sure that there is no https configuration involved here - is that correct?
I can't see it can be if you are doing a fresh install, but thought I should check...
The reason I mention this is because SSL configured systems can cause issues with the PSI JVM not having the servers self-signed SSL certificates (or sometimes the Certificate Authority ca-bundles for "proper" certificates) in it's key stores and hence the PSI cannot connect to the Apache server...
Starting to run out of ideas now...
How about trying the install on standard ports (http / 80) and then reconfiguring it afterwards to your non-standard ports?
Rgds
Gary