VMKB 1009562 has a lot of good information, I’m not going to repeat it here, but it is a great resource for determining what network ports have to be open between what devices when using SRM & vSphere Replication.
Also, this diagram is surprisingly complicated… (reminds me of a dream-catcher)