Configuring RDWeb with custom RDS listening port

We are using a custom port for RDS on the server. Works properly

We also disable UDP via GPO for access to remote desktop server. 

When I connect to the RDWeb I can access (SSL configured porperly) But now when I try to access any apps it fails on opening remote port. 

RD GW Mgr -> Resource Auth Polciy -> Default policies created

RDG_AllDomainComputers -> Changed port from 3389 to match custom port

RDG_RDConnectionBrokers -> changed port from 3389 to match custom port

I have all RDS roles on single server. Using CA root Cert. 

Any suggestions would be helpful. 

Thanks,

SJ