We can connect to the remote.domain.com/rdweb and authenticate
We can see the icons but they suffer from the same issue as using a premade RDS icon
'there is a problem connecting to the remote resource, ask your network administrator for help'
Will not connect to any machine on the remote LAN but the connection works fine from elsewhere.

Is it NTLM or something that is locked-down by their firewall?