Both devices need to be connected the same way to your home network. This will not work if one device is on an ethernet connection, and the other is on a Wi-Fi connection.
Make sure you are signed into the XBox app with the same account you use on your XBox One.