Xbox controllers are safe to use and do NOT cause the game to crash. Some controllers (Dual Shock / PS4 / Logitech): Having these controllers connected, even if you aren't planning to use them, will cause the game to crash. I have an update from our Senior GM on steps you can take to troubleshoot/fix the crashes.
