It seems that the issue has to do with Two Factor Authentication. When I remove it, I am able to log in and see the site perfectly fine. If I activate Yuibikey, it takes me to the login page but after that, I do not get a section to verify my Yubikey. That's what is breaking. I have another site using the JA Good template and when I do the same, I am taken to a page to verify my Yubikey without any issues.
The login page does not show Secret Key anymore