I had set up a new toolbar menu to test some new features I was working on and created an ACL group called Beta Testers where were to have access to it, it would not show for anyone other than Super User but when I moved that to a "regular" menu it worked exactly as expected, only people in the Beta Tester group could see the menu item.