Eureka! it works.
I was almost there but I was trying to do it backwards, that is I was trying to make the groups for each group, not a page with groups who can access the pages.
Talk about twisted Boolean logic that I can comprehend only every third day, some days I just sit and stare at the screen.
Thanks also to Tom's reply who somehow made me feel better 'cause I couldnt quite get it.