I was working along side someone that is both in the same town as me, and the same guild. I put a Fleshing Beam on my plot and activated all the permissions except public. They still couldn't access it, despite the guild box being checked and being in the same guild as me.