Unfortunately there is no way to hide annotations while editing.
As for layer management, it doesn't exist either, but you can do a rough emulation of layers using groups. Put your regular widgets into one group, and annotations into another group. Then you can edit groups independently by "entering" them, which will fade out the elements in the other group.
Let me know if this is an acceptable workaround for you.