earliest documentary of 'Wudang' appeared in the Hanshu. It has been a sacred site for Daoism since the Tang dynasty. But it wasn't until around the Ming era that it was it was recognised as a martial arts school. As for Zhang Sanfeng, those stories are just what they are, stories. There are no reason to believe the guy even knows martial arts outside the folklores and novels. Historical documentions are inconclusive if whether he was even around. And most stories of him intenting Taijiquan has been blasted to pieces already.
Most of the other 'sects' you mentioned are either pure fiction or have little to do with martial arts. They are merely religious sites where temples are built in which practicing of Qigong is more about health and spiritual cultivation rather than having any martial arts intentions.
The begger sect has been explained here
http://www.chinahistoryforum.com/index.php?showtopic=13522