According to The Place Names Of Wiltshire (English Place-Name Society Volume XVI) by J.E.B. Gover, Allen Mawer and F.M. Stenton, published by Cambridge University Press, 1970:
Warminster. Beggar’s Bush (6″) is Beggers bushe 1581 – Documents in the possession of Corpus Christi College, Oxford.