From what I've read, I am not convinced he actually lived with VF although there is not a huge amount of information about where he lived other than the past 6 months
If we work a little timeline for his accommodation during the VF relationship it might be this:
September 2012 Moved to Ceinws (Friend and villager Carl Utteridge, 76, said he had spoken briefly with Mr Bridger when they were both waiting for a bus several weeks ago. He was living here and waiting for a bus into Machynlleth but we didnt say much. He had only been living here about a month and we only spoke the once. He didnt say much.)
April 2012 Moved into Llanbrynmair (The couples 22-year-old son, a garage worker also called Paul Edwards, said: I knew Mark relatively well, since he moved in about six months ago. About three-to-four weeks ago I realised hed moved out)
(where was he living at this point? With VF? And if it was with VF, where had he come from?)
Oct/Nov 2011 got together with VF (reports say they were together for 11 months but split a 'few weeks back', which was quoted about a fortnight ago, making the split around mid September)
(I've not seen anything regarding accommodation prior to this date)
http://www.dailypost.co.uk/news/in-depth/april_jones/2012/10/05/april-jones-police-focus-efforts-on-former-home-of-mark-bridger-55578-31970337/
Edit: This is all very vague and lots based on people saying 'a few weeks ago', which if they are anything like me, could mean a few months ago! If anyone has any corrections or amendments, please wade in and add them.