Where to get cheap fabric remnants?

Just got a sewing machine, took a visit to the local fabric shop and almost passed out with shock at the prices! I would like to experiment,, does anybody know where (in uk) I could maybe get a bag of remnants/scraps without breaking the bank or the pieces being about 2"x4".