The Bodleian Libraries have extensive printed map collections as well as excellent digital mapping facilities.
A good starting point for finding information about map collections is the guide 'Finding aids for Maps'. This includes instructions for using Map Search on SOLO.
You may also find the Bodleian Library Map Room website useful.
The Oxfordshire History Centre has an extensive collection of printed maps and also provides digital mapping facilities.