Hillmorton Marina - we were there last March-June. There's no noise from the trains or the pub, we found it a pleasant spot and the people friendly, boaters & marina staff. There's a boat workshop there, and a chandlers shop that seems well supplied, and they have a washing machine for boaters' use too!
The bus stop is close and buses about every 20-30 mins, but if you walk half a mile towards Rugby buses comes out of a side road also, so are more frequent. Sometimes buses run direct from the railway station, otherwise you have to change in the town centre. Going by taxi to the railway station is probably the same as the bus fare though!
The 'Hungry Horse' (Royal Oak) pub is OK, a bit like a Wetherspoons but nicer - we had many meals there and no complaints.