Van Giang is about 20km from Hoan Kiem, on the east side of the Red River, past Bat Trang (pottery village).
There are places to stay on that side of the river in Gia Lam. Finding an apartment on that side of the river shouldn't be too expensive, and the hotels have a bit of a bad reputation.