I only need accommodation for part of my trip
If you're spending some time in Rongcheng District, Jieyang Palace and Jinxian Gate Tower are top sights worth seeing.
You might make a stop by Liusha People's Park while you're exploring Baiyinshan.