Water changes will help, but not much. I assume you have plenty of circulation in your system (e.g. it's not excess CO2 depressing the pH), and that you know how to test for excess CO2 (take a water sample, run an airstone thru it outside for an hour or two before testing pH).
If it is low pH, and not excess CO2, I'd do a partial water change, and add buffer to your water change water. The buffer will bring your pH back towards the 8.0 to 8.4 range, and increase your alkalinity slightly. (Or, alternatively, use baking soda at 1 tsp/20gal/day and retest all parameters). Be sure your calcium reactor is offline while you do your adjustments.