Don't use tap water. You'll regret it for the life of your tank. RO/DI is a necessity, whether you buy a unit or pick up RO water from your LFS (test it yourself to be sure they are producing true 0 TDS water as some have been known to get lazy about servicing membranes/filters) or supposedly a local Walmart (they apparently have machines that dispense RO water, although I don't know of any Walmarts around here).
I picked up a pure-flo RO/DI on sale. The fact is, these units are all assembled pretty much the same way. The first canister is for mechanical filtration, followed by a carbon block canister (which is important in removing chlorine which will damage the RO membrane, along with other organics) then to the RO membrane, followed by, if you opt for it (I recommend you do) a DI cartridge. The output should have nothing in it, and show a reading of 0 TDS with a standard TDS meter.
The factors you need to consider are which membrane and what is the estimated output as gallons per day. Membranes rated for 50gpd and under are usually good for a 98-99% rejection rate, that is, not passing through 98% of minerals present through the membrane and rejecting that material into the waste water that is fed out on a separate line from the membrane canister. You can get higher gpd rated membranes if you need more water for a large tank, but rejection rates fall to 93-96%. Not true reverse osmosis, but more like nano filtration. However, the 4th stage DI canister will handle that slight excess, and you'll still end up with 0 TDS. You may run through the DI media faster, though, and need to replace the resin sooner. Still, it will give you the flow rate you need. The gold standard of membranes are DOW filmtecs', which are found on just about every decent system you'll find.
What does the expense and effort get you? Tap water is notorious for containing water treatments such as chlorine/chloramines for disinfection, although NYC water does not treat with chloramines anymore, just chlorine, and phosphates in the form of orthophosphates are added to water to "coat" pipes and reduce any leaching of lead from old lead soldered tubing, are the most common. Minerals picked up either flow through reservoirs or leaching into groundwater wells. This is why some water is regarded as "hard" and is characterized by difficulty in developing a lather from soap. Depending on the water source, nitrates may be present (the EPA allows up to 10 ppm of nitrate to be present and still be considered potable). It's pretty tough to work hard at reducing nitrates in your tank when your replacement water is starting at 10 ppm. Phosphates from other sources will also contaminate some water, leading to continuous attempts to remove phosphates from your tank to reduce algae blooms, and so on. These are some reasons why RO/DI water is needed.
In using RO/DI water for top off, you can take three approaches depending on your tank size. You can top off manually from a bucket with a measuring cup. You can buy an automatic top off controller which has a float switch, which, when lowered past a set point as evaporation occurs, activates a pump in a container to fill your sump/tank level back up to the float's off point. You can, if you are running a large tank, plumb your unit directly to your top off water container, and split off to a second container which you use to mix your SW.
Bottom line, you can set it up as simple as you want, or as automated as you desire. Still, it all starts with the same idea, purified water that can be your blank canvas to create the ideal water for your tank under your control. Your tap won't give that.
Henry