Correct. It's mostly the dissolved minerals that give water its flavour. For tap water, the disinfection chemicals (namely chlorine) also contribute to the taste, with some people saying they associate it with being refreshing while other people claiming it to have an off taste (either way the tiny amount of chlorine is perfectly safe in case anyone is worried).
The social network of the future: No ads, no corporate surveillance, ethical design, and decentralization! Own your data with Mastodon!