That's exactly right. An analogue oscillator will *always* oscillate from the moment you turn it on, even between the notes. It doesn't even know when the notes begin and end, it only knows when to change pitch.
The attenuator/amplifier has a gain knob which controls how much of its input you're *constantly* hearing, and the CV knob controls how much of its input you hear *in proportion to the CV signal*.
I suspect I didn't quite grasp this the first week or so of having an A-100, which is why my first few tracks are so noisy (the first few tracks in my album Blast Off!), with subtle gain-knob-induced discordant humming throughout that's only really noticeable at the beginning and end of each track, when everything's supposed to be silent. In this time of softsynths, I've been complimented by a few people for keeping this noise in the final mix. :D
But yeah, if you don't want it, just keep the gain knob down and use the CV one only. :)
All the best,
Zoë.