What you're hearing is your midi output mapping the pitches as you enter them, which could be useful when trying to place a tone that has been severely edited with pitch bends and arpeggios, but rather annoying all the same.
To turn this off, go to Settings -> Midi and set Output Device to <none>.
)