Your issue is most likely the self hosting connection. There are some tricks you can do to reduce the effect of this.
Firstly, Attempt to change your SampleInterval to around 20.
Secondly, As you said, adjust teamspeak settings
Thirdly, If both of these fail, try running a VB Linux Sinusbot -...