• If you need help or want to discuss things, you now can also join us on our Discord Server!

Solved Bots Disconnecting daily

R3v07v3R

Active Member
Hi Guys,

I've been using the bots for a few years and they're amazing! Thank you.

I have been having an issue with the bots disconnecting every day, sometimes twice a day.
I will then need to SSH into the server and run"service sinusbot restart".
The web interface also becomes unavailable, but this appears to be a by-product of the service not running.

Below is a link to my Log File (@lvl-10) and the Debug Script Output.

Log File:
https://pastebin.com/CPtqBpPZ

Code:
==========================================================
SINUSBOT RELATED
SYSTEM INFORMATION
- Operating System: Ubuntu 20.04.1 LTS
- Kernel: Linux 5.4.0-1034-aws x86_64
- Load Average: 0.15 0.07 0.03
- Uptime: 1 days, 1 hours, 2 minutes, 47 seconds
- OS x64 check: OK
- OS Updates: 0 (well done!)
- OS Missing Packages: None
- OS APT Last Update: 07.01.2021 04:00:42 UTC +00:00:00
- Shell Locale: C.UTF-8
- Bot Start Script: not found
- CPU:
    Architecture:                    x86_64
    CPU(s):                          2
    Thread(s) per core:              2
    Core(s) per socket:              1
    Socket(s):                       1
    Model name:                      Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz
    CPU MHz:                         2499.998
    Hypervisor vendor:               KVM
    Virtualization type:             full
- RAM: 523.28 MB/953.37 MB in use (54%)
- SWAP: 0 B/0 B in use (0%) (SWAP disabled)
- DISK: 8.10 GB/9.63 GB in use (84%)
- Package versions:
   - libglib: 2.64.3-1~ubuntu20.04.1

BOT INFORMATION
- Status: not running
- Webinterface: port locally not reachable (Port: 8087)
- Binary: /opt/sinusbot/sinusbot
- Binary Info: MD5 Hash: 224b687db910b732fe5a7cfec4f6c78e, Perms: 755, User: sinusbot
- Version: 1.0.0-beta.10-202ee4d
- TS3 Plugin: installed (md5 hash match)
   - Bot Plugin: aa483aea105cb62033392b1ce6d317ab
   - TS3 Client: aa483aea105cb62033392b1ce6d317ab
- Config:
   - LogLevel = 10 (debug log active)
   - TS3Path = /opt/sinusbot/teamspeak3-client/ts3client_linux_amd64 (Version 3.5.3)
   - YoutubeDLPath = /usr/local/bin/youtube-dl (does exist, version: 2021.01.03)
- Installed scripts: advertising.js; alonemode.js; bookmark.js; channelcleaner.js; command.js; followme.js; norecording.js; rememberChannel.js; simple_channel_creator.js; simple_channel_notifications.js; sinusbot-commands.js; welcome.js

BOT TECHNICAL INFORMATION
- File exists:
   - TS3Client/libqxcb-glx-integration.so: no
- LDD output:
    linux-vdso.so.1 (0x00007ffe6945c000)
    libswresample.so.2 => /opt/sinusbot/libswresample.so.2 (0x00007fd518091000)
    libavfilter.so.6 => /opt/sinusbot/libavfilter.so.6 (0x00007fd517d39000)
    libavformat.so.57 => /opt/sinusbot/libavformat.so.57 (0x00007fd517938000)
    libavcodec.so.57 => /opt/sinusbot/libavcodec.so.57 (0x00007fd516fd3000)
    libavutil.so.55 => /opt/sinusbot/libavutil.so.55 (0x00007fd516d5f000)
    libdl.so.2 => /lib/x86_64-linux-gnu/libdl.so.2 (0x00007fd516d50000)
    libm.so.6 => /lib/x86_64-linux-gnu/libm.so.6 (0x00007fd516bff000)
    libpthread.so.0 => /lib/x86_64-linux-gnu/libpthread.so.0 (0x00007fd516bdc000)
    libstdc++.so.6 => /lib/x86_64-linux-gnu/libstdc++.so.6 (0x00007fd5169fb000)
    libgcc_s.so.1 => /lib/x86_64-linux-gnu/libgcc_s.so.1 (0x00007fd5169e0000)
    libc.so.6 => /lib/x86_64-linux-gnu/libc.so.6 (0x00007fd5167ee000)
    libz.so.1 => /lib/x86_64-linux-gnu/libz.so.1 (0x00007fd5167d2000)
    librt.so.1 => /lib/x86_64-linux-gnu/librt.so.1 (0x00007fd5167c5000)
    /lib64/ld-linux-x86-64.so.2 (0x00007fd5182ad000)

REACHABILITY CHECKS
- HTTPS check with IPv4 mode: SUCCESS [Connection established to www.sinusbot.com, CODE #200]
- HTTPS check with IPv6 mode: IGNORED [Disabled]
- DNS resolution check: SUCCESS [www.sinusbot.com resolved to 172.67.132.160]
- Update server checks:
    update01.sinusbot.com -> 104.28.14.74: SUCCESS [CODE #404]
    update02.sinusbot.com -> 104.28.14.74: SUCCESS [CODE #404]
    update03.sinusbot.com -> 104.28.15.74: SUCCESS [CODE #404]

TIME INFORMATION
- Time (local): 07.01.2021 06:37:00 UTC +00:00:00
- Time (remote): 07.01.2021 06:37:00 UTC +00:00:00
- Time (difference): 0 secs (Time diff less than 2 secs. Good.)
- Timezone: Etc/UTC

OTHER INFORMATION
- TeamSpeak3 Version: 3.5.3
- youtube-dl Version: 2021.01.03
- DiagScript Version: 0.8.0
==========================================================
 
Last edited:

R3v07v3R

Active Member
I'm sure all the system info is in the Debug Script, however, I will pull it out and format it to make it easier.
Added the config.ini at the bottom.

Please let me know if there is any other information I can log or provide to make the diagnosis easier, as I have no idea what else to look for.
  • SinusBot version:
    • 1.0.0-beta.10-202ee4d
  • TS Client:
    • TeamSpeak3 Version: 3.5.3
  • OS:
    • - Operating System: Ubuntu 20.04.1 LTS
      - Kernel: Linux 5.4.0-1034-aws x86_64
  • uname -a:
    • (Linux ip-<server-ip> 5.4.0-1034-aws #35-Ubuntu SMP Thu Dec 17 23:32:42 UTC 2020 x86_64 x86_64 x86_64 GNU/Linux)
  • hardware specs:
    • CPU:
      • Architecture: x86_64
        CPU(s): 2
        Thread(s) per core: 2
        Core(s) per socket: 1
        Socket(s): 1
        Model name: Intel(R) Xeon(R) Platinum 8175M CPU @ 2.50GHz
        CPU MHz: 2499.998
        Hypervisor vendor: KVM
        Virtualization type: full
    • RAM:
      • 523.28 MB/953.37 MB in use (54%)
    • HDD:
      • DISK: 8.10 GB/9.63 GB in use (84%)
TS3Path = "/opt/sinusbot/teamspeak3-client/ts3client_linux_amd64"
ListenHost = "0.0.0.0"
DataDir = "/opt/sinusbot/data/"
ListenPort = 8087
LocalPlayback = false
EnableLocalFS = false
MaxBulkOperations = 300
LogLevel = 10
EnableProfiler = false
YoutubeDLPath = "/usr/local/bin/youtube-dl"
EnableDebugConsole = false
EnableInternalCommands = false
AllowStreamPush = false
UploadLimit = 83886080
RunAsUser = 0
RunAsGroup = 0
ExternalFileBase = ""
InstanceActionLimit = 6
UseSSL = false
SSLKeyFile = ""
SSLCertFile = ""
Hostname = ""
HostnameMask = ""
SampleInterval = 60
StartVNC = false
EnableWebStream = false
LogFile = "/opt/sinusbot/fullLog.txt"
LicenseKey = "L79uB1ngvx+kuPq/ULOZ+xzhNu2tPmNHYWulTWK4JE4="
IsProxied = false
DenyStreamURLs = []
Pragma = 0
UserAgent = ""

[YoutubeDL]
BufferSize = 524288
MaxDownloadSize = 419430400
MaxDownloadRate = 104857600
MaxSimultaneousChunkDownloads = 6
CacheStreamed = false
TimeoutSingleDownloader = 0
TimeoutMultiDownloader = 0
ChunkSize = 3145728

[TS3]
AvatarMaxWidth = 0
AvatarMaxHeight = 0
AllowGIF = false

[StreamRewrites]

[Scripts]
Debug = false
AllowReload = false
EnableTimer = false
DisableLegacyEvents = false
DevMode = false
ScriptTimeout = 5

[Themes]
Default = ""

[SpeechRecognition]
Enable = false

[FFmpeg]
UserAgent = "SinusBot (1.0.0-beta.10-202ee4d)"
WaitTime = 0

[DAV]
Enable = false

[XServer]
Delay = 0
Debug = false

[SHMem]
Enable = false
Size = 0
Delay = 0
Interval = 0

[RadioStations]
URL = ""
UpdateInterval = 0

[TTS]
Enabled = false
 

flyth

is reticulating splines
Staff member
Developer
Contributor
I'm really sorry, I didn't see the debug in the spoiler but looked for the output in the pastebin.

Your available RAM seems pretty low, that might be it.
You said the web interface isn't available as the process has been stopped when it happens, so if that's not due to a crash, your system log might deliver more info on that (on high memory pressure processes might get killed). So you could try and search for clues in your /var/log/messages, /var/log/syslog (whichever of these exists for you) and the dmesg output.
 

R3v07v3R

Active Member
Alright, I happened to be online when the bots disconnected.
I checked the /var/log/syslog file as you suggested and filtered the results for for "sinusbot", below are the results;

Jan 10 04:19:43 ip-<server-ip> kernel: [341133.871582] [ 55733] 1002 55733 16022 260 102400 0 0 sinusbot
Jan 10 04:19:43 ip-<server-ip> kernel: [341133.871584] [ 55734] 1002 55734 777429 38142 3096576 0 0 sinusbot
Jan 10 04:19:43 ip-<server-ip> kernel: [341133.871654] oom-kill:constraint=CONSTRAINT_NONE,nodemask=(null),cpuset=/,mems_allowed=0,global_oom,task_memcg=/system.slice/sinusbot.service,task=sinusbot,pid=55734,uid=1002
Jan 10 04:19:43 ip-<server-ip> kernel: [341133.871707] Out of memory: Killed process 55734 (sinusbot) total-vm:3109716kB, anon-rss:152552kB, file-rss:16kB, shmem-rss:0kB, UID:1002 pgtables:3024kB oom_score_adj:0
Jan 10 04:19:43 ip-<server-ip> kernel: [341133.941127] oom_reaper: reaped process 55734 (sinusbot), now anon-rss:0kB, file-rss:0kB, shmem-rss:0kB
Jan 10 04:19:44 ip-<server-ip> systemd[1]: sinusbot.service: Main process exited, code=exited, status=255/EXCEPTION
Jan 10 04:19:45 ip-<server-ip> systemd[1]: sinusbot.service: Failed with result 'exit-code'.

From what I can make out, the "Out of memory: Killed process 55734 (sinusbot)" is the issue.

Your available RAM seems pretty low
Good guess!
I was not sure what to set the system up with initially.

I have added;
Please let me know if you think I should modify those values.

I will get back to you in 24 hours if it hasn't crashed
 

Similar threads

Top