Solved [NOT A BUG] youtube-dl slow download rate

irgendwr · Jan 20, 2018

xuninho said:
I get full download speed if I use youtube-dl from the shell too.

;/

holy shit, who could have expected this?11!11

xuninho · Jan 20, 2018

Sorry, I just wanted some help.

Multivitamin · Jan 20, 2018

and again if we just check this site: https://github.com/rg3/youtube-dl/issues?utf8=✓&q=is:issue+slow+download
You probably see that there are multiple issues within the last 4-5 days and those are probably not all sinusbot users

ManuPlaysLP · Jan 20, 2018

Code:

Version: 0.11.0-8e5f1a2

System: Debian 8

Browser: Firefox

Code:

2018-01-20T20:48:41+01:00 TS/ERR 2564 e'access to default group is forbidden' x'' r'PR:{554b707d-ee7e-4cf9-89e4-3dcd280ad712}:152/GCLL'
2018-01-20T20:48:40+01:00 New connection status 4; Error 0
2018-01-20T20:48:40+01:00 TS |INFO |PermManager | |Loading permissions from cache
2018-01-20T20:48:40+01:00 TS |INFO |ClientUI |1 |Connect status: Connection established
2018-01-20T20:48:40+01:00 ManuPlays LP joined the channel
2018-01-20T20:48:40+01:00 GamingTV joined the channel
2018-01-20T20:48:40+01:00 New connection status 3; Error 0
2018-01-20T20:48:40+01:00 TS |INFO |ClientUI |1 |Connect status: Establishing connection
2018-01-20T20:48:40+01:00 New connection status 2; Error 0
2018-01-20T20:48:40+01:00 TS |INFO |ClientUI |1 |Connect status: Connected
2018-01-20T20:48:40+01:00 TS |DEVELOP |PktHandler | |Puzzle solve time: 3
2018-01-20T20:48:40+01:00 TS |INFO | | |Statistics report: Not yet, next report on Sun Jan 21 14:48:19 2018
2018-01-20T20:48:40+01:00 New connection status 1; Error 0
2018-01-20T20:48:40+01:00 TS |INFO |ClientUI | |Last update check was: Tue Jan 1 00:00:01 2019
2018-01-20T20:48:40+01:00 TS |INFO |Bookmarks | |Collecting autoconnect bookmarks
2018-01-20T20:48:40+01:00 TS |INFO |ClientUI |1 |Connect status: Connecting
2018-01-20T20:48:39+01:00 TS |INFO |PreProSpeex |1 |Speex version: 1.2rc1
2018-01-20T20:48:39+01:00 TS |INFO |TSDNS | |No TSDNS found
2018-01-20T20:48:39+01:00 TS |INFO |TSDNS | |TSDNS queried unsuccessfully 62.210.220.100:41144
2018-01-20T20:48:39+01:00 TS |INFO |ClientUI |1 |Initiating connection: 62.210.220.100:9987
2018-01-20T20:48:39+01:00 TS |INFO |ClientUI |1 |Resolve successful: 62.210.220.100:9987
2018-01-20T20:48:39+01:00 TS |INFO |ClientUI |1 |Lookup finished: ip=62.210.220.100 port=9987 query=xcasatv.de error=0
2018-01-20T20:48:39+01:00 TS |INFO |TSDNS | |A/AAAA DNS resolve successful, "ts3.xcasatv.de" =(h: 62.210.220.100 p:0)
2018-01-20T20:48:39+01:00 TS |INFO |TSDNS | |SRV DNS resolve successful, "_tsdns._tcp.xcasatv.de" =(h: tsdns.xcasatv.de p:41144)
2018-01-20T20:48:39+01:00 TS |INFO |TSDNS | |A/AAAA DNS resolve for possible TSDNS successful, "xcasatv.de" =(h: 62.210.220.100 p:0)
2018-01-20T20:48:39+01:00 TS |INFO |TSDNS | |A/AAAA DNS resolve successful, "xcasatv.de" =(h: 62.210.220.100 p:0)
2018-01-20T20:48:39+01:00 TS |INFO |TSDNS | |SRV DNS resolve successful, "_ts3._udp.xcasatv.de" =(h: ts3.xcasatv.de p:9987)
2018-01-20T20:48:39+01:00 TS |INFO |ClientUI |1 |Trying to resolve xcasatv.de
2018-01-20T20:48:39+01:00 TS |INFO |ClientUI |1 |Connect to server: xcasatv.de
2018-01-20T20:48:39+01:00 TS |INFO |ClientUI | |ts3server: xcasatv.de?port=9987&nickname=xCasatv.de%20%7C%20ManuPlays%20LP&password=&cid=13&channelpassword=
2018-01-20T20:48:39+01:00 TS |INFO |ClientUI | |Using configuration location: /opt/Casa_Manu/data/ts3/95c67b02-055f-46cb-86d8-c03b738bcbf0/2718148c-03c1-48fb-9afe-5d36c9f17c67/settings.db
2018-01-20T20:48:39+01:00 TS |INFO |ClientUI | |Qt version: 5.6.1
2018-01-20T20:48:39+01:00 TS |INFO |ClientUI | |Failed to init text to speech engine
2018-01-20T20:48:39+01:00 TS |DEVELOP |ClientUI | |Notifications init: Soundpack path: /opt/Casa_Manu/TeamSpeak3-Client-linux_amd64/sound/nosounds
2018-01-20T20:48:39+01:00 TS |INFO | | |*** Time [INIT]: 138
2018-01-20T20:48:39+01:00 TS |INFO | | |*** Time [MAINWINDOW]: 138
2018-01-20T20:48:39+01:00 Could not send config: HTTP returned an error: Error; Code: 500; Message: Error
2018-01-20T20:48:39+01:00 TS |INFO |Plugins | |Loading plugin: libsoundbot_plugin.so
2018-01-20T20:48:38+01:00 TS |INFO |Addons | |Checking for addon updates...
2018-01-20T20:48:38+01:00 TS |INFO | | |successfully downloaded revocation list
2018-01-20T20:48:38+01:00 TS |INFO |ClientUI | |OpenGL Info: LibGL, Vendor: VMware, Inc., Renderer: Gallium 0.4 on llvmpipe (LLVM 3.5, 256 bits), Version: 3.0 Mesa 10.3.2
2018-01-20T20:48:38+01:00 TS |ERROR |SoundBckndIntf| |/opt/Casa_Manu/TeamSpeak3-Client-linux_amd64/soundbackends/libpulseaudio_linux_amd64.so error: INIT_PA_IMPL
2018-01-20T20:48:38+01:00 TS |ERROR |PulseAudio | |pa_context_connect failed -
2018-01-20T20:48:38+01:00 TS |ERROR |PulseAudio | |failed to connect to pulse audio server -
2018-01-20T20:48:38+01:00 TS |INFO | | |Using hardware aes
2018-01-20T20:48:38+01:00 TS |INFO | | |SystemInformation: Linux 2.6.32-openvz-042stab123.9-amd64 #1 SMP Thu Jun 29 13:03:39 MSK 2017 x86_64 Binary: 64bit
2018-01-20T20:48:38+01:00 TS |INFO | | |TeamSpeak 3 Client 3.1.7 (2017-12-13 11:07:31)
2018-01-20T20:48:38+01:00 TS>DUMP defined! Dumpdir is: /opt/Casa_Manu/data/ts3/95c67b02-055f-46cb-86d8-c03b738bcbf0/2718148c-03c1-48fb-9afe-5d36c9f17c67/crashdumps
2018-01-20T20:48:38+01:00 TS>Crashdump ENABLED, directory is: /opt/Casa_Manu/data/ts3/95c67b02-055f-46cb-86d8-c03b738bcbf0/2718148c-03c1-48fb-9afe-5d36c9f17c67/crashdumps
2018-01-20T20:48:35+01:00 Starting instance ts3server://xcasatv.de?port=9987&nickname=xCasatv.de%20%7C%20ManuPlays%20LP&password=&cid=13&channelpassword=
2018-01-20T20:48:35+01:00 Could not insert into FileTransfer-Tableno such table: FileTransfer
2018-01-20T20:48:35+01:00 Could not delete from FileTransferno such table: FileTransfer
2018-01-20T20:48:35+01:00 Could not insert into FileTransfer-Tableno such table: FileTransfer
2018-01-20T20:48:35+01:00 Could not delete from FileTransferno such table: FileTransfer
2018-01-20T20:48:35+01:00 Could not insert into FileTransfer-Tableno such table: FileTransfer
2018-01-20T20:48:35+01:00 Could not delete from FileTransferno such table: FileTransfer
2018-01-20T20:48:35+01:00 Could not insert into FileTransfer-Tableno such table: FileTransfer
2018-01-20T20:48:35+01:00 Could not delete from FileTransferno such table: FileTransfer
2018-01-20T20:48:35+01:00 Could not insert into FileTransfer-Tableno such table: FileTransfer
2018-01-20T20:48:35+01:00 Could not delete from FileTransferno such table: FileTransfer
2018-01-20T20:48:35+01:00 Could not insert into FileTransfer-Tableno such table: FileTransfer
2018-01-20T20:48:35+01:00 Could not delete from FileTransferno such table: FileTransfer
2018-01-20T20:48:35+01:00 Could not create Notifications-Tabletable Notifications already exists
2018-01-20T20:48:35+01:00 Could not create WhisperReceive-Tabletable WhisperReceive already exists
2018-01-20T20:48:35+01:00 Could not create Chat-Tabletable Chat already exists
2018-01-20T20:48:35+01:00 Done playing
2018-01-20T20:48:35+01:00 Auto-Playing last track
2018-01-20T20:48:35+01:00 About to run.
2018-01-20T20:48:35+01:00 Prespawn.
2018-01-20T20:48:34+01:00 Last track was 1ff0d07c-7525-40e1-8601-b4658239a89a, will auto-play soon
2018-01-20T20:48:34+01:00 Auto-Starting 95c67b02-055f-46cb-86d8-c03b738bcbf0/2718148c-03c1-48fb-9afe-5d36c9f17c67 in 500 ms...
2018-01-20T20:48:34+01:00 Initialization complete

Code:

TS3Path = "/opt/Casa_Manu/TeamSpeak3-Client-linux_amd64/ts3client_linux_amd64"
ListenHost = "0.0.0.0"
DataDir = "/opt/Casa_Manu/data/"
ListenPort = 8087
LocalPlayback = false
EnableLocalFS = false
MaxBulkOperations = 300
LogLevel = 10
EnableProfiler = false
YoutubeDLPath = "/usr/local/bin/youtube-dl"
EnableDebugConsole = false
UploadLimit = 83886080
RunAsUser = 0
RunAsGroup = 0
InstanceActionLimit = 6
UseSSL = false
SSLKeyFile = ""
SSLCertFile = ""
Hostname = ""
HostnameMask = ""
SampleInterval = 60
StartVNC = false
EnableWebStream = false
LogFile = ""
LicenseKey = "1KbywuLDVbFm+BfIekfxFq88dNHrlior84Thzi7lvD0="
IsProxied = false
DenyStreamURLs = []
Pragma = 0

[YoutubeDL]
  BufferSize = 524288
  MaxDownloadSize = 419430400
  MaxDownloadRate = 104857600
  CacheStreamed = false

[TS3]
  AvatarMaxWidth = 0
  AvatarMaxHeight = 0
  AllowGIF = false

[StreamRewrites]

[Scripts]
  AllowReload = false
  EnableTimer = false
  DisableLegacyEvents = false
  ScriptTimeout = 5

[Themes]
  Default = ""

[SpeechRecognition]
  Enable = false

[FFmpeg]
  UserAgent = "SinusBot (0.11.0-8e5f1a2)"

[DAV]
  Enable = false

[XServer]
  Delay = 0
  Debug = false

[SHMem]
  Enable = false
  Size = 0
  Delay = 0
  Interval = 0

[RadioStations]
  URL = ""
  UpdateInterval = 0

Erik444 · Jan 20, 2018

Same problem :/
Console:

Code:

youtube-dl https://www.youtube.com/watch?v=fKopy74weus

[youtube] fKopy74weus: Downloading webpage

[youtube] fKopy74weus: Downloading video info webpage

[youtube] fKopy74weus: Extracting video information

[youtube] fKopy74weus: Downloading js player vflNX6xa_

[youtube] fKopy74weus: Downloading js player vflNX6xa_

[download] Destination: Imagine Dragons - Thunder-fKopy74weus.mp4

[download] 100% of 26.30MiB in 00:00

Sinusbot:

in sinusbot 70kib max,
on Console:

version:

ItsMe_Daniel · Jan 20, 2018

Langsamer Server // Verbindung? :O

Kubson · Jan 21, 2018

Same...

Swok · Jan 21, 2018

same :/

flyth · Jan 21, 2018

It's the same for EVERYONE, no need to post 'same' - and you would know if you just had read the answers of the mods / checked the provided links. It's something YouTube has changed and ytdl is suffering from.

The difference between your manual tests and the bot is that the bot uses the audio only flag - disabling that would lead to much larger files, which is not acceptable either IMHO.

Maybe ytdl will come up with a solution but I'm afraid that's out of the scope of the bot.

mikibrek · Jan 21, 2018

flyth said:
It's the same for EVERYONE, no need to post 'same' - and you would know if you just had read the answers of the mods / checked the provided links. It's something YouTube has changed and ytdl is suffering from.

The difference between your manual tests and the bot is that the bot uses the audio only flag - disabling that would lead to much larger files, which is not acceptable either IMHO.

Maybe ytdl will come up with a solution but I'm afraid that's out of the scope of the bot.

Fix it then!

flyth · Jan 21, 2018

mikibrek said:
Fix it then

Congratulations, thanks to you the thread reached an even lower level than it had reached before. Chapeau!

Lala Sabathil · Jan 21, 2018

mikibrek said:
Fix it then!

Honestly?
He's already written what it is.

R3v07v3R · Jan 24, 2018

flyth said:
It's the same for EVERYONE, no need to post 'same' - and you would know if you just had read the answers of the mods / checked the provided links. It's something YouTube has changed and ytdl is suffering from.

The difference between your manual tests and the bot is that the bot uses the audio only flag - disabling that would lead to much larger files, which is not acceptable either IMHO.

Maybe ytdl will come up with a solution but I'm afraid that's out of the scope of the bot.

as someone who doesn't mind having a large file size in exchange for a faster download would it be possible to remove this audio-only flag until YT-DL does fix it?

**A change to my files - not your coding.

Lala Sabathil · Jan 24, 2018

no, cause it must be the audio only
oder @flyth ?

R3v07v3R · Jan 24, 2018

Lala Deviluke said:
no, cause it must be the audio only
oder @flyth ?

ok fair enough if it does change the downloaded format then i can understand why it's audio only #mp3

Zeldri · Jan 24, 2018

Someone just do a patch(very dirty) who apparently """"""fixed"""""" the problem

Github Thread

I dont really know how to patch Yt-dl so if someone could try and tell us if it's works that would be cool

TomRiddle01 · Jan 24, 2018

I just found an easy temporary fix that works for me. Might be easier than using that patch that just got posted in the meantime...

We replace the youtube-dl file by a middleman.
Change your config.ini to point at the new file youtube-dl2.

INI:

YoutubeDLPath2 = "/usr/local/bin/youtube-dl"
YoutubeDLPath = "./youtube-dl2"

(I left the original line there too so I dont forget about it when i want to disable this workaround. But you can remove the first line if you want.)

Create the file youtube-dl2 in the same folder:

Bash:

#!/bin/bash
youtube-dl ${@/bestaudio/43}

Ans use

Bash:

chmod +x youtube-dl2

to make it executable.

That file replaces the -f bestaudio flag for the download to -f 43. Format 43 seems to be the .webm format which is not throttled by youtube.

Hope it helps anyone.

edit: It does not seem to work for every video as some are not available in format 43 but it worked most of the time for me now...

R3v07v3R · Jan 24, 2018

TomRiddle01 said:
I just found an easy temporary fix that works for me. Might be easier than using that patch that just got posted in the meantime...

We replace the youtube-dl file by a middleman.
Change your config.ini to point at the new file youtube-dl2.

INI:

YoutubeDLPath2 = "/usr/local/bin/youtube-dl" YoutubeDLPath = "./youtube-dl2"

(I left the original line there too so I dont forget about it when i want to disable this workaround. But you can remove the first line if you want.)

Create the file youtube-dl2 in the same folder:

Bash:

#!/bin/bash youtube-dl ${@/bestaudio/43}

Ans use

Bash:

chmod +x youtube-dl2

to make it executable.

That file replaces the -f bestaudio flag for the download to -f 43. Format 43 seems to be the .webm format which is not throttled by youtube.

Hope it helps anyone.

edit: It does not seem to work for every video as some are not available in format 43 but it worked most of the time for me now...

This is exactly the kind of tempo patch I was looking for - My users were more concerned with waiting 30 - 40min for a 1hour mix to load than finding another if it doesn't...

Thank you,

Dinip · Jan 24, 2018

TomRiddle01 said:
I just found an easy temporary fix that works for me. Might be easier than using that patch that just got posted in the meantime...

We replace the youtube-dl file by a middleman.
Change your config.ini to point at the new file youtube-dl2.

INI:

YoutubeDLPath2 = "/usr/local/bin/youtube-dl" YoutubeDLPath = "./youtube-dl2"

(I left the original line there too so I dont forget about it when i want to disable this workaround. But you can remove the first line if you want.)

Create the file youtube-dl2 in the same folder:

Bash:

#!/bin/bash youtube-dl ${@/bestaudio/43}

Ans use

Bash:

chmod +x youtube-dl2

to make it executable.

That file replaces the -f bestaudio flag for the download to -f 43. Format 43 seems to be the .webm format which is not throttled by youtube.

Hope it helps anyone.

edit: It does not seem to work for every video as some are not available in format 43 but it worked most of the time for me now...

It works! Tks man

tired of downloading @170kb/s, a 3 min music was taking 2 or 3 mins to download...

Zeldri · Jan 24, 2018

Nope, it keep saying that youtube-dl is missing ^^

Solved [NOT A BUG] youtube-dl slow download rate

no longer active, "retired" staff member

Member

Well-Known Member

Member

Member

Helping Hand

New Member

Member

is reticulating splines

Member

is reticulating splines

Donor

Active Member

Donor

Active Member

Member

New Member

Active Member

Member

Member