Yeah, I still have scrobbles from last night's not appearing. A lot of backlog I guess
turleboy500[m] has quit
monkey[m]
A transient database, it looks like.
database issue *
rustynova[m]
The hord is getting culled. Only 9 hours of delay!
terinjokes has left the channel
mukkel joined the channel
mukkel has quit
terinjokes joined the channel
monkey[m]
Lol there were 'only' 300K items in the queue...
rustynova[m]
Still a lot
outsidecontext[m
Looks like LB is over the hill and has mostly managed yesterday's lastfm mass import.
outsidecontext[m uploaded an image: (71KiB) < https://matrix.chatbrainz.org/_matrix/media/v3/download/matrix.org/INnGWeQIKSUmbKnzntHtiokf/image.png >
elkiensad[m]
<rustynova[m]> "The hord is getting culled. Only..." <- it is 6 now
monkey[m]
And we're back live!
outsidecontext[m
That was a nice stress test. The system works :D
elkiensad[m]
we are so back!
monkey[m]
It appears the listen writer lost connection to the database yesterday morning, fixed early morning today. Not yet clear if it was related to the LastFM imports or if it was a coincidence.
elkiensad[m]
any loses?
monkey[m]
No, everything was being stored in our import queue, the only side-effect was having to wait for that backlog to be imported after the fix.
aerozol[m]1
Phew!
Ignoring our usual listen submissions I guess that was (verrry roughly) 8.5 mil listens imported in a short timeframe? Based off us hitting 1bil listens and it now being at 1,008,459,085
elkiensad[m]
I think it is more than that
aerozol[m]1
I’ll make sure not to promote to last.fm users again unless we have another server ready...
Exciting! Hit us with your math elkiensad! Or do you mean because our stats is behind? I haven’t looked at the graph closely
elkiensad[m]
<elkiensad[m]> "also we are at 999,814,739..." <- ^