Yeah, I still have scrobbles from last night's not appearing. A lot of backlog I guess
2024-11-06 31137, 2024
turleboy500[m] has quit
2024-11-06 31105, 2024
monkey[m]
A transient database, it looks like.
2024-11-06 31110, 2024
monkey[m]
database issue *
2024-11-06 31147, 2024
rustynova[m]
The hord is getting culled. Only 9 hours of delay!
2024-11-06 31119, 2024
terinjokes has left the channel
2024-11-06 31146, 2024
mukkel joined the channel
2024-11-06 31138, 2024
mukkel has quit
2024-11-06 31159, 2024
terinjokes joined the channel
2024-11-06 31156, 2024
monkey[m]
Lol there were 'only' 300K items in the queue...
2024-11-06 31108, 2024
rustynova[m]
Still a lot
2024-11-06 31155, 2024
outsidecontext[m
Looks like LB is over the hill and has mostly managed yesterday's lastfm mass import.
2024-11-06 31159, 2024
outsidecontext[m uploaded an image: (71KiB) < https://matrix.chatbrainz.org/_matrix/media/v3/download/matrix.org/INnGWeQIKSUmbKnzntHtiokf/image.png >
2024-11-06 31122, 2024
elkiensad[m]
<rustynova[m]> "The hord is getting culled. Only..." <- it is 6 now
2024-11-06 31155, 2024
monkey[m]
And we're back live!
2024-11-06 31123, 2024
outsidecontext[m
That was a nice stress test. The system works :D
2024-11-06 31107, 2024
elkiensad[m]
we are so back!
2024-11-06 31138, 2024
monkey[m]
It appears the listen writer lost connection to the database yesterday morning, fixed early morning today. Not yet clear if it was related to the LastFM imports or if it was a coincidence.
2024-11-06 31132, 2024
elkiensad[m]
any loses?
2024-11-06 31110, 2024
monkey[m]
No, everything was being stored in our import queue, the only side-effect was having to wait for that backlog to be imported after the fix.
2024-11-06 31128, 2024
aerozol[m]1
Phew!
2024-11-06 31140, 2024
aerozol[m]1
Ignoring our usual listen submissions I guess that was (verrry roughly) 8.5 mil listens imported in a short timeframe? Based off us hitting 1bil listens and it now being at 1,008,459,085
2024-11-06 31111, 2024
elkiensad[m]
I think it is more than that
2024-11-06 31118, 2024
aerozol[m]1
I’ll make sure not to promote to last.fm users again unless we have another server ready...
2024-11-06 31126, 2024
aerozol[m]1
Exciting! Hit us with your math elkiensad! Or do you mean because our stats is behind? I haven’t looked at the graph closely
2024-11-06 31148, 2024
elkiensad[m]
<elkiensad[m]> "also we are at 999,814,739..." <- ^
