reosarevok: what's slow vs fast? I'm not too worried about specific order, I just see that we have a bug in BU that only sorts by release year (and therefore it's possible that SQL could just sort differently within all releases in a certain year if we're doing paging)
2022-05-02 12201, 2022
reosarevok
But if you only want titles and artists, yeah, you could probably manage with less tables :)
2022-05-02 12217, 2022
reosarevok
alastairp: slow uses normal queries for mirrors without the materialized tables
2022-05-02 12241, 2022
reosarevok
(so we check if the tables exist and have content, and if not, we use the slow mechanism)
2022-05-02 12247, 2022
alastairp
ah, right
2022-05-02 12201, 2022
q3lont
I only query 8 tables, so I'd like to exclude all the rest
2022-05-02 12245, 2022
alastairp
thanks reosarevok! this helps us significantly
2022-05-02 12201, 2022
alastairp
(I mean, it now means that we need to do more work, but at least things will look better)
2022-05-02 12229, 2022
reosarevok
q3lont: that'd probably need some changes to dbmirror, so you might want bitmap, but he's mostly away for a few days at least, so maybe after that he can check? I haven't played with the replication much at all
2022-05-02 12218, 2022
reosarevok
I mean, I guess maybe you could drop all the tables you don't want, and then always run ImportReplicationChanges with --ignore-errors (if a table fails to import, continue anyway)
2022-05-02 12232, 2022
reosarevok
And see if that somehow doesn't fail terribly? :D
2022-05-02 12244, 2022
reosarevok
But I certainly cannot suggest that in good faith, it *might* fail terribly :D
2022-05-02 12221, 2022
reosarevok
alastairp: no problem, always glad to make y'all work more
2022-05-02 12230, 2022
alastairp
^
2022-05-02 12219, 2022
riksucks
btw alastairp, just wanted to give you a heads up, I have created the JIRA ticket and also updated the PR, although the test failed because of the sqlalchemy connection error, which is a false positive.do lmk if you want any more changes. I would now get started on the frontend :)
2022-05-02 12232, 2022
alastairp
riksucks: yeah, dn
2022-05-02 12248, 2022
alastairp
yeah, don't worry about the connection error. I'll take a look at the PR now and re-trigger the tests
mayhem: interesting, I was just thinking about the listen writer last week (in the context of "what happens if the listenstore goes away while it's doing stuff?")
2022-05-02 12203, 2022
alastairp
so in the case of crash-only software this should just fail but if an operation didn't completely finish, when it starts up again it should pick up from where it stopped, potentially re-reading the same thing from the queue and trying to add it again
2022-05-02 12254, 2022
mayhem
yes. while I would not call the ts writer crash-only, that is the general concept. architect so that things are idempotent and can without harm be re-done. only consider something done, when we've got confirmation for it.
2022-05-02 12239, 2022
mayhem
I find this to be a good exercise in building resilient systems. it is pleasure to watch LB heal itself after PG or something else was down.
2022-05-02 12242, 2022
alastairp
yeah, that last sentence is key
2022-05-02 12250, 2022
mayhem
2-3 seconds and everything is back. great feeling.
2022-05-02 12236, 2022
mayhem
that article gave me faith that people are perhaps making progress on truly distributed systems. I first delved into this stuff during 2001 when everyone was convinced everything would be decentralized going forward because we had napsten and limewire.
2022-05-02 12249, 2022
odnes has quit
2022-05-02 12254, 2022
mayhem
I'm so glad I eventually gave up and just focused on building a working centralized version.
2022-05-02 12212, 2022
mayhem
alastairp: do you happen to have some academic articles that describe how to build a playlist?
the one AB-like feature I wish we had was to analyze the begin and end of a track.
2022-05-02 12259, 2022
alastairp
although I think that the main task for this project was for "playlist continuation", so given 10 tracks already in a playlist, recommend the next 5 to add
2022-05-02 12219, 2022
mayhem
it would be really nice to know if a tracks starts/ends: quietly, suddenly, different types of ramp-up, etc...
2022-05-02 12227, 2022
alastairp
not sure if anyone did "create a playlist from scratch given existing interests"
2022-05-02 12259, 2022
mayhem
exactly. I think ben & paul's presentation is the closest I've seen.
2022-05-02 12209, 2022
alastairp
yes right, I've thought about this kind of stuff too. from time to time I've wondered if my discover weekly had this kind of stuff going - the last track always seemed great. but that hasn't happened much recently
2022-05-02 12237, 2022
mayhem
recently everything produced by spotify has been mediocre at best.
2022-05-02 12212, 2022
mayhem
your recommended tracks already feels more promising, but it is missing variance.
2022-05-02 12251, 2022
mayhem
hmm.
2022-05-02 12228, 2022
mayhem
I wonder if there is space for different moods of daily jams. daily energetic jams, daily chill out jams...
[bookbrainz-site] 14the-good-boy opened pull request #841 (03master…attributes-on-display-pages): [BB-666]: Relationship Attributes should be shown on entity display pages too https://github.com/metabrainz/bookbrainz-site/pul…
I’m awaiting a delivery between 10 (AM) and 19… It was "loaded for delivery" at 16:23 and still isn’t here, so just a heads up that if I’m a minute late for starting the meeting, sorry in advance. :|
Got a couple of mailed in reviews, so let’s start off with those:
2022-05-02 12223, 2022
Freso
monkey says…
2022-05-02 12233, 2022
Freso
"""
2022-05-02 12233, 2022
Freso
Hi everyone!
2022-05-02 12233, 2022
Freso
Last week I’ve been preparing for moving ay (which is today), but I did do a few things:
2022-05-02 12233, 2022
Freso
Continued the ListenBrainz metadata viewer and merged that first PR (currently deployed on beta.LB)
2022-05-02 12233, 2022
Freso
I did some outreach and debugging with third-party players and scrobblers that use the ListenBrainz API, mostly relating to better support for love/hate feedback.
2022-05-02 12233, 2022
Freso
I reviewed PRs for LB and BB, and did a bunch of repository admin and ticket triage.
2022-05-02 12233, 2022
Freso
There was a notice from Github that some OAuth tokens were leaked by Travis (which we were using for BB). According to Github we weren’t targeted, but I disconnected Travis app on Github and ensured no tokens or authorization remained for it.
2022-05-02 12234, 2022
Freso
That’s most of it for me! I expect to be partly AFK this week, between unpacking and no internet at the new house.
2022-05-02 12234, 2022
Freso
Take care y’all !
2022-05-02 12235, 2022
Freso
"""
2022-05-02 12239, 2022
Freso
yvanzo says…
2022-05-02 12245, 2022
Freso
"""
2022-05-02 12245, 2022
Freso
Last week, I continued updating documents on securing MeB infrastructure
2022-05-02 12245, 2022
Freso
with the 2nd meeting this past Tuesday.
2022-05-02 12245, 2022
Freso
Also updated my PR documenting our current instance of RabbitMQ (which has
2022-05-02 12246, 2022
Freso
to be eventually replaced with a cluster).
2022-05-02 12246, 2022
Freso
Freed tens of GBs of useless logs related to a bug that has been fixed in
2022-05-02 12246, 2022
Freso
2020.
2022-05-02 12247, 2022
Freso
Opened a pair of small pull requests to docker server configs and ansible.
2022-05-02 12247, 2022
Freso
Plus PR reviews and support.
2022-05-02 12248, 2022
Freso
"""
2022-05-02 12250, 2022
Freso
Others up: lucifer, alastairp, atj, reosarevok, zas, akshaaatt, bitmap, mayhem, CatQuest, Freso – anyone else who wish to give review, let me know ASAP. :)
2022-05-02 12250, 2022
Freso
lucifer: Go!
2022-05-02 12255, 2022
lucifer
hi all!
2022-05-02 12221, 2022
Freso
(No delivery yet btw, so sorry if I disappear for a minute.)
2022-05-02 12200, 2022
lucifer
last week, i worked on adding last listened times to recommendations but data turned out to be too much to store in LB database so need to rework it to do more stuff on spark side.
2022-05-02 12214, 2022
aerozol
I'm here too 😃
2022-05-02 12231, 2022
mayhem waves at aerozol
2022-05-02 12254, 2022
hackerman joined the channel
2022-05-02 12255, 2022
lucifer
other than i worked on more recommendations tuning and refactoring LB recommendations to use more and newer built-in Spark APIs instead of hand rolling our own code.
2022-05-02 12207, 2022
hackerman has quit
2022-05-02 12216, 2022
Freso
aerozol: I assume that’s you saying you want to be added to the list?
2022-05-02 12240, 2022
hackerman joined the channel
2022-05-02 12247, 2022
lucifer
finally investigated, some LB issues like broken emails, broken dumps and some ISEs due to bad user data submission.
2022-05-02 12256, 2022
lucifer
that's it for me. alastairp: next?
2022-05-02 12200, 2022
alastairp
hi there
2022-05-02 12203, 2022
aerozol
Freso: yes plz
2022-05-02 12236, 2022
Freso
(Others up: atj, reosarevok, zas, akshaaatt, mayhem, aerozol, CatQuest, Freso – anyone else who wish to give review, let me know ASAP. :))
2022-05-02 12218, 2022
alastairp
last week I fixed a bug in CB that prevented non-releasegroup reviews from appearing on the admin "reported reviews" page, and also fixed a bug that had been reported where a user could craft a malicious oauth redirect url on an oauth app
2022-05-02 12249, 2022
alastairp
I also fixed some bugs in CB oauth around dealing with invalid client ids/secrets
2022-05-02 12215, 2022
alastairp
I reviewed some of Ansh's open PRs about adding more data to Label and Place pages on CB
2022-05-02 12211, 2022
alastairp
I restarted some old tasks about making data dumps for LB/MB datasets that we want to publish, and I fixed a bug in our config file generation for LB that prevented us from using consul to take down the listenstore the last time we had an LB downtime
2022-05-02 12223, 2022
alastairp
that's me, atj next?
2022-05-02 12256, 2022
atj
hi
2022-05-02 12214, 2022
atj
last week I spent some time rewriting the netplan ansible role to try and simplify network configuration
2022-05-02 12241, 2022
atj
this is currently a WIP PR that will hopefully result in some further benefits to other configuration, such as managing /etc/hosts
2022-05-02 12253, 2022
atj
I think that's it, aerozol?
2022-05-02 12254, 2022
atj
has aerozol nodded off? akshaaatt?
2022-05-02 12257, 2022
aerozol
Mōrena! Not much to report, but I did some guideline updates and want to make sure people still have it on their to-do list to have a look
The endless back and forth between long country lists for digital and worldwide has worn me down and I'm keen to tackle it finally - wondering if there's any devs that are interested or have ideas. Let me know!
2022-05-02 12246, 2022
aerozol
That's me! Go akshaaatt
2022-05-02 12251, 2022
akshaaatt
Hi!
2022-05-02 12200, 2022
akshaaatt
Last week I continued my work on the MusicBrianz revamp. The updates have been made to https://test.musicbrainz.org
2022-05-02 12223, 2022
akshaaatt
We have made the updates to the header mainly after some debugging. Also, we are sorta ready for the revamp with the major updates made.
2022-05-02 12250, 2022
akshaaatt
Also, I helped aerozol with the updates to his PR in design system!
2022-05-02 12207, 2022
akshaaatt
The team looks so focused towards to revamp, which is a great feeling!
2022-05-02 12229, 2022
aerozol
Oh yeah, I almost jumped into traffic because I suck at GitHub, thanks for saving me!!
2022-05-02 12254, 2022
akshaaatt
I have completed my work in the android app as well, which can be a great addition soon in regards to the listenabrainz integration!
2022-05-02 12208, 2022
akshaaatt
Great vibes here. That's about it for me. Thank you!
2022-05-02 12212, 2022
akshaaatt
Go mayhem!
2022-05-02 12227, 2022
mayhem
hey
2022-05-02 12244, 2022
Freso
(Others still up: reosarevok, zas, CatQuest, Freso – anyone else who wish to give review, let me know ASAP. :))
2022-05-02 12246, 2022
mayhem
last week was a lot of little stuff here and there as life continues to be challenging.
2022-05-02 12206, 2022
mayhem
but lucifer and I are making good progress on getting the recommendations to work better.
2022-05-02 12219, 2022
mayhem
and I'm starting to work on getting troi-bot to start making daily jam playlists.
2022-05-02 12242, 2022
mayhem
and with spotify's recs recently not doing so well, I'm quite keen to get that going.
