ruaok: monkey: akshaaatt: weekly year in music status check-in time?
2021-11-29 33348, 2021
akshaaatt
Hi!
2021-11-29 33351, 2021
akshaaatt
I'm in
2021-11-29 33356, 2021
PrathameshG
Hello there :))
2021-11-29 33359, 2021
monkey
I'm here
2021-11-29 33351, 2021
PrathameshG
Mind if I ask what you guys are working on 👀
2021-11-29 33328, 2021
lucifer
something like spotify wrapped but for ListenBrainz.
2021-11-29 33335, 2021
monkey
Not a lot to report on my side. Started work on the year in music page, but mostly putting placeholder components and creating a header image
2021-11-29 33355, 2021
monkey
Didn't get much more done that that
2021-11-29 33312, 2021
akshaaatt
I've added the component to image part in lb and we can now generate images of our cards for social sharing across various platforms
2021-11-29 33323, 2021
PrathameshG
Sounds cool!
2021-11-29 33334, 2021
monkey
Yeah, that a great addition akshaaatt
2021-11-29 33348, 2021
akshaaatt
I was also adding in some changes to the UI but got a little stuck with the responses, working on that currently
2021-11-29 33304, 2021
PrathameshG
Is there anything that i can help you guys with? I have been playing a lot with my scrapped last.fm scrobbles on jupyter notebooks
2021-11-29 33313, 2021
PrathameshG
I was hoping to implement it somewhere as well
2021-11-29 33340, 2021
akshaaatt
To begin with PrathmeshG, I suggest you pick some relevant tickets from https://tickets.metabrainz.org/ and discuss any potential work you might have to suggest :)
2021-11-29 33305, 2021
lucifer
oh that sounds nice. although it might be a bit late to get it implemented in prod for this year's year in music. but we are always looking for cool additions to LB in general. maybe there's something we could add to that.
2021-11-29 33305, 2021
monkey
lucifer: I guess we'll need to coordinate to make a transition from back-end to front-end, mainly putting the relevant data in the YIM page props
2021-11-29 33329, 2021
PrathameshG
Sure, I'll try to make a ticket once I am a little confident haha
2021-11-29 33352, 2021
monkey
Welcome PrathameshG ! Interested to see what you've been working on
2021-11-29 33307, 2021
PrathameshG
Coool, I'll try sharing some of it over ehre
2021-11-29 33317, 2021
lucifer
monkey: sure, lmk what you need. the api was on beta till some days ago before i replaced it with another PR. we can make year in music PR permanently appear on test or beta for the next few days.
I guess the part I'm not going to want to touch are fetching the necessary data for the initial props load. I can figure out the API calls for updates on the front-end
2021-11-29 33347, 2021
reosarevok
yvanzo: how's that fix looking? I'll start working on a blog template and whatnot at least :)
2021-11-29 33352, 2021
lucifer
we were planning to send all data in one api call, no?
I meant more initial load of page props from flask endpoint rather than from API call
2021-11-29 33339, 2021
Anshika581 joined the channel
2021-11-29 33332, 2021
lucifer
i see, what should those props include? (other than the global context stuff)
2021-11-29 33335, 2021
monkey
At first glance, everything we would return from the YIM API call
2021-11-29 33343, 2021
monkey
Same format makes sense
2021-11-29 33348, 2021
lucifer
PrathameshG: i suggest you to take a look at our incremental dumps, we have them in jsonl and parquet format. the jsonl ones are actual data submitted by users. and the parquet ones are subset of those data we currently use to generate stats.
2021-11-29 33322, 2021
lucifer
monkey, sure can do that.
2021-11-29 33325, 2021
Anshika581
Hi everyone! This is Anshika from DTU currently in my 3rd year of Computer Engineering. I am very fond of contributing in open source projects. Looking forward for my participation in 2022.
2021-11-29 33347, 2021
monkey
Welcome Anshika581 !
2021-11-29 33348, 2021
PrathameshG
lucifer: thats exactly what I was looking for! Mind linking it?
the spark dump ones are parquet and the other ones are jsonl.
2021-11-29 33329, 2021
PrathameshG
Hmmm I'll try doing something with the JSON ones
2021-11-29 33337, 2021
PrathameshG
The project that I shared above was all in JSON as well
2021-11-29 33357, 2021
PrathameshG
is there anything specific that you might want me to do? e.g. I can write scripts to clean up and separate data
2021-11-29 33300, 2021
monkey
Cool, thanks lucifer I think with that I can start plugging in the data and we can see what we're missing
2021-11-29 33318, 2021
akshaaatt
Sounds good to me as well monkey
2021-11-29 33323, 2021
lucifer
PrathameshG: feel free to share your findings and ask for help in case needed here. the documentation can be a bit thin at places.
2021-11-29 33312, 2021
PrathameshG
Surely, I'll try something out and let you know :))
2021-11-29 33315, 2021
Anshika581 has quit
2021-11-29 33321, 2021
monkey
ruaok: discovering some good tunes in that playlist! Mission accomplished!
2021-11-29 33352, 2021
PrathameshG
I was also planning on using the Musicbrainz API to infer more from the existing data as well. Worried about the rate limiting tho.
2021-11-29 33353, 2021
lucifer
PrathameshG: i don't think we need anything particular at the moment, we have a pipeline of stats ready and i would consider the parquet dumps to rather cleaned well already.
2021-11-29 33326, 2021
lucifer
btw ruaok is not around currently, maybe ask him/talk to him as well but other than that a good starting point would be looking at existing tickets as akshaaatt suggested earlier.
2021-11-29 33306, 2021
PrathameshG
Hmmm alright. ig I'll try browsing the tickets as well and come up with something
2021-11-29 33329, 2021
PrathameshG
I am a bit new to all this so might take a little while to get used to I guess
2021-11-29 33341, 2021
lucifer
sure no worries. sounds good.
2021-11-29 33307, 2021
PrathameshG
Thanks for being this accomodating :))
2021-11-29 33324, 2021
monkey
We're here to help PrathameshG !
2021-11-29 33352, 2021
lucifer
monkey: i was thinking that sending the YIM data in props could make the page load a bit slow because YIM has a lot of data (although we can remove the unneeded data, once we are clear on what frontend needs) but then this page is going to be heavy to laod anyways (i think?) so perhaps fine.
2021-11-29 33323, 2021
monkey
I think in general we're going to slowly have to move towards passing initial props for all pages, to ease moving towards server-side rendering when the time comes
2021-11-29 33343, 2021
lucifer
ah ok, sounds good then.
2021-11-29 33314, 2021
monkey
At which level do you anticipate it'll slow down? Back-end? Front-end?
2021-11-29 33328, 2021
lucifer
frontend.
2021-11-29 33350, 2021
monkey
I don't think parsing more props from the page will have significant impact
2021-11-29 33318, 2021
monkey
And I'm guessing it's faster than having to call the AI and do the same parsing anyway.
2021-11-29 33325, 2021
monkey
API*
2021-11-29 33333, 2021
lucifer
makes sense. yeah i have been playing with some large json files today so probably overthinking this. in general efferct should be not noticeable.
2021-11-29 33341, 2021
akshaaatt
!m lucifer with all the json work!
2021-11-29 33341, 2021
BrainzBot
You're doing good work, lucifer with all the json work!!
2021-11-29 33354, 2021
riksucks
hi PrathameshG! Welcome to the community :D. Excited to see your work!
2021-11-29 33332, 2021
PrathameshG
thanks a lot! riksucks excited to be a part of the community as well :))
btw i forgot to mention my update for YIM, i dumped the data for AB and transferred it to michael. however am not sure on what stat to build out of it. we discussed weekday vs bpm but there are a few issues with it. i was hoping to enlist alastairp's help on that but since he is unavailable currently will either ask ruaok's help or drop AB stat plans.
2021-11-29 33310, 2021
ruaok returns
2021-11-29 33322, 2021
ruaok
sorry, I keep forgetting our extra meeting.
2021-11-29 33346, 2021
ruaok
but I've been sharing my results frequently, so I am guessing you all know what I've been working on.
2021-11-29 33303, 2021
ruaok
with the last playlist being a hit, so it seems, I'm nearly done with my work.
2021-11-29 33310, 2021
lucifer
yup i think all of your playlists are done now?
2021-11-29 33332, 2021
lucifer
nice :D
2021-11-29 33333, 2021
ruaok
I only need write code to list the playlists for each user in the YIM stats table.
2021-11-29 33303, 2021
ruaok
yes, all one. I made the decision to pivot on the last one, I was expecting bad results. now we have one with good results.
2021-11-29 33315, 2021
ruaok
which means that I can help you tomorrow on the AB front, lucifer
2021-11-29 33343, 2021
lucifer
i see, but we currently don't have any way for troi to connect stats table.
2021-11-29 33347, 2021
lucifer
awesome! :D
2021-11-29 33316, 2021
ruaok
yeah, I haven't worked out those details yet.
2021-11-29 33354, 2021
lucifer
maybe dump to a json/csv from troi and have a script run on lb backend insert in yim table.
2021-11-29 33357, 2021
ruaok
I might write a csv file and then a short script to import the data to stats
2021-11-29 33303, 2021
ruaok
lol. great minds!
2021-11-29 33306, 2021
lucifer
:D
2021-11-29 33323, 2021
TOPIC: MetaBrainz Community and Development channel | MusicBrainz non-development: #musicbrainz | BookBrainz: #bookbrainz | Channel is logged; see https://musicbrainz.org/doc/IRC for details | Agenda: Reviews, theless/insolite (reosarevok), aretha load (zas), Follow up on Summit Notes -> Tickets
2021-11-29 33317, 2021
yvanzo
reosarevok: thank you, looks good to me but the TBD :)
2021-11-29 33355, 2021
ruaok
heh. by listening to the top missed tracks, I'm influencing my listening future.
2021-11-29 33310, 2021
ruaok
I didn't think I had to consider time travel downsides when making playlists
2021-11-29 33329, 2021
CatQuest
wait what?
2021-11-29 33336, 2021
CatQuest
explain
2021-11-29 33333, 2021
ruaok
I'm listening to stuff that I haven't listened to yet. so when this playlist runs for real, it will have been affected by the tracks I listened to just now.
2021-11-29 33308, 2021
yvanzo
reosarevok: let's release musicbrainz-docker without the patch (still WIP), the issue was just servers being temporarily unavailable.
2021-11-29 33318, 2021
reosarevok
yvanzo: oh, perfect
2021-11-29 33321, 2021
reosarevok
ruaok: oooh, heh
2021-11-29 33326, 2021
Freso
<BANG>
2021-11-29 33326, 2021
Freso
It’s International Monday of Solidarity with the Palestinian People!
People up for reviews: bitmap, akshat, ruaok, lucifer, reosarevok, alastairp, zas, yvanzo, monkey, CatQuest, Freso – anyone else who want to give review, let me know ASAP!
2021-11-29 33326, 2021
Freso
bitmap: Go!
2021-11-29 33336, 2021
bitmap
hi
2021-11-29 33354, 2021
bitmap
I was sick last week so was mostly resting and didn't get much work done. feeling a lot better today
2021-11-29 33310, 2021
ruaok
yay
2021-11-29 33316, 2021
bitmap
not much to report otherwise. fin, go yvanzo!
2021-11-29 33337, 2021
yvanzo
Hi!
2021-11-29 33351, 2021
yvanzo
Reviewed some MBS pull requests
2021-11-29 33302, 2021
yvanzo
Fixed a small bug in new MBS deployment script
2021-11-29 33311, 2021
yvanzo
Investigated load issue with dump builders on aretha
2021-11-29 33350, 2021
yvanzo
Fin. Go reosarevok!
2021-11-29 33354, 2021
reosarevok
Hi!
2021-11-29 33353, 2021
reosarevok
I did quite a bit of work on updating old PRs and improving them, and finally improving our autoselect support for Apple Music links now that we can use multi-types (thanks again yyoung[m])
2021-11-29 33308, 2021
reosarevok
And I also spent quite a bit of time looking at a ton of genre lists and whatnot for alastairp :)
2021-11-29 33341, 2021
reosarevok
Currently preparing for a prod server release, and that's about it from me
2021-11-29 33345, 2021
reosarevok
CatQuest: what about you?
2021-11-29 33347, 2021
CatQuest
Meow! `😺`
2021-11-29 33359, 2021
CatQuest
Did several more summit tickets!
2021-11-29 33308, 2021
akshaaatt
!m CatQuest
2021-11-29 33308, 2021
BrainzBot
You're doing good work, CatQuest!
2021-11-29 33309, 2021
CatQuest
but ya'll cna do the rest now, I'm done :P
2021-11-29 33313, 2021
CatQuest
:D
2021-11-29 33331, 2021
CatQuest
The next four weeks I'll be busy doing various preparations, baking cookies, etcetra, so you'll see less of me :3
2021-11-29 33331, 2021
CatQuest
♏
2021-11-29 33331, 2021
CatQuest
fin, go zas
2021-11-29 33336, 2021
zas
Hey
2021-11-29 33344, 2021
Freso
(People still up: akshat, ruaok, lucifer, alastairp, monkey, Freso – anyone else who want to give review, let me know ASAP!)
2021-11-29 33359, 2021
zas
I continued my research on new gen gateways, started to write this down
2021-11-29 33328, 2021
zas
I also worked on Picard, mainly code cleanup, we should release another beta tomorrow
2021-11-29 33301, 2021
zas
Saturday there was an issue with github, and I noticed gitzconsul was creating zombie processes
2021-11-29 33313, 2021
zas
(btw, this issue was also existing with git2consul)
2021-11-29 33307, 2021
zas
so I investigated and patched it. The issue was very tricky, some subprocesses of git weren't properly killed on timeout
2021-11-29 33317, 2021
Shubh has quit
2021-11-29 33353, 2021
zas
I also investigated aretha load issue with the help of yvanzo, solutions are on the way
