#metabrainz

/

      • agatzk9 joined the channel
      • 2021-05-06 12608, 2021

      • agatzk9 has quit
      • 2021-05-06 12616, 2021

      • agatzk joined the channel
      • 2021-05-06 12634, 2021

      • mckean_ joined the channel
      • 2021-05-06 12658, 2021

      • mckean has quit
      • 2021-05-06 12610, 2021

      • milkii joined the channel
      • 2021-05-06 12648, 2021

      • nelgin has quit
      • 2021-05-06 12648, 2021

      • bitmap has quit
      • 2021-05-06 12648, 2021

      • navap- has quit
      • 2021-05-06 12648, 2021

      • ijc has quit
      • 2021-05-06 12659, 2021

      • nelgin joined the channel
      • 2021-05-06 12659, 2021

      • bitmap joined the channel
      • 2021-05-06 12659, 2021

      • navap- joined the channel
      • 2021-05-06 12659, 2021

      • ijc joined the channel
      • 2021-05-06 12646, 2021

      • thomasross has quit
      • 2021-05-06 12650, 2021

      • agatzk has quit
      • 2021-05-06 12635, 2021

      • nelgin
        yvanzo ?
      • 2021-05-06 12604, 2021

      • CatQuest has quit
      • 2021-05-06 12604, 2021

      • reosarevok
        ROpdebee, bitmap: any idea what could cause https://twitter.com/LatDorian/status/138997131856… ?
      • 2021-05-06 12632, 2021

      • reosarevok
        nelgin: IIRC yvanzo said he wouldn't be around a lot today, but leave the question and he might be able to help when he does appear :)
      • 2021-05-06 12650, 2021

      • nelgin
        I did and still waiting.
      • 2021-05-06 12655, 2021

      • nelgin
        Here it is again - https://pastebin.com/48HYrZPB (2nd attempt)
      • 2021-05-06 12600, 2021

      • reosarevok
        yvanzo: ^ when around
      • 2021-05-06 12609, 2021

      • CatQuest joined the channel
      • 2021-05-06 12649, 2021

      • _lucifer
        alastairp: https://github.com/metabrainz/listenbrainz-server… any reason we run mkdir prior to WORKDIR. my understanding is that WORKDIR creates the directory if it does not exist.
      • 2021-05-06 12658, 2021

      • _lucifer
      • 2021-05-06 12620, 2021

      • _lucifer
        >If the WORKDIR doesn’t exist, it will be created even if it’s not used in any subsequent Dockerfile instruction.
      • 2021-05-06 12638, 2021

      • nawcom has quit
      • 2021-05-06 12601, 2021

      • nawcom joined the channel
      • 2021-05-06 12606, 2021

      • sumedh joined the channel
      • 2021-05-06 12637, 2021

      • alastairp
        _lucifer: mmm, interesting. I guess I always just assumed that you had to create it before switching to it
      • 2021-05-06 12633, 2021

      • mrtriad joined the channel
      • 2021-05-06 12612, 2021

      • alastairp
        I had a dream last night that I was hosting all participants in the MeB summit, because I had 7 bedrooms in my house, but when we got home I remembered that I already had guests and there wasn't enough space for everyone
      • 2021-05-06 12654, 2021

      • mrtriad
        Good evening everyone. First of all I want to congrats for the musicbrainz project. Finding such a big and detailed open database was pretty unexpected ahah.
      • 2021-05-06 12654, 2021

      • mrtriad
        Anyway, I'm working on a small project for my uni. As a starting point I need to place on a nice map artists and albums, but I don't want to annoy with details. The whole thing should work on nodejs. Now, I set up the local dev version of musicbrainz, it works, but now I'm really starting to think if interacting with that server and some of the
      • 2021-05-06 12655, 2021

      • mrtriad
        community api is more or less convinient that setting up the database on its own.
      • 2021-05-06 12655, 2021

      • mrtriad
        I'd like to hear what are the advantages of interacting with the server in spite of the direct database, and I guess that this is the best place to ask that. Otherwise tell me simply to go away ;3
      • 2021-05-06 12658, 2021

      • ruaok
        calendaring is hard. even whle asleep.
      • 2021-05-06 12646, 2021

      • reosarevok
        mrtriad: depends on what you want to do
      • 2021-05-06 12651, 2021

      • ruaok
        mrtriad: welcome! and thanks!
      • 2021-05-06 12654, 2021

      • reosarevok
        The database is always going to be more powerful
      • 2021-05-06 12617, 2021

      • reosarevok
        (since you don't depend on the specific combinations of data the API offers you)
      • 2021-05-06 12626, 2021

      • reosarevok
        But on the other hand, you need to maintain a database copy :)
      • 2021-05-06 12604, 2021

      • reosarevok
        If you don't care about keeping the data up to date and are happy with just a static snapshot, you might as well use the database you already have, I guess :)
      • 2021-05-06 12617, 2021

      • mrtriad
        That's not a big deal luckily. But yay, thanks for the confirmation.
      • 2021-05-06 12617, 2021

      • mrtriad
        A few more question since you are so quick ahah. First of all, I installed the dev version during the server installation, though it's not so clear what's the difference from the normal one. (it's not a slave, so it's not up to date, though there are also a few other version to choose and the dev one is much smaller than the others)
      • 2021-05-06 12641, 2021

      • ruaok
        it has a tiny test database.
      • 2021-05-06 12604, 2021

      • ruaok
        which won't be useful for your purposes of collecting data. useful for development and not waiting a long time for data to download.
      • 2021-05-06 12617, 2021

      • ruaok
        do you have a list of artists for whom you want releases? how big is it?
      • 2021-05-06 12650, 2021

      • sumedh has quit
      • 2021-05-06 12658, 2021

      • reosarevok
        Yeah, it's basically taking a bunch of big artists and the data connected to them, so that there's enough to play with
      • 2021-05-06 12612, 2021

      • reosarevok
        So, it'd work for you to test, maybe, but it won't help much otherwise
      • 2021-05-06 12635, 2021

      • mrtriad
        oh, k. Clear clear.
      • 2021-05-06 12637, 2021

      • reosarevok
        (also because if you want countries, that's missing some area to country connections)
      • 2021-05-06 12618, 2021

      • mrtriad
        Also to get the db as a stand alone should I download the big one as I set up the server or should I follow this git https://github.com/lalinsky/mbdata?
      • 2021-05-06 12633, 2021

      • mrtriad
        (hope that posting link is legal)
      • 2021-05-06 12649, 2021

      • reosarevok
        Sure, why wouldn't it be :) luks is a friend
      • 2021-05-06 12612, 2021

      • reosarevok
        Assuming mbdata is up to date, the question is: do you want to be able to use the website too, or do you just need the DB
      • 2021-05-06 12637, 2021

      • mrtriad
        I just need the DB
      • 2021-05-06 12639, 2021

      • reosarevok
        If the DB is enough, mbdata is probably all you need. If you want to have a copy of the website locally to view the data with and whatnot, then use the main server
      • 2021-05-06 12656, 2021

      • mrtriad
        oh, ok. Perfect ^^
      • 2021-05-06 12624, 2021

      • mrtriad
        Welp, that's it for now. Thanks for your support and the quick replies
      • 2021-05-06 12625, 2021

      • reosarevok
        ruaok: I'm not missing any recent changes wrt mbdata, right? :)
      • 2021-05-06 12632, 2021

      • alastairp
        mrtriad: are you talking about using the mbdata db loading/replication functionality?
      • 2021-05-06 12632, 2021

      • reosarevok
        Just to make sure
      • 2021-05-06 12649, 2021

      • ruaok knows nothing
      • 2021-05-06 12654, 2021

      • alastairp
        reosarevok: it should be up to date. we use it in brainzutils
      • 2021-05-06 12618, 2021

      • alastairp
        but it's 2 things: an ORM for accessing the database from python, and some additional tools to set up a database without needing to use musicbrainz-docker or mbserver
      • 2021-05-06 12645, 2021

      • mrtriad
        Hmm what do you mean by "mbdata db loading/replication functionality"? I still have to take a look at the mbdata functionalities. I guess that at the end of that I'll have a local postgre with the musicbrainz db. Am I right?
      • 2021-05-06 12644, 2021

      • reosarevok
        I never used the orm, but I remember using it to just get a DB ready back in the day when I didn't want a local MB copy
      • 2021-05-06 12654, 2021

      • reosarevok
        But this was... well, a long time ago :D
      • 2021-05-06 12607, 2021

      • reosarevok
        Maybe by now just using the docker files would make your life easier
      • 2021-05-06 12623, 2021

      • alastairp
        mrtriad: sorry, I may not have explained that clearly. let me read your backlog
      • 2021-05-06 12650, 2021

      • alastairp
        mrtriad: I understand that you set up the database with musicbrainz-docker? Does that work well for you?
      • 2021-05-06 12631, 2021

      • mrtriad
        I set it up without docker. But yay, it works
      • 2021-05-06 12637, 2021

      • alastairp
        ah, right.
      • 2021-05-06 12652, 2021

      • alastairp
        mbdata does the same thing - if you've managed to set it up yourself then you don't need it
      • 2021-05-06 12601, 2021

      • yvanzo has quit
      • 2021-05-06 12634, 2021

      • reosarevok
        Yeah, I guess if you already have all installed, you could drop the sample data, and install the main data, and that would be the same
      • 2021-05-06 12619, 2021

      • mrtriad
        Oh, ok.
      • 2021-05-06 12639, 2021

      • mrtriad
        Welp, thanks again :3
      • 2021-05-06 12618, 2021

      • mrtriad
        Have a nice day and good luck at keeping up the project ^^
      • 2021-05-06 12602, 2021

      • sumedh joined the channel
      • 2021-05-06 12658, 2021

      • yvanzo joined the channel
      • 2021-05-06 12639, 2021

      • BrainzGit
        [musicbrainz-android] akshaaatt opened pull request #69 (master…update_barcode): Update Barcode Scanner Library to Google ML-Kit Barcode Scanning https://github.com/metabrainz/musicbrainz-android…
      • 2021-05-06 12632, 2021

      • akshaaatt[m]
        Hi _lucifer so apparently since jcenter has served its end, the barcode scanner library that we used to use needed to be switched since its creator had stopped the support and even the repo was no longer available, I have made the switch to the Google ML-Kit Barcode scanning library.
      • 2021-05-06 12612, 2021

      • akshaaatt[m] uploaded a video: MusicBrainz (6484KiB) < https://matrix.org/_matrix/media/r0/download/matrix.org/WKrNNxNAIENvEzBoBazFqRIl >
      • 2021-05-06 12634, 2021

      • yvanzo
        Hi nelgin: Sorry for not responding earlier, this is a SEARCH bug (happened in prod too), it is not related to your settings.
      • 2021-05-06 12630, 2021

      • BrainzGit
        [musicbrainz-server] reosarevok opened pull request #2093 (master…MBS-11643): MBS-11643: Don't disable links that haven't ended yet https://github.com/metabrainz/musicbrainz-server/…
      • 2021-05-06 12643, 2021

      • _lucifer
        akshaaatt[m]: we cannot use google ml library or for that matter any closed source library. otherwise we cannot publish on fdroid.
      • 2021-05-06 12620, 2021

      • ROpdebee
        reosarevok: RE that tweet, no clue. there's not much to go off, could be due to recent changes, could be similar to MBS-11621, could be something else entirely
      • 2021-05-06 12621, 2021

      • BrainzBot
        MBS-11621: can't upload cover art https://tickets.metabrainz.org/browse/MBS-11621
      • 2021-05-06 12645, 2021

      • _lucifer
        regarding the end of jcenter, they have recently decided to leave it as read only repository indefinitely so no urgent worry on that end.
      • 2021-05-06 12646, 2021

      • reosarevok
        I thought of MBS-11621 but they say it works for most files
      • 2021-05-06 12620, 2021

      • reosarevok
        So it's probably something else, but no idea what
      • 2021-05-06 12654, 2021

      • akshaaatt[m]
        <_lucifer "akshaaatt: we cannot use google "> Oh! I didn't know this.
      • 2021-05-06 12651, 2021

      • akshaaatt[m]
        <_lucifer "regarding the end of jcenter, th"> Okayy, so I'll close my pull request then and mark it stale.
      • 2021-05-06 12613, 2021

      • _lucifer
        thanks!
      • 2021-05-06 12634, 2021

      • BrainzGit
        [musicbrainz-android] akshaaatt closed pull request #69 (master…update_barcode): Update Barcode Scanner Library to Google ML-Kit Barcode Scanning https://github.com/metabrainz/musicbrainz-android…
      • 2021-05-06 12633, 2021

      • _lucifer
      • 2021-05-06 12623, 2021

      • sumedh has quit
      • 2021-05-06 12629, 2021

      • alastairp
        _lucifer: 1424 has some pending work on it - I found some other issues
      • 2021-05-06 12627, 2021

      • _lucifer
        oh ok! ever since i saw that PR I cannot bear the long docker build times ;). i'll wait for now then.
      • 2021-05-06 12611, 2021

      • _lucifer
        alastairp, regarding zipstream i checked its GPLv3. GNU's website says that GPLv2 and GPLv3 are incompatible so indeed we cannot use it.
      • 2021-05-06 12620, 2021

      • _lucifer
      • 2021-05-06 12614, 2021

      • _lucifer
        searching on pypi for other zip libraries also doesn't turn up much only xtract and reusables seem usable and xtract is GPLv3. reuseables is MIT license. i'll checkout reuseables and see if it serves our purpose.
      • 2021-05-06 12615, 2021

      • alastairp
        _lucifer: ok, it's a quick fix on 1424, let me do it now. it was related to my question about the new spark image
      • 2021-05-06 12627, 2021

      • alastairp
        _lucifer: the reason for using a streaming library is so that we don't have to load all items into memory, then compress it, then send it (that'll make a request take a long time, especially for a large dataset)
      • 2021-05-06 12642, 2021

      • alastairp
        another option would be to only allow users to do it for small datasets, but that's annoying too
      • 2021-05-06 12612, 2021

      • _lucifer
        how about moving the task into background and asking the user to check back later on a page that will get updated once the zip is generated?
      • 2021-05-06 12648, 2021

      • _lucifer
        we could say retain the zip for a week or so.
      • 2021-05-06 12623, 2021

      • alastairp
        yeah, that was the other other option, but it has its own set of problems
      • 2021-05-06 12629, 2021

      • _lucifer
        yeah right
      • 2021-05-06 12633, 2021

      • _lucifer
        this issue also comes up in LB in listens export.
      • 2021-05-06 12637, 2021

      • alastairp
        1) backend processing system, 2) notification system, 3) DoS/file cleanup
      • 2021-05-06 12653, 2021

      • alastairp
        so... if we need it for 2 services... should we just implement it in BU?
      • 2021-05-06 12624, 2021

      • _lucifer
        yeah, i think that's the right way forward.
      • 2021-05-06 12651, 2021

      • sumedh joined the channel
      • 2021-05-06 12636, 2021

      • _lucifer
        LB-324
      • 2021-05-06 12637, 2021

      • BrainzBot
        LB-324: the export data feature currently does all its work in the webserver view https://tickets.metabrainz.org/browse/LB-324
      • 2021-05-06 12639, 2021

      • alastairp
        well, let's put that on the list some time :)
      • 2021-05-06 12627, 2021

      • _lucifer
        just checked reusables its just a wrapper around zipfile, no streaming support there :(
      • 2021-05-06 12658, 2021

      • alastairp
        hah, right
      • 2021-05-06 12620, 2021

      • alastairp
        in order to close this PR off, we could run some experiments and come up with a limit... maybe 1000 items? and do it in the view
      • 2021-05-06 12630, 2021

      • alastairp
        then open a new ticket/plan for background processing
      • 2021-05-06 12645, 2021

      • _lucifer
        yeah makes sense.
      • 2021-05-06 12652, 2021

      • alastairp
        thanks!
      • 2021-05-06 12643, 2021

      • alastairp
        oh, looking at my last commits that's exactly what I did
      • 2021-05-06 12603, 2021

      • alastairp
        so let's run some tests on bono (there's an almost full db there) and see what a good limit is
      • 2021-05-06 12642, 2021

      • mrtriad has quit
      • 2021-05-06 12622, 2021

      • _lucifer
        alastairp, i think i do not have the permissions for acousticbrainz directory on bono.
      • 2021-05-06 12634, 2021

      • _lucifer
        i am unable to run any git command there.
      • 2021-05-06 12652, 2021

      • alastairp
        sudo su - acousticbrainz
      • 2021-05-06 12620, 2021

      • _lucifer
        iirc i do not have sudo permissions on bono
      • 2021-05-06 12644, 2021

      • _lucifer
        >lucifer is not in the sudoers file. This incident will be reported.
      • 2021-05-06 12604, 2021

      • alastairp
        you're in the sudo group now. log out and log in again
      • 2021-05-06 12647, 2021

      • _lucifer
        works now thanks!
      • 2021-05-06 12648, 2021

      • alastairp
        great
      • 2021-05-06 12654, 2021

      • alastairp
        1424 is ready, I'm just doing it now
      • 2021-05-06 12635, 2021

      • _lucifer
        thanks, i'll merge 1430 after 1424 and so that https://github.com/metabrainz/listenbrainz-server… can be tested
      • 2021-05-06 12626, 2021

      • _lucifer
        alastairp, i do not understand why we need to add PYTHON_BASE_IMAGE_VERSION twice in 1424.
      • 2021-05-06 12617, 2021

      • _lucifer
        ah ok, just saw that if its declared before FROM it cannot be used after it.
      • 2021-05-06 12615, 2021

      • Mr_Monkey
        _lucifer: I've been digging some more around those typescript issues (#1429) but didn't find a better solution than the commit you added.
      • 2021-05-06 12615, 2021

      • Mr_Monkey
        I tried removing preset-typesrcript to use only plugin-transform-typescript but ran into issue with tsx and with libraries.
      • 2021-05-06 12615, 2021

      • Mr_Monkey
        These issues should go away when Babel v8 comes out.
      • 2021-05-06 12630, 2021

      • Mr_Monkey
        In the meantime this seems to work fine, so I'm doing a last round of checking before merging.
      • 2021-05-06 12615, 2021

      • _lucifer
        cool, thanks!
      • 2021-05-06 12641, 2021

      • _lucifer
        i wanted to merge 1430 before it so that it could be tested but since its working for you as well. we can go ahead and merge it.
      • 2021-05-06 12626, 2021

      • BrainzGit
        [listenbrainz-server] MonkeyDo merged pull request #1429 (master…monkey-fix-typescript-compilation): Fix typescript compilation https://github.com/metabrainz/listenbrainz-server…
      • 2021-05-06 12651, 2021

      • Mr_Monkey
        I'll now update #1390