#metabrainz

/

      • outsidecontext
        yes, shared translation memory is possible
      • CatQuest
        (but not with the dedicated cloud thing apparently)
      • outsidecontext
        looks like we can't download the existing TM from transifex, though, unless we have a payed plan there :(
      • CatQuest
        ew
      • ruaok
        so if we want tshared translation we need the 17eur version?
      • CatQuest
        if I understood the prices page correctly
      • yvanzo
        outsidecontext: ok, that was the main point (using both weblate and transifex for Picard to start with), thanks.
      • sumedh has quit
      • Freso
        If we decide to switch to Weblate, could we do a one-time payment to Tfx to fetch the TM from there and import that to WL?
      • CatQuest
        since th uy seems resonable to talk to acc to outsidecontext we can ask?
      • yvanzo
        I worked on MB OAuth integration too, so I’m curious if it could be possible to have it with paid hosting.
      • Mr_Monkey
        That's what I was thinking too
      • ruaok
        I'm confused that shared memory is only available on the 17 tier, but SSO only on 25? WTF?
      • CatQuest
        "You can add screenshots to ease translation of UI"
      • wow
      • Freso
        Either way, seems like a decent trade-off to get out of exactly that vendor lock-in. The longer we stay in the lock-in, the more the sunken cost will be.
      • outsidecontext
        ruaok: I think this note about shared TM is meant different: On 17€ you only get a TM you have to share with others
      • CatQuest
        ruaok: yea, that seems weird. so i think we might ask the guy
      • oooohhhhhh
      • outsidecontext
        I think we should go with the 25€ version for full control of settings
      • ruaok
        ah, ok, yes.
      • should I just go sign us up?
      • CatQuest
        I mean we could test picard *first* but
      • ...
      • "You can integrate your own oauth provider, so login with MB credentials would be possible"
      • ruaok
        oh, loads more options. let me know what we need, I have no clue what our current needs are.
      • CatQuest
        man I say go!
      • Freso
        Maybe outsidecontext and ruaok et al can figure out the specifics outside of the meeting. :)
      • ruaok
        yeah.
      • CatQuest
        nothing i've seen on weblate or testing it some time earlier made me hate it :d
      • outsidecontext
        ruaok: I'll probably not have time to set things up this week, not sure yet. wait a bit, I'll check a few things what is possible and needed and then we can talk about signing up
      • Freso
        yvanzo: Got more comments, or good to go? :)
      • yvanzo
        CatQuest: not really out of the box, it requires some glue code.
      • ruaok
        looking further, I think 99eur is actually what we'll need. :(
      • CatQuest
        sure of course
      • aw
      • Freso
        I think we’re all done, so…
      • Thank you everyone for your time! Stay safe out there, and enjoy the sun (while wearing a mask and using sunscreen and otherwise staying safe!) if you have some where you are!
      • </BANG>
      • yvanzo
        Thank you!
      • _lucifer
      • alastairp
        ruaok: however, they also offer that same plan free to open source projects, so maybe there's some wiggle room to ask for that but offer to pay something
      • Mr_Monkey
        Thanks !
      • Have a good week everyone!
      • _lucifer
        the cache works but this time pulling the image took more time.
      • alastairp
        yeah, interesting
      • ruaok
        if there is a free plan, then I'll just donate 500eur per year and be done.
      • alastairp
        yeah, right.
      • yvanzo
        this looks nice to support weblate one way or another
      • ruaok
        for sure.
      • _lucifer
        the actions' docs say that pulling from docker hub is almost always faster.
      • Mr_Monkey
        I think the open-source plan is the same (for free) as the 99€/m plan, if I read correctly
      • alastairp
        though did outsidecontext say that all open source projects share a server and it's sometimes slow? might be something to consider
      • _lucifer: I think it's saying there "pull complete images from docker hub every time instead of caching the pulled image"
      • ruaok
        once we understand our needs I'll chat them up and see if we can reach some middle ground consensus that doesn't lump is into the OSS much
      • muck
      • _lucifer
        alastairp: yes, that's what i intended to say 😅.
      • alastairp
        _lucifer: ah, right
      • maybe this will have a bit more impact on larger projects
      • _lucifer
        yeah.
      • alastairp
        with the original basic version: 1m to build, 1m to pull, 30s to run tests
      • BrainzGit
        [musicbrainz-server] reosarevok opened pull request #2057 (master…edit-preview-id-warning): Fix Catalyst warning: id is missing in edit previews https://github.com/metabrainz/musicbrainz-serve...
      • alastairp
        I just re-ran and the pull was faster: https://github.com/metabrainz/brainzutils-pytho...
      • _lucifer
        yup, i saw.
      • alastairp
        but it's 1m pull, 20s uncache, 30s run tests, 20s re-cache
      • ruaok
        jasondk: added comments to your proposal.
      • alastairp
        see how build was only 7s though!
      • _lucifer
        yes, this should be useful in LB.
      • alastairp
        so in this case 20+20+7 is the same as the 1m to build
      • but if in LB it means we can do 20+20+7 instead of 5m, that'd be great
      • _lucifer
        i'll add login to this PR and work on LB next.
      • maybe if we use github's docker registry, it gets a bit faster?
      • alastairp
        yeah, I was wondering about that
      • do you know why the cache has so many different items?
      • _lucifer
        i think its caching all the layers
      • alastairp
        if you expand the log, it's uncoompressing hundreds of files
      • MRiddickW has quit
      • ah, because it tells docker to write layers to /home/runner/work/_temp/, and then it just compresses everything?
      • _lucifer
        yes, see the post run log
      • /usr/bin/sh -c docker save '93323ae7d41a' '93323ae7d41a' 'd4b80a89fb19' '539e6638127c' 'fd3a0bfdf6e5' '73f376d0faa9' 'd2b96ca0ec01' '1258b0a636fa' 'd674c0ed597b' '3b94a3228b2f' '31fb65592bb8' '12224c6bf952' 'cf3f2a822d1d' 'e8c5cba13786' '87c80a349ede' '87c80a349ede' 'f5b92d01403e' 'deb6b0db88c8' 'fd3a0bfdf6e5' '73f376d0faa9' 'd2b96ca0ec01' '1258b0a636fa' 'd674c0ed597b' '3b94a3228b2f' '31fb65592bb8' '12224c6bf952' 'cf3f2a822d1d'
      • 'e8c5cba13786' '1191a3b81e8b' '1191a3b81e8b' '634c18ad9871' '4b29d21373f6' 'fd3a0bfdf6e5' '73f376d0faa9' 'd2b96ca0ec01' '1258b0a636fa' 'd674c0ed597b' '3b94a3228b2f' '31fb65592bb8' '12224c6bf952' 'cf3f2a822d1d' 'e8c5cba13786' 'e8c5cba13786' 'e8c5cba13786' 'brainzutils_test_test:latest' '93323ae7d41a' 'd4b80a89fb19' '539e6638127c' 'fd3a0bfdf6e5' '73f376d0faa9' 'd2b96ca0ec01' '1258b0a636fa' 'd674c0ed597b' '3b94a3228b2f' '31fb65592bb8'
      • '12224c6bf952' 'cf3f2a822d1d' 'e8c5cba13786' 'metabrainz/python:3.7-20210115' 'e8c5cba13786' | tar xf - -C .
      • alastairp
        maybe we could tell it to not do any compressing for example, to make it faster?
      • we'll see how it goes in LB, maybe it needs a bit of tweaking
      • less tweaking than jenkins though ;)
      • _lucifer
        yeah, let's try that in LB so that we can have better results. in BU, the variance in results will be more i think
      • ShivamAwasthi joined the channel
      • i was going to try this for login `echo ${{ secrets.DOCKERHUB_PASSWORD }} | docker login -u ${{ secrets.DOCKERHUB_USERNAME }} --password-stdin`
      • MRiddickW joined the channel
      • this shouldn't print the password to logs i think, but i would like to confirm.
      • alastairp
        yeah, I think that might work
      • rememeer that you can set the password to a fake one first and run it... see what happens ;)
      • if it works, the login should fail
      • _lucifer
        ah yes! will do that.
      • seems to work as expected!
      • outsidecontext
        regarding LB spammers: what's the point there? I don't really get the concept, how and why does someone spam LB!?
      • _lucifer
        the spammers send listens of the same song or artist a large number of times.
      • i am not sure what the point is but it can definitely act as a bias in recommendations or other features.
      • ruaok
        outsidecontext: beats me
      • utterly pointless
      • but at least the sockpuppets are easy to identify
      • CatQuest
        maybe agents of some label or popularity thing
      • outsidecontext
        ok. I guess as soon as one can submit data somewhere someone will spam it
      • ruaok
        yep
      • googlejuice maybe?
      • CatQuest
        spam is so stupid! i didn't sign up for ebay for yeeeaaars becasue i got spam from there and it put me off
      • _lucifer
        alastairp: ruaok: how about adding docker password and username as organization level secrets so that we can use them in actions across all MeB projects. otherwise, we'd have to add it on to each repo individually.
      • CatQuest
        only after it was explaiend to me that they thmselves didn't sned spam did i start to understand
      • ruaok
        sounds like a decent idea to me, but I don't know much about it.
      • _lucifer
        i think there's probably a control for the org admin to define it there and then limit visibility to specific repos.
      • (in case we want to do that)
      • alastairp
        _lucifer: yeah, good idea to make it org-level
      • _lucifer
        awesome! ruaok, can you do the honours please :)
      • alastairp
        _lucifer: find some docs for him to follow :)
      • _lucifer
      • alastairp
        + names of the secrets, and where to find the values in syswiki
      • _lucifer
        we need to add `DOCKER_HUB_USERNAME` and `DOCKER_HUB_PASSWORD`. their values are here https://github.com/metabrainz/syswiki/blob/mast...
      • shivam-kapila
        Mr_Monkey: what component did you use for the date time picker
      • Mr_Monkey
      • shivam-kapila
        Thanks :)
      • Mr_Monkey
        I dropped the time picker part, which comes with another package (https://github.com/wojtekmaj/react-datetime-picker)
      • shivam-kapila
        Oh the latter is what I need. Thanks again
      • BrainzGit
        [brainzutils-python] amCap1712 opened pull request #64 (master…cache-misc): Miscellaneous pending cache changes https://github.com/metabrainz/brainzutils-pytho...
      • _lucifer
        alastairp: what details should we add here? https://github.com/metabrainz/brainzutils-pytho...
      • BrainzGit
        [listenbrainz-server] amCap1712 opened pull request #1385 (master…gh): Ciao Jenkins! https://github.com/metabrainz/listenbrainz-serv...
      • alastairp
        _lucifer: just something like "calls _prep_key on the keys of dictionaries with the namespace and encode_val on the values if encode is True"
      • jasondk
        Thank you alastairp :)
      • _lucifer
        alastairp: 👍, and regarding tests for `_prep_key`, do you have any specific test case in mind that should definitely be added?
      • alastairp
        remind me - are there any tests for it?
      • what does it do? add namespace to a key?
      • _lucifer
        no
      • jasondk
        and I appreciate the feedback ruaok, I will update the proposal on the forum and also submit it on the GSoC site tonight.
      • alastairp
        it used to encode to bytes, but doesn't do that any more?
      • Vardan joined the channel
      • Vardan
        Hello everyone, so the idea I am planning on working is "Integrate more music services for recording listens and playing music" and I need some guidance how should write my proposal. If you guys have some referral implementations that would be great. I want to integrate deezer
      • alastairp
        (sorry, I don't have it open atm)
      • _lucifer
        alastairp: yes add to namespace and ensure ascii
      • alastairp
        _lucifer: right, those sound like 2 great tests :)
      • Vardan has quit
      • vardan_ is now known as vardan
      • _lucifer
        👍
      • Vardan13 joined the channel
      • vardan: we currently have a spotify integration which may be helpful https://github.com/metabrainz/listenbrainz-serv...
      • Vardan13
        Do you guys have any reference code or any reference template that I can see. That would be a great help
      • thx @_luc
      • _lucifer
        deezer or any other music service should probably be similar
      • Vardan13
        Ohkay thx
      • flamingspinach has quit
      • flamingspinach joined the channel