#metabrainz

/

      • D4RK-PH0ENiX joined the channel
      • 2020-03-10 07013, 2020

      • D4RK-PH0ENiX has quit
      • 2020-03-10 07040, 2020

      • Lotheric joined the channel
      • 2020-03-10 07041, 2020

      • D4RK-PH0ENiX joined the channel
      • 2020-03-10 07041, 2020

      • d4rkie joined the channel
      • 2020-03-10 07043, 2020

      • D4RK-PH0ENiX has quit
      • 2020-03-10 07026, 2020

      • Endurance21 joined the channel
      • 2020-03-10 07043, 2020

      • BrainzGit
        [bookbrainz-site] prabalsingh24 opened pull request #386 (master…EditorActivity): Editor activity https://github.com/bookbrainz/bookbrainz-site/pul…
      • 2020-03-10 07008, 2020

      • antara joined the channel
      • 2020-03-10 07040, 2020

      • Endurance21 has quit
      • 2020-03-10 07041, 2020

      • Endurance21 joined the channel
      • 2020-03-10 07008, 2020

      • Endurance21 has quit
      • 2020-03-10 07023, 2020

      • Endurance21 joined the channel
      • 2020-03-10 07007, 2020

      • D4RK-PH0ENiX joined the channel
      • 2020-03-10 07009, 2020

      • d4rkie has quit
      • 2020-03-10 07018, 2020

      • D4RK-PH0ENiX has quit
      • 2020-03-10 07052, 2020

      • D4RK-PH0ENiX joined the channel
      • 2020-03-10 07010, 2020

      • skywinder joined the channel
      • 2020-03-10 07048, 2020

      • Endurance21 has quit
      • 2020-03-10 07042, 2020

      • skywinder
        hello, music fellows
      • 2020-03-10 07022, 2020

      • sumedh joined the channel
      • 2020-03-10 07018, 2020

      • prabal has quit
      • 2020-03-10 07059, 2020

      • skywinder has quit
      • 2020-03-10 07013, 2020

      • skywinder2 joined the channel
      • 2020-03-10 07003, 2020

      • sumedh_p joined the channel
      • 2020-03-10 07035, 2020

      • sumedh- joined the channel
      • 2020-03-10 07055, 2020

      • sumedh has quit
      • 2020-03-10 07044, 2020

      • skywinder2 is now known as skywinder
      • 2020-03-10 07003, 2020

      • skywinder is now known as skywinder3
      • 2020-03-10 07048, 2020

      • sumedh_p has quit
      • 2020-03-10 07048, 2020

      • skywinde_ joined the channel
      • 2020-03-10 07048, 2020

      • skywinde_ is now known as skywinder_
      • 2020-03-10 07002, 2020

      • skywinder_ is now known as skywinder3_
      • 2020-03-10 07006, 2020

      • skywinder3_ is now known as skywinderr
      • 2020-03-10 07016, 2020

      • skywinderr is now known as skywinder_
      • 2020-03-10 07014, 2020

      • skywinder_
        /msg NickServ VERIFY REGISTER skywinder_ pgzdvspwjoqv
      • 2020-03-10 07016, 2020

      • sumedh joined the channel
      • 2020-03-10 07002, 2020

      • sumedh- has quit
      • 2020-03-10 07023, 2020

      • skywinder joined the channel
      • 2020-03-10 07035, 2020

      • skywinder_ has quit
      • 2020-03-10 07058, 2020

      • sumedh has quit
      • 2020-03-10 07017, 2020

      • sumedh joined the channel
      • 2020-03-10 07024, 2020

      • shivam-kapila joined the channel
      • 2020-03-10 07040, 2020

      • skywinde_ joined the channel
      • 2020-03-10 07012, 2020

      • skywinde_ is now known as skywinder_
      • 2020-03-10 07017, 2020

      • skywinder_ is now known as skywinder__
      • 2020-03-10 07039, 2020

      • skywinder3 has quit
      • 2020-03-10 07045, 2020

      • sumedh has quit
      • 2020-03-10 07039, 2020

      • sumedh joined the channel
      • 2020-03-10 07045, 2020

      • sumedh has quit
      • 2020-03-10 07000, 2020

      • skywinder has quit
      • 2020-03-10 07000, 2020

      • skywinder__ has quit
      • 2020-03-10 07023, 2020

      • prabal joined the channel
      • 2020-03-10 07034, 2020

      • prabal
        Hello skywinder
      • 2020-03-10 07038, 2020

      • skywinder__ joined the channel
      • 2020-03-10 07021, 2020

      • skywinder__ has quit
      • 2020-03-10 07054, 2020

      • pristine__
        Happy Holi everyone
      • 2020-03-10 07006, 2020

      • shivam-kapila
        Happy Holi 🎉
      • 2020-03-10 07012, 2020

      • ishaanshah[m]
        Happy Holi!!
      • 2020-03-10 07038, 2020

      • CatQuest
        :D happyholi indians and others!
      • 2020-03-10 07031, 2020

      • CatQuest
      • 2020-03-10 07031, 2020

      • CatQuest
        so that fits
      • 2020-03-10 07025, 2020

      • shivam-kapila
        Oho. Thats nice!!
      • 2020-03-10 07010, 2020

      • Pac23
        Happy Holi
      • 2020-03-10 07045, 2020

      • Pac23
        *canceled
      • 2020-03-10 07026, 2020

      • gr0uch0mars
        Sorry Pac23 here schools are being cancelled too
      • 2020-03-10 07052, 2020

      • Pac23
        where ?
      • 2020-03-10 07005, 2020

      • gr0uch0mars
        Madrid, Spain
      • 2020-03-10 07014, 2020

      • Pac23
        but canceling schools is just nice
      • 2020-03-10 07027, 2020

      • Pac23
        i wish someone canceled my univ
      • 2020-03-10 07027, 2020

      • gr0uch0mars
        And companies are “suggesting” to work remotely
      • 2020-03-10 07045, 2020

      • gr0uch0mars
        hahaha Try with some coughs in class
      • 2020-03-10 07020, 2020

      • Pac23
        my college did not cancel cancel even during riots
      • 2020-03-10 07026, 2020

      • Pac23
        corono aint affecting them
      • 2020-03-10 07026, 2020

      • shivam-kapila
        Interesting idea
      • 2020-03-10 07044, 2020

      • shivam-kapila
        Pac23: U study at Delhi?
      • 2020-03-10 07051, 2020

      • Pac23
        nope mumbai
      • 2020-03-10 07002, 2020

      • Gazooo has quit
      • 2020-03-10 07016, 2020

      • shivam-kapila
        Ohh. Not aware of mumbai riots
      • 2020-03-10 07035, 2020

      • Pac23
        this happened a year ago or so
      • 2020-03-10 07044, 2020

      • Gazooo joined the channel
      • 2020-03-10 07049, 2020

      • Pac23
        would some feedback on the .proto file https://github.com/Pac23/listenbrainz-server/comm…
      • 2020-03-10 07014, 2020

      • Pac23
        this represents the submit listen endpoints json load
      • 2020-03-10 07025, 2020

      • yvanzo
        happy holi
      • 2020-03-10 07052, 2020

      • pristine__
        > i wish someone canceled my univ
      • 2020-03-10 07056, 2020

      • pristine__
        Me too Pac23
      • 2020-03-10 07020, 2020

      • shivam-kapila
        Isnt NITH already on bunks
      • 2020-03-10 07056, 2020

      • BrainzGit
        [musicbrainz-server] yvanzo merged pull request #1406 (master…dump-compress-level): Add compression level to MBDump https://github.com/metabrainz/musicbrainz-server/…
      • 2020-03-10 07029, 2020

      • Pac23
        > would some feedback on the .proto file
      • 2020-03-10 07033, 2020

      • Pac23
        *love some
      • 2020-03-10 07044, 2020

      • SothoTalKer joined the channel
      • 2020-03-10 07054, 2020

      • SothoTalKer_ has quit
      • 2020-03-10 07025, 2020

      • D4RK-PH0ENiX has quit
      • 2020-03-10 07028, 2020

      • D4RK-PH0ENiX joined the channel
      • 2020-03-10 07035, 2020

      • alastairp
        Freso: good morning. Last year, did we decide to hide old proposals in community during the submission period? I seem to recall that I was in favour of it to encourage students to write their own proposals instead of copying the structure of previous ones
      • 2020-03-10 07018, 2020

      • prabal has quit
      • 2020-03-10 07024, 2020

      • SomalRudra joined the channel
      • 2020-03-10 07050, 2020

      • SomalRudra
        Hello ! i've uploaded a draft proposal for MusicBrainz android on the community website.Kindly have a look at it and give your valuable Feedbacks... https://community.metabrainz.org/t/gsoc-2020-desi…
      • 2020-03-10 07027, 2020

      • gr0uch0mars
        Great! I'll check it /cc _lucifer
      • 2020-03-10 07005, 2020

      • gr0uch0mars
        SomalRudra: let’s wait till _lucifer reads it because he’s working on it too. I was last year’s mentor and this year too
      • 2020-03-10 07043, 2020

      • SomalRudra
        Yeah yeah please take your time :)
      • 2020-03-10 07023, 2020

      • Pac23
        ruaok have you thought about a schema for timescale db ?
      • 2020-03-10 07056, 2020

      • SomalRudra has quit
      • 2020-03-10 07008, 2020

      • SothoTalKer has quit
      • 2020-03-10 07045, 2020

      • SothoTalKer joined the channel
      • 2020-03-10 07057, 2020

      • c1e0 joined the channel
      • 2020-03-10 07027, 2020

      • CatQuest
      • 2020-03-10 07031, 2020

      • c1e0 has quit
      • 2020-03-10 07037, 2020

      • c1e0 joined the channel
      • 2020-03-10 07001, 2020

      • c1e0_ joined the channel
      • 2020-03-10 07009, 2020

      • c1e0 has quit
      • 2020-03-10 07009, 2020

      • ruaok
      • 2020-03-10 07023, 2020

      • ruaok
        I will add one more column, but that is it.
      • 2020-03-10 07008, 2020

      • ruaok
        CatQuest: that picture, the tennis ball one and the pineapple ones are sent to me about once a month. :)
      • 2020-03-10 07024, 2020

      • ruaok
        Pac23: time to read some background on go's protobufs, then i'll look at your schema
      • 2020-03-10 07017, 2020

      • Pac23
        ruaok i found this better than the other link that pops up on google search
      • 2020-03-10 07018, 2020

      • Pac23
      • 2020-03-10 07052, 2020

      • Pac23
        ill check out the timedb code and get back asap ,working on the proposal aswell now will get back with that too :)
      • 2020-03-10 07055, 2020

      • ruaok
        thx. and proto3 is what was just releases, yes?
      • 2020-03-10 07006, 2020

      • Pac23
        the new golang api for that was released recently,proto3 is kind of old now almost 8-9 monhts
      • 2020-03-10 07010, 2020

      • Pac23
        *months
      • 2020-03-10 07022, 2020

      • Pac23
        but yes the latest of all porotobufs
      • 2020-03-10 07044, 2020

      • ruaok
        why not code to the latest version then?
      • 2020-03-10 07054, 2020

      • Pac23
        i am coding to the latest version
      • 2020-03-10 07056, 2020

      • Pac23
        proto3
      • 2020-03-10 07048, 2020

      • ruaok
        the new golang api is what proto4?
      • 2020-03-10 07019, 2020

      • Pac23
        no afaik ,even google only had language guides upto proto3
      • 2020-03-10 07027, 2020

      • Pac23
        *has
      • 2020-03-10 07000, 2020

      • Pac23
        also i have been thinking about using https://pkg.go.dev/github.com/golang/protobuf/jso… to marshall json to proto
      • 2020-03-10 07001, 2020

      • ruaok
        so marshall json to PB asap, then use PB for the ingestion and then right before insertion, back to JSON?
      • 2020-03-10 07036, 2020

      • Pac23
        marhsall json to pb for ingestion yes, right before insertion where rabbit mq to spark ? or db ? i thought this should be kept in protobuf aswell why convert back to something ? am i missing something ?
      • 2020-03-10 07049, 2020

      • ruaok
        db. the DB will remain JSON.
      • 2020-03-10 07028, 2020

      • Pac23
        oh,had not seen the recently shared schema,
      • 2020-03-10 07049, 2020

      • Pac23
        saw it now,
      • 2020-03-10 07053, 2020

      • Pac23
        yup so back to json or why not insert the original json itself,keep it in the memory at the start itself,unless only specific json fields are to be inserted
      • 2020-03-10 07028, 2020

      • shivam-kapila
        I am not sure. But I guess protobuf is to be transmitted via RMQ. The converted json is to be stored at other end.
      • 2020-03-10 07049, 2020

      • ruaok
        shivam-kapila: that.
      • 2020-03-10 07021, 2020

      • Pac23
        ah so ingested data back to json -> db
      • 2020-03-10 07017, 2020

      • antara has quit
      • 2020-03-10 07042, 2020

      • Pac23
        so ruaok i am kind of ashamed to admit this but the root of all the confusion related to the workflow lies in >" a tool that will read incoming listens from the RabbitMQ queue, write them to the Timescale DB and then pass on the unique listens down another RabbbitMQ pipeline (was influx_writer, will soon be timescale_writer). "
      • 2020-03-10 07003, 2020

      • Pac23
        i get that the tool will write to db and i have to write the tool,my question is where does this RBMQ pipeline come from ? the ingestor written in go ?
      • 2020-03-10 07017, 2020

      • ruaok
        have you made that diagram I asked you to make?
      • 2020-03-10 07043, 2020

      • Pac23
        i was creating that infact when i asked this,
      • 2020-03-10 07059, 2020

      • ruaok
        show me what you've got.
      • 2020-03-10 07015, 2020

      • Pac23
        i understand upto the point of data after validation being submitted to the specific queue as per the type
      • 2020-03-10 07043, 2020

      • ruaok
        show me your diagram so far.
      • 2020-03-10 07014, 2020

      • CatQuest
        i don know the tennis ball one or he pineapple one. this is the first time I see lizard-head man
      • 2020-03-10 07027, 2020

      • CatQuest
        :)
      • 2020-03-10 07026, 2020

      • Pac23
      • 2020-03-10 07033, 2020

      • Pac23
        uptil now