#metabrainz

/

      • nawcom has quit
      • 2019-05-16 13605, 2019

      • nawcom joined the channel
      • 2019-05-16 13658, 2019

      • Nyanko-sensei joined the channel
      • 2019-05-16 13657, 2019

      • D4RK-PH0ENiX has quit
      • 2019-05-16 13614, 2019

      • Nyanko-sensei has quit
      • 2019-05-16 13646, 2019

      • D4RK-PH0ENiX joined the channel
      • 2019-05-16 13643, 2019

      • BestSteve has quit
      • 2019-05-16 13613, 2019

      • BestSteve joined the channel
      • 2019-05-16 13652, 2019

      • AfroThundr|main has quit
      • 2019-05-16 13640, 2019

      • AfroThundr|main joined the channel
      • 2019-05-16 13605, 2019

      • DropItLikeItsHot joined the channel
      • 2019-05-16 13645, 2019

      • AfroThundr|main has quit
      • 2019-05-16 13636, 2019

      • yvanzo
        mo’’in’
      • 2019-05-16 13628, 2019

      • ruaok
        moin
      • 2019-05-16 13630, 2019

      • BrainzGit
        [sir] yvanzo merged pull request #105 (master…bump-req): Update requirements mbdata and pysolr https://github.com/metabrainz/sir/pull/105
      • 2019-05-16 13628, 2019

      • disruptek has quit
      • 2019-05-16 13650, 2019

      • disruptek joined the channel
      • 2019-05-16 13638, 2019

      • Mr_Monkey
        Moin !
      • 2019-05-16 13601, 2019

      • Gazooo has quit
      • 2019-05-16 13649, 2019

      • Nyanko-sensei joined the channel
      • 2019-05-16 13650, 2019

      • Gazooo joined the channel
      • 2019-05-16 13615, 2019

      • D4RK-PH0ENiX has quit
      • 2019-05-16 13639, 2019

      • D4RK-PH0ENiX joined the channel
      • 2019-05-16 13613, 2019

      • Nyanko-sensei has quit
      • 2019-05-16 13644, 2019

      • D4RK-PH0ENiX has quit
      • 2019-05-16 13646, 2019

      • D4RK-PH0ENiX joined the channel
      • 2019-05-16 13636, 2019

      • akhilesh
        Mr_Monkey: Hi!
      • 2019-05-16 13648, 2019

      • Mr_Monkey
        Hi akhilesh
      • 2019-05-16 13633, 2019

      • akhilesh
        Mr_Monkey: How can I update bookbrainz_test database schema?
      • 2019-05-16 13651, 2019

      • akhilesh
      • 2019-05-16 13606, 2019

      • Mr_Monkey
        akhilesh: You can run the sql script at sql/migrations/2019-04/up.sql against bookbrainz_test
      • 2019-05-16 13617, 2019

      • Mr_Monkey
        Yes, tests are failing because of the schema change.
      • 2019-05-16 13636, 2019

      • akhilesh
        Ok :)
      • 2019-05-16 13602, 2019

      • Mr_Monkey
        If you have psql on your local machine, yo can run `psql -h localhost -p 5432 -U bookbrainz -d bookbrainz_test < ./sql/migrations/2019-04/up.sq`
      • 2019-05-16 13646, 2019

      • Mr_Monkey
        If not, you'll have to run a similar command from within the website docker container, using postgres instead of localhost
      • 2019-05-16 13619, 2019

      • Mr_Monkey
        You also need to run this script afterwards:
      • 2019-05-16 13619, 2019

      • Mr_Monkey
        `psql -h localhost -p 5432 -U bookbrainz -d bookbrainz_test < ./sql/scripts/create_triggers.sql`
      • 2019-05-16 13654, 2019

      • Mr_Monkey
        Hmm, in the commands I posted, you'll probably want to replace the user (-U flag) with postgres instead of bookbrainz
      • 2019-05-16 13622, 2019

      • gr0uch0mars joined the channel
      • 2019-05-16 13619, 2019

      • akhilesh
        Yes, It require, how to replace user with postgres instead of bookbrainz?
      • 2019-05-16 13635, 2019

      • Mr_Monkey
        `-U postgres`
      • 2019-05-16 13645, 2019

      • Mr_Monkey
        instread of `-U bookbrainz`
      • 2019-05-16 13649, 2019

      • akhilesh
        ok
      • 2019-05-16 13657, 2019

      • ayerhart_ has quit
      • 2019-05-16 13613, 2019

      • akhilesh
        Mr_Monkey: Running now, Thanks!
      • 2019-05-16 13623, 2019

      • Mr_Monkey
        Great :)
      • 2019-05-16 13656, 2019

      • ayerhart joined the channel
      • 2019-05-16 13648, 2019

      • akhilesh
        Mr_Monkey: In which issue, You are working ?
      • 2019-05-16 13611, 2019

      • akhilesh
        in BB
      • 2019-05-16 13642, 2019

      • Mr_Monkey
        Currently on ListenBrainz, but about to go back to tackling entity merging
      • 2019-05-16 13615, 2019

      • akhilesh
        I am working with date validation tests, then I think we should move to author_credit
      • 2019-05-16 13623, 2019

      • akhilesh
        also, it is imp
      • 2019-05-16 13608, 2019

      • akhilesh
        Mr_Monkey ^
      • 2019-05-16 13629, 2019

      • Mr_Monkey
        Agreed
      • 2019-05-16 13653, 2019

      • Mr_Monkey
        That gives me a day or two to think of a plan and what needs to be done
      • 2019-05-16 13620, 2019

      • akhilesh
        By that time, I will try to finish date related work.
      • 2019-05-16 13647, 2019

      • ayerhart has quit
      • 2019-05-16 13656, 2019

      • D4RK-PH0ENiX has quit
      • 2019-05-16 13629, 2019

      • D4RK-PH0ENiX joined the channel
      • 2019-05-16 13659, 2019

      • Matthew_ joined the channel
      • 2019-05-16 13603, 2019

      • D4RK-PH0ENiX has quit
      • 2019-05-16 13606, 2019

      • Matthew_
        Hi. I'm struggling to get full indexing working properly on Solr. I note a lot of errors in logs about missing fields when running reindex from mb-sir. It seems that the submodules for mb-solr are very old and aren't aware of some schema 25 fields. Does anyone know what revisions I should be using to reindex against a schema 25 database? Or should I be using a < schema 25 version of mb-sir to do the indexing? Thanks!
      • 2019-05-16 13655, 2019

      • yvanzo
        Hi Matthew_: are errors about label/isni only?
      • 2019-05-16 13656, 2019

      • Matthew_
        Hi yvanzo. I'm mostly seeing issues with artists - haven't got any further than the 'a's ;) I'm seeing 'unknown field 'primary_alias'' a lot.
      • 2019-05-16 13616, 2019

      • yvanzo
        schema 25 should still work with previous versions of mb-solr/sir
      • 2019-05-16 13648, 2019

      • yvanzo
        Matthew_: Ok, which versions of mb-solr and sir do you run?
      • 2019-05-16 13640, 2019

      • yvanzo
        sir master is ready to work with schema 25, but mb-solr is still work-in-progress
      • 2019-05-16 13658, 2019

      • yvanzo
        We still run previous versions of mb-solr/sir in production.
      • 2019-05-16 13610, 2019

      • Matthew_
        For mb-solr, I've tried 'master' should I be using v3.0? For sir, I don't see any branch/tag that leaps out as stable so I'm also on master
      • 2019-05-16 13651, 2019

      • Matthew_
        OK. Thanks, yvanzo. What versions/revisions would you recommend for those components?
      • 2019-05-16 13610, 2019

      • yvanzo
        mb-solr v3.0
      • 2019-05-16 13632, 2019

      • yvanzo
        and sir commit 5109d2606eb84a444b1c15dd6efe70571e67afd7
      • 2019-05-16 13645, 2019

      • Matthew_
        Great. Thanks, yvanzo!
      • 2019-05-16 13645, 2019

      • yvanzo
        Matthew_: you will have to patch sir requirements.txt because mbdata 2017.6.2 is no more available from PyPI
      • 2019-05-16 13601, 2019

      • Matthew_
        Thanks yvanzo. What version should I be replacing it with? most recent? 25.0.3?
      • 2019-05-16 13631, 2019

      • yvanzo
        Same version, but it should retrieved from github instead as follows:
      • 2019-05-16 13600, 2019

      • yvanzo
      • 2019-05-16 13612, 2019

      • Matthew_
        OK. Thanks. Will suck it and see
      • 2019-05-16 13603, 2019

      • D4RK-PH0ENiX joined the channel
      • 2019-05-16 13625, 2019

      • zas
        something very wrong with solr search server
      • 2019-05-16 13643, 2019

      • yvanzo
        Matthew_: I pushed that fix to metabrainz/sir branch schema-24
      • 2019-05-16 13659, 2019

      • zas
        ah it's back, 2 nodes were down... not sure why & how
      • 2019-05-16 13600, 2019

      • Matthew_
        Brilliant. Thanks yvanzo!
      • 2019-05-16 13601, 2019

      • Lotheric_ joined the channel
      • 2019-05-16 13615, 2019

      • Lotheric has quit
      • 2019-05-16 13644, 2019

      • Lotheric__ joined the channel
      • 2019-05-16 13642, 2019

      • Lotheric_ has quit
      • 2019-05-16 13636, 2019

      • BrainzGit
        [listenbrainz-server] MonkeyDo opened pull request #572 (master…search-song-spotify): Search song spotify https://github.com/metabrainz/listenbrainz-server…
      • 2019-05-16 13620, 2019

      • Lotheric__ is now known as Lotheric
      • 2019-05-16 13659, 2019

      • zas
        ignore telegraf alerts, that's me, just reboot grafana machine for upgrades
      • 2019-05-16 13615, 2019

      • zas
        i'll reboot jira machine for upgrades and new cert deployment
      • 2019-05-16 13625, 2019

      • zas
        yvanzo: you around ? in case of...
      • 2019-05-16 13637, 2019

      • yvanzo
        zas: yup
      • 2019-05-16 13646, 2019

      • zas
        i'll reboot jira now
      • 2019-05-16 13611, 2019

      • zas
        voilà, jira is back, with new certs, system & kernel were upgraded too
      • 2019-05-16 13619, 2019

      • yvanzo
        Mineo: sir reindex never stops, it cannot be interrupted using Ctrl+c either, should 'queue_to_solr' have a 'live' parameter we could disable?
      • 2019-05-16 13623, 2019

      • zas
        ruaok: *.meb certs deployed
      • 2019-05-16 13643, 2019

      • ruaok
        yay, thanks!
      • 2019-05-16 13600, 2019

      • yvanzo
        !m zas
      • 2019-05-16 13601, 2019

      • BrainzBot
        You're doing good work, zas!
      • 2019-05-16 13603, 2019

      • ohrstrom joined the channel
      • 2019-05-16 13618, 2019

      • travis-ci joined the channel
      • 2019-05-16 13618, 2019

      • travis-ci
        Project bookbrainz-site build #2183: passed in 3 min 42 sec: https://travis-ci.org/bookbrainz/bookbrainz-site/…
      • 2019-05-16 13618, 2019

      • travis-ci has left the channel
      • 2019-05-16 13609, 2019

      • gr0uch0mars has quit
      • 2019-05-16 13626, 2019

      • ohrstrom has quit
      • 2019-05-16 13627, 2019

      • HenryG has quit
      • 2019-05-16 13603, 2019

      • HenryG joined the channel
      • 2019-05-16 13609, 2019

      • ohrstrom joined the channel
      • 2019-05-16 13658, 2019

      • ohrstrom has quit
      • 2019-05-16 13622, 2019

      • spellew
        ferbncode: Hi
      • 2019-05-16 13642, 2019

      • spellew
        ferbncode: Finals could always be better, but it wasn't too bad.
      • 2019-05-16 13624, 2019

      • Lotheric_ joined the channel
      • 2019-05-16 13645, 2019

      • ohrstrom joined the channel
      • 2019-05-16 13652, 2019

      • Lotheric has quit
      • 2019-05-16 13632, 2019

      • alastairp
        how do I submit acoustids with picard? on mac, I have fpcalc bundled, I added an API key, the album has mbids
      • 2019-05-16 13611, 2019

      • alastairp
        the icon is grayed out
      • 2019-05-16 13609, 2019

      • CallerNo6
        alastairp, and you've hit the `scan` button I assume
      • 2019-05-16 13655, 2019

      • alastairp
        no, it wasn't clear that you have to scan before you can submit (in this case I know that the album has no fingerprints, so I assumed that scan wasn't necessary)
      • 2019-05-16 13620, 2019

      • alastairp
        also, scan only works if there are files in the left, but since they all have mbids, they all go straight to the right
      • 2019-05-16 13627, 2019

      • alastairp
        anyway, I found the scan button now, doing that.
      • 2019-05-16 13628, 2019

      • CallerNo6
        no, it's not very clear. it trips me up every time I've done it.
      • 2019-05-16 13609, 2019

      • CallerNo6
        You can select and drag a set of files back to the left to do further operations on them at any time.
      • 2019-05-16 13610, 2019

      • alastairp
        thanks
      • 2019-05-16 13617, 2019

      • alastairp
        looks like acoustid is down anyway, I'll finish tomorrow
      • 2019-05-16 13618, 2019

      • CallerNo6
        argh. anyway, iirc the submit button will also be ghosted if there's already a match (same mbid and acoustid).
      • 2019-05-16 13656, 2019

      • Lotheric_ is now known as Lotheric
      • 2019-05-16 13640, 2019

      • ferbncode
        spellew: Cool, just let me know whenever you're done fixing the timelines. :) Also, hit me with any questions that you encounter o/
      • 2019-05-16 13657, 2019

      • Matthew_ has quit
      • 2019-05-16 13655, 2019

      • ohrstrom has quit
      • 2019-05-16 13609, 2019

      • spellew
        ferbncode: Sure thing
      • 2019-05-16 13641, 2019

      • ohrstrom joined the channel
      • 2019-05-16 13627, 2019

      • ohrstrom has quit
      • 2019-05-16 13653, 2019

      • iliekcomputers
        alastairp: re comments on PR, if the rows aren't ordered, suppose the current max is 3, the query then returns rows 8, 9, 10 without returning 4, 5, 6, that'd be a bug.
      • 2019-05-16 13620, 2019

      • alastairp
        iliekcomputers: mmm, sure. but it only has to return 4, 5, 6 eventually. if it computes 8 9 10 then the left join against highlevel will have non-null rows, so they won't be selected, and maybe 4 5 6 will appear
      • 2019-05-16 13615, 2019

      • iliekcomputers
        but once 10's hl data is calculated, the new max would become 10, so the query would only return ids >= 10.
      • 2019-05-16 13631, 2019

      • iliekcomputers
        that's the way I wrote it, not sure if there's something I'm missing.
      • 2019-05-16 13642, 2019

      • alastairp
        mmm, yes. this is the bit that I was missing
      • 2019-05-16 13652, 2019

      • alastairp
        you're right. if we want to have a limit we need to do it in order
      • 2019-05-16 13631, 2019

      • alastairp
        OK, I think we should try it splitting into 2 queries too then - as ruaok pointed out last week, doing order by with the json table in the picture makes queries quite slow
      • 2019-05-16 13640, 2019

      • alastairp
        do you understand the queryplans that I asked for?
      • 2019-05-16 13659, 2019

      • iliekcomputers
        yep, i'm working on it.
      • 2019-05-16 13607, 2019

      • iliekcomputers
        doing it on frank to get actual values.
      • 2019-05-16 13640, 2019

      • alastairp
        yeah, good(ish) idea
      • 2019-05-16 13643, 2019

      • alastairp
        don't break it :)
      • 2019-05-16 13628, 2019

      • iliekcomputers has safety gloves on.
      • 2019-05-16 13632, 2019

      • iliekcomputers
        * no order by, no limit -- https://explain.depesz.com/s/8fsx
      • 2019-05-16 13632, 2019

      • iliekcomputers
        * new query -- ll.id >= 10**6, with order by -- https://explain.depesz.com/s/Svet
      • 2019-05-16 13632, 2019

      • iliekcomputers
        * only join ll and hl, ll.id >= 10** 6, with order by -- https://explain.depesz.com/s/tlqV
      • 2019-05-16 13635, 2019

      • iliekcomputers
        the query joining ll, llj and hl is faster?