#metabrainz

/

      • aron_kexp has quit

        • 2016-06-28 18055, 2016

      • bitmap
        chirlu: not sure how useful it is nowadays, but I'd vote to just update it

        • 2016-06-28 18018, 2016

      • Leftmost
        LordSputnik, I'll take a look tomorrow, definitely.

        • 2016-06-28 18032, 2016

      • Leftmost
        Do we know for certain that we'll be able to get editors linked up that quickly? Is there any chance of having a backup plan with private data? How's MB handling that?

        • 2016-06-28 18046, 2016

      • fqtw_ joined the channel

        • 2016-06-28 18051, 2016

      • chirlu has quit

        • 2016-06-28 18019, 2016

      • fqtw has quit

        • 2016-06-28 18049, 2016

      • CallerNo6 joined the channel

        • 2016-06-28 18014, 2016

      • chirlu joined the channel

        • 2016-06-28 18008, 2016

      • Slurpee has quit

        • 2016-06-28 18039, 2016

      • JesseW joined the channel

        • 2016-06-28 18059, 2016

      • demonimin has quit

        • 2016-06-28 18017, 2016

      • demonimin joined the channel

        • 2016-06-28 18017, 2016

      • demonimin has quit

        • 2016-06-28 18017, 2016

      • demonimin joined the channel

        • 2016-06-28 18057, 2016

      • fqtw__ joined the channel

        • 2016-06-28 18058, 2016

      • fqtw_ has quit

        • 2016-06-28 18021, 2016

      • JesseW has quit

        • 2016-06-28 18001, 2016

      • fqtw joined the channel

        • 2016-06-28 18033, 2016

      • fqtw__ has quit

        • 2016-06-28 18059, 2016

      • JesseW joined the channel

        • 2016-06-28 18030, 2016

      • fqtw_ joined the channel

        • 2016-06-28 18010, 2016

      • fqtw has quit

        • 2016-06-28 18026, 2016

      • Nyanko-sensei joined the channel

        • 2016-06-28 18055, 2016

      • D4RK-PH0ENiX has quit

        • 2016-06-28 18014, 2016

      • Mineo joined the channel

        • 2016-06-28 18048, 2016

      • ephemer0l has quit

        • 2016-06-28 18046, 2016

      • colbydray has quit

        • 2016-06-28 18005, 2016

      • ephemer0l joined the channel

        • 2016-06-28 18052, 2016

      • ephemer0l has quit

        • 2016-06-28 18054, 2016

      • ephemer0l joined the channel

        • 2016-06-28 18049, 2016

      • Nyanko-sensei has quit

        • 2016-06-28 18016, 2016

      • D4RK-PH0ENiX joined the channel

        • 2016-06-28 18024, 2016

      • JesseW has quit

        • 2016-06-28 18001, 2016

      • mihaitish joined the channel

        • 2016-06-28 18021, 2016

      • kanha has quit

        • 2016-06-28 18044, 2016

      • ariscop has quit

        • 2016-06-28 18048, 2016

      • LordSputnik
        Leftmost: it's only password and email. The other data is publicly visible

        • 2016-06-28 18024, 2016

      • LordSputnik
        And after the deadline editors can still reply to the email or contact us to manually link

        • 2016-06-28 18007, 2016

      • Mineo has quit

        • 2016-06-28 18057, 2016

      • kanha joined the channel

        • 2016-06-28 18042, 2016

      • jesus2099 joined the channel

        • 2016-06-28 18058, 2016

      • jesus2099 has quit

        • 2016-06-28 18058, 2016

      • ruaok
        zas: ping

        • 2016-06-28 18034, 2016

      • ruaok
        we may finally have a lead on the problem from DWNI. solution: keep a ping going.

        • 2016-06-28 18001, 2016

      • zas
        ??

        • 2016-06-28 18007, 2016

      • ruaok
        see email

        • 2016-06-28 18045, 2016

      • zas
        lol

        • 2016-06-28 18006, 2016

      • zas
        what do you ping exactly ? gateways ?

        • 2016-06-28 18014, 2016

      • ruaok
        not me.

        • 2016-06-28 18021, 2016

      • ruaok
        the email is all the info I have

        • 2016-06-28 18001, 2016

      • zas
        hmmm looks weird

        • 2016-06-28 18025, 2016

      • zas
        let me re-read this with a bit more coffee in my blood

        • 2016-06-28 18014, 2016

      • zas
        http://stats.metabrainz.org/dashboard/db/musicbra…

        • 2016-06-28 18022, 2016

      • zas
        no drop since a long time

        • 2016-06-28 18036, 2016

      • ruaok
        ping, the magical network tool!

        • 2016-06-28 18037, 2016

      • zas
        small drops are related to indexer/search pushes

        • 2016-06-28 18002, 2016

      • ruaok
        we finally have a lead. :)

        • 2016-06-28 18010, 2016

      • zas
        last true issue was at 0:52

        • 2016-06-28 18010, 2016

      • ruaok
        I think that correlates with when he stopped the ping

        • 2016-06-28 18041, 2016

      • ruaok
        > I then stopped them again around 3:15 PM again, and it looks like we had another traffic loss spike at 3:45 PM.

        • 2016-06-28 18047, 2016

      • ruaok
        add 9 hours, yep.

        • 2016-06-28 18003, 2016

      • zas
        interesting

        • 2016-06-28 18036, 2016

      • zas
        arp cache issue? hmmm

        • 2016-06-28 18007, 2016

      • kanha has quit

        • 2016-06-28 18031, 2016

      • MBJenkins joined the channel

        • 2016-06-28 18028, 2016

      • chirlu has quit

        • 2016-06-28 18036, 2016

      • chirlu joined the channel

        • 2016-06-28 18035, 2016

      • ariscop joined the channel

        • 2016-06-28 18050, 2016

      • kanha joined the channel

        • 2016-06-28 18044, 2016

      • ruaok
        shall we try this?

        • 2016-06-28 18045, 2016

      • ruaok
        http://askubuntu.com/questions/516567/how-long-is…

        • 2016-06-28 18009, 2016

      • ruaok
        zas ^^

        • 2016-06-28 18058, 2016

      • zas
        I don't understand how entries could get out of cache with the traffic we have

        • 2016-06-28 18036, 2016

      • zas
        And even if they do, I fail to see how it explains the drops

        • 2016-06-28 18049, 2016

      • zas
        We may start monitoring the ARP cache on gateways

        • 2016-06-28 18040, 2016

      • zas
        https://www.irccloud.com/pastebin/2CLqPRmb/

        • 2016-06-28 18019, 2016

      • zas
        why are 72.29.167.148 & 157 incomplete ?

        • 2016-06-28 18002, 2016

      • zas
        https://www.irccloud.com/pastebin/3DrIDakQ/

        • 2016-06-28 18036, 2016

      • zas
        https://www.irccloud.com/pastebin/ZdE0xfAq/

        • 2016-06-28 18055, 2016

      • zas
        ruaok: do you see anything abnormal in this ^^ ?

        • 2016-06-28 18013, 2016

      • ruaok
        I'm not well enough versed with this level of networking to tell.

        • 2016-06-28 18029, 2016

      • ruaok
        should I work with the DWNI guy to get him an account on our gateways?

        • 2016-06-28 18054, 2016

      • Gentlecat
        alastairp: did you apply changes that were merged?

        • 2016-06-28 18033, 2016

      • alastairp
        release them? not yet

        • 2016-06-28 18035, 2016

      • Gentlecat
        should I do it?

        • 2016-06-28 18044, 2016

      • Gentlecat
        want to make sure that everything works correctly before merging challenges part

        • 2016-06-28 18049, 2016

      • alastairp
        go for it

        • 2016-06-28 18059, 2016

      • Gentlecat
        which change was the last one?

        • 2016-06-28 18015, 2016

      • Gentlecat
        maybe we should actually keep track of that somewhere

        • 2016-06-28 18040, 2016

      • alastairp
        hmm, yeah

        • 2016-06-28 18011, 2016

      • alastairp
        normally these database upgrade tools have a table which keeps track of what's been applied

        • 2016-06-28 18025, 2016

      • alastairp
        can we roll our own? perhaps a script that you give a sql file as an argument

        • 2016-06-28 18033, 2016

      • alastairp
        it applies it, and adds it to a status table

        • 2016-06-28 18031, 2016

      • Gentlecat
        might be a bit complicated

        • 2016-06-28 18043, 2016

      • Gentlecat
        the problem is that they still need to be applied in specific order

        • 2016-06-28 18006, 2016

      • alastairp
        I think that as long as we apply them in date order we shouldn't have a problem?

        • 2016-06-28 18019, 2016

      • Gentlecat
        I think so, yes

        • 2016-06-28 18022, 2016

      • alastairp
        I thought a little about this when we moved from numbers to dates

        • 2016-06-28 18036, 2016

      • Gentlecat
        otherwise they should also have an additional number

        • 2016-06-28 18046, 2016

      • alastairp
        and I don't think it's any more complex than what we do in init_db in manage.py, right?

        • 2016-06-28 18053, 2016

      • alastairp
        read some sql file, apply it

        • 2016-06-28 18059, 2016

      • Gentlecat
        like with snapshots https://github.com/metabrainz/acousticbrainz-serv…

        • 2016-06-28 18028, 2016

      • alastairp
        then an extra step to insert the row to a `migrations_applied` table or somesuch

        • 2016-06-28 18037, 2016

      • alastairp
        not sure how to do the python files

        • 2016-06-28 18027, 2016

      • alastairp
        anyway, regarding what's already done, user admin is

        • 2016-06-28 18034, 2016

      • Gentlecat
        ok

        • 2016-06-28 18036, 2016

      • alastairp
        but I don't think api keys are

        • 2016-06-28 18048, 2016

      • alastairp
        and snapshots no

        • 2016-06-28 18016, 2016

      • alastairp
        postgres on spike is on port 5434

        • 2016-06-28 18054, 2016

      • alastairp
        we should change this soon (5432 is 9.3, 5433 is 9.4 [uninstalled], 5434 is 9.5)

        • 2016-06-28 18044, 2016

      • alastairp
        rob and I agreed to keep the 9.3 core around until we needed the disk space, but I don't think it's work keeping now. the data in 9.5 has increased so much since the migration, which was over 6 months ago now

        • 2016-06-28 18019, 2016

      • mihaitish has quit

        • 2016-06-28 18035, 2016

      • Gentlecat
        hmm, so how do I connect to it? `psql -p 5434` doesn't work

        • 2016-06-28 18044, 2016

      • Gentlecat
        just connects me to 9.3

        • 2016-06-28 18002, 2016

      • Gentlecat
        oh, it does, sorry

        • 2016-06-28 18009, 2016

      • Gentlecat
        9.5.3

        • 2016-06-28 18030, 2016

      • Gentlecat
        and just `psql` actually, ok

        • 2016-06-28 18000, 2016

      • Gentlecat
        yeah, there's no api_key

        • 2016-06-28 18025, 2016

      • mihaitish joined the channel

        • 2016-06-28 18027, 2016

      • ruaok
        maybe port numbers should correlate to PG version.

        • 2016-06-28 18051, 2016

      • ruaok
        5493, 5494, 5495. :)

        • 2016-06-28 18059, 2016

      • alastairp
        :)

        • 2016-06-28 18057, 2016

      • Gentlecat
        ugh, my eyes need an upgrade. "psql (9.5.3)" is not the same as "psql (9.5.3, server 9.3.13)"

        • 2016-06-28 18027, 2016

      • Gentlecat
        I applied that api key upgrade on the old database

        • 2016-06-28 18033, 2016

      • Gentlecat
        probably doesn't matter

        • 2016-06-28 18031, 2016

      • mihaitish has quit

        • 2016-06-28 18007, 2016

      • alastairp
        yeah, it doesn't matter

        • 2016-06-28 18039, 2016

      • alastairp
        in fact. we should consider disabling the 9.3 cluster entirely. I don't think it should be running

        • 2016-06-28 18007, 2016

      • Gentlecat
        alastairp: ok, upgraded and restarted

        • 2016-06-28 18016, 2016

      • Gentlecat
        makes sense

        • 2016-06-28 18041, 2016

      • Gentlecat
        evaluations are still there, seems to be working

        • 2016-06-28 18050, 2016

      • mihaitish joined the channel

        • 2016-06-28 18050, 2016

      • Gentlecat
        let me know if anything got borked

        • 2016-06-28 18034, 2016

      • Gentlecat is happy when scripts just work

        • 2016-06-28 18007, 2016

      • Gentlecat
        alastairp: documentation builds are broken now with that requirements file change https://readthedocs.org/projects/acousticbrainz/b…

        • 2016-06-28 18034, 2016

      • Gentlecat
        https://github.com/metabrainz/acousticbrainz-serv…

        • 2016-06-28 18029, 2016

      • Gentlecat
        and I can't specify multiple requirement files in readthedocs

        • 2016-06-28 18049, 2016

      • kanha has quit

        • 2016-06-28 18011, 2016

      • kanha joined the channel

        • 2016-06-28 18035, 2016

      • MBJenkins
        Project acousticbrainz-server build #141: SUCCESS in 7 min 6 sec: https://ci.metabrainz.org/job/acousticbrainz-serv…

        • 2016-06-28 18041, 2016

      • Gentlecat
        another thing we could do is just post a comment on pull request with a schema change

        • 2016-06-28 18000, 2016

      • Gentlecat
        all of them should be tagged anyway

        • 2016-06-28 18026, 2016

      • Gentlecat
        https://github.com/metabrainz/acousticbrainz-serv…

        • 2016-06-28 18040, 2016

      • MBJenkins
        Project acousticbrainz-server build #142: SUCCESS in 7 min 16 sec: https://ci.metabrainz.org/job/acousticbrainz-serv…

        • 2016-06-28 18030, 2016

      • D4RK-PH0ENiX has quit

        • 2016-06-28 18049, 2016

      • Gentlecat
        hellska: we merged some API stuff

        • 2016-06-28 18059, 2016

      • hellska
        gentlecat: you mean the #182 right?

        • 2016-06-28 18016, 2016

      • Gentlecat
        yep

        • 2016-06-28 18026, 2016

      • Gentlecat
        https://acousticbrainz.org/api/v1/datasets/e672ff…