#metabrainz

/

      • supersandro2000 has quit
      • 2020-07-09 19119, 2020

      • supersandro2000 joined the channel
      • 2020-07-09 19129, 2020

      • D4RK-PH0ENiX has quit
      • 2020-07-09 19137, 2020

      • D4RK-PH0ENiX joined the channel
      • 2020-07-09 19122, 2020

      • supersandro2000 has quit
      • 2020-07-09 19132, 2020

      • supersandro2000 joined the channel
      • 2020-07-09 19154, 2020

      • v6lur has quit
      • 2020-07-09 19125, 2020

      • Gore has quit
      • 2020-07-09 19139, 2020

      • Gore joined the channel
      • 2020-07-09 19121, 2020

      • HenryG has quit
      • 2020-07-09 19123, 2020

      • HenryG joined the channel
      • 2020-07-09 19116, 2020

      • Lotheric
        ruaok, you know when irccloud is down, you can use other irc clients :)
      • 2020-07-09 19106, 2020

      • prabal46 joined the channel
      • 2020-07-09 19119, 2020

      • prabal46 has left the channel
      • 2020-07-09 19156, 2020

      • prabal13 joined the channel
      • 2020-07-09 19126, 2020

      • prabal13 has quit
      • 2020-07-09 19130, 2020

      • shivam-kapila
        Good morning
      • 2020-07-09 19143, 2020

      • ishaanshah
        Morning!
      • 2020-07-09 19101, 2020

      • Darkloke joined the channel
      • 2020-07-09 19105, 2020

      • sumedh joined the channel
      • 2020-07-09 19151, 2020

      • BrainzGit
        [listenbrainz-server] vansika merged pull request #942 (master…format-recommend): Append DF to var names for consistency https://github.com/metabrainz/listenbrainz-server…
      • 2020-07-09 19147, 2020

      • iliekcomputers has quit
      • 2020-07-09 19158, 2020

      • iliekcomputers joined the channel
      • 2020-07-09 19110, 2020

      • sumedh has quit
      • 2020-07-09 19128, 2020

      • jmp_music joined the channel
      • 2020-07-09 19102, 2020

      • jmp_music
        morning!
      • 2020-07-09 19136, 2020

      • shivam-kapila
        Can anyone help me out with docker for personal project?
      • 2020-07-09 19107, 2020

      • shivam-kapila
      • 2020-07-09 19145, 2020

      • shivam-kapila
        If I use `FROM python:3.7 as aam_aadmi_aspataal-base` then this error occurs
      • 2020-07-09 19103, 2020

      • shivam-kapila
        If I use `FROM metsbrainz/python:3.7 as aam_aadmi_aspataal-base` then this error vanishes
      • 2020-07-09 19117, 2020

      • shivam-kapila
        Any idea what could be the reason?
      • 2020-07-09 19123, 2020

      • iliekcomputers
        ruaok: hey, just FYI, my personal laptop is dead and at a repair store. Could we postpone today's timescale plans?
      • 2020-07-09 19103, 2020

      • iliekcomputers
        shivam-kapila: post your entire dockerfile?
      • 2020-07-09 19118, 2020

      • shivam-kapila
      • 2020-07-09 19129, 2020

      • iliekcomputers
        Looks like the main python image has an older libpq version
      • 2020-07-09 19115, 2020

      • iliekcomputers
        Our python image is on a different base image than the main python one
      • 2020-07-09 19134, 2020

      • shivam-kapila
        metabrainz/python:3.7 has version 9.xx but it automatically updates
      • 2020-07-09 19156, 2020

      • shivam-kapila
        Can you tell me whats metabrainz/python image based on?
      • 2020-07-09 19123, 2020

      • iliekcomputers
      • 2020-07-09 19129, 2020

      • iliekcomputers
      • 2020-07-09 19108, 2020

      • diru1100
        Morning!
      • 2020-07-09 19108, 2020

      • inkasso0815 joined the channel
      • 2020-07-09 19151, 2020

      • sumedh joined the channel
      • 2020-07-09 19112, 2020

      • ruaok
        iliekcomputers: hmm. how difficult is it to trigger the data dump without spark? I'd really like to get moving on timescale...
      • 2020-07-09 19107, 2020

      • iliekcomputers
      • 2020-07-09 19126, 2020

      • ruaok
        alastairp: woo, AB quoted in the BBC! https://www.bbc.com/news/entertainment-arts-53167…
      • 2020-07-09 19144, 2020

      • iliekcomputers
        need to remove this line from the code base and then just run `python manage.py dump create_full`
      • 2020-07-09 19115, 2020

      • iliekcomputers
        i was hoping to make it an option while we were at it. but I think we just remove it.
      • 2020-07-09 19144, 2020

      • ruaok
        do you start a new container to run it?
      • 2020-07-09 19104, 2020

      • iliekcomputers
        i'd just deploy a new version of cron-prod
      • 2020-07-09 19157, 2020

      • ruaok
        ok, kewl. I might just start doing that in a little while so I can monitor for weird shit.
      • 2020-07-09 19144, 2020

      • yvanzo
        !m alastairp
      • 2020-07-09 19144, 2020

      • BrainzBot
        You're doing good work, alastairp!
      • 2020-07-09 19159, 2020

      • iliekcomputers
        ruaok: sg, thanks!
      • 2020-07-09 19125, 2020

      • alastairp
        ruaok: yeah, I just saw it!
      • 2020-07-09 19134, 2020

      • alastairp
        I really hope our BPM values are accurate, lol
      • 2020-07-09 19125, 2020

      • iliekcomputers
        :D
      • 2020-07-09 19130, 2020

      • ruaok
        it also does give an interesting insight. here the BBC published an article, they put their stamp of approval on it by doing so..
      • 2020-07-09 19149, 2020

      • ruaok
        base on some reasearchers work. based on our work.
      • 2020-07-09 19112, 2020

      • ruaok
        what all does this say about the media?
      • 2020-07-09 19101, 2020

      • Gazooo has quit
      • 2020-07-09 19146, 2020

      • Gazooo joined the channel
      • 2020-07-09 19146, 2020

      • ljunkie has quit
      • 2020-07-09 19104, 2020

      • reosarevok
      • 2020-07-09 19101, 2020

      • v6lur joined the channel
      • 2020-07-09 19114, 2020

      • shivam-kapila
        yvanzo: hi. can you help me out for some docker help. I am trying to install pg-client-12. It depends on libpq5. I install it in the dockerfile but thats installing v11 but pg-client-12 needs v 12.3 or above. I am using python:3.8 as base
      • 2020-07-09 19158, 2020

      • shivam-kapila
        If I use metabrainz/python:3.7 as base it libpq5 installs v9 first but then updates to v12.3 automatically
      • 2020-07-09 19113, 2020

      • shivam-kapila
        Any idea what can be the issue
      • 2020-07-09 19100, 2020

      • yvanzo
        hi shivam-kapila: this is because v11 is the latest version available in ubuntu repo.
      • 2020-07-09 19112, 2020

      • yvanzo
        you should add postgres repo
      • 2020-07-09 19110, 2020

      • yvanzo
      • 2020-07-09 19100, 2020

      • yvanzo
        More general info about this repo: https://wiki.postgresql.org/wiki/Apt
      • 2020-07-09 19144, 2020

      • ljunkie joined the channel
      • 2020-07-09 19149, 2020

      • shivam-kapila
        I have added it
      • 2020-07-09 19143, 2020

      • shivam-kapila
      • 2020-07-09 19133, 2020

      • yvanzo
        yeah but you are installing libpq-dev before adding this repo, that should be the other way around.
      • 2020-07-09 19135, 2020

      • alastairp
        reosarevok: yeah, I saw that. I guess you have residency already?
      • 2020-07-09 19151, 2020

      • shivam-kapila
        yvanzo: No change
      • 2020-07-09 19106, 2020

      • alastairp
        shivam-kapila: note that the python base image uses debian buster. you can see that here: https://hub.docker.com/_/python
      • 2020-07-09 19123, 2020

      • alastairp
        and the postgres client that you're installing is for jessie, a different version of postgres
      • 2020-07-09 19154, 2020

      • alastairp
        if you don't specifically know that you need that client, you could just install the one that comes with debian by default, so you don't need the `RUN echo 'deb http://apt.postgresql.org/pub/repos/apt/ ` line or the following one
      • 2020-07-09 19105, 2020

      • alastairp
        *jessie, a different version of debian
      • 2020-07-09 19157, 2020

      • yvanzo
        shivam-kapila: specify the version to be installed: libpq5=12.*
      • 2020-07-09 19132, 2020

      • yvanzo
        Oh right, that might be jessie/buster, use lsb_release instead as in https://github.com/metabrainz/musicbrainz-docker/…
      • 2020-07-09 19101, 2020

      • alastairp
        but also keep in mind if you actually need the client from pgdg
      • 2020-07-09 19133, 2020

      • shivam-kapila
        yvanzo: alastairp: thanks. using jessie was a silly mistake
      • 2020-07-09 19141, 2020

      • shivam-kapila
        alastairp: Yes I need it
      • 2020-07-09 19152, 2020

      • alastairp
        shivam-kapila: why do you need it?
      • 2020-07-09 19137, 2020

      • shivam-kapila
        To get a psql shell like we do ./develop.sh psql in LB
      • 2020-07-09 19151, 2020

      • alastairp
        right, but debian includes postgresql
      • 2020-07-09 19102, 2020

      • alastairp
        the reason that we install it from the postgresql.org site is to get a more up-to-date version
      • 2020-07-09 19136, 2020

      • alastairp
        but postgresql clients are mostly backwards compatible with servers. You could install the postgres11 client that's available in debian without setting up the additional repository
      • 2020-07-09 19106, 2020

      • shivam-kapila
        Yes totally. Debian has v11 as the latest.
      • 2020-07-09 19124, 2020

      • shivam-kapila
        And I also needed the latest version in this case
      • 2020-07-09 19129, 2020

      • alastairp
        OK, sure. do that if you need to
      • 2020-07-09 19146, 2020

      • alastairp
        I've never had a problem connecting to a v11 server with a v10 client, or v12 server - v11 client
      • 2020-07-09 19156, 2020

      • alastairp
        it prints a small warning, but nothing changes
      • 2020-07-09 19125, 2020

      • shivam-kapila
        Yeah. Initally for some time we were using 9.5 client in LB too after PG12 upgrade
      • 2020-07-09 19137, 2020

      • iliekcomputers
        Should just use the metabrainz image
      • 2020-07-09 19142, 2020

      • iliekcomputers
        :)
      • 2020-07-09 19108, 2020

      • shivam-kapila
        Yeah that was my 2nd option
      • 2020-07-09 19108, 2020

      • reosarevok
        alastairp: yeah, EU so no problems at all for mw
      • 2020-07-09 19109, 2020

      • reosarevok
        *me
      • 2020-07-09 19128, 2020

      • alastairp
        sure. so they're looking further abroad
      • 2020-07-09 19140, 2020

      • alastairp
        nice to see that they have a reasonable monthly income requirement
      • 2020-07-09 19153, 2020

      • alastairp
        you can't move there if you make $500/month doing drop-shipping :-P
      • 2020-07-09 19150, 2020

      • ruaok
        iliekcomputers: ok , for me to deploy a not cron-prod on lemmy now?
      • 2020-07-09 19125, 2020

      • iliekcomputers
        Sure
      • 2020-07-09 19100, 2020

      • ruaok
        k
      • 2020-07-09 19113, 2020

      • reosarevok
        alastairp: I'm surprised this gvmt is even moving forward with this, otherwise they seem to hate foreigners coming here
      • 2020-07-09 19140, 2020

      • yvanzo
        so it is for non EU citizens? (Russians being the closest)
      • 2020-07-09 19117, 2020

      • reosarevok
        €3504 is an absurd amount of money for this country
      • 2020-07-09 19134, 2020

      • reosarevok
        So I guess that's their way of trying to make sure applicants are rich and white :p
      • 2020-07-09 19115, 2020

      • yvanzo
        rich at least
      • 2020-07-09 19105, 2020

      • alastairp
        americans who typically move to south east asia
      • 2020-07-09 19153, 2020

      • alastairp
        (but the stereotype of them is that they move there so that they can live on less than $1000/month, so...)
      • 2020-07-09 19125, 2020

      • reosarevok
        alastairp: you can absolutely live here on only a bit more than that
      • 2020-07-09 19131, 2020

      • reosarevok
        That's why that's an absurd amount of money :p
      • 2020-07-09 19147, 2020

      • reosarevok
        I don't think we can compete with SE Asia weather wise though...
      • 2020-07-09 19134, 2020

      • yvanzo
        May Snowden be eligible? (his right of asylum expires this year)
      • 2020-07-09 19143, 2020

      • reosarevok
        This is the EU, he'd get deported
      • 2020-07-09 19148, 2020

      • reosarevok
        Probably :p
      • 2020-07-09 19103, 2020

      • yvanzo
        :D
      • 2020-07-09 19153, 2020

      • yvanzo
        He knocked on the door of France, we have a new minister of justice since Monday who supported his demand (before being nominated minister of course).
      • 2020-07-09 19101, 2020

      • reosarevok
        I mean, he shouldn't get deported, but we need US help against Russia, so yeah
      • 2020-07-09 19115, 2020

      • reosarevok
        (not that I would trust the current US gvt to help if Russia does anything)
      • 2020-07-09 19126, 2020

      • ruaok
        US "help"?
      • 2020-07-09 19128, 2020

      • ruaok
        right.
      • 2020-07-09 19115, 2020

      • ruaok
        iliekcomputers: got a quick sec to talk through rabbitmq queues/exchanges for the timescale migration?
      • 2020-07-09 19144, 2020

      • ruaok
        in my migration doc I said to create a new exchange to capture new listens coming from the incoming queue.
      • 2020-07-09 19106, 2020

      • ruaok
        wouldn't it make more sense to connect a new queue to the incoming exchange?
      • 2020-07-09 19126, 2020

      • Rotab has quit
      • 2020-07-09 19154, 2020

      • iliekcomputers
        i think that makes more sense
      • 2020-07-09 19102, 2020

      • iliekcomputers
        it would require code change right?
      • 2020-07-09 19128, 2020

      • ruaok
        I don't believe so.
      • 2020-07-09 19145, 2020

      • ruaok
        I'm hoping to create the queue from rabbitmqadmin .
      • 2020-07-09 19132, 2020

      • iliekcomputers
        and then hook up timescale-writer to the queue. sure, makes sense.
      • 2020-07-09 19139, 2020

      • ruaok
        that.
      • 2020-07-09 19146, 2020

      • ruaok
        k, thanx.
      • 2020-07-09 19134, 2020

      • ruaok
        iliekcomputers: ok, queue created, data flowing.
      • 2020-07-09 19100, 2020

      • ruaok
        where do I run this: `python manage.py dump create_full` ? in the newly created cron-prod container?
      • 2020-07-09 19115, 2020

      • ruaok
        zas: ping
      • 2020-07-09 19101, 2020

      • zas
        Pong
      • 2020-07-09 19140, 2020

      • ruaok
        zas: I've created a new rabbit mq queue called incoming_ts_migration
      • 2020-07-09 19103, 2020

      • ruaok
        it is going to grow RAPIDLY over the next 24-48 hours. this is as designed.
      • 2020-07-09 19131, 2020

      • ruaok
        we're dumping the influx data and preparing a new import into timescale. by batching the incoming listens in rabbitmq, we're ensuring that we have all of them.
      • 2020-07-09 19150, 2020

      • ruaok
        there is loads of disk space on trille for this to not be a problem.
      • 2020-07-09 19106, 2020

      • ruaok
        I'm actively monitoring the process.
      • 2020-07-09 19113, 2020

      • ruaok
        can we turn off alerts for this queue?
      • 2020-07-09 19144, 2020

      • zas
        Yes, I can exclude this specific queue from alerts