#metabrainz

/

      • minimal has quit
      • 2024-07-17 19955, 2024

      • BrainzGit
        [listenbrainz-android] 14dependabot[bot] opened pull request #456 (03dev…dependabot/gradle/dev/androidGradlePlugin-8.5.1): Bump androidGradlePlugin from 8.5.0 to 8.5.1 https://github.com/metabrainz/listenbrainz-androi…
      • 2024-07-17 19909, 2024

      • BrainzGit
        [listenbrainz-android] 14dependabot[bot] opened pull request #457 (03dev…dependabot/gradle/dev/io.socket-socket.io-client-2.1.1): Bump io.socket:socket.io-client from 2.1.0 to 2.1.1 https://github.com/metabrainz/listenbrainz-androi…
      • 2024-07-17 19917, 2024

      • BrainzGit
        [listenbrainz-android] 14dependabot[bot] opened pull request #458 (03dev…dependabot/gradle/dev/org.jsoup-jsoup-1.18.1): Bump org.jsoup:jsoup from 1.17.2 to 1.18.1 https://github.com/metabrainz/listenbrainz-androi…
      • 2024-07-17 19922, 2024

      • BrainzGit
        [listenbrainz-android] 14dependabot[bot] opened pull request #459 (03dev…dependabot/gradle/dev/io.sentry.android.gradle-4.10.0): Bump io.sentry.android.gradle from 4.9.0 to 4.10.0 https://github.com/metabrainz/listenbrainz-androi…
      • 2024-07-17 19934, 2024

      • BrainzGit
        [listenbrainz-android] 14dependabot[bot] opened pull request #460 (03dev…dependabot/gradle/dev/com.google.devtools.ksp-2.0.0-1.0.23): Bump com.google.devtools.ksp from 2.0.0-1.0.22 to 2.0.0-1.0.23 https://github.com/metabrainz/listenbrainz-androi…
      • 2024-07-17 19906, 2024

      • adhawkins has quit
      • 2024-07-17 19957, 2024

      • Strykar has quit
      • 2024-07-17 19920, 2024

      • Strykar joined the channel
      • 2024-07-17 19928, 2024

      • Lotheric joined the channel
      • 2024-07-17 19953, 2024

      • mukti joined the channel
      • 2024-07-17 19903, 2024

      • mukti has quit
      • 2024-07-17 19916, 2024

      • mukti joined the channel
      • 2024-07-17 19938, 2024

      • adhawkins joined the channel
      • 2024-07-17 19929, 2024

      • FichteFoll has quit
      • 2024-07-17 19957, 2024

      • FichteFoll joined the channel
      • 2024-07-17 19921, 2024

      • peifwjpi- has quit
      • 2024-07-17 19913, 2024

      • peifwjpiq1 joined the channel
      • 2024-07-17 19956, 2024

      • Lotheric_ joined the channel
      • 2024-07-17 19929, 2024

      • Lotheric has quit
      • 2024-07-17 19923, 2024

      • pite has quit
      • 2024-07-17 19939, 2024

      • bob has quit
      • 2024-07-17 19939, 2024

      • bob_ is now known as bob
      • 2024-07-17 19957, 2024

      • bob_ joined the channel
      • 2024-07-17 19903, 2024

      • Sophist-UK joined the channel
      • 2024-07-17 19913, 2024

      • rgggn has quit
      • 2024-07-17 19953, 2024

      • Sophist-UK has quit
      • 2024-07-17 19927, 2024

      • Pokey has quit
      • 2024-07-17 19947, 2024

      • Pokey joined the channel
      • 2024-07-17 19917, 2024

      • BrainzGit
        [listenbrainz-server] 14amCap1712 merged pull request #2941 (03master…fix-fresh-releaess): Fix fresh releases api https://github.com/metabrainz/listenbrainz-server…
      • 2024-07-17 19905, 2024

      • BrainzGit
        [listenbrainz-server] release 03v-2024-07-17.0 has been published by 14github-actions[bot]: https://github.com/metabrainz/listenbrainz-server…
      • 2024-07-17 19945, 2024

      • monkey[m]
        Updating test.LB
      • 2024-07-17 19932, 2024

      • lucifer[m]
        <mayhem[m]> "lucifer: yep, what specs of..." <- i am thinking, two machines of similar specs for spark cluster so that we can repurpose them later.
      • 2024-07-17 19956, 2024

      • lucifer[m]
        we have ryzen5 3600, 64gb ram, 1TB disk machines atm. checking server auctions for stuff around that.
      • 2024-07-17 19934, 2024

      • lucifer[m]
        how much do any of the existing spark server cost?
      • 2024-07-17 19922, 2024

      • mayhem[m]
        moin!
      • 2024-07-17 19932, 2024

      • mayhem[m]
        I think they are about 30eur/mo
      • 2024-07-17 19947, 2024

      • zas[m]
        lucifer: current spark cluster machines are AX41, check AX42 (the new AX41) on https://www.hetzner.com/dedicated-rootserver/matr…
      • 2024-07-17 19946, 2024

      • lucifer[m]
        Oh i see. I was under the impression they are server auction machines.
      • 2024-07-17 19920, 2024

      • zas[m]
        to be sure, sparker cluster is Jackson5 machines right? They are all AX41-NVMe
      • 2024-07-17 19959, 2024

      • lucifer[m]
        Yes indeed. Makes sense
      • 2024-07-17 19920, 2024

      • lucifer[m]
        ax42 looks great if we could replace the drives to be at least 1TB.
      • 2024-07-17 19922, 2024

      • lucifer[m]
        I see an option to add a 1TB drive but doesn't seem possible to remove the 512gb ones.
      • 2024-07-17 19910, 2024

      • zas[m]
        What's the purpose of new machines? Increase the capacity of the cluster? or different role?
      • 2024-07-17 19944, 2024

      • lucifer[m]
        For now load testing a LB solr installation and later yes increasing the capacity of the cluster.
      • 2024-07-17 19916, 2024

      • mayhem[m] had totally forgotten that we upgraded them to VMs
      • 2024-07-17 19921, 2024

      • zas[m]
        lucifer: for load testing, wouldn't virtual machines good enough? That's temporary right?
      • 2024-07-17 19948, 2024

      • zas[m]
        mayhem: spark cluster are physical machines, AX41-NVMe x 5
      • 2024-07-17 19942, 2024

      • lucifer[m]
        Yeah a vm would work too but even the 32gb ram one costs same as ax-42
      • 2024-07-17 19907, 2024

      • lucifer[m]
        We need one machine to run the solr installation and that should have lots of ram.
      • 2024-07-17 19942, 2024

      • lucifer[m]
        The second machine to run jmeter can be a smaller vm.
      • 2024-07-17 19905, 2024

      • akshaaatt[m] has quit
      • 2024-07-17 19917, 2024

      • akshaaatt[m] joined the channel
      • 2024-07-17 19918, 2024

      • zas[m]
        lucifer: ok, perhaps we should then go for AX52 (for SOLR) +1 VM for jmeter (no setup fee, temporary use). Then we can upgrade spark nodes to AX52 (increased cpu perf, more disk space, newer hardware), and decide if we keep 5 or 6. What do you think?
      • 2024-07-17 19958, 2024

      • zas[m]
        hmmm, J5 nodes are using raid0 disks so they already have 1Tb disk space
      • 2024-07-17 19959, 2024

      • lucifer[m]
        zas: sorry, i just realised that we could pay for hetzner VMs hourly. two vms would do fine. one 64gb one, one 16gb one. dedicated vcpus for both.
      • 2024-07-17 19902, 2024

      • lucifer[m]
        ideally we are done with both in a week.
      • 2024-07-17 19902, 2024

      • zas[m]
        they will run software independently for the rest right? (no consul?)
      • 2024-07-17 19939, 2024

      • zas[m]
        s/for/from/
      • 2024-07-17 19939, 2024

      • lucifer[m]
        zas: yes.
      • 2024-07-17 19930, 2024

      • lucifer[m]
        just need to be communicate to each other, preferably internal vlan? so that nothing needs to be exposed to public internet.
      • 2024-07-17 19930, 2024

      • zas[m]
        You need them now?
      • 2024-07-17 19945, 2024

      • zas[m]
        hmmm, but VMs will not have much disk space, max is 960Gb for ccx63 (dedicated vCPU), and we need to ask for d. vcpu limit increase for that.
      • 2024-07-17 19950, 2024

      • zas[m] uploaded an image: (120KiB) < https://matrix.chatbrainz.org/_matrix/media/v3/download/matrix.org/mcGNyxiuXdYOphOYkkILvFeO/image.png >
      • 2024-07-17 19938, 2024

      • lucifer[m]
        zas: CCX23 and CCX43 would work fine. enough disk space for this test.
      • 2024-07-17 19921, 2024

      • zas[m]
        ok, tell me when you need them, We need to keep them the shortest time possible to limit costs.
      • 2024-07-17 19935, 2024

      • lucifer[m]
        now would be great
      • 2024-07-17 19952, 2024

      • Sophist-UK joined the channel
      • 2024-07-17 19956, 2024

      • zas[m]
        ok, on it
      • 2024-07-17 19938, 2024

      • BrainzGit
        [listenbrainz-server] 14MonkeyDo merged pull request #2808 (03master…LB-1508-allow-hiding-personal-recommendations): LB-1508 Allow hiding personal recommendations https://github.com/metabrainz/listenbrainz-server…
      • 2024-07-17 19928, 2024

      • zas[m]
        lucifer: machines ready
      • 2024-07-17 19950, 2024

      • lucifer[m]
        thanks!
      • 2024-07-17 19938, 2024

      • zas[m]
        lucifer: please keep tests as short as possible and tell me when VMs aren't needed anymore
      • 2024-07-17 19956, 2024

      • lucifer[m]
        zas: makes sense, will do.
      • 2024-07-17 19943, 2024

      • BrainzGit
        [bookbrainz-data-js] 14MonkeyDo merged pull request #319 (03master…approve-import): Make approval of imported entities work https://github.com/metabrainz/bookbrainz-data-js/…
      • 2024-07-17 19945, 2024

      • Sophist-UK has quit
      • 2024-07-17 19927, 2024

      • nbin has quit
      • 2024-07-17 19941, 2024

      • nbin joined the channel
      • 2024-07-17 19907, 2024

      • q3lont joined the channel
      • 2024-07-17 19909, 2024

      • texke has quit
      • 2024-07-17 19926, 2024

      • texke joined the channel
      • 2024-07-17 19928, 2024

      • qookie has quit
      • 2024-07-17 19936, 2024

      • qookie joined the channel
      • 2024-07-17 19905, 2024

      • rozlav has quit
      • 2024-07-17 19938, 2024

      • rozlav joined the channel
      • 2024-07-17 19901, 2024

      • rozlav has quit
      • 2024-07-17 19919, 2024

      • rozlav joined the channel
      • 2024-07-17 19919, 2024

      • yano has quit
      • 2024-07-17 19954, 2024

      • yano joined the channel
      • 2024-07-17 19959, 2024

      • ajhalili2006 has quit
      • 2024-07-17 19907, 2024

      • ajhalili2006 joined the channel
      • 2024-07-17 19920, 2024

      • rozlav has quit
      • 2024-07-17 19940, 2024

      • qookie has quit
      • 2024-07-17 19905, 2024

      • qookie joined the channel
      • 2024-07-17 19930, 2024

      • q3lont has quit
      • 2024-07-17 19924, 2024

      • rozlav joined the channel
      • 2024-07-17 19943, 2024

      • Sophist-UK joined the channel
      • 2024-07-17 19952, 2024

      • minimal joined the channel
      • 2024-07-17 19926, 2024

      • mayhem[m]
        anyone have a moment to proof read a happy birthday blog post? https://wordpress.com/post/blog.metabrainz.org/11…
      • 2024-07-17 19937, 2024

      • mayhem[m]
        (meb blog account holders only)
      • 2024-07-17 19958, 2024

      • BrainzGit
        [troi-recommendation-playground] 14mayhem merged pull request #142 (03main…appledesc): Fixed bug with description https://github.com/metabrainz/troi-recommendation…
      • 2024-07-17 19954, 2024

      • yvanzo[m]
        mayhem: It looks nice! I just added categories and tags.
      • 2024-07-17 19906, 2024

      • mayhem[m]
        thanks!
      • 2024-07-17 19950, 2024

      • yvanzo[m]
        Further proofreaders, please use the preview link instead to lower editing conflicts: https://musicbrainz.wordpress.com/?p=11644&pr…
      • 2024-07-17 19915, 2024

      • mayhem[m]
        reosarevok: ^^
      • 2024-07-17 19918, 2024

      • lucifer[m]
        lgtm as well
      • 2024-07-17 19934, 2024

      • zas[m]
        blog post looks good apart some missing characters (lets instead of let's in 3rd paragraph, its instead of it's in last paragraph).
      • 2024-07-17 19915, 2024

      • mayhem[m]
        zas: did you fix those mistakes or should I? (thanks)
      • 2024-07-17 19939, 2024

      • Maxr1998_ has quit
      • 2024-07-17 19950, 2024

      • Maxr1998 joined the channel
      • 2024-07-17 19929, 2024

      • mayhem[m]
        you did, ok, thanks!
      • 2024-07-17 19907, 2024

      • mayhem[m]
        that's probably enough review, let me post it.
      • 2024-07-17 19910, 2024

      • mayhem[m]
        reosarevok: ^^
      • 2024-07-17 19937, 2024

      • reosarevok[m]
        Ok :)
      • 2024-07-17 19927, 2024

      • mayhem[m]
      • 2024-07-17 19936, 2024

      • mayhem[m]
        aerozol: ^^ care to tweet about this?
      • 2024-07-17 19942, 2024

      • Jigen has quit
      • 2024-07-17 19939, 2024

      • Jigen joined the channel
      • 2024-07-17 19919, 2024

      • mayhem[m]
        lucifer: this is quite interesting regarding strings. I wonder if some of these insights could help us sometime down the line: https://cedardb.com/blog/german_strings/
      • 2024-07-17 19908, 2024

      • BrainzGit
        [bookbrainz-data-js] 14kellnerd opened pull request #320 (03master…import-annotation): Support annotations for imported entities https://github.com/metabrainz/bookbrainz-data-js/…
      • 2024-07-17 19920, 2024

      • BrainzGit
        [bookbrainz-site] 14MonkeyDo merged pull request #1103 (03import-entities…imports-2024): Make approval of imported entities work & other improvements https://github.com/metabrainz/bookbrainz-site/pul…
      • 2024-07-17 19941, 2024

      • zas[m]
        mayhem: sorry I was afk, I didn't fix them yet, but now it's done ;)
      • 2024-07-17 19959, 2024

      • mayhem[m]
        they were fixed when I got there. :) thanks!
      • 2024-07-17 19919, 2024

      • BrainzGit
        [bookbrainz-utils] 14MonkeyDo merged pull request #49 (03master…importer-dev-setup): Update DB setup instructions for importer https://github.com/metabrainz/bookbrainz-utils/pu…
      • 2024-07-17 19906, 2024

      • lucifer[m]
        mayhem: interesting read, indeed. thanks for sharing!
      • 2024-07-17 19908, 2024

      • mayhem[m]
        np. I figured I should share some stories from the past from time to time
      • 2024-07-17 19926, 2024

      • outsidecontext[m
        Happy birthday, MusicBrainz 🥳
      • 2024-07-17 19949, 2024

      • Sophist-UK has quit
      • 2024-07-17 19904, 2024

      • Sophist-UK joined the channel
      • 2024-07-17 19952, 2024

      • lusciouslover has quit
      • 2024-07-17 19913, 2024

      • lusciouslover joined the channel
      • 2024-07-17 19918, 2024

      • pite joined the channel
      • 2024-07-17 19923, 2024

      • s-crypt has quit
      • 2024-07-17 19938, 2024

      • s-crypt joined the channel
      • 2024-07-17 19933, 2024

      • lucifer[m]
        zas: is it possible to add the ccx-43 vm to monitoring? i would like to monitor various metrics for the load tests.
      • 2024-07-17 19916, 2024

      • lucifer[m]
        if its not possible, which commands/metrics do you usually watch out for? i can write a quick script to log them manually to a file and plot later.
      • 2024-07-17 19913, 2024

      • mayhem[m]
        CPU use, memory use and disk use are the most critical. network saturation is also good.
      • 2024-07-17 19941, 2024

      • mayhem[m]
        but given our use of ansible, it might not be hard to setup full monitoring.
      • 2024-07-17 19902, 2024

      • pite has quit
      • 2024-07-17 19936, 2024

      • BrainzGit
        [bookbrainz-site] 14MonkeyDo opened pull request #1105 (03master…annotation-revision-id-null): chore: Allow annotation revision ids to be null https://github.com/metabrainz/bookbrainz-site/pul…
      • 2024-07-17 19909, 2024

      • discordbrainz
        <03metadataismydrug> Question for the devs https://tickets.metabrainz.org/browse/SEARCH-722 Did the recent Solr upgrade happen to resolve this? I don't know if related or not, but the blog post mentioned search indexing, as does yvanzo's comment on the forums( https://community.metabrainz.org/t/digital-releas… ).
      • 2024-07-17 19910, 2024

      • BrainzBot
        SEARCH-722: Editing release events triggers duplicate index messages
      • 2024-07-17 19948, 2024

      • yvanzo[m]
        Hi metadataismydrug, no.
      • 2024-07-17 19918, 2024

      • discordbrainz
        <03metadataismydrug> Ah ok, thank you!
      • 2024-07-17 19920, 2024

      • BrainzGit
        [musicbrainz-server] 14reosarevok merged pull request #3240 (03master…eslint-9): Update to eslint flat config and yea/nay all rules https://github.com/metabrainz/musicbrainz-server/…
      • 2024-07-17 19954, 2024

      • BrainzGit
        [bookbrainz-site] 14MonkeyDo opened pull request #1106 (03import-entities…import-annotation-id): chore: Allow annotation revision ids to be null (rebased) https://github.com/metabrainz/bookbrainz-site/pul…
      • 2024-07-17 19919, 2024

      • BrainzGit
        [bookbrainz-site] 14MonkeyDo closed pull request #1105 (03import-entities…annotation-revision-id-null): chore: Allow annotation revision ids to be null https://github.com/metabrainz/bookbrainz-site/pul…
      • 2024-07-17 19935, 2024

      • opticdelusion has quit
      • 2024-07-17 19950, 2024

      • opticdelusion joined the channel
      • 2024-07-17 19918, 2024

      • wargreen has quit