#metabrainz

[listenbrainz-android] 14dependabot[bot] opened pull request #456 (03dev…dependabot/gradle/dev/androidGradlePlugin-8.5.1): Bump androidGradlePlugin from 8.5.0 to 8.5.1 https://github.com/metabrainz/listenbrainz-andr...

[listenbrainz-android] 14dependabot[bot] opened pull request #457 (03dev…dependabot/gradle/dev/io.socket-socket.io-client-2.1.1): Bump io.socket:socket.io-client from 2.1.0 to 2.1.1 https://github.com/metabrainz/listenbrainz-andr...

[listenbrainz-android] 14dependabot[bot] opened pull request #458 (03dev…dependabot/gradle/dev/org.jsoup-jsoup-1.18.1): Bump org.jsoup:jsoup from 1.17.2 to 1.18.1 https://github.com/metabrainz/listenbrainz-andr...

[listenbrainz-android] 14dependabot[bot] opened pull request #459 (03dev…dependabot/gradle/dev/io.sentry.android.gradle-4.10.0): Bump io.sentry.android.gradle from 4.9.0 to 4.10.0 https://github.com/metabrainz/listenbrainz-andr...

[listenbrainz-android] 14dependabot[bot] opened pull request #460 (03dev…dependabot/gradle/dev/com.google.devtools.ksp-2.0.0-1.0.23): Bump com.google.devtools.ksp from 2.0.0-1.0.22 to 2.0.0-1.0.23 https://github.com/metabrainz/listenbrainz-andr...

[listenbrainz-server] 14amCap1712 merged pull request #2941 (03master…fix-fresh-releaess): Fix fresh releases api https://github.com/metabrainz/listenbrainz-serv...

[listenbrainz-server] release 03v-2024-07-17.0 has been published by 14github-actions[bot]: https://github.com/metabrainz/listenbrainz-serv...

Updating test.LB

<mayhem[m]> "lucifer: yep, what specs of..." <- i am thinking, two machines of similar specs for spark cluster so that we can repurpose them later.

we have ryzen5 3600, 64gb ram, 1TB disk machines atm. checking server auctions for stuff around that.

how much do any of the existing spark server cost?

moin!

I think they are about 30eur/mo

lucifer: current spark cluster machines are AX41, check AX42 (the new AX41) on https://www.hetzner.com/dedicated-rootserver/ma...

Oh i see. I was under the impression they are server auction machines.

to be sure, sparker cluster is Jackson5 machines right? They are all AX41-NVMe

Yes indeed. Makes sense

ax42 looks great if we could replace the drives to be at least 1TB.

I see an option to add a 1TB drive but doesn't seem possible to remove the 512gb ones.

What's the purpose of new machines? Increase the capacity of the cluster? or different role?

For now load testing a LB solr installation and later yes increasing the capacity of the cluster.

lucifer: for load testing, wouldn't virtual machines good enough? That's temporary right?

mayhem: spark cluster are physical machines, AX41-NVMe x 5

Yeah a vm would work too but even the 32gb ram one costs same as ax-42

We need one machine to run the solr installation and that should have lots of ram.

The second machine to run jmeter can be a smaller vm.

lucifer: ok, perhaps we should then go for AX52 (for SOLR) +1 VM for jmeter (no setup fee, temporary use). Then we can upgrade spark nodes to AX52 (increased cpu perf, more disk space, newer hardware), and decide if we keep 5 or 6. What do you think?

hmmm, J5 nodes are using raid0 disks so they already have 1Tb disk space

zas: sorry, i just realised that we could pay for hetzner VMs hourly. two vms would do fine. one 64gb one, one 16gb one. dedicated vcpus for both.

ideally we are done with both in a week.

they will run software independently for the rest right? (no consul?)

s/for/from/

zas: yes.

just need to be communicate to each other, preferably internal vlan? so that nothing needs to be exposed to public internet.

You need them now?

hmmm, but VMs will not have much disk space, max is 960Gb for ccx63 (dedicated vCPU), and we need to ask for d. vcpu limit increase for that.

zas: CCX23 and CCX43 would work fine. enough disk space for this test.

ok, tell me when you need them, We need to keep them the shortest time possible to limit costs.

now would be great

ok, on it

[listenbrainz-server] 14MonkeyDo merged pull request #2808 (03master…LB-1508-allow-hiding-personal-recommendations): LB-1508 Allow hiding personal recommendations https://github.com/metabrainz/listenbrainz-serv...

lucifer: machines ready

thanks!

lucifer: please keep tests as short as possible and tell me when VMs aren't needed anymore

zas: makes sense, will do.

[bookbrainz-data-js] 14MonkeyDo merged pull request #319 (03master…approve-import): Make approval of imported entities work https://github.com/metabrainz/bookbrainz-data-j...

anyone have a moment to proof read a happy birthday blog post? https://wordpress.com/post/blog.metabrainz.org/...

(meb blog account holders only)

[troi-recommendation-playground] 14mayhem merged pull request #142 (03main…appledesc): Fixed bug with description https://github.com/metabrainz/troi-recommendati...

mayhem: It looks nice! I just added categories and tags.

thanks!

Further proofreaders, please use the preview link instead to lower editing conflicts: https://musicbrainz.wordpress.com/?p=11644&...

reosarevok: ^^

lgtm as well

blog post looks good apart some missing characters (lets instead of let's in 3rd paragraph, its instead of it's in last paragraph).

zas: did you fix those mistakes or should I? (thanks)

you did, ok, thanks!

that's probably enough review, let me post it.

reosarevok: ^^

Ok :)

aerozol: ^^ care to tweet about this?

lucifer: this is quite interesting regarding strings. I wonder if some of these insights could help us sometime down the line: https://cedardb.com/blog/german_strings/

[bookbrainz-data-js] 14kellnerd opened pull request #320 (03master…import-annotation): Support annotations for imported entities https://github.com/metabrainz/bookbrainz-data-j...

[bookbrainz-site] 14MonkeyDo merged pull request #1103 (03import-entities…imports-2024): Make approval of imported entities work & other improvements https://github.com/metabrainz/bookbrainz-site/p...

mayhem: sorry I was afk, I didn't fix them yet, but now it's done ;)

they were fixed when I got there. :) thanks!

[bookbrainz-utils] 14MonkeyDo merged pull request #49 (03master…importer-dev-setup): Update DB setup instructions for importer https://github.com/metabrainz/bookbrainz-utils/...

mayhem: interesting read, indeed. thanks for sharing!

np. I figured I should share some stories from the past from time to time

Happy birthday, MusicBrainz 🥳

zas: is it possible to add the ccx-43 vm to monitoring? i would like to monitor various metrics for the load tests.

if its not possible, which commands/metrics do you usually watch out for? i can write a quick script to log them manually to a file and plot later.

CPU use, memory use and disk use are the most critical. network saturation is also good.

but given our use of ansible, it might not be hard to setup full monitoring.

[bookbrainz-site] 14MonkeyDo opened pull request #1105 (03master…annotation-revision-id-null): chore: Allow annotation revision ids to be null https://github.com/metabrainz/bookbrainz-site/p...

<03metadataismydrug> Question for the devs https://tickets.metabrainz.org/browse/SEARCH-722 Did the recent Solr upgrade happen to resolve this? I don't know if related or not, but the blog post mentioned search indexing, as does yvanzo's comment on the forums( https://community.metabrainz.org/t/digital-rele... ).

SEARCH-722: Editing release events triggers duplicate index messages

Hi metadataismydrug, no.

<03metadataismydrug> Ah ok, thank you!

[musicbrainz-server] 14reosarevok merged pull request #3240 (03master…eslint-9): Update to eslint flat config and yea/nay all rules https://github.com/metabrainz/musicbrainz-serve...

[bookbrainz-site] 14MonkeyDo opened pull request #1106 (03import-entities…import-annotation-id): chore: Allow annotation revision ids to be null (rebased) https://github.com/metabrainz/bookbrainz-site/p...

[bookbrainz-site] 14MonkeyDo closed pull request #1105 (03import-entities…annotation-revision-id-null): chore: Allow annotation revision ids to be null https://github.com/metabrainz/bookbrainz-site/p...