we need a tiny VM instance with 1 or 2 vCPU and a BOAT LOAD of diskspace.
2021-05-20 14016, 2021
adhawkins
I can run that in the VM that is the docker host without any problem (although it takes quite a while to download just 25 Meg)
2021-05-03 12350, 2021
nelgin
Where do I sent my invoice for all the testing and stuff I've been doing on the VM? :)
2021-04-30 12044, 2021
Welp, the crontab is there already. I dunno, man. something definitely odd. I've been through this several times before, I'm sure. Right anyway, did you want to tinker with the vm any more, if not I'll shut the ssh port down for now.
2021-04-29 11945, 2021
Isn't 100GB enough for the musicbrainz vm?
2021-04-28 11845, 2021
It would be nice if the Vm came with all the perl modules already installed. That's one of the time consuming parts.
yvanzo, I don't know about other errors. I've shut the vm down and trying to get sir to run on my ubuntu box
yvanzo
And yes, it is certainly faster to use a Linux host (docker or not) than a VM on Windows. :)
nelgin
Well, it'll be faster on my linux hardware than a vm on my windows machine.
2021-04-27 11736, 2021
I rebooted my vm and restarted the docker and now it appears to be working.
How can I determine if live indexing is turned on with the musicbrainz vm?
2021-04-25 11548, 2021
Hey all, long time no see. It's been about 6 months since I connected to musicbrainz with my vm so what would be the quickest/easiest way to get my database up to date? Should I just wipe and start from scratch?
2021-04-12 10236, 2021
yvanzo
rdswift: the torrent made sense for MB VM images as they were available for a long time. that is not the case for most of our dumps that change weekly.
we use to have .torrent on ftp for mb vm iirc
2021-03-22 08104, 2021
zas
I guess so, but we need resources for that, prolly a VM, and time, backups, etc...
2021-03-15 07455, 2021
yvanzo
reosarevok: into the vm and into our images for production :)
reosarevok
yvanzo: what's the highest still easy to get into the vm? 5.30?
bitmap
ruaok: good question, we should certainly encourage people to use the VM in any case
2021-02-24 05526, 2021
alastairp
that is, shared buffers * 4 was > memory allocated to docker VM
2021-02-17 04824, 2021
iliekcomputers
it's a vm on google cloud iirc
2021-02-02 03345, 2021
ruaok
the only real way of doing what you want to do is to install a copy of MB on a VM and then query postgres directly, but that is much more work than calling an API. :(
2021-01-12 01252, 2021
zas
alastairp, ruaok: I was checking VM prices, but we still have machines with enough cpu/ram/disk to host jenkins, for example cage, which is not overused atm
ruaok
I wasn't thinking VM, but that doesn't rule it out.
alastairp
(were you even thinking of using a vm? It was a suggestion that zas had while you were on the way to the office yesterday)
what's your thoughts on the cost of the VM? is there a limit we shouldn't go over? is it worth spending admin time trying to configure it to shut down when not in use?
2021-01-11 01150, 2021
bitmap
anyway I'm all for that since a dedicated vm would likely make mbs's selenium tests more stable while json dumps are running
ah. so install jenkins directly in the vm rather than use docker-in-docker
alastairp
(7 hours ago, re: moving jenkins to hetzner vm)
zas
ruaok, alastairp: you want to move jenkins somewhere else? can it run on a hetzner VM? does it depend on mb-hetzner infrastructure (consul etc...)?
ruaok
oh. funkwhale on a personal VM. heh.
2021-01-10 01054, 2021
zas: I cleaned up some stuff in my home dir and an old VM from the NGS days.
2020-12-28 36311, 2020
where is the VM?
yvanzo
(I tried to restart the vm, and to enable the rescue mode, but it did not change anything.)
hi bitmap, do you have access to musicbrainz-docker-test VM? Its ssh port is timing out here, since yesterday.
2020-12-20 35528, 2020
ballin
is it normal for a docker hosted VM of musicbrainz to have a slow response to the base url? I have it on 3 cores, 8GB RAM on ye olde 4000 series i5. api url requests seem fast
2020-11-20 32537, 2020
ruaok
how much ram does your VM have?
2020-10-26 30020, 2020
zas
and created an hetzner VM for yvanzo MB related stuff
yvanzo
Otherwise I mostly spent time working on search components and got started with a new VM to test indexing load thanks to zas.
2020-10-23 29721, 2020
adhawkins
Seems a lot, considering the previous VM that ran it worked fine with just 4 Gig. I guess if the docker-compose file can be arranged so as to optionally not start the search indexing stuff that might help?
2020-10-22 29603, 2020
zas
yvanzo: when do you need this VM?
2020-10-09 28346, 2020
adhawkins
6 Gig does sound rather a lot though. My previous VM only had 4 Gig and didn't seem to run into these issues.
Hi all. Just to let you know that since I put the postgres memory back to 'standard', and increased the VM to 6 Gig RAM, I haven't had any OOM errors (been running about 2 days). Might be worth considering an update to the instructions for the docker images to reflect suggested RAM size?
2020-10-07 28151, 2020
_lucifer
ah great! I actually just saw that setup is using JDK 8. Upgrading to 11 and using Graal VM in addition to it may have a huge performance boost. might be worth experimenting some time
adhawkins
Hi all. Still getting OOM errors overnight on my VM running mbserver under docker. I've put the database memory back to 2 Gig, and increased the VM to 6 Gig (from 4)
2020-10-01 27530, 2020
I'm just running a scan over my music at the moment. When this completes I'll reboot the VM running it all.
2020-09-29 27322, 2020
It's not happening a lot. These are since the VM was booted on 22nd Sept:
ruaok
moin adhawkins. 4gig seems rather paltry for a VM. Go for 8 and I think you'll see some problems go awa.
adhawkins
Hi all. Seeing fairly regular OOM reports on my VM running MBserver under docker. Not generating search indexes. VM has 4 Gig of RAM and 2 processors.
2020-09-15 25928, 2020
nelgin
yvanzo, I've tweaked everything I can on the VM, so It looks like its down to you.
2020-09-14 25829, 2020
yvanzo, I also just found that I didn't install virtualbox guest additions on the new VM I created. I'm going to do that and reboot.
2020-09-12 25652, 2020
yvanzo, the reason the queue is smaller is because I created a new VM with fixed disk instead of dynamic and it's on a new ssd.
2020-09-05 24948, 2020
yvanzo
nelgin: so the issue was specific to running a VM on Windows?
2020-09-04 24853, 2020
nelgin
Looks like it took 12 hours on a 4 core vm with 16gb of memory assigned, with 4gb each to the DB and search.
Very nice. My VM died.
yvanzo ,for some reason the setting to change my VM from 10 to 16gb didn't take, hardware acceleration was off and video memory was at 4mb. I've tweaked the setings back to something more reasonable so I'm going to give it another go.
2020-09-03 24754, 2020
yvanzo, I keep getting OOM killer breaking my indexing. I've now assigned 16gb to the VM. Any suggestions?
2020-09-02 24635, 2020
I gave my vm 10gb - what would be a reasonable allocation for pgsql ?Should I leave it at default?
2020-09-01 24504, 2020
the vm has 127mb free, so yeah. I think it likes it.
I gave 10gb to the VM.
I think I need to get another 32gb of memory for my pc if I'm going to be running docker on a vm lol
Let me see. I'm lagging it bit on my pc due to the vm.
Hi all. I just started up my VM and started replication manually and getting a ton of "WARNING: amqp could not commit tx mode on broker 1, reply_type=3, library_errno=0" messages. Any suggestions?
2020-08-30 24310, 2020
adhawkins
It's a VM so if need be I could revert and start again.
2020-08-17 23028, 2020
ruaok
yvanzo: yeah, bono or a vm for that. lets chat in a bit.
2020-08-12 22539, 2020
nelgin
I rebooted the vm and the docker service starts on boot
Let me reboot the vm
2020-08-11 22458, 2020
Something is terribly wrong here. I'm just going to reinstall the vm. Also, any way to have it use a us rather than eu mirror for downloading the files?
alastairp
how much memory does the VM have?
nelgin
OK. I'm back. I'm going to add 2gb to the VM and see if that'll help it through.
I might be able to give 2gb more to the vm for reindexing but that'd leave the pc short, so it's be a temp measure.
to the VM of which 4G was given to postgres via the tuning parameter.
Hi all. I'm creating a new vm with the instructions from https://github.com/metabrainz/musicbrainz-docker. When I get to creating the indexes it gets so far then I get ""server closed the connection unexpectedly". This has happened twice now. What's going on?
2020-07-30 21248, 2020
alastairp
in the end it was because shared_buffers was higher than maximum ram the docker VM on mac had
2020-07-20 20254, 2020
zas
legoktm: yes, but it would be perhaps safer to build a new VM from scratch, and migrate
legoktm
ruaok, zas: would it be possible to upgrade the wiki.musicbrainz VM to a newer OS version? it's on xenial now, which has PHP 7.0. if we could go to focal with 7.4, that would be ideal.
2020-06-26 17849, 2020
zas
it will be looong, vm isn't very fast when it comes to intensive tasks like this
2020-06-25 17740, 2020
ruaok
most people who show up here are like "I got loads and loads of ram on my VM. I gave it 2GB!"
2020-06-19 17125, 2020
yvanzo: did you see my message about the MB VM VM on azure? I would like to stop that instance and close our azure account near the end of the month
2020-06-17 16949, 2020
yvanzo: our azure sponsorship is ending and thus we should move the musicbrainz-docker VM someplace else before the end of the month.
2020-06-14 16647, 2020
yvanzo
yeah, dockerization made dependency management and maintenance much easier, but the vm was using it already :)
Z903
yvanzo the fact that your vm package just runs docker is hilarious
yvanzo
reosarevok: there is no reason to keep the old VM in the FTP, I just forgot to remove it after updating docs, will do, thanks.
Z903
I totally understand that docker has no issues in a vm, all i was saying was that it seems redundant. Since I am going to be spinning up an whole enviroment anyway.
DjSlash
docker runs just as fine on a vm
reosarevok
But it honestly might take less time than to do all the upgrading processes for an ages-old VM anyway :)
Sorry, but we don't maintain a separate VM install anymore since Docker is just what we use for our own stuff anyway :)
Z903
It seems kinda pointless to use docker if im already using a vm
I was hpoing to avoid using docker since I have a vm host already
reosarevok
ruaok, yvanzo: is there a reason we still have the old VM in the FTP?
download and import takes a while (last time I set up a dev vm I let it run overnight)
2020-04-23 11454, 2020
iliekcomputers
yvanzo: i think recommending Ubuntu as a VM makes sense too
Mr_Monkey
I thinkt he first and easiest step is to try with PowerShell, since it likely comes pre-installed. If that fails and user is on win10, using WSL is probably second best. VM is slower and trickier in my opinion
Zastai
I use VirtualBox on Windows, so can't use the current Docker for Windows. I only run docker inside a Debian VirtualBox vm, for listenbrainz
2020-04-05 09628, 2020
nelgin
I may have broken my replication or something. I know my vm crashed maybe while doing an import. I just started it up and logged into the docker session and I'm seeing a replication.sh running but there's no slave.log - Should that only be running while replicating? There's no slave.log. I'm wondering what steps I should take to check the database is valid and restart replication.
in the docker dashboard i just changed the location of vm-data folder
2020-02-27 05859, 2020
tmontney
I realized my VM disk was too small.
2020-02-24 05552, 2020
yvanzo
ruaok: I agree, VM should be replaced with Docker for mirrors.
2020-02-23 05404, 2020
ruaok
want a login to the VM?
2020-02-22 05326, 2020
tmontney
you said if nothing else, the VM search would be better
VM
ruaok
in production or on the VM?
tmontney
so how does the VM search work?
ruaok
if you care about accuracy, the I would go with the VM with search.
if you use the VM, search is built in.
i'm super happy to get rid of VM images.
fire up a VM, install docker, then run that. wait. done.
tmontney
Instance is a fresh VMWare VM
iliekcomputers
ruaok: the newleader isn't a hetzner vm now, right?
2020-02-19 05038, 2020
ruaok
yvanzo: do you have a roadmap of features needed for the VM?
2020-02-12 04330, 2020
zas
and it runs fast on the smallest hetzner VM :)
2020-02-10 04156, 2020
Apart usual stuff (upgrades, supervision, alert handling), I configured a VM for livegrep, work still in progress
2020-02-05 03635, 2020
adhawkins
If you want to use me as a test bed for upgrade instructions, feel free. It's a VM and I can take a snapshot before starting so nothing can go wrong :)
2020-01-28 02802, 2020
zas
iliekcomputers: I didn't had time today, but it is planned ;) I think about setting up a VM for it
2020-01-27 02704, 2020
yvanzo
1. The VM is not up-to-date and is not suitable for development.
2020-01-22 02254, 2020
ruaok
yeah, we suggest a clean VM with docker installed as the base layer.
petre: are you setting up a VM with musicbrainz-docker?
2020-01-05 00522, 2020
Zastai
has something changed with transifex? authentication using the API token works, but I'm getting a Forbidden error trying to pull new translations for MusicBrainz (setting up my dev vm again)
alastairp
OK, I don't know what the VM is. perhaps iliekcomputers used it to prototytype the move from spike?
oh, that's a VM, right
ruaok
hetzner cloud vm.
alastairp
ruaok: VM or hetzner?
ruaok
alastairp: we have a VM acousticbrainz-test that we fired up a year ago. is that still in use?
2020-01-04 00412, 2020
first VM didn't come out well. will try again.
iliekcomputers
makes sense to me. If the problem still exists, then we know that it's spark and not the VM
i thought it might be the VM.
ruaok
spark or the VM? we know those VMs suck ass.
2019-12-30 36417, 2019
yvanzo
Hmm... which Solr VM?
zas
Is there a dump on solr VM ?
2019-12-26 36007, 2019
nelgin
If anyone is interested, the initial building of search indexes on a VM with 10867MB of memory and 6 processors (on a Ryzen 5 3600) on an external USB hard drive was 13 1/3 hours. :)
Not sure who is on here who's also on #musicbrainz but I'm building a new vm and ran the indexing...I posted this
2019-12-12 34615, 2019
zas
bitmap: the main problem is Jenkins, built images aren't cleaned, perhaps we should just move jenkins to a VM or smt
2019-12-06 34053, 2019
reosarevok
If you're willing to help a bit if and when I get stuck, I can - sir and the vm do need the work too
2019-12-04 33852, 2019
sbvkrishna
Using a VM (virtual machine) for running those dependencies. I'll write about it as a comment on the task
2019-12-02 33613, 2019
crashtestdummy
I was running the VM on my windows box but my perl scripts were on the Linux box, making it more difficult than necessary to connect to the vm instance when running host network. Bridged is much better since you can get an ip from your router and no have to worry about all that, get internet access, ssh works etc.
