we need a tiny VM instance with 1 or 2 vCPU and a BOAT LOAD of diskspace.
2021-05-20 14016, 2021
adhawkins
I can run that in the VM that is the docker host without any problem (although it takes quite a while to download just 25 Meg)
2021-05-03 12350, 2021
nelgin
Where do I sent my invoice for all the testing and stuff I've been doing on the VM? :)
2021-04-30 12044, 2021
nelgin
Welp, the crontab is there already. I dunno, man. something definitely odd. I've been through this several times before, I'm sure. Right anyway, did you want to tinker with the vm any more, if not I'll shut the ssh port down for now.
2021-04-29 11945, 2021
nelgin
Isn't 100GB enough for the musicbrainz vm?
2021-04-28 11845, 2021
nelgin
It would be nice if the Vm came with all the perl modules already installed. That's one of the time consuming parts.
2021-04-28 11822, 2021
nelgin
yvanzo, I don't know about other errors. I've shut the vm down and trying to get sir to run on my ubuntu box
2021-04-28 11821, 2021
yvanzo
And yes, it is certainly faster to use a Linux host (docker or not) than a VM on Windows. :)
2021-04-28 11839, 2021
nelgin
Well, it'll be faster on my linux hardware than a vm on my windows machine.
2021-04-27 11736, 2021
nelgin
I rebooted my vm and restarted the docker and now it appears to be working.
2021-04-27 11736, 2021
nelgin
How can I determine if live indexing is turned on with the musicbrainz vm?
2021-04-25 11548, 2021
nelgin
Hey all, long time no see. It's been about 6 months since I connected to musicbrainz with my vm so what would be the quickest/easiest way to get my database up to date? Should I just wipe and start from scratch?
2021-04-12 10236, 2021
yvanzo
rdswift: the torrent made sense for MB VM images as they were available for a long time. that is not the case for most of our dumps that change weekly.
2021-04-12 10200, 2021
yvanzo
we use to have .torrent on ftp for mb vm iirc
2021-03-22 08104, 2021
zas
I guess so, but we need resources for that, prolly a VM, and time, backups, etc...
2021-03-15 07455, 2021
yvanzo
reosarevok: into the vm and into our images for production :)
2021-03-15 07417, 2021
reosarevok
yvanzo: what's the highest still easy to get into the vm? 5.30?
2021-03-15 07407, 2021
bitmap
ruaok: good question, we should certainly encourage people to use the VM in any case
2021-02-24 05526, 2021
alastairp
that is, shared buffers * 4 was > memory allocated to docker VM
2021-02-17 04824, 2021
iliekcomputers
it's a vm on google cloud iirc
2021-02-02 03345, 2021
ruaok
the only real way of doing what you want to do is to install a copy of MB on a VM and then query postgres directly, but that is much more work than calling an API. :(
2021-01-12 01252, 2021
zas
alastairp, ruaok: I was checking VM prices, but we still have machines with enough cpu/ram/disk to host jenkins, for example cage, which is not overused atm
2021-01-12 01204, 2021
ruaok
I wasn't thinking VM, but that doesn't rule it out.
2021-01-12 01248, 2021
alastairp
(were you even thinking of using a vm? It was a suggestion that zas had while you were on the way to the office yesterday)
2021-01-12 01232, 2021
alastairp
what's your thoughts on the cost of the VM? is there a limit we shouldn't go over? is it worth spending admin time trying to configure it to shut down when not in use?
2021-01-11 01150, 2021
bitmap
anyway I'm all for that since a dedicated vm would likely make mbs's selenium tests more stable while json dumps are running
2021-01-11 01122, 2021
bitmap
ah. so install jenkins directly in the vm rather than use docker-in-docker
2021-01-11 01110, 2021
alastairp
(7 hours ago, re: moving jenkins to hetzner vm)
2021-01-11 01152, 2021
zas
ruaok, alastairp: you want to move jenkins somewhere else? can it run on a hetzner VM? does it depend on mb-hetzner infrastructure (consul etc...)?
2021-01-11 01107, 2021
ruaok
oh. funkwhale on a personal VM. heh.
2021-01-10 01054, 2021
ruaok
zas: I cleaned up some stuff in my home dir and an old VM from the NGS days.
2020-12-28 36311, 2020
ruaok
where is the VM?
2020-12-28 36310, 2020
yvanzo
(I tried to restart the vm, and to enable the rescue mode, but it did not change anything.)
2020-12-28 36339, 2020
yvanzo
hi bitmap, do you have access to musicbrainz-docker-test VM? Its ssh port is timing out here, since yesterday.
2020-12-20 35528, 2020
ballin
is it normal for a docker hosted VM of musicbrainz to have a slow response to the base url? I have it on 3 cores, 8GB RAM on ye olde 4000 series i5. api url requests seem fast
2020-11-20 32537, 2020
ruaok
how much ram does your VM have?
2020-10-26 30020, 2020
zas
and created an hetzner VM for yvanzo MB related stuff
2020-10-26 30030, 2020
yvanzo
Otherwise I mostly spent time working on search components and got started with a new VM to test indexing load thanks to zas.
2020-10-23 29721, 2020
adhawkins
Seems a lot, considering the previous VM that ran it worked fine with just 4 Gig. I guess if the docker-compose file can be arranged so as to optionally not start the search indexing stuff that might help?
2020-10-22 29603, 2020
zas
yvanzo: when do you need this VM?
2020-10-09 28346, 2020
adhawkins
6 Gig does sound rather a lot though. My previous VM only had 4 Gig and didn't seem to run into these issues.
2020-10-09 28355, 2020
adhawkins
Hi all. Just to let you know that since I put the postgres memory back to 'standard', and increased the VM to 6 Gig RAM, I haven't had any OOM errors (been running about 2 days). Might be worth considering an update to the instructions for the docker images to reflect suggested RAM size?
2020-10-07 28151, 2020
_lucifer
ah great! I actually just saw that setup is using JDK 8. Upgrading to 11 and using Graal VM in addition to it may have a huge performance boost. might be worth experimenting some time
2020-10-07 28146, 2020
adhawkins
Hi all. Still getting OOM errors overnight on my VM running mbserver under docker. I've put the database memory back to 2 Gig, and increased the VM to 6 Gig (from 4)
2020-10-01 27530, 2020
adhawkins
I'm just running a scan over my music at the moment. When this completes I'll reboot the VM running it all.
2020-09-29 27322, 2020
adhawkins
It's not happening a lot. These are since the VM was booted on 22nd Sept:
2020-09-29 27302, 2020
ruaok
moin adhawkins. 4gig seems rather paltry for a VM. Go for 8 and I think you'll see some problems go awa.
2020-09-29 27310, 2020
adhawkins
Hi all. Seeing fairly regular OOM reports on my VM running MBserver under docker. Not generating search indexes. VM has 4 Gig of RAM and 2 processors.
2020-09-15 25928, 2020
nelgin
yvanzo, I've tweaked everything I can on the VM, so It looks like its down to you.
2020-09-14 25829, 2020
nelgin
yvanzo, I also just found that I didn't install virtualbox guest additions on the new VM I created. I'm going to do that and reboot.
2020-09-12 25652, 2020
nelgin
yvanzo, the reason the queue is smaller is because I created a new VM with fixed disk instead of dynamic and it's on a new ssd.
2020-09-05 24948, 2020
yvanzo
nelgin: so the issue was specific to running a VM on Windows?
2020-09-04 24853, 2020
nelgin
Looks like it took 12 hours on a 4 core vm with 16gb of memory assigned, with 4gb each to the DB and search.
2020-09-04 24845, 2020
nelgin
Very nice. My VM died.
2020-09-04 24836, 2020
nelgin
yvanzo ,for some reason the setting to change my VM from 10 to 16gb didn't take, hardware acceleration was off and video memory was at 4mb. I've tweaked the setings back to something more reasonable so I'm going to give it another go.
2020-09-03 24754, 2020
nelgin
yvanzo, I keep getting OOM killer breaking my indexing. I've now assigned 16gb to the VM. Any suggestions?
2020-09-02 24635, 2020
nelgin
I gave my vm 10gb - what would be a reasonable allocation for pgsql ?Should I leave it at default?
2020-09-01 24504, 2020
nelgin
the vm has 127mb free, so yeah. I think it likes it.
2020-09-01 24528, 2020
nelgin
I gave 10gb to the VM.
2020-09-01 24550, 2020
nelgin
I think I need to get another 32gb of memory for my pc if I'm going to be running docker on a vm lol
2020-09-01 24549, 2020
nelgin
Let me see. I'm lagging it bit on my pc due to the vm.
2020-09-01 24533, 2020
nelgin
Hi all. I just started up my VM and started replication manually and getting a ton of "WARNING: amqp could not commit tx mode on broker 1, reply_type=3, library_errno=0" messages. Any suggestions?
2020-08-30 24310, 2020
adhawkins
It's a VM so if need be I could revert and start again.
2020-08-17 23028, 2020
ruaok
yvanzo: yeah, bono or a vm for that. lets chat in a bit.
2020-08-12 22539, 2020
nelgin
I rebooted the vm and the docker service starts on boot
2020-08-12 22551, 2020
nelgin
Let me reboot the vm
2020-08-11 22458, 2020
nelgin
Something is terribly wrong here. I'm just going to reinstall the vm. Also, any way to have it use a us rather than eu mirror for downloading the files?
2020-08-11 22453, 2020
alastairp
how much memory does the VM have?
2020-08-11 22445, 2020
nelgin
OK. I'm back. I'm going to add 2gb to the VM and see if that'll help it through.
2020-08-11 22411, 2020
nelgin
I might be able to give 2gb more to the vm for reindexing but that'd leave the pc short, so it's be a temp measure.
2020-08-11 22437, 2020
nelgin
to the VM of which 4G was given to postgres via the tuning parameter.
2020-08-11 22436, 2020
nelgin
Hi all. I'm creating a new vm with the instructions from https://github.com/metabrainz/musicbrainz-docker. When I get to creating the indexes it gets so far then I get ""server closed the connection unexpectedly". This has happened twice now. What's going on?
2020-07-30 21248, 2020
alastairp
in the end it was because shared_buffers was higher than maximum ram the docker VM on mac had
2020-07-20 20254, 2020
zas
legoktm: yes, but it would be perhaps safer to build a new VM from scratch, and migrate
2020-07-20 20259, 2020
legoktm
ruaok, zas: would it be possible to upgrade the wiki.musicbrainz VM to a newer OS version? it's on xenial now, which has PHP 7.0. if we could go to focal with 7.4, that would be ideal.
2020-06-26 17849, 2020
zas
it will be looong, vm isn't very fast when it comes to intensive tasks like this
2020-06-25 17740, 2020
ruaok
most people who show up here are like "I got loads and loads of ram on my VM. I gave it 2GB!"
2020-06-19 17125, 2020
ruaok
yvanzo: did you see my message about the MB VM VM on azure? I would like to stop that instance and close our azure account near the end of the month
2020-06-17 16949, 2020
ruaok
yvanzo: our azure sponsorship is ending and thus we should move the musicbrainz-docker VM someplace else before the end of the month.
2020-06-14 16647, 2020
yvanzo
yeah, dockerization made dependency management and maintenance much easier, but the vm was using it already :)
2020-06-14 16656, 2020
Z903
yvanzo the fact that your vm package just runs docker is hilarious
2020-06-14 16640, 2020
yvanzo
reosarevok: there is no reason to keep the old VM in the FTP, I just forgot to remove it after updating docs, will do, thanks.
2020-06-14 16636, 2020
Z903
I totally understand that docker has no issues in a vm, all i was saying was that it seems redundant. Since I am going to be spinning up an whole enviroment anyway.
2020-06-14 16651, 2020
DjSlash
docker runs just as fine on a vm
2020-06-14 16646, 2020
reosarevok
But it honestly might take less time than to do all the upgrading processes for an ages-old VM anyway :)
2020-06-14 16648, 2020
reosarevok
Sorry, but we don't maintain a separate VM install anymore since Docker is just what we use for our own stuff anyway :)
2020-06-14 16636, 2020
Z903
It seems kinda pointless to use docker if im already using a vm
2020-06-14 16634, 2020
Z903
I was hpoing to avoid using docker since I have a vm host already
2020-06-14 16652, 2020
reosarevok
ruaok, yvanzo: is there a reason we still have the old VM in the FTP?
download and import takes a while (last time I set up a dev vm I let it run overnight)
2020-04-23 11454, 2020
iliekcomputers
yvanzo: i think recommending Ubuntu as a VM makes sense too
2020-04-23 11414, 2020
Mr_Monkey
I thinkt he first and easiest step is to try with PowerShell, since it likely comes pre-installed. If that fails and user is on win10, using WSL is probably second best. VM is slower and trickier in my opinion
2020-04-23 11426, 2020
Zastai
I use VirtualBox on Windows, so can't use the current Docker for Windows. I only run docker inside a Debian VirtualBox vm, for listenbrainz
2020-04-05 09628, 2020
nelgin
I may have broken my replication or something. I know my vm crashed maybe while doing an import. I just started it up and logged into the docker session and I'm seeing a replication.sh running but there's no slave.log - Should that only be running while replicating? There's no slave.log. I'm wondering what steps I should take to check the database is valid and restart replication.
in the docker dashboard i just changed the location of vm-data folder
2020-02-27 05859, 2020
tmontney
I realized my VM disk was too small.
2020-02-24 05552, 2020
yvanzo
ruaok: I agree, VM should be replaced with Docker for mirrors.
2020-02-23 05404, 2020
ruaok
want a login to the VM?
2020-02-22 05326, 2020
tmontney
you said if nothing else, the VM search would be better
2020-02-22 05318, 2020
tmontney
VM
2020-02-22 05314, 2020
ruaok
in production or on the VM?
2020-02-22 05346, 2020
tmontney
so how does the VM search work?
2020-02-22 05313, 2020
ruaok
if you care about accuracy, the I would go with the VM with search.
2020-02-22 05350, 2020
ruaok
if you use the VM, search is built in.
2020-02-22 05307, 2020
ruaok
i'm super happy to get rid of VM images.
2020-02-22 05338, 2020
ruaok
fire up a VM, install docker, then run that. wait. done.
2020-02-22 05341, 2020
tmontney
Instance is a fresh VMWare VM
2020-02-22 05311, 2020
iliekcomputers
ruaok: the newleader isn't a hetzner vm now, right?
2020-02-19 05038, 2020
ruaok
yvanzo: do you have a roadmap of features needed for the VM?
2020-02-12 04330, 2020
zas
and it runs fast on the smallest hetzner VM :)
2020-02-10 04156, 2020
zas
Apart usual stuff (upgrades, supervision, alert handling), I configured a VM for livegrep, work still in progress
2020-02-05 03635, 2020
adhawkins
If you want to use me as a test bed for upgrade instructions, feel free. It's a VM and I can take a snapshot before starting so nothing can go wrong :)
2020-01-28 02802, 2020
zas
iliekcomputers: I didn't had time today, but it is planned ;) I think about setting up a VM for it
2020-01-27 02704, 2020
yvanzo
1. The VM is not up-to-date and is not suitable for development.
2020-01-22 02254, 2020
ruaok
yeah, we suggest a clean VM with docker installed as the base layer.
2020-01-22 02200, 2020
ruaok
petre: are you setting up a VM with musicbrainz-docker?
2020-01-05 00522, 2020
Zastai
has something changed with transifex? authentication using the API token works, but I'm getting a Forbidden error trying to pull new translations for MusicBrainz (setting up my dev vm again)
2020-01-05 00514, 2020
alastairp
OK, I don't know what the VM is. perhaps iliekcomputers used it to prototytype the move from spike?
2020-01-05 00538, 2020
alastairp
oh, that's a VM, right
2020-01-05 00532, 2020
ruaok
hetzner cloud vm.
2020-01-05 00511, 2020
alastairp
ruaok: VM or hetzner?
2020-01-05 00549, 2020
ruaok
alastairp: we have a VM acousticbrainz-test that we fired up a year ago. is that still in use?
2020-01-04 00412, 2020
ruaok
first VM didn't come out well. will try again.
2020-01-04 00409, 2020
iliekcomputers
makes sense to me. If the problem still exists, then we know that it's spark and not the VM
2020-01-04 00413, 2020
iliekcomputers
i thought it might be the VM.
2020-01-04 00454, 2020
ruaok
spark or the VM? we know those VMs suck ass.
2019-12-30 36417, 2019
yvanzo
Hmm... which Solr VM?
2019-12-30 36422, 2019
zas
Is there a dump on solr VM ?
2019-12-26 36007, 2019
nelgin
If anyone is interested, the initial building of search indexes on a VM with 10867MB of memory and 6 processors (on a Ryzen 5 3600) on an external USB hard drive was 13 1/3 hours. :)
2019-12-26 36006, 2019
nelgin
Not sure who is on here who's also on #musicbrainz but I'm building a new vm and ran the indexing...I posted this
2019-12-12 34615, 2019
zas
bitmap: the main problem is Jenkins, built images aren't cleaned, perhaps we should just move jenkins to a VM or smt
2019-12-06 34053, 2019
reosarevok
If you're willing to help a bit if and when I get stuck, I can - sir and the vm do need the work too
2019-12-04 33852, 2019
sbvkrishna
Using a VM (virtual machine) for running those dependencies. I'll write about it as a comment on the task
2019-12-02 33613, 2019
crashtestdummy
I was running the VM on my windows box but my perl scripts were on the Linux box, making it more difficult than necessary to connect to the vm instance when running host network. Bridged is much better since you can get an ip from your router and no have to worry about all that, get internet access, ssh works etc.
