ruaok: they should, but old ntp is conflicting with new systemd stuff, i need to check in details, that's on my virtual todo list
2016-11-11 31631, 2016
legoktm
ruaok, zas: on the wiki's vm, do I need to do anything special to open up ports? I started a nodejs service that should be exposed on port 8142, but I can't seem to connect to it from the outside (internally works)
2016-11-11 31642, 2016
legoktm
and my laptop battery is about to die, so I'll bbl
2016-11-11 31631, 2016
zas
legoktm: yes, we need to open ports on gcloud firewall, only http(s)/ssh are open by default
2016-11-11 31650, 2016
zas
can we see that tomorrow, i'm about to go to sleep
2016-11-11 31653, 2016
zas
?
2016-11-11 31637, 2016
Freso has quit
2016-11-11 31627, 2016
Freso joined the channel
2016-11-11 31601, 2016
drsaunders has quit
2016-11-11 31606, 2016
drsaunder joined the channel
2016-11-11 31645, 2016
drsaunder has quit
2016-11-11 31644, 2016
hibiscuskazeneko has quit
2016-11-11 31600, 2016
drsaunder joined the channel
2016-11-11 31618, 2016
gcilou joined the channel
2016-11-11 31613, 2016
CatQuest has quit
2016-11-11 31640, 2016
CatQuest joined the channel
2016-11-11 31634, 2016
Leo_Verto has quit
2016-11-11 31639, 2016
Slurpee has quit
2016-11-11 31613, 2016
hibiscuskazeneko joined the channel
2016-11-11 31612, 2016
chirlu
UmkaDK: So much about important people not dying before replication is restored …
2016-11-11 31647, 2016
bitmap
:(
2016-11-11 31659, 2016
drsaunder
"there's a crack in everything, that's how the light gets in"
2016-11-11 31610, 2016
CallerNo6
word
2016-11-11 31616, 2016
chirlu
bitmap: Is a dump running, by the way?
2016-11-11 31622, 2016
chirlu
When we tell people they need to reimport, it would be good to have a dump ready. :-)
2016-11-11 31631, 2016
bitmap
chirlu: not yet, I'll start one now
2016-11-11 31650, 2016
bitmap
I always forget the command
2016-11-11 31603, 2016
bitmap
I think just ./admin/RunExport 1
2016-11-11 31646, 2016
colbydray|laptop joined the channel
2016-11-11 31644, 2016
bitmap
zas: installing screen on all the servers would be nice :)
should only be one 'musicbrainz' there, I've fixed the rsync daemon
2016-11-11 31659, 2016
colbydray|laptop joined the channel
2016-11-11 31609, 2016
colbydray|laptop has quit
2016-11-11 31641, 2016
gcilou has quit
2016-11-11 31644, 2016
naught101 has quit
2016-11-11 31653, 2016
jcazevedo has quit
2016-11-11 31613, 2016
Leftmost has quit
2016-11-11 31648, 2016
Leftmost joined the channel
2016-11-11 31625, 2016
magerharz has quit
2016-11-11 31653, 2016
pingupingu joined the channel
2016-11-11 31626, 2016
pingupingu has quit
2016-11-11 31617, 2016
drsaunder has quit
2016-11-11 31604, 2016
hibiscuskazeneko has quit
2016-11-11 31640, 2016
mihaitish joined the channel
2016-11-11 31651, 2016
naught101 joined the channel
2016-11-11 31620, 2016
kyan has quit
2016-11-11 31635, 2016
hibiscuskazeneko joined the channel
2016-11-11 31649, 2016
drsaunder joined the channel
2016-11-11 31634, 2016
D4RK-PH0ENiX joined the channel
2016-11-11 31618, 2016
Nyanko-sensei has quit
2016-11-11 31616, 2016
mihaitish has quit
2016-11-11 31620, 2016
hibiscuskazeneko has quit
2016-11-11 31639, 2016
mihaitish joined the channel
2016-11-11 31604, 2016
naught101 has quit
2016-11-11 31626, 2016
Gore|home joined the channel
2016-11-11 31600, 2016
naught101 joined the channel
2016-11-11 31603, 2016
naught101_ joined the channel
2016-11-11 31604, 2016
dboys_ joined the channel
2016-11-11 31637, 2016
naught101 has quit
2016-11-11 31635, 2016
Gore|home is now known as Gore|woerk
2016-11-11 31611, 2016
D4RK-PH0ENiX has quit
2016-11-11 31638, 2016
D4RK-PH0ENiX joined the channel
2016-11-11 31657, 2016
mihaitish has quit
2016-11-11 31649, 2016
naught101_ has quit
2016-11-11 31621, 2016
naught101_ joined the channel
2016-11-11 31634, 2016
naught101_ has quit
2016-11-11 31648, 2016
naught101_ joined the channel
2016-11-11 31636, 2016
luks
Freso: zas: if you want to do a new picard release, it would be best to do it soon, I need to rebuild my jenkins setup after which I might not be able to build picard on win/osx (for some time)
2016-11-11 31632, 2016
luks
my build machines are windows xp and os x 10.6, none of which support java 8 and that is needed for recent versions of jenkins
2016-11-11 31657, 2016
chirlu
Good morning UmkaDK. Some bad news for you, whenever you are prepared for it. :-|
2016-11-11 31600, 2016
JonnyJD_ joined the channel
2016-11-11 31626, 2016
legoktm
zas: ok, no rush :)
2016-11-11 31656, 2016
chirlu
bitmap: Do we still have the pg_dump that was used to transfer the database from OldHost to NewHost? If so, that would provide us the state-as-of-99848 if we import it into a new master DB, even including the tags and so on.
2016-11-11 31601, 2016
chirlu
And the FTP server seems to have synced already. Advantage of rsync’s deduplication – renames don’t matter much.
2016-11-11 31610, 2016
mihaitish joined the channel
2016-11-11 31617, 2016
JonnyJD_ has quit
2016-11-11 31652, 2016
naught101_ has quit
2016-11-11 31650, 2016
yeeeargh joined the channel
2016-11-11 31601, 2016
JonnyJD_ joined the channel
2016-11-11 31650, 2016
JonnyJD_ has quit
2016-11-11 31644, 2016
luks
chirlu: do I get it right that replication is running now, but there is just the one missing packet? if I do a fresh import, everything will work?
2016-11-11 31627, 2016
chirlu
Yes, exactly. You need the new dump from today.
2016-11-11 31644, 2016
chirlu
There is still a slim chance that we find back the missing packet, but it’s slim.
2016-11-11 31641, 2016
chirlu
If there is anyone (in addition to the FreeDB gateway) who got the relevant packet while it was available, replication continues for them without problems.
2016-11-11 31646, 2016
luks
ok, thanks, I'll do a new import
2016-11-11 31655, 2016
alastairp
I have a machine that replicated, can I try and recover the deleted file?
2016-11-11 31625, 2016
chirlu
It’s normally deleted after the import, but if you changed that to keep the packets, that would be helpful. :)
2016-11-11 31635, 2016
alastairp
no, I didn't change it
2016-11-11 31646, 2016
chirlu
I looked on the FreeDB gateway already with extundelete, but there was no trace of it.
2016-11-11 31639, 2016
alastairp
ah, can't do it on a mounted partition?
2016-11-11 31654, 2016
chirlu
Unsurprisingly, since that was after two days or so, and there had been logs etc. written to the machine.
2016-11-11 31654, 2016
chirlu
For when did you set the cronjob to run?
2016-11-11 31658, 2016
alastairp
h:15
2016-11-11 31645, 2016
chirlu
You can, the chances are just better if the partition is no longer written to.
2016-11-11 31652, 2016
Zastai joined the channel
2016-11-11 31622, 2016
chirlu
I couldn’t unmount either, to I let it write the undeleted files to a different partition instead.
2016-11-11 31648, 2016
alastairp
don't have one of them around (spike, the acousticbrainz server)
2016-11-11 31613, 2016
chirlu
AB is up, isn’t it, and accepting submissions? Then it’s very, very unlikely that any deleted file hasn’t been overwritten yet.
2016-11-11 31613, 2016
alastairp
lots of free disk space
2016-11-11 31633, 2016
Zastai|2 joined the channel
2016-11-11 31600, 2016
chirlu
Well, just try it (even on the same partition). Can’t happen more than that the file isn’t found.
2016-11-11 31619, 2016
alastairp
how do you run it? extundelete --restore-file tmp/replication-99848.tar.bz2 /dev/sda1 ?
2016-11-11 31645, 2016
chirlu
Yes, should work.
2016-11-11 31605, 2016
alastairp
should I be in a tmpfs or something?
2016-11-11 31615, 2016
chirlu
I just ran extundelete /dev/sda1, which will restore everything it finds.
2016-11-11 31631, 2016
Zastai has quit
2016-11-11 31635, 2016
chirlu
If you have one ready, why not. :)
2016-11-11 31649, 2016
chirlu
Avoids writes to the main partition in any case.
2016-11-11 31600, 2016
alastairp
nope, not found
2016-11-11 31640, 2016
chirlu
Thanks for trying, though. :)
2016-11-11 31655, 2016
alastairp
np
2016-11-11 31633, 2016
UmkaDK
ruaok: pong :)
2016-11-11 31653, 2016
UmkaDK
chirlu: Yep, we might have spoke to soon there ... :(
2016-11-11 31628, 2016
chirlu
It seems most likely that you will need to do a fresh import.
2016-11-11 31603, 2016
chirlu
That is the “works immediately” way, in any case.
2016-11-11 31633, 2016
chirlu
If you want to wait, it’s possible but not that likely that we find back the missing packet.
2016-11-11 31628, 2016
chirlu
We’ve also considered recreating it. For that, we would need a database as it is before the missing packet.
2016-11-11 31658, 2016
chirlu
Meaning: It would be great if you could provide us with a dump of your replicated DB. :-)
2016-11-11 31633, 2016
chirlu
But only if it isn’t too much work, because otherwise it isn’t worth it for the relatively low chance to fix things.
2016-11-11 31627, 2016
UmkaDK
chirlu: I've composed myself and is now ready for the news ... ?? :)
2016-11-11 31634, 2016
Gore|woerk has quit
2016-11-11 31651, 2016
chirlu
See above. :) The news is that you may have to do a fresh import.
2016-11-11 31650, 2016
UmkaDK
... oh ... OOoohhhhh!! :(
2016-11-11 31604, 2016
chirlu
UmkaDK: And you could help us by giving us a dump of the DB, because if (if) we still have the dump from OldHost, we could possibly recreate the missing packet from those two.
2016-11-11 31634, 2016
UmkaDK
would a dump at 99847 help?
2016-11-11 31641, 2016
drsaunder has quit
2016-11-11 31652, 2016
UmkaDK
or do you need it to be older then that?
2016-11-11 31631, 2016
chirlu
alastairp: You hit the perfect moment with your *:15 – the packet was ready at :12 and probably available for download at :13; it went down around :28.
2016-11-11 31614, 2016
chirlu
UmkaDK: Yes, at 99847. We might have the state as of 99848, but we need the previous one to compute a diff, essentially.
2016-11-11 31659, 2016
UmkaDK
kk, no worries! give me a few minutes, and I'll let you know what I can do
2016-11-11 31649, 2016
UmkaDK
Ok, we are going to try and export our DB (replication sequence 99847) and put it somewhere where you can download it guys.
