13:05 PM
ruaok
O_O
2015-04-26 11609, 2015
13:06 PM
ruaok
the query works. but gives a blank result.
2015-04-26 11622, 2015
13:06 PM
rvedotrc
is ns1 their auth server, or a resolver?
2015-04-26 11630, 2015
13:06 PM
ruaok
not sure
2015-04-26 11641, 2015
13:06 PM
rvedotrc
if auth, then it's ok for it to refuse.
2015-04-26 11603, 2015
13:07 PM
rvedotrc
my guess is that we're only allowed to query via their resolvers, 72.29.161.2 and .1
2015-04-26 11609, 2015
13:07 PM
rvedotrc
as you say, firewall.
2015-04-26 11633, 2015
13:07 PM
rvedotrc
Anyway, all good now.
2015-04-26 11647, 2015
13:07 PM
ruaok
thanks again!
2015-04-26 11657, 2015
13:07 PM
ruaok
I'll go for a ride and then I'll work on getting services moved again.
2015-04-26 11616, 2015
13:08 PM
ruaok
this time I'll start with the mail-mx, since that was one thing I never tested.
2015-04-26 11619, 2015
13:08 PM
ruaok
OH. one more Q.
2015-04-26 11621, 2015
13:08 PM
ruaok
or two.
2015-04-26 11625, 2015
13:08 PM
rvedotrc
?
2015-04-26 11630, 2015
13:08 PM
ruaok
the logger service that we have running on an ip...
2015-04-26 11635, 2015
13:08 PM
ruaok looks
2015-04-26 11650, 2015
13:08 PM
ruaok
10.1.1.249 -- what is it and how do I test it?
2015-04-26 11605, 2015
13:09 PM
ruaok
same goes for .246 -- monitor.
2015-04-26 11649, 2015
13:10 PM
rvedotrc
249 is on scooby. It's a syslog service. It's up to us to define if it's useful, I guess.
2015-04-26 11620, 2015
13:11 PM
rvedotrc
.246 is the source address used by the gateways when they query machines on the network for nagios checks.
2015-04-26 11637, 2015
13:11 PM
ruaok
249 is not in use then?
2015-04-26 11642, 2015
13:11 PM
rvedotrc
so nothing "runs on" .246
2015-04-26 11657, 2015
13:11 PM
rvedotrc
well. scooby is still up, and it has that IP...
2015-04-26 11605, 2015
13:12 PM
ruaok
oh, scooby.
2015-04-26 11623, 2015
13:12 PM
ruaok
ok, I'll nuke that from the list and then only do a ping test on .246
2015-04-26 11635, 2015
13:12 PM
ruaok
that should suffice, yes?
2015-04-26 11603, 2015
13:13 PM
rvedotrc
Not sure what you mean.
2015-04-26 11623, 2015
13:13 PM
rvedotrc
If you want a syslogger, then ~something~ needs to have that IP, and log what it receives.
2015-04-26 11628, 2015
13:13 PM
rvedotrc
If not, then ~meh~.
2015-04-26 11646, 2015
13:13 PM
ruaok
testing wise -- that when I move the IP, I just need to ping .246 and if response, I'm done.
2015-04-26 11600, 2015
13:14 PM
ruaok
I'll just leave .249 alone for the time being, since I'm not touching scooby.
2015-04-26 11614, 2015
13:14 PM
rvedotrc
For 246, the symptom of getting it wrong will be failing nagios checks on many machines.
2015-04-26 11626, 2015
13:14 PM
ruaok
very obvious, in other words. :)
2015-04-26 11629, 2015
13:14 PM
ruaok
good good.
2015-04-26 11631, 2015
13:14 PM
rvedotrc
Assuming we still use nagios :_)
2015-04-26 11656, 2015
13:14 PM
ruaok
we do.
2015-04-26 11605, 2015
13:15 PM
ruaok
I recently spent some time cleaning things up a bit.
2015-04-26 11618, 2015
13:15 PM
ruaok
finally, we'd love a clue (or fix, if your up for it) on this:
2015-04-26 11619, 2015
13:15 PM
ruaok
2015-04-26 11649, 2015
13:15 PM
ruaok
during some failure, carl running out of disk, i think, these graphs stopped. ian has looked at it, but couldn't work out the issue.
2015-04-26 11624, 2015
13:16 PM
ruaok
all of the nginx-rrd graphs stopped working.
2015-04-26 11634, 2015
13:16 PM
rvedotrc
eww. OK. Will look later.
2015-04-26 11640, 2015
13:16 PM
ruaok
lol
2015-04-26 11642, 2015
13:16 PM
ruaok
k.
2015-04-26 11647, 2015
13:16 PM
ruaok
I'm off for a ride then.
2015-04-26 11648, 2015
13:16 PM
ruaok
thanks!
2015-04-26 11659, 2015
13:17 PM
Freso
ruaok: "lsmod now needs a sort option,", it has one: `man sort` ;)
2015-04-26 11622, 2015
13:30 PM
LordSputnik joined the channel
2015-04-26 11609, 2015
14:00 PM
alastairp
Gentlecat: importing the first incremental dump doesn’t work - conflicts with the statistics table
2015-04-26 11619, 2015
14:00 PM
alastairp
maybe incremental always dumps all statistics?
2015-04-26 11630, 2015
14:02 PM
Gentlecat
2015-04-26 11656, 2015
14:05 PM
alastairp
also, AB-44
2015-04-26 11602, 2015
14:06 PM
alastairp
which is more urgent
2015-04-26 11611, 2015
14:06 PM
alastairp
we import highlevel first
2015-04-26 11616, 2015
14:06 PM
alastairp
but it has a FK to lowlevel
2015-04-26 11641, 2015
14:06 PM
alastairp
so once you have FK constraints set up, this fails
2015-04-26 11628, 2015
14:07 PM
alastairp
one final question, does the dump of highlevel only dump things that we also did in lowlevel? or still based on the dates?
2015-04-26 11642, 2015
14:07 PM
Gentlecat
you are importing data using import_data command, right?
2015-04-26 11644, 2015
14:07 PM
alastairp
yes
2015-04-26 11629, 2015
14:08 PM
alastairp
if a low-level track is submitted, timestamp x, we create a dump point x + 1, then the highlevel of that track is created x + 2, then we perform the dump at x + 3
2015-04-26 11631, 2015
14:08 PM
Gentlecat
yeah, I guess we should drop constraints there before importing like it's done in init_db
2015-04-26 11645, 2015
14:08 PM
alastairp
is the highlevel track included?
2015-04-26 11606, 2015
14:09 PM
alastairp
or left for the next one, because it was created after the date in the dump table
2015-04-26 11624, 2015
14:09 PM
alastairp
yeah, dropping constraints could be dangerous… I’m not sure
2015-04-26 11652, 2015
14:09 PM
alastairp
should the mirror be unavailable during an import?
2015-04-26 11654, 2015
14:12 PM
alastairp
2015-04-26 11611, 2015
14:13 PM
Gentlecat
to your first question: everything is based on dates right now
2015-04-26 11631, 2015
14:13 PM
Gentlecat
so it is assumed that you have all previous incremental dumps imported before that
2015-04-26 11656, 2015
14:13 PM
Gentlecat
maybe we should do something different for json dumps
2015-04-26 11631, 2015
14:14 PM
alastairp
that’s not exactly what I’m asking - there may be a possible race condition that incremental dump 2 has the lowlevel row, but the highlevel row won’t appear until incr dump 3
2015-04-26 11650, 2015
14:14 PM
reosarevok joined the channel
2015-04-26 11638, 2015
14:15 PM
Gentlecat
oh, and highlevel data is going to be calculated before next dump is imported?
2015-04-26 11635, 2015
14:16 PM
alastairp
don’t worry about a mirror - assume that the mirror doesn’t run any highlevel computation, or accept submission
2015-04-26 11604, 2015
14:19 PM
Gentlecat
ok, I don't understand what the problem is then
2015-04-26 11618, 2015
14:19 PM
alastairp
let me find the code and see if it’s a problem
2015-04-26 11640, 2015
14:21 PM
alastairp
2015-04-26 11654, 2015
14:21 PM
alastairp
this uses `now()` as the value for `highlevel.submitted`
2015-04-26 11640, 2015
14:22 PM
alastairp
so, highlevel.submitted is always later in time than lowlevel.submitted - because the high level tool runs in batches
2015-04-26 11652, 2015
14:22 PM
Gentlecat
right
2015-04-26 11637, 2015
14:23 PM
alastairp
this means there’s a theoretical condition where I could set a incremental dump to include all submissions that occur before a set time
2015-04-26 11649, 2015
14:23 PM
alastairp
and this time could include the lowlevel for a track, but not the highlevel
2015-04-26 11629, 2015
14:26 PM
Gentlecat
and you want that highlevel data to be in the same incremental dump?
2015-04-26 11648, 2015
14:26 PM
alastairp
yes, I think it makes senese
2015-04-26 11646, 2015
14:27 PM
alastairp
2015-04-26 11647, 2015
14:27 PM
Gentlecat
but think about how it would work if you need to create next incremental dump and highlevel data is not calculated yet
2015-04-26 11656, 2015
14:27 PM
alastairp
yes, this is also a problem
2015-04-26 11600, 2015
14:28 PM
Gentlecat
from cron job, let's say
2015-04-26 11615, 2015
14:29 PM
alastairp
2 solutions: 1) always do an incremental dump from earlier than now - so a dump at 3pm only accepts tracks submitted up to 2pm
2015-04-26 11635, 2015
14:29 PM
alastairp
2) since the lowlevel dump is going to take so long, we can assume that highlevel will be ready by then
2015-04-26 11637, 2015
14:29 PM
Gentlecat
and it means we need to make sure that all lowlevel datasets have highlevel caluclated before allowing to create a dump
2015-04-26 11642, 2015
14:29 PM
alastairp
or 3) ...
2015-04-26 11645, 2015
14:29 PM
alastairp
yeah, what you said
2015-04-26 11649, 2015
14:29 PM
alastairp
actually verify beforehand
2015-04-26 11603, 2015
14:30 PM
Gentlecat
otherwise it will cause a lot of conflicts and you aren't going to be able to import anything
2015-04-26 11643, 2015
14:30 PM
alastairp
do you understand the problem now? can you write an issue that you understand
2015-04-26 11608, 2015
14:31 PM
Gentlecat
I don't quite understand why it is a problem
2015-04-26 11645, 2015
14:31 PM
Gentlecat
that you have to wait for a month for that highlevel data if it's missing?
2015-04-26 11612, 2015
14:32 PM
alastairp
yes
2015-04-26 11619, 2015
14:32 PM
Gentlecat
ok, yeah
2015-04-26 11631, 2015
14:32 PM
alastairp
the majority of people who will run a mirror will be running it because they actually want this information
2015-04-26 11606, 2015
14:33 PM
Gentlecat
should they be able to calculate highlevel data on their mirrors?
2015-04-26 11611, 2015
14:33 PM
alastairp
no
2015-04-26 11617, 2015
14:33 PM
alastairp
because that’s just going to result in pain
2015-04-26 11630, 2015
14:33 PM
Gentlecat
and no submissions, right?
2015-04-26 11635, 2015
14:33 PM
alastairp
yeah
2015-04-26 11646, 2015
14:33 PM
Gentlecat
because "mirror", got it
2015-04-26 11649, 2015
14:33 PM
alastairp
but for now, probably just informally
2015-04-26 11612, 2015
14:34 PM
alastairp
that is, we allow them to if they want to, but with no guarantees as to what happens the next time they try and load an incremental
2015-04-26 11643, 2015
14:34 PM
Gentlecat
yeah
2015-04-26 11606, 2015
14:35 PM
alastairp
the main people we should support are those who just want a copy of the database
2015-04-26 11632, 2015
14:35 PM
alastairp
we can try and support others who are a bit more tech-savvy and can work around issues that they might create
2015-04-26 11648, 2015
14:35 PM
alastairp
but we shouldn’t go out of our way to do stuff if it makes more work for us
2015-04-26 11651, 2015
14:35 PM
Gentlecat
can you create a ticket so we can keep track of all that?
2015-04-26 11602, 2015
14:36 PM
alastairp
ok
2015-04-26 11632, 2015
14:36 PM
Gentlecat
I'll think how to implement all that
2015-04-26 11647, 2015
14:36 PM
alastairp
:D
2015-04-26 11641, 2015
14:38 PM
Sebastinas
Are there any plans shutting down WS/1 or will it continue to be available for the next couple of years?
2015-04-26 11644, 2015
14:38 PM
Gentlecat
probably next week, still have some other things I need to get done
2015-04-26 11600, 2015
14:39 PM
alastairp
Sebastinas: years might be stretching it
2015-04-26 11627, 2015
14:39 PM
alastairp
at a guess, it might disappear when we release ws/3, but that’s barely in the planning stage yet
2015-04-26 11634, 2015
14:39 PM
alastairp
why do you still want to use ws1?
2015-04-26 11606, 2015
14:40 PM
Sebastinas
I don't. I'd like to push for a removal of libmusicbrainz3 which still uses WS/1.
2015-04-26 11613, 2015
14:40 PM
Sebastinas
(In Debian)
2015-04-26 11619, 2015
14:40 PM
alastairp
ahh
2015-04-26 11643, 2015
14:40 PM
Sebastinas
Having a date would make that a lot easier.
2015-04-26 11652, 2015
14:40 PM
alastairp
does anything still depend on it?
2015-04-26 11603, 2015
14:41 PM
Sebastinas
kicad and gnome-mplayer
2015-04-26 11618, 2015
14:41 PM
alastairp
urg
2015-04-26 11651, 2015
14:41 PM
Sebastinas
s/kicad/kscd/
2015-04-26 11618, 2015
14:42 PM
alastairp
ah, that looks better
2015-04-26 11645, 2015
14:42 PM
alastairp
I can’t give you a more concrete answer
2015-04-26 11604, 2015
14:43 PM
alastairp
you could get better feedback if you posted to the musicbrainz-devel mailing list
2015-04-26 11610, 2015
14:43 PM
Gentlecat
alastairp: I updated that comment about data editor. Is it still unclear?
2015-04-26 11656, 2015
14:43 PM
alastairp
my feeling is that no one here will have bad feelings if the bindings disappear, but I understand if that’s not a strong enough statement for you
2015-04-26 11647, 2015
14:44 PM
alastairp
Gentlecat: ah, right. yeah, I expected that someone who wanted to view the dataset could also see the metadata
2015-04-26 11615, 2015
14:45 PM
Gentlecat
it would be more friendly than MBIDs, for sure
2015-04-26 11615, 2015
14:45 PM
alastairp
if there was no plan to show metadata on ‘view’, I would argue that it’s not needed on ‘create’ either
2015-04-26 11639, 2015
14:45 PM
alastairp
but if we do show metadata, anywhere in the editor, it should be cached through the server
2015-04-26 11604, 2015
14:46 PM
alastairp
certain amount of time, is what I was thinking
2015-04-26 11602, 2015
14:48 PM
Gentlecat
not sure which "view" and "create" you are talking about
2015-04-26 11620, 2015
14:49 PM
Gentlecat
I assume we'll need some way to display public datasets on the website
2015-04-26 11659, 2015
14:49 PM
ruaok
Freso: I'm too lazy to type " | sort" :)
2015-04-26 11651, 2015
14:50 PM
alastairp
create - when someone is making a dataset and adding a mbid to a class
2015-04-26 11658, 2015
14:50 PM
kepstin-laptop joined the channel
2015-04-26 11659, 2015
14:50 PM
alastairp
view, when someone is looking at all of the things in a dataset
2015-04-26 11614, 2015
14:54 PM
alastairp
poor postgres
2015-04-26 11618, 2015
14:54 PM
alastairp
not happy with acousticbrainz=> delete from highlevel_json;
2015-04-26 11630, 2015
14:54 PM
ruaok
truncate is much faster.
2015-04-26 11631, 2015
14:54 PM
alastairp
oh. I guess I should have used truncate
2015-04-26 11636, 2015
14:54 PM
alastairp
snap
