10:46 AM
alastairp
the main drive is resyncing (probably because of reallocated bad sectors)
2018-08-22 23458, 2018
10:46 AM
alastairp
this is going to affect the speed of the dumps (and the dumps will affect the speed of the resync)
2018-08-22 23417, 2018
10:47 AM
alastairp
12 days to finish the resync
2018-08-22 23454, 2018
10:47 AM
iliekcomputers
okay, so they should be a bit faster on frank then.
2018-08-22 23405, 2018
10:48 AM
alastairp
what disks does frank have?
2018-08-22 23419, 2018
10:48 AM
iliekcomputers
let me check
2018-08-22 23452, 2018
10:49 AM
CatQuest
I'm going out for a bit, but LordSputnik, pong me when you have a test ready for me :D
2018-08-22 23439, 2018
10:50 AM
iliekcomputers
2018-08-22 23419, 2018
10:51 AM
iliekcomputers
2018-08-22 23425, 2018
10:51 AM
alastairp
right, normal spinning disks, then
2018-08-22 23441, 2018
10:51 AM
iliekcomputers
yes
2018-08-22 23443, 2018
10:51 AM
iliekcomputers
7200 rpm
2018-08-22 23400, 2018
10:53 AM
iliekcomputers was on 5400 rpm hdds until a few months ago
2018-08-22 23404, 2018
10:53 AM
iliekcomputers
:/
2018-08-22 23428, 2018
10:58 AM
ruaok
4TB is SSD is quite expensive. :(
2018-08-22 23440, 2018
10:58 AM
ruaok
*of
2018-08-22 23405, 2018
10:59 AM
alastairp
I can imagine
2018-08-22 23436, 2018
10:59 AM
iliekcomputers
lolyea
2018-08-22 23423, 2018
11:09 AM
iliekcomputers
another 30GB file done and being compressed rn
2018-08-22 23432, 2018
11:09 AM
alastairp
mmm. faster??
2018-08-22 23431, 2018
11:11 AM
Nyanko-sensei joined the channel
2018-08-22 23403, 2018
11:12 AM
iliekcomputers
this is the second one, I don't think so, I think it took around the same time.
2018-08-22 23457, 2018
11:12 AM
D4RK-PH0ENiX has quit
2018-08-22 23420, 2018
11:14 AM
clarjon1 joined the channel
2018-08-22 23420, 2018
11:14 AM
clarjon1 has quit
2018-08-22 23401, 2018
11:16 AM
Nyanko-sensei has quit
2018-08-22 23406, 2018
11:31 AM
Mr_Monkey has quit
2018-08-22 23426, 2018
11:32 AM
bhargav joined the channel
2018-08-22 23450, 2018
11:32 AM
bhargav is now known as Guest27381
2018-08-22 23444, 2018
11:33 AM
D4RK-PH0ENiX joined the channel
2018-08-22 23409, 2018
11:35 AM
bukwurm joined the channel
2018-08-22 23411, 2018
11:37 AM
Mr_Monkey joined the channel
2018-08-22 23451, 2018
11:39 AM
Guest27381 has quit
2018-08-22 23422, 2018
11:40 AM
bhargav_prakash joined the channel
2018-08-22 23434, 2018
11:41 AM
bukwurm
2018-08-22 23447, 2018
11:41 AM
bukwurm
2018-08-22 23433, 2018
11:42 AM
bukwurm
I think postgres version is causing issue here.
2018-08-22 23434, 2018
11:42 AM
bhargav_prakash_ joined the channel
2018-08-22 23444, 2018
11:42 AM
bhargav_prakash_ has quit
2018-08-22 23425, 2018
11:43 AM
bukwurm
Later tests which fail are:
2018-08-22 23437, 2018
11:43 AM
bukwurm
`insert into "bookbrainz"."editor_type" ("id", "label") values ($1, $2) returning "id" - relation "bookbrainz.editor_type" does not exist[0m[90m error: relation "bookbrainz.editor_type" does not exist`
2018-08-22 23413, 2018
11:44 AM
bukwurm
I wonder if transaction is aborted then how partial tables are created and remaining tests pass
2018-08-22 23425, 2018
11:47 AM
Mr_Monkey has quit
2018-08-22 23415, 2018
11:54 AM
bhargav_prakash has quit
2018-08-22 23447, 2018
11:54 AM
bhargav_prakash joined the channel
2018-08-22 23432, 2018
12:04 PM
Mr_Monkey joined the channel
2018-08-22 23437, 2018
12:07 PM
bukwurm
Postgres version is 9.6.6, so something else is perhaps the matter.
2018-08-22 23407, 2018
12:13 PM
LordSputnik
CatQuest: won't be today I'm afraid, had guests over last night and I'm out tonight - but the code is working now and I just need to commit everything and update the server, so maybe I can do that tomorrow night
2018-08-22 23409, 2018
12:15 PM
CatQuest
:(
2018-08-22 23431, 2018
12:18 PM
AC`97_ joined the channel
2018-08-22 23417, 2018
12:19 PM
AC`97_ has quit
2018-08-22 23427, 2018
13:05 PM
Mr_Monkey
bukwurm Thanks, I'll have a look!
2018-08-22 23451, 2018
13:37 PM
bhargav_prakash has quit
2018-08-22 23419, 2018
14:14 PM
outsidecontext has quit
2018-08-22 23423, 2018
14:34 PM
outsidecontext joined the channel
2018-08-22 23407, 2018
14:42 PM
Mr_Monkey
2018-08-22 23409, 2018
14:42 PM
kurianbenoy joined the channel
2018-08-22 23440, 2018
14:44 PM
Mr_Monkey
I can't figure out where the postgres configuration is in Travis. I think maybe the version 9.6.6 that bukwurm saw is only that of psql rather than the postgres server version, in which case it might just need an update to >9.4
2018-08-22 23408, 2018
14:49 PM
iw00t21 joined the channel
2018-08-22 23412, 2018
14:49 PM
iw00t21 has quit
2018-08-22 23418, 2018
14:53 PM
outsidecontext has quit
2018-08-22 23452, 2018
14:53 PM
kurianbenoy has quit
2018-08-22 23450, 2018
15:05 PM
bukwurm
Mr_Monkey: Yes, the gist shared showed the cause of error being jsonb type missing
2018-08-22 23417, 2018
15:06 PM
bukwurm
*I shared
2018-08-22 23421, 2018
15:06 PM
bukwurm
jsonb was used to store metadata related to imports
2018-08-22 23402, 2018
15:07 PM
bukwurm
jsonb support I think is in 9.6+ versions
2018-08-22 23434, 2018
15:07 PM
bukwurm
2018-08-22 23443, 2018
15:07 PM
bukwurm
*9.4+
2018-08-22 23455, 2018
15:07 PM
Mr_Monkey
bukwurm Yes, just confirming and doing a recap. Do you have access to the Travis config?
2018-08-22 23423, 2018
15:08 PM
bukwurm
Mr_Monkey: No :/
2018-08-22 23414, 2018
15:09 PM
bukwurm
Mr_Monkey: But I do wonder, if the entire schema creation is done in a single transaction, when it fails how come other tests pass?
2018-08-22 23437, 2018
15:09 PM
bukwurm
Maybe something to do with tests rather than database setup I guess
2018-08-22 23448, 2018
15:13 PM
bukwurm
2018-08-22 23408, 2018
15:14 PM
Mr_Monkey
I'm not familiar enough with the setup yet to venture an educated guess. It looks to me like the schema creation only fails for the last few operations though
2018-08-22 23400, 2018
15:15 PM
Mr_Monkey
Yeah, I saw that configuration, but there's nothing there that describes the postgres server, so I assume there is some extra config somewhere.
2018-08-22 23459, 2018
15:15 PM
bukwurm
Mr_Monkey: I am guessing "npm run-script test-ci" is the one
2018-08-22 23436, 2018
15:16 PM
Mr_Monkey
That's in the bookbrainz-site package.json, and here is what it runs:
2018-08-22 23437, 2018
15:16 PM
Mr_Monkey
nyc --reporter=lcovonly --reporter=text-summary npm run test
2018-08-22 23428, 2018
15:17 PM
bukwurm
That's not it then :P
2018-08-22 23454, 2018
15:21 PM
iliekcomputers
alastairp: 4 files done now.
2018-08-22 23442, 2018
15:23 PM
alastairp
2018-08-22 23445, 2018
15:24 PM
Mr_Monkey
Could it be just that? Thanks alastairp, I'll try that.
2018-08-22 23400, 2018
15:25 PM
alastairp
(not a travis expert)
2018-08-22 23416, 2018
15:25 PM
bukwurm
alastairp: Ok. Could there any other way to specify postgres version on Travis?
2018-08-22 23429, 2018
15:25 PM
alastairp
no idea, sorry
2018-08-22 23434, 2018
15:25 PM
bukwurm
Or for that matter, any other service.
2018-08-22 23438, 2018
15:25 PM
bukwurm
alastairp: Ok
2018-08-22 23413, 2018
15:27 PM
bukwurm
Mr_Monkey: As you're trying it, do tell what happens when you mention the version in the .travis.yml file
2018-08-22 23417, 2018
15:27 PM
bukwurm
:)
2018-08-22 23438, 2018
15:27 PM
Mr_Monkey
Will do
2018-08-22 23402, 2018
15:28 PM
bukwurm
👍
2018-08-22 23403, 2018
15:30 PM
alastairp
2018-08-22 23439, 2018
15:31 PM
alastairp
"The Travis CI build environments use version 9.2 by default on Trusty images, but other versions from the official PostgreSQL APT repository are also available."
2018-08-22 23426, 2018
15:32 PM
bukwurm
That's gotta be it, I think.
2018-08-22 23451, 2018
15:35 PM
Mr_Monkey
bukwurm & alastairp Boom chacka boom ! all tests passing. Thanks for your help !
2018-08-22 23400, 2018
15:36 PM
bukwurm
Mr_Monkey: Awesome
2018-08-22 23433, 2018
15:38 PM
travis-ci joined the channel
2018-08-22 23434, 2018
15:38 PM
travis-ci
2018-08-22 23434, 2018
15:38 PM
travis-ci has left the channel
2018-08-22 23435, 2018
15:38 PM
bukwurm
Mr_Monkey: I think getting webpack integration with module replacement is awesome for the project, it's gonna make development so much easier.
2018-08-22 23413, 2018
15:40 PM
bukwurm
Awesome work 👍
2018-08-22 23441, 2018
15:41 PM
Mr_Monkey
It's quite nice indeed ! Currently the recompilation is a bit long for my taste, but I think I can optimize it.
2018-08-22 23419, 2018
15:42 PM
Mr_Monkey
Using Webpack for production builds I'm still working on, there are a few snags, especially with css/less.
2018-08-22 23426, 2018
15:43 PM
Mr_Monkey
And thanks :)
2018-08-22 23453, 2018
15:56 PM
LordSputnik
bukwurm, Mr_Monkey: nice work guys. I did think I specified postgres 9.4 - perhaps for data-js
2018-08-22 23432, 2018
15:57 PM
LordSputnik
Yeah: bookbrainz-data-js/blob/master/.travis.yml
2018-08-22 23451, 2018
15:57 PM
LordSputnik
2018-08-22 23404, 2018
15:58 PM
LordSputnik
We just need to do the same for the site repo
2018-08-22 23417, 2018
15:58 PM
bukwurm
LordSputnik: I think the confusion due to earlier tests failures due to two versions running complicated the issue
2018-08-22 23453, 2018
15:58 PM
bukwurm
It only today when I really looked at the logs, to find the jsonb issue
2018-08-22 23459, 2018
15:59 PM
bukwurm
LordSputnik: Do you recall what was the issue earlier, when you mentioned something about two version causing race condition or something?
2018-08-22 23455, 2018
16:12 PM
LordSputnik
bukwurm: oh, that turned out to be a missing transaction passed to a bookshelf query
2018-08-22 23410, 2018
16:13 PM
LordSputnik
So it was running outside the transaction
2018-08-22 23440, 2018
16:55 PM
Mr_Monke_ joined the channel
2018-08-22 23413, 2018
16:57 PM
Mr_Monkey has quit
2018-08-22 23419, 2018
17:16 PM
BestSteve joined the channel
2018-08-22 23449, 2018
17:18 PM
BestSteve has quit
2018-08-22 23409, 2018
17:20 PM
bukwurm
LordSputnik: Ok
2018-08-22 23420, 2018
17:25 PM
jwf has quit
2018-08-22 23421, 2018
17:25 PM
moufl has quit
2018-08-22 23421, 2018
17:25 PM
CatQuest has quit
2018-08-22 23421, 2018
17:25 PM
GeneralDiscourse has quit
2018-08-22 23421, 2018
17:25 PM
dseomn has quit
2018-08-22 23459, 2018
17:25 PM
CatQuest joined the channel
2018-08-22 23459, 2018
17:25 PM
dseomn joined the channel
2018-08-22 23445, 2018
17:29 PM
CatQuest has quit
2018-08-22 23445, 2018
17:29 PM
CatQuest joined the channel
2018-08-22 23402, 2018
17:36 PM
badpixel9 joined the channel
2018-08-22 23404, 2018
17:36 PM
badpixel9 has quit
2018-08-22 23408, 2018
17:55 PM
reosarevok
ruaok: see Doug's email, might be interesting :)
2018-08-22 23424, 2018
17:55 PM
yokel joined the channel
2018-08-22 23454, 2018
17:55 PM
yokel has quit
2018-08-22 23454, 2018
17:55 PM
yokel joined the channel
2018-08-22 23401, 2018
17:58 PM
yokel has quit
2018-08-22 23437, 2018
18:00 PM
yokel joined the channel
2018-08-22 23452, 2018
18:00 PM
yokel has quit
2018-08-22 23452, 2018
18:00 PM
yokel joined the channel
2018-08-22 23440, 2018
18:08 PM
Dr-Flay joined the channel
2018-08-22 23438, 2018
18:22 PM
UmkaDK_ has quit
2018-08-22 23446, 2018
18:50 PM
Freso
Sounds like Doug should be put in contact with the people who previously talked about a similar project, maybe?
2018-08-22 23407, 2018
18:54 PM
Freso
Chris Mendez and Mickaël Arcos.
2018-08-22 23402, 2018
18:57 PM
Freso
2018-08-22 23451, 2018
19:01 PM
ephemer0l joined the channel
2018-08-22 23457, 2018
19:01 PM
ephemer0l has quit
2018-08-22 23457, 2018
19:01 PM
ephemer0l joined the channel
2018-08-22 23423, 2018
19:02 PM
moufl joined the channel
2018-08-22 23422, 2018
19:04 PM
ephemer0l is now known as GeneralDiscourse
2018-08-22 23444, 2018
19:05 PM
reosarevok
I can send him that at least :)
2018-08-22 23444, 2018
19:12 PM
Freso
I can also create a follow-up e-mail introducing the two others maybe?
2018-08-22 23431, 2018
19:22 PM
reosarevok
Feel free! :)
