ruaok: dump (recordings) for month of may copied to your account.
c1e0_ has quit
eharris joined the channel
shivam-kapila joined the channel
Etua joined the channel
Etua has quit
Etua joined the channel
Etua has quit
Gazooo has quit
Gazooo joined the channel
shivam-kapila has quit
Etua joined the channel
D4RK-PH0ENiX has quit
SomalRudra joined the channel
D4RK-PH0ENiX joined the channel
ruaok
iliekcomputers: Inserted 50000 rows in 1.409, 35489 rows/s. Total 1550000
with SSDs and correct insert order and tuned chunk size.
this level was consistent over 10M listens.
once my sort finishes, I'll try with the full dump
iliekcomputers
Sounds like a plan
The cron job for stats is working
ruaok
great.
iliekcomputers
I'm gonna write a job for importing new full dumps
And that should be enough for us to monitor for a few weeks
ferbncode: are you around by any chance?
darkstardevx joined the channel
Raghav joined the channel
raven__ has quit
raven__ joined the channel
darkstardevx has quit
prakhar_ joined the channel
prakhar_
Hello eveyone!
yvanzo
hi prakhar_!
BrainzGit
[listenbrainz-server] paramsingh opened pull request #743 (master…param/add-data-dump-import-request): [wip] Automate new data dump imports into the spark cluster https://github.com/metabrainz/listenbrainz-serv...
I was trying to setup bookbrainz local server. While running the database script I am getting an error
```postgres:5432 - no response
Postgres is not ready - sleeping...```
Any idea why this is happening?
ruaok
your postgres didn't start. check how postgres was started
prabal has quit
prabal joined the channel
Etua has quit
Etua joined the channel
Etua has quit
prakhar has quit
prakhar joined the channel
Sophist-UK joined the channel
Etua joined the channel
prakhar has quit
Chinmay3199
Okay I will try
ruaok
copying files at 200Mb/s O_O
filling my very first hard drive about 7 times a second. lol.
zas
In fact, it would have exploded on the 3rd time.... ;)
ruaok
srsly.
> 186GB 189.9MB/s 16:44
😍
and the originating server is still trying to gzip that file. ok, never mind compression then.
ok, finally starting the full sorted import of all the LB data. Let's see if this finishes in a reasonable amount of time..
Sophist_UK joined the channel
yvanzo
zas: Is there a way to expose solrcloud admin/collections to a specific container through haproxy?
Sophist-UK has quit
zas
yes, likely. But what do you want to achieve? the current haproxy setup was made quite restrictive because of the insecure nature of solr...
though SIR has extended access (IP-based restrictions)
yvanzo
BACKUP from a dedicated mb container on williams
it may also involve running commands from that container on solrcloud leader.
Sophist-UK joined the channel
amCap1712
A few more people had tested the plugin and given feedback on the forums. The ListenBrainz plugin for VLC works on all three platforms: Linux, Windows and macOS. Should I wait for more people to test or prepare a patch to submit upstream ?
iliekcomputers
amCap1712: i think just submit upstream, and monitor if bugs come in and fix as appropriate
I also updated the docs with the instructions to run frontend tests
Please have a look
iliekcomputers
ishaanshah[m]: awesome!
yeah, looking.
thanks!
ishaanshah[m]
Also I was interested in the graph generation project for gsoc
iliekcomputers
did you see my comment about not putting tests in `__tests__` and instead just keeping them next to the file they're testing.
?
ishaanshah[m]
Oh i missed that one
Etua joined the channel
I'll change it
iliekcomputers
ishaanshah[m]: just a few small comments and this should be mergeable
ishaanshah[m]
>Also I was interested in the graph generation project for gsoc
Do you have a small task that can help me get familiarised with the apache codebase
I have some ideas about some graphs and stats being generated
I will list them down so that we can discuss upon that
Etua_ joined the channel
iliekcomputers
ishaanshah[m]: i'll look into something that helps you understand how our spark stuff works. leave that with me for now.
the local development environment for the spark stuff is a bit immature right now. it needs some looking after.
Etua has quit
Etua_ is now known as Etua
i haven't read shivam-kapila's docs PR but that might have some stuff that you find interesting.
however, if you can start building the frontend of some graphs that you think we should have (just assume the format of the data you have), that'd be nice.
just make sure to co-ordinate with shivam-kapila on this so that you don't duplicate work.
does that sound good?
ishaanshah[m]
Yep, sounds good thanks a lot
iliekcomputers
(also, i'd really appreciate it if we could add more tests to the last.fm importer, that task has a huge impact to the graphs project indirectly because it makes frontend dev so much easier)