yeah, I saw that LB configures watch automatically if mode is development. I see now how that fits in with the builder container - you always want it running. I added a separate command for it so that we could run build:dev once off if you're doing other stuff, or build;watch if you're developing js
2020-04-28 11911, 2020
iliekcomputers
about the jenkins issue, right now the script `jenkins-test.sh` is in the jenkins config. Maybe we could change the config to just run the script off the git repository instead.
2020-04-28 11956, 2020
alastairp
if that script is only in jenkins, then I agree, probably a good idea
but you're also right that it raises an interesting question about where files generated during runtime should be kept - in the source tree, or in a separate working directory
2020-04-28 11934, 2020
alastairp
I see the value for a working dir, then this could just be another volume somewhere + a config option
2020-04-28 11920, 2020
alastairp
we have a setup at the uni where we can start a container as a user that exists on the host. we do it by creating a user in the Dockerfile and then passing in the user's UID and name as env vars. then the entrypoint runs usermod to change the user's name and uid so that permissions work properly on linux, and it looks like you're logged in as yourself
2020-04-28 11948, 2020
gabbo
yvanzo That's very helpful, thanks a million. I will keep you updated (:
2020-04-28 11957, 2020
gabbo
yvanzo It tells me: `sir: error: unrecognized arguments: -e area`. Is this syntax correct?
LB-542: Expose the artist stats on an API endpoint
2020-04-28 11959, 2020
gabbo
yvanzo Thanks again
2020-04-28 11900, 2020
yvanzo
gabbo: 'recording' search index takes over 80% of the building time, you might want to skip it if you don't need to send recording search requests.
2020-04-28 11923, 2020
alastairp
iliekcomputers: btw, not sure if you saw that I removed the use of the manifest file in development, so now you don't have to restart the webserver when the asset hashes change
2020-04-28 11926, 2020
iliekcomputers
nice, i wasn't aware that that had to be done in AB :D
yvanzo Do live indexing and replication work in my case (not all indexes have been built) ?
2020-04-28 11946, 2020
v6lur has quit
2020-04-28 11922, 2020
sumedh has quit
2020-04-28 11940, 2020
v6lur joined the channel
2020-04-28 11933, 2020
gabbo
yvanzo I'm experiencing the same problem when I try to import the artist. Same kind of exception, the procedure won't end .. Should I open an issue?
2020-04-28 11956, 2020
Zastai joined the channel
2020-04-28 11923, 2020
Zastai
yvanzo: ping
2020-04-28 11930, 2020
gabbo has quit
2020-04-28 11953, 2020
jmp_music has quit
2020-04-28 11934, 2020
yvanzo
Zastai: pong
2020-04-28 11943, 2020
gabbo joined the channel
2020-04-28 11913, 2020
yvanzo
gabbo: yes please, report this issue with as much relevant logs as possible.
2020-04-28 11939, 2020
yvanzo
live indexing cannot skip a particular search index
2020-04-28 11953, 2020
gabbo
Ok thank you. Are there other doable ways to access data from MusicBrainz directly offline?
2020-04-28 11920, 2020
yvanzo
Probably not, but it depends on the info you want to query.
2020-04-28 11952, 2020
shivam-kapila has quit
2020-04-28 11945, 2020
Zastai
I'm trying to get mb-solr op and running, and it's proving challenging. Most of my trouble seems to stem from Java 11 vs Java 8.
2020-04-28 11916, 2020
Zastai
But also, for the tests: do I understand that foo.xml is the input document, and foo-list.xml/json are the expected outputs?
2020-04-28 11932, 2020
gabbo
yvanzo I need a way to retrieve the MBID for artists and release-groups. Once I have those, I can exploit the DB version without the search indices to access other information, granted that I have the IDs at my disposal
2020-04-28 11944, 2020
Zastai
gabbo: define offline. you can download the data dumps and load those into postgres, without setting up the full MB server, and just SQL queries for your data
2020-04-28 11944, 2020
Zastai
and if you only want artists and rgs, you can _probably_ import only those dumps
2020-04-28 11943, 2020
gabbo
yvanzo Offline meaning that I'm currently using the XML WS 2 Apis to do everything I have described before (through the Python library), but that is too slow for my purposes. I need to do so without performing any HTTP calls in the internet
2020-04-28 11901, 2020
gabbo
But querying instead a local dump
2020-04-28 11904, 2020
Zastai
no way to do that and have live data, but if local dump is fine, then you should be able to do as I said - create the postgres db and import the tables you want from the dumps. the you just access pg from python to do lookups there
2020-04-28 11942, 2020
Zastai
download and import takes a while (last time I set up a dev vm I let it run overnight)
yvanzo: see above. and I take it foo.xml (area.xml etc) are supposed to be what sir produces? are they supposed to comply with mmd2-schema? (currently they don't; e.g. <lifespan><ended>false</ended></lifespan> is not valid because <ended> can only contain true)
2020-04-28 11945, 2020
yvanzo
Zastai: tests are not up-to-date indeed.
2020-04-28 11958, 2020
Zastai
I had to update some maven dependencies (com.sun.xml.bind -> javax.bind for brainz-mmd-schema, and jaxb 2.3.1 for mb-solr)
but the tests are still not running (as in: failing for non-functional reasons), in ways I can't really diagnose properly (for example, the json output seems to be "<0>.")
2020-04-28 11953, 2020
Zastai
rather hard to implement fixes for the json output when there is no baseline to work from
2020-04-28 11933, 2020
Zastai
and debian no longer ships a JDK8; guess I'll install a third-party one like Adopt, to rule out issues from that angle
2020-04-28 11929, 2020
gabbo
yvanzo What do you suggest?
2020-04-28 11946, 2020
Zastai
yvanzo: assuming I have time to work on it, would PRs be accepted to try and get things to the point where they run on Java 11 (brainz-mmd-schema and mb-solr)?
2020-04-28 11936, 2020
yvanzo
gabbo: I will look into this issue tomorrow, in the meantime mostly what Zastai suggested.
Zastai: It is based on adoptopenjdk you just mentioned.
2020-04-28 11938, 2020
gabbo
yvanzo Zastai I don't know if I get it right: you suggest to use the dumps with Postgres to retrieve the MBID of Artists and Release-Groups, and, for everything else, use the Offline Server without Search Indices (that I'm not able to build right now)?
2020-04-28 11903, 2020
yvanzo
gabbo: What do you use to retrieve MBID? Artist’s name? If so, there is no easy way for you to do it right now.
2020-04-28 11937, 2020
yvanzo
For example, if you had something like a barcode, it would be easy to directly query directly the database instead.
That seems simpler to fix tests staying with Java 8 at first, just follow the easiest path for you, assuming you have time, that would be awesome.
2020-04-28 11918, 2020
petaaaah joined the channel
2020-04-28 11946, 2020
petaaaah
Anyway, I could get late entry into GSoC?
2020-04-28 11916, 2020
gabbo has quit
2020-04-28 11941, 2020
petaaaah has quit
2020-04-28 11940, 2020
sampsyo has quit
2020-04-28 11925, 2020
sampsyo joined the channel
2020-04-28 11943, 2020
BestSteve has quit
2020-04-28 11935, 2020
BestSteve joined the channel
2020-04-28 11907, 2020
supersandro2000 has quit
2020-04-28 11922, 2020
supersandro2000 joined the channel
2020-04-28 11941, 2020
chaban
Too many broken links in the timeline graph :( I'll stop filing tickets for now.
2020-04-28 11927, 2020
prabal has quit
2020-04-28 11907, 2020
Zastai
yvanzo: not quite up on docker. as for the PRs, the first ones would just be bumped/changing mavend dependencies. for example, brainz-mmd-schema uses a comn.sun.xxx one for jaxb, but that one gets "illegal reflective access" warnings/errors on java 11. switching that to the javax.bind version 2.3.1 resolves that
2020-04-28 11918, 2020
Zastai
and fits in better with mb-solr, whih already uses that (it just needs to go from 2.3.0 to 2.3.1)
