regarding the highlevel dump, this one won't need to select an element of a json column, so we could just `\copy (select highlevel as ll_row_id, data from highlevel_model where model in (our models))`
this is what spotify has for the Cantelowes track ruaok shared earlier. AB has 185 BPM for this.
2021-12-01 33552, 2021
monkey
Is there a way we can sort items by the most confident high level indicator, for example for this one maybe 'loudness', for another track might be 'danceability' ?
2021-12-01 33536, 2021
alastairp
yeah, that's why I wanted to consider using bpm_histogram_first_peak_weight, but it seems that there are many cases where it's pretty confident with this value as well
2021-12-01 33537, 2021
lucifer
is this an issue with just high bpm recordings or can occur in any type of recordings. if its just high, then we could try querying spotify if a bpm is above a threshold?
2021-12-01 33546, 2021
lucifer
but regardless, querying the bpm's spotify has and comparing with AB might be a nice way to detect issues with AB data and possibly identify the issue with the bpm detection alg.
2021-12-01 33549, 2021
alastairp
no, sorry
2021-12-01 33534, 2021
yvanzo
Rescheduled MB search indexes dump to run soon (11:40 UTC) with I/O patch.
it suggests that it could work, if we had sufficient coverage in AB.
2021-12-01 33559, 2021
alastairp
a shame that we didn't get around to finishing the mbid redirect table task
2021-12-01 33517, 2021
alastairp
lucifer: maybe we should just go with the external database for this for now so that we can get a bunch of improvements made
2021-12-01 33544, 2021
lucifer
sure, sounds good to me.
2021-12-01 33544, 2021
alastairp
maybe I'll have a look at that this week
2021-12-01 33543, 2021
lucifer
so something like setting up a cron job that queries all recording_redirect entries since last run and then update recording mbids in AB tables?
2021-12-01 33510, 2021
alastairp
no, I'd do it on demand. you query an MBID, it looks up all of the possible redirects, then it returns you data for all submissions for all mbids in the "set"
2021-12-01 33534, 2021
alastairp
this way, the results of a query don't change over time
2021-12-01 33541, 2021
lucifer
i see. if you want i could take a quick stab at it, put it on ab beta so that ruaok can test it.
2021-12-01 33519, 2021
ruaok
lucifer: alastairp : I think you two can stop working on an of this stuff. its just not useful.
2021-12-01 33527, 2021
ruaok
lets go back to whatever original tasks we had.
2021-12-01 33537, 2021
ruaok
alastairp: do we have any algorithms that we incorporate into a new-AB? Let assume for a second we ditch our AB DB and start over. How would we do that?
2021-12-01 33518, 2021
ruaok
can we collect better data with much smaller segment times that would allow us to build better algorithms for better feature detection later?
[bookbrainz-site] 14dependabot[bot] opened pull request #726 (03master…dependabot/npm_and_yarn/normalize-url-4.5.1): chore(deps): bump normalize-url from 4.5.0 to 4.5.1 https://github.com/bookbrainz/bookbrainz-site/pul…
[bookbrainz-site] 14dependabot[bot] closed pull request #726 (03master…dependabot/npm_and_yarn/normalize-url-4.5.1): chore(deps): bump normalize-url from 4.5.0 to 4.5.1 https://github.com/bookbrainz/bookbrainz-site/pul…
2021-12-01 33507, 2021
BrainzGit
[bookbrainz-site] 14dependabot[bot] opened pull request #727 (03master…dependabot/npm_and_yarn/postcss-8.4.4): chore(deps): bump postcss from 8.2.4 to 8.4.4 https://github.com/bookbrainz/bookbrainz-site/pul…
2021-12-01 33507, 2021
BrainzGit
[bookbrainz-site] 14dependabot[bot] opened pull request #728 (03master…dependabot/npm_and_yarn/browserslist-4.18.1): chore(deps): bump browserslist from 4.12.0 to 4.18.1 https://github.com/bookbrainz/bookbrainz-site/pul…
2021-12-01 33515, 2021
BrainzGit
[bookbrainz-site] 14dependabot[bot] opened pull request #729 (03master…dependabot/npm_and_yarn/webpack-5.64.4): chore(deps-dev): bump webpack from 5.12.3 to 5.64.4 https://github.com/bookbrainz/bookbrainz-site/pul…
2021-12-01 33520, 2021
BrainzGit
[bookbrainz-site] 14dependabot[bot] closed pull request #717 (03master…dependabot/npm_and_yarn/webpack-5.64.2): chore(deps-dev): bump webpack from 5.12.3 to 5.64.2 https://github.com/bookbrainz/bookbrainz-site/pul…
2021-12-01 33543, 2021
monkey
Yeah, that's right !
2021-12-01 33555, 2021
monkey
Go Dependabot, go !
2021-12-01 33557, 2021
monkey
Solving security alerts by removing a security alert mitigation tool. How ironic.
2021-12-01 33505, 2021
BrainzGit
[bookbrainz-site] 14MonkeyDo merged pull request #728 (03master…dependabot/npm_and_yarn/browserslist-4.18.1): chore(deps): bump browserslist from 4.12.0 to 4.18.1 https://github.com/bookbrainz/bookbrainz-site/pul…
I tried to log into a musicbrainz-website-prod container and run ./admin/RunReports.pl but I get
2021-12-01 33509, 2021
reosarevok
root@4bd87d4e8684:/home/musicbrainz/musicbrainz-server# ./admin/RunReports.pl Can't locate List/AllUtils.pm in @INC (you may need to install the List::AllUtils module) (@INC contains: /home/musicbrainz/musicbrainz-server/admin/../lib /etc/perl /usr/local/lib/x86_64-linux-gnu/perl/5.30.0 /usr/local/share/perl/5.30.0 /usr/lib/x86_64-linux-gnu/perl5/5.30 /usr/share/perl5 /usr/lib/x86_64-linux-gnu/perl/5.30 /usr/share/perl/5.30
2021-12-01 33510, 2021
reosarevok
/usr/local/lib/site_perl /usr/lib/x86_64-linux-gnu/perl-base) at ./admin/RunReports.pl line 8. BEGIN failed--compilation aborted at ./admin/RunReports.pl line 8.
2021-12-01 33534, 2021
reosarevok
yvanzo, bitmap: how do you run reports manually when needed? I know at least bitmap has done that in the past
2021-12-01 33517, 2021
reosarevok
I mean, I assume the answer is not "run cpanm"
2021-12-01 33511, 2021
akshaaatt
Spotify wrapped has dropped for this year
2021-12-01 33526, 2021
akshaaatt
Ngl it is pretty good
2021-12-01 33507, 2021
alastairp
hi reosarevok, I saw more feedback from you on the genres, thanks
2021-12-01 33526, 2021
reosarevok
np :) Happy to help with whatever comes next
2021-12-01 33516, 2021
alastairp
as I said last week, I'll go through the first sheet and hard-code all of our decisions that we weren't able to do automatically. Once that looks good I'll put together a tag submitter
ruaok: good question. there are new feature extractors in essentia that do more detailed low level features. now that deep learning algorithms seem to give good results (especially for classification), this seems to be the minimum required amount of data
2021-12-01 33501, 2021
alastairp
in fact, I was speaking with Dmitry about this a few weeks ago, and he thinks that they're close with a proposed extractor that we could include in AB in order to have better features
2021-12-01 33513, 2021
ruaok
are any of them good enough for to think about an AB reboot?
2021-12-01 33550, 2021
alastairp
yes, he and I are planning on prototyping a data refresh if not by the end of this year, definitely early next year
2021-12-01 33511, 2021
ruaok
are you in the office tomorrow?
2021-12-01 33512, 2021
alastairp
I think it's been interesting to see how the scale of AB "breaks" many of the algorithms in essentia - we knew this early on with the machine learning stuff
2021-12-01 33537, 2021
alastairp
but the bpm stuff is interesting too. there are a lot of good results, but we just have so much stuff that there is also bad stuff too
2021-12-01 33518, 2021
alastairp
office - unsure. laptop is out for repair and I'm not 100% healthy yet
2021-12-01 33532, 2021
ruaok
ok, next week then.
2021-12-01 33519, 2021
ruaok
but I am rather down on AB right now. I'm questioning the further existence of the project. at very least we need to have a hard look at our short term plans.
2021-12-01 33557, 2021
ruaok
right now we're putting on band-aids and performance improvements of something that seems entirely worthless to me.
2021-12-01 33556, 2021
ruaok
so, question for next week: What should the MVP for AB so that it can provide some value to its users?
2021-12-01 33523, 2021
alastairp
right, we're going to have to think about the value of 100% automated algorithms that we just set and forget
2021-12-01 33509, 2021
ruaok
and we need to think about being able to iterate on the algorithms more easily.
