IRC log of musicbrainz on 2004-02-23
Timestamps are in UTC.
- 00:08:46 [jwatk03]
- jwatk03 has left #musicbrainz
- 00:09:29 [jwatk03]
- jwatk03 has joined #musicbrainz
- 00:13:50 [djce]
- djce has quit
- 00:24:41 [jwatk03]
- jwatk03 has left #musicbrainz
- 00:37:52 [jwatk03]
- jwatk03 has joined #musicbrainz
- 00:53:03 [RJ]
- RJ has quit
- 00:53:34 [RJ]
- RJ has joined #musicbrainz
- 00:55:41 [Knio]
- Knio is now known as Knio-dinner
- 00:56:05 [wolfsong]
- wolfsong has quit
- 00:56:29 [jwatk03_]
- jwatk03_ has joined #musicbrainz
- 01:00:28 [jwatk03_]
- jwatk03_ has quit
- 01:01:42 [jwatk03]
- jwatk03 has quit
- 01:03:43 [jwatk03]
- jwatk03 has joined #musicbrainz
- 01:13:55 [Knio-dinner]
- Knio-dinner is now known as Knio
- 01:17:44 [jwatk03]
- jwatk03 has left #musicbrainz
- 01:30:53 [RJ]
- RJ has quit
- 01:33:29 [ruaok]
- ruaok has joined #musicbrainz
- 01:46:42 [jwatk03]
- jwatk03 has joined #musicbrainz
- 03:12:17 [spooge]
- spooge has quit
- 03:12:17 [Necronom]
- Necronom has quit
- 03:12:17 [icepick-away]
- icepick-away has quit
- 03:12:45 [spooge]
- spooge has joined #musicbrainz
- 03:12:45 [icepick-away]
- icepick-away has joined #musicbrainz
- 03:12:45 [Necronom]
- Necronom has joined #musicbrainz
- 03:49:28 [jwatk03]
- jwatk03 has left #musicbrainz
- 04:01:23 [Knio]
- Knio is now known as Knio-tv
- 04:05:24 [Knio]
- Knio has joined #musicbrainz
- 05:14:02 [Knio-tv]
- Knio-tv is now known as Knio`
- 05:53:56 [Knio`]
- Knio` is now known as Knio-sleep
- 09:26:03 [orogor]
- orogor has joined #musicbrainz
- 10:27:35 [RJ]
- RJ has joined #musicbrainz
- 10:39:39 [sbw]
- sbw has quit
- 11:35:48 [Knio]
- Knio has quit
- 11:36:25 [Knio-sleep]
- Knio-sleep has quit
- 13:02:24 [Knio]
- Knio has joined #musicbrainz
- 13:02:26 [Knio1]
- Knio1 has joined #musicbrainz
- 15:02:15 [Knio1]
- Knio1 is now known as Knio`
- 15:22:35 [Knio`]
- Knio` is now known as Knio-school
- 16:45:33 [wolfsong]
- wolfsong has joined #musicbrainz
- 18:23:09 [duncf]
- duncf has joined #musicbrainz
- 19:15:39 [sbw]
- sbw has joined #musicbrainz
- 20:11:30 [orogor_]
- orogor_ has joined #musicbrainz
- 20:19:23 [orogor]
- orogor has quit
- 20:37:46 [sbw]
- sbw has quit
- 20:45:58 [sbw]
- sbw has joined #musicbrainz
- 20:49:37 [orogor_]
- orogor_ is now known as orogor
- 21:12:05 [djce]
- djce has joined #musicbrainz
- 21:35:38 [sward_3]
- sward_3 has joined #musicbrainz
- 21:35:47 [ruaok]
- djce: how are things?
- 21:35:53 [djce]
- not bad thanks!
- 21:36:11 [ruaok]
- Final tally on the board of directors: 5 yes, 3 no.
- 21:36:15 [djce]
- just need to test Match.pl, then I'm all set for tomorrow.
- 21:36:17 [djce]
- cool!
- 21:36:26 [ruaok]
- Now I have 5 *excellent* candidates that I must choose from.
- 21:36:32 [djce]
- So are you over-subscribed? wow.
- 21:36:33 [ruaok]
- * ruaok waves to danbri
- 21:37:17 [ruaok]
- That was intentional -- we wanted to get more yeses that we can handle in order to build a balanced board.
- 21:37:40 [ruaok]
- Its going to be hard having to say no to two people.
- 21:38:05 [ruaok]
- Interesting breakdown of locations as well:
- 21:38:26 [ruaok]
- 1 .jp, 3 .uk 2 .us (myself not included)
- 21:39:17 [ruaok]
- .de and .nl are missing for a board that would be truely representative of the nations that most participate in MB.
- 21:40:15 [djce]
- good going then. It's nice to see things moving forward apace.
- 21:40:43 [ruaok]
- now I need to nail down a treasurer and a secretary. Preferrably in SF.
- 21:51:18 [sward_]
- sward_ has joined #musicbrainz
- 21:53:53 [sward_2]
- sward_2 has quit
- 21:56:57 [sward_2]
- sward_2 has joined #musicbrainz
- 21:57:31 [sward_3]
- sward_3 has quit
- 21:59:08 [danbri]
- danbri has quit
- 22:01:07 [sward_]
- sward_ has quit
- 22:01:14 [danbri]
- danbri has joined #musicbrainz
- 22:01:15 [wolfsong]
- wolfsong has quit
- 22:01:37 [wolfsong]
- wolfsong has joined #musicbrainz
- 22:02:03 [soccos]
- soccos has joined #musicbrainz
- 22:02:26 [djce]
- djce has quit
- 22:02:26 [alus]
- alus has quit
- 22:03:28 [djce]
- djce has joined #musicbrainz
- 22:03:28 [alus]
- alus has joined #musicbrainz
- 22:04:34 [jwatk03]
- jwatk03 has joined #musicbrainz
- 22:05:41 [djce]
- ruaok: I've found why my Match.pl shows no matches.
- 22:05:55 [djce]
- the response I'm getting says:
- 22:05:57 [djce]
- "Your request has one or more parameters missing. Please check and retry."
- 22:06:00 [djce]
- Where do I start looking?
- 22:09:41 [soccos]
- soccos has quit
- 22:14:57 [ruaok]
- djce: you will need uncomment the blank AWS entries in DBDefs and replace it with the non-blank ones
- 22:15:10 [djce]
- ok
- 22:15:25 [djce]
- so Match.pl should be run until we can get the OK from OPG?
- 22:15:58 [ruaok]
- it should run as long as we support amazon integration.
- 22:16:03 [djce]
- s/should/shouldn't/
- 22:16:29 [ruaok]
- we may need to hard-code our AWS numbers in Match.pl for now.
- 22:16:45 [djce]
- sure
- 22:16:56 [ruaok]
- but we should be running it continually, regardless our incorporation state
- 22:16:58 [djce]
- or add another flag for "pass associate IDs to cart" etc
- 22:17:26 [ruaok]
- yeah, I think tinkering with Match.pl has less of an impact.
- 22:17:50 [djce]
- true. that'll do for now.
- 22:17:53 [djce]
- thanks
- 22:18:14 [ruaok]
- np
- 22:20:59 [ruaok]
- * ruaok is away: bike ride while its dry
- 22:26:17 [RJ]
- RJ has quit
- 22:35:39 [Knio-school]
- Knio-school is now known as Knio`
- 22:37:50 [feverish]
- feverish has joined #musicbrainz
- 23:19:13 [djce]
- ruaok: another Q about Match.pl, when you're back
- 23:19:26 [ruaok]
- * ruaok is back (gone 00:58:27)
- 23:19:28 [ruaok]
- sorry.
- 23:19:46 [djce]
- hi
- 23:19:59 [djce]
- How long do you think --daily mode will take?
- 23:20:03 [djce]
- each day, that is
- 23:20:27 [ruaok]
- a while. could be hours.
- 23:20:45 [ruaok]
- given that we cannot make more than one connection to amazon per second, it does take a while.
- 23:20:55 [ruaok]
- perhaps a seperate cron job is in order?
- 23:21:06 [djce]
- By a very rough estimate, I'm thinking: 80,000 artists / 30 = ~ 25,000
- 23:21:21 [djce]
- and it's taking 3-5 seconds per artist for me
- 23:21:34 [djce]
- which is probably about a 24 hour run time.
- 23:21:56 [ruaok]
- the script initially took 2 or so full days to run.
- 23:22:06 [ruaok]
- Call it three full days.
- 23:22:23 [djce]
- Maybe you've got a faster connection to Amazon than me.
- 23:22:28 [ruaok]
- Given that I'd expect it to run in about 2.5 hours a day>?
- 23:22:49 [ruaok]
- I don't think its that -- it depends on what artists and where in the dataset you connect.
- 23:23:06 [ruaok]
- the lower ids (better established artists) were really slow.
- 23:23:19 [djce]
- I'm wondering if an option more like "--stop-after=DELTATIME" is appropriate.
- 23:23:29 [ruaok]
- the higher ids (lesser known artists) move fast where some artists are done in 1 second.
- 23:23:30 [djce]
- e.g. run for 1 hour then stop
- 23:23:47 [ruaok]
- Sounds very reasonable.
- 23:24:02 [djce]
- just to guard against the cron job running on for ages, or possibly even overlapping with the next run.
- 23:24:05 [ruaok]
- perhaps we can write its actual completion time (and percent complete at completion) to a log to monitor it.
- 23:24:14 [djce]
- ok, I'll have a look at that.
- 23:24:18 [ruaok]
- sweet.
- 23:24:34 [ruaok]
- I don't anticipate this being a problem, but I appreciate your care.
- 23:24:50 [djce]
- I like to be careful, from time to time :-)
- 23:25:02 [ruaok]
- complements me nicely. :-)
- 23:26:10 [djce]
- What are the actual conditions of the AWS service? are we limited to only one connection at a time, for example?
- 23:26:20 [ruaok]
- yes.
- 23:26:36 [djce]
- is it one sec between response and next request, or request and next request?
- 23:26:43 [ruaok]
- one connection per IP per second.
- 23:26:46 [ruaok]
- unspecified.
- 23:27:18 [ruaok]
- and if the tool gets distributed, each instance of the tool cannot make more than 1 connection per second.
- 23:27:30 [djce]
- ok, there may be something to exploit there if we need to.
- 23:38:53 [jwatk03]
- jwatk03 has quit
- 23:40:55 [jwatk03]
- jwatk03 has joined #musicbrainz
- 23:49:18 [wolfsong]
- wolfsong has quit
- 23:54:49 [jwatk03]
- jwatk03 has quit
- 23:59:54 [jwatk03]
- jwatk03 has joined #musicbrainz