This is a public chat log generated from the #semsol IRC channel.
12:18:17
bengee: so will arc be able to support rdf/json as a native structure (and if so, do you want any help with the grunt work)?
12:19:33
wel, it's a php tool, but an importer shouldn't be too hard
12:19:45
I guess you have one already? ;)
12:24:25
yes - json_unserialise ;)
12:25:20
so are we stuck with 'val' and 'dt' internally for the duration of arc2 then?
12:34:26
no, Ill adjust it
12:45:35
sweet :)
12:46:41
bengee: I'd like to do another rdfizer or 2, and hopefully contribute it back to arc - what do you think would be most useful next - Atom ?
12:47:08
I do have code for atom already
12:47:21
oh really? I missed that :)
12:47:36
it's not in the package yet
12:47:50
opml blogrolls would be a cool thing to have
15:39:04
how much opml is there in the wild?
15:39:18
dunno
15:39:30
is it that common?
15:52:52
for blogrolls, I think
16:41:12
Hi! Is there anything I can do to improve LOAD speed right now (e.g. mysql tweaking etc)?
16:43:36
increasing the index key size should help
16:46:05
Ok. I'll google that and see if it helps.
16:46:55
it's key_buffer_size
16:48:36
handy test query
16:48:37
PREFIX xfn: <http://gmpg.org/xfn/11#>
16:48:38
PREFIX : <http://xmlns.com/foaf/0.1/>
16:48:39
SELECT DISTINCT ?g ?p1 ?p2
16:48:41
WHERE {
16:48:42
GRAPH ?g {
16:48:43
{ ?x xfn:friend ?y . } UNION { ?x xfn:contact ?y }
16:48:44
?x :homepage ?p1 .
16:48:45
?y :homepage ?p2 .
16:48:47
}
16:48:49
}
16:48:53
this works ok on extracted xfn
16:49:38
the following doesn't (already mailed bengee):
16:49:40
PREFIX xfn: <http://gmpg.org/xfn/11#>
16:49:41
PREFIX : <http://xmlns.com/foaf/0.1/>
16:49:42
SELECT DISTINCT ?p1 ?p2
16:49:43
WHERE {
16:49:44
GRAPH ?p1 {
16:49:46
{ ?x xfn:friend ?y . } UNION { ?x xfn:contact ?y }
16:49:47
?x :homepage ?p1 .
16:49:48
?y :homepage ?p2 .
16:49:49
}
16:49:50
}
16:49:51
Error: Unknown column 'G_0_0_0_0_0_0_0.g' in 'on clause' via ARC2_StoreSelectQueryHandler
16:51:04
(re performance)... this seems useful for me: http://www.ghastlyfop.com/blog/2008/01/lamp-performance-for-dummies.html
16:51:30
another tweak could be to set delay_key_write to ON
16:53:18
Great! Thx.
16:54:58
or to somehow bulk-insert all changed files at once
16:55:32
ah, no
16:55:48
doesn't work for separate graphs..
16:56:34
I should add a way to manually create/release table locks
16:57:17
hen you could do multiple inserts and delay the index update
16:57:30
s/hen/then/
16:57:49
That would be nice. Sometimes you know you want to insert a lot of stuff in one go.
16:58:22
yeah
17:00:45
there's also an optimize_tables() in the store class now, which might help a bit
17:03:58
Do I call optimize_tables() manually?
17:04:56
you can, but it is auto-called by ARC after a number of inserts/loads, too
17:06:06
Ok. Thx for all your help. I'll have a look at tuning tonight.
17:06:24
please report if it helped
17:06:31
Will do. bye!
17:06:39
cool, cya