From mboxrd@z Thu Jan 1 00:00:00 1970 Path: news.gmane.org!.POSTED.blaine.gmane.org!not-for-mail From: Ted Thibodeau Jr Newsgroups: gmane.org.wikimedia.wikidata,gmane.lisp.guile.user,gmane.org.w3c.semantic-web Subject: Re: [ANN] nomunofu v0.1.0 Date: Sun, 22 Dec 2019 18:36:06 -0500 Message-ID: <3C3055B6-0BDC-444B-832F-C67477535E35@openlinksw.com> References: Reply-To: Discussion list for the Wikidata project Mime-Version: 1.0 (Mac OS X Mail 8.2 \(2104\)) Content-Type: multipart/mixed; boundary="===============6502130502182748028==" Injection-Info: blaine.gmane.org; posting-host="blaine.gmane.org:195.159.176.226"; logging-data="30143"; mail-complaints-to="usenet@blaine.gmane.org" Cc: Guile User , semantic-web To: Discussion list for the Wikidata project Original-X-From: wikidata-bounces-RusutVdil2icGmH+5r0DM0B+6BGkLq7r@public.gmane.org Mon Dec 23 00:35:48 2019 Return-path: Envelope-to: goww-wikidata-l@m.gmane.org Original-Received: from lists.wikimedia.org ([208.80.154.21]) by blaine.gmane.org with esmtps (TLS1.2:ECDHE_RSA_AES_128_GCM_SHA256:128) (Exim 4.89) (envelope-from ) id 1ijAlI-0007hP-BK for goww-wikidata-l@m.gmane.org; Mon, 23 Dec 2019 00:35:48 +0100 DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=lists.wikimedia.org; s=wikimedia; h=Sender:Content-Type:Reply-To:List-Subscribe:List-Help:List-Post:List-Archive:List-Unsubscribe:List-Id:Subject:Cc:To:References:Message-Id:Date:In-Reply-To:From:Mime-Version; bh=FBScrZBUhPRhzVJdy8I1EBMOfCzWLA5euckgVNQCV5s=; b=R/mG9Qm/0NgyW61/9BgtAyXfTPNTo7JEezL5VGzT4+ZPG/np36uhnqOycUgD2X1TLzjsLa9CWJD/94yrnknv0667w0xBJeQivxLXB139JZwIr0AzDlATRvEzTiRwgLunJ+HFsyutav+cY3ybIzfbAWDZl9XwQ3ZsfdZGz84ypfw=; Original-Received: from localhost ([::1]:33938 helo=fermium.wikimedia.org) by fermium.wikimedia.org with esmtp (Exim 4.84_2) (envelope-from ) id 1ijAks-0000d2-1b; Sun, 22 Dec 2019 23:35:22 +0000 Original-Received: from mail.openlinksw.com ([194.109.129.60]:33756) by fermium.wikimedia.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.84_2) (envelope-from ) id 1ijAkj-0000cc-0g for wikidata-RusutVdil2icGmH+5r0DM0B+6BGkLq7r@public.gmane.org; Sun, 22 Dec 2019 23:35:16 +0000 DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=openlinksw.com; s=dkim-20170105; h=To:References:Message-Id:Cc:Date: In-Reply-To:From:Content-Type:Mime-Version:Subject:Sender:Reply-To: Content-Transfer-Encoding:Content-ID:Content-Description:Resent-Date: Resent-From:Resent-Sender:Resent-To:Resent-Cc:Resent-Message-ID:List-Id: List-Help:List-Unsubscribe:List-Subscribe:List-Post:List-Owner:List-Archive; bh=kJdNaIdUSkPALfK4l9It+hy7+59Gfuf+G6ZbAipAGV8=; b=LaMeFVNkY44hrAuVE+EK5mGwd aN1H7Np8XSUZsPYXpmZSIErlTFx0mtq/c1q2Dc3xwVfnrbyST8uxAjsAIELfif3a0Z94TnHJz6rZQ eXuDsusBciENgt95nGMPF8lCiqjcLSWGZmZ5hITxsBXo16koYTY84fDcDiKFjqWcungvts+vlbW1/ KK3hwIxtMkSSFxhjDP//GKI3d99WXsqWpEdRcRu5035eCMgS0fSrAYghi8QRewGHhR5AFuOj+Tr1l DKG43+sNoSTV86xsXsopOlUeIMwfk9uOCOZWhkSIiEL+gcEVLEfZYiiibbovxOMejDzQbp63gJOtO 3OItt35MQ==; Original-Received: from c-73-60-162-242.hsd1.ma.comcast.net ([73.60.162.242] helo=[192.168.86.118]) by mail.openlinksw.com with esmtpsa (TLSv1:ECDHE-RSA-AES256-SHA:256) (Exim 4.92.3) (envelope-from ) id 1ijAkW-0006ff-FU; Mon, 23 Dec 2019 00:35:00 +0100 In-Reply-To: X-Mailer: Apple Mail (2.2104) X-BeenThere: wikidata-RusutVdil2icGmH+5r0DM0B+6BGkLq7r@public.gmane.org X-Mailman-Version: 2.1.18 Precedence: list List-Id: Discussion list for the Wikidata project List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: wikidata-bounces-RusutVdil2icGmH+5r0DM0B+6BGkLq7r@public.gmane.org Original-Sender: "Wikidata" Xref: news.gmane.org gmane.org.wikimedia.wikidata:12839 gmane.lisp.guile.user:15968 gmane.org.w3c.semantic-web:26084 Archived-At: --===============6502130502182748028== Content-Type: multipart/signed; boundary="Apple-Mail=_A7DC3092-FCC1-4C5C-AB02-8A85D2A2CA77"; protocol="application/pkcs7-signature"; micalg=sha1 --Apple-Mail=_A7DC3092-FCC1-4C5C-AB02-8A85D2A2CA77 Content-Transfer-Encoding: quoted-printable Content-Type: text/plain; charset=us-ascii On Dec 22, 2019, at 03:17 PM, Amirouche Boubekki = wrote: >=20 > Hello all ;-) >=20 >=20 > I ported the code to Chez Scheme to do an apple-to-apple comparison > between GNU Guile and Chez and took the time to launch a few queries > against Virtuoso available in Ubuntu 18.04 (LTS). Hi, Amirouche -- Kingsley's points about tuning Virtuoso to use available=20 RAM [1] and other system resources are worth looking into,=20 but a possibly more important first question is -- Exactly what version of Virtuoso are you testing? If you followed the common script on Ubuntu 18.04, i.e., -- sudo apt update sudo apt install virtuoso-opensource -- then you likely have version 6.1.6 of VOS, the Open Source=20 Edition of Virtuoso, which shipped 2012-08-02 [2], and is far behind the latest version of both VOS (v7.2.5+) and Enterprise=20 Edition (v8.3+)! The easiest way to confirm what you're running is to review=20 the first "paragraph" of output from the command corresponding=20 to the name of your Virtuoso binary -- virtuoso-t -? virtuoso-iodbc-t -? If I'm right, and you're running 6.x, you'll get much better test results just by running a current version of Virtuoso. You can build VOS 7.2.6+ from source [3] (we'd recommend the=20 develop/7 branch [4] for the absolute latest), or download a=20 precompiled binary [5] of VOS 7.2.5.1 or 7.2.6.dev. You can also try Enterprise Edition at no cost for 30 days [5]. [1] http://vos.openlinksw.com/owiki/wiki/VOS/VirtRDFPerformanceTuning [2] = http://vos.openlinksw.com/owiki/wiki/VOS/VOSNews2012#2012-08-02%20--%20Ann= ouncing%20Virtuoso%20Open-Source%20Edition%20v6.1.6. [3] http://vos.openlinksw.com/owiki/wiki/VOS/VOSBuild [4] https://github.com/openlink/virtuoso-opensource/tree/develop/7 [5] https://sourceforge.net/projects/virtuoso/files/virtuoso/=20 > Spoiler: the new code is always faster. >=20 > The hard disk is SATA, and the CPU is dubbed: Intel(R) Xeon(R) CPU > E3-1220 V2 @ 3.10GHz >=20 > I imported latest-lexeme.nt (6GB) using guile-nomunofu, chez-nomunofu > and Virtuoso: >=20 > - Chez takes 40 minutes to import 6GB > - Chez is 3 to 5 times faster than Guile > - Chez is 11% faster than Virtuoso How did you load the data? Did you use Virtuoso's build-load facilities? This is the recommended method [6]. [6] http://vos.openlinksw.com/owiki/wiki/VOS/VirtBulkRDFLoader > Regarding query time, Chez is still faster than Virtuoso with or > without cache. The query I am testing is the following: >=20 > SELECT ?s ?p ?o > FROM > WHERE { > ?s = . > ?s > . > ?s ?o > }; >=20 > Virtuoso first query takes: 1295 msec. > The second query takes: 331 msec. > Then it stabilize around: 200 msec. >=20 > chez nomunofu takes around 200ms without cache. >=20 > There is still an optimization I can do to speed up nomunofu a little. >=20 >=20 > Happy hacking! I'll be interested to hear your new results, with a current build, and with proper INI tuning in place. Regards, Ted -- A: Yes. http://www.idallen.com/topposting.html | Q: Are you sure? =20 | | A: Because it reverses the logical flow of conversation. | | | Q: Why is top posting frowned upon? Ted Thibodeau, Jr. // voice +1-781-273-0900 x32 Senior Support & Evangelism // mailto:tthibodeau-HpHEqLDO2a7UEDaH6ef/NA@public.gmane.org // http://twitter.com/TallTed OpenLink Software, Inc. // http://www.openlinksw.com/ 20 Burlington Mall Road, Suite 322, Burlington MA 01803 Weblog -- http://www.openlinksw.com/blogs/ Community -- https://community.openlinksw.com/ LinkedIn -- http://www.linkedin.com/company/openlink-software/ Twitter -- http://twitter.com/OpenLink Facebook -- http://www.facebook.com/OpenLinkSoftware Universal Data Access, Integration, and Management Technology Providers --Apple-Mail=_A7DC3092-FCC1-4C5C-AB02-8A85D2A2CA77 Content-Disposition: attachment; filename=smime.p7s Content-Type: application/pkcs7-signature; name=smime.p7s Content-Transfer-Encoding: base64 MIAGCSqGSIb3DQEHAqCAMIACAQExCzAJBgUrDgMCGgUAMIAGCSqGSIb3DQEHAQAAoIIETjCCBEow ggMyoAMCAQICAghjMA0GCSqGSIb3DQEBCwUAMIGeMQswCQYDVQQGEwJVUzELMAkGA1UECAwCTUEx IzAhBgNVBAoMGk9wZW5MaW5rIFNvZnR3YXJlIExvY2FsIENBMRowGAYDVQQLDBFPcGVuTGluayBT b2Z0d2FyZTEaMBgGA1UEAwwRaWQubXlvcGVubGluay5uZXQxJTAjBgkqhkiG9w0BCQEWFnN1cHBv cnRAb3Blbmxpbmtzdy5jb20wHhcNMTUwNjE4MTUyNDI2WhcNMjUwNjE1MTUyNDI2WjBlMRkwFwYD VQQDDBBUZWQgVGhpYm9kZWF1IEpyMR4wHAYDVQQKDBVPcGVuTGluayBTb2Z0d2FyZSBJbmMxKDAm BgkqhkiG9w0BCQEWGXR0aGlib2RlYXVAb3Blbmxpbmtzdy5jb20wggEiMA0GCSqGSIb3DQEBAQUA A4IBDwAwggEKAoIBAQC2JDwHIrJinAtVwxKPQ9VzJyUTH2whdWt+BZzihCtf2XuLZnKNfc04yoX8 6zs7P1uvhI46hy+/ENM+IZQK4UfZWUrm7eHHTAElTUtHgkWKGmb8Kv6tpva2O9cuh7N/XHB8bwmT mOo+qEHyc46yGHZHuA/LGdWpFeWWei2KEHfPvfQhh4u9DX9s0iUdwQEInU4R9KPIzEdCVvCKpimI zFD5JqKQ6Wi+peXDe9BtKVcOinJhUGkvS+rFtbxEHTOa/g+UFuDK0zGwomX7dFdD/917vC9xy08f yOJdsdd7KGEaDsjBkTii4YYwlUEF0QtqBibt3wwIoyPbaVyiHtExFKCrAgMBAAGjgckwgcYwHQYD VR0OBBYEFKYMy+fRMQyYNLOuraAIBSQtEq+4MEQGA1UdEQQ9MDuGOWh0dHA6Ly9pZC5teW9wZW5s aW5rLm5ldC9kYXRhc3BhY2UvcGVyc29uL3R0aGlib2RlYXUjdGhpczAtBglghkgBhvhCAQ0EIBYe VmlydHVvc28gR2VuZXJhdGVkIENlcnRpZmljYXRlMA4GA1UdDwEB/wQEAwIFoDAgBgNVHSUBAf8E FjAUBggrBgEFBQcDAgYIKwYBBQUHAwQwDQYJKoZIhvcNAQELBQADggEBAGNfIwdUSnz9PmS+dLu6 kE++uoVPEpxzzA+gwAFAYKvndk8NKPTmfrR3vF17vZnjh1/VhgYl242j9pqAXXc8Fa6fNk/nPs6t +WbvMWIN25J57YB+wPy1epiWwNWn5buyOFGVgUeOYktIFFcgEvWL/vp6b2WOk1xnxAhxg7zFWUEq 6P/eSZhuUi/3jtiu4Nd7QjA6KYQYWkYOv4KJxGejhxKCkgqx8vcFZwp4e4d8MGUtvPMUy3Icsggp 6BJA3ZxabH+iyahBfaZfS/k+pfBQunNAalee2Y2xf6n7UqaC+OiCuz5ZDNgZreEHyi00soR0sUyu L+FEnKeLZRCO7B1jJTQxggOiMIIDngIBATCBpTCBnjELMAkGA1UEBhMCVVMxCzAJBgNVBAgMAk1B MSMwIQYDVQQKDBpPcGVuTGluayBTb2Z0d2FyZSBMb2NhbCBDQTEaMBgGA1UECwwRT3Blbkxpbmsg U29mdHdhcmUxGjAYBgNVBAMMEWlkLm15b3BlbmxpbmsubmV0MSUwIwYJKoZIhvcNAQkBFhZzdXBw b3J0QG9wZW5saW5rc3cuY29tAgIIYzAJBgUrDgMCGgUAoIIB0TAYBgkqhkiG9w0BCQMxCwYJKoZI hvcNAQcBMBwGCSqGSIb3DQEJBTEPFw0xOTEyMjIyMzM2MTFaMCMGCSqGSIb3DQEJBDEWBBQb02F8 mStF9lUtExGZ280g11nZ2TCBtgYJKwYBBAGCNxAEMYGoMIGlMIGeMQswCQYDVQQGEwJVUzELMAkG A1UECAwCTUExIzAhBgNVBAoMGk9wZW5MaW5rIFNvZnR3YXJlIExvY2FsIENBMRowGAYDVQQLDBFP cGVuTGluayBTb2Z0d2FyZTEaMBgGA1UEAwwRaWQubXlvcGVubGluay5uZXQxJTAjBgkqhkiG9w0B CQEWFnN1cHBvcnRAb3Blbmxpbmtzdy5jb20CAghjMIG4BgsqhkiG9w0BCRACCzGBqKCBpTCBnjEL MAkGA1UEBhMCVVMxCzAJBgNVBAgMAk1BMSMwIQYDVQQKDBpPcGVuTGluayBTb2Z0d2FyZSBMb2Nh bCBDQTEaMBgGA1UECwwRT3BlbkxpbmsgU29mdHdhcmUxGjAYBgNVBAMMEWlkLm15b3Blbmxpbmsu bmV0MSUwIwYJKoZIhvcNAQkBFhZzdXBwb3J0QG9wZW5saW5rc3cuY29tAgIIYzANBgkqhkiG9w0B AQEFAASCAQBuqnpUVj4ed/bZYg58Sk5+2zyeL5ZzNXmjo6uKSAwt+DsxpSOdtS1V/4R3zfRAwzNr IIhetbBBfLYPBKXKBwpsmvwylH8s5V/eyYEhtrLSFK2syb1TzUfnsmYI/QAOyhD9HiWsWo/+iuUw Hdpz31x0tTVn5b+fOtQnY4fUjx7IPZxQ4b+ChAkJuS3ZR1vplVU6ayLtWg0CzcbWB1cNgvVn+Ad4 OJ2/SZL1G+4AtRmulrIu7cPNG/uTeSTfY+mE8ypOkzy2rwCpHzqI2a5BTw6VQ8THdCSbNofnq+LZ vcfIkJsSTQPkTFHnBr/vVEf30xiTUgsEcNMkpZYRFI4dZB3XAAAAAAAA --Apple-Mail=_A7DC3092-FCC1-4C5C-AB02-8A85D2A2CA77-- --===============6502130502182748028== Content-Type: text/plain; charset="utf-8" MIME-Version: 1.0 Content-Transfer-Encoding: base64 Content-Disposition: inline X19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX19fX18KV2lraWRhdGEg bWFpbGluZyBsaXN0Cldpa2lkYXRhQGxpc3RzLndpa2ltZWRpYS5vcmcKaHR0cHM6Ly9saXN0cy53 aWtpbWVkaWEub3JnL21haWxtYW4vbGlzdGluZm8vd2lraWRhdGEK --===============6502130502182748028==--