From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mp11.migadu.com ([2001:41d0:403:478a::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by ms9.migadu.com with LMTPS id yGSWMuva9mQVAAAA9RJhRA:P1 (envelope-from ) for ; Tue, 05 Sep 2023 09:38:19 +0200 Received: from aspmx1.migadu.com ([2001:41d0:403:478a::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by mp11.migadu.com with LMTPS id yGSWMuva9mQVAAAA9RJhRA (envelope-from ) for ; Tue, 05 Sep 2023 09:38:19 +0200 Received: from lists.gnu.org (lists.gnu.org [209.51.188.17]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by aspmx1.migadu.com (Postfix) with ESMTPS id E495E46473 for ; Tue, 5 Sep 2023 09:38:18 +0200 (CEST) Authentication-Results: aspmx1.migadu.com; dkim=pass header.d=elephly.net header.s=zoho header.b=iHo+rzeW; spf=pass (aspmx1.migadu.com: domain of "guix-devel-bounces+larch=yhetil.org@gnu.org" designates 209.51.188.17 as permitted sender) smtp.mailfrom="guix-devel-bounces+larch=yhetil.org@gnu.org"; dmarc=none; arc=pass ("zohomail.com:s=zohoarc:i=1") ARC-Message-Signature: i=2; a=rsa-sha256; c=relaxed/relaxed; d=yhetil.org; s=key1; t=1693899499; h=from:from:sender:sender:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-type:content-type: content-transfer-encoding:content-transfer-encoding: in-reply-to:in-reply-to:references:references:list-id:list-help: list-unsubscribe:list-subscribe:list-post:dkim-signature; bh=cQSXM/d8Q429z6URqyEK4mTLFUsab6KbL7+4j0ceSoc=; b=mekyO74CPZF+G8dKT90VK2JM850W+s13oBp7/8mDDH40okVy8b7x4pla4gqxq38Q9DTcZt /5kHrpjs3WVBw5HfoDsEWelh+/Ane/J/8jYCMTnzwIQ2Scb6a3G1E34O130GIn8WAj2R46 2UGS6DKnalTu0B/zVDsBsLZLOLUmpDz14ahTK19WHNElodNaqvbCezpH+p3W9mVA2iT29v +kOfD2siMcCU8NUphRYmC2zW0XNV2SXWZvXRoJUA6yeXD9LwnVXfQFxp7RRyXTfgck/0Vf ggdnL1Fl6QRgERT96WPah0hDP0nHH/LHI8YBdcLM+cBhsaJFrN7ao0fwwfZgTA== ARC-Seal: i=2; s=key1; d=yhetil.org; t=1693899499; a=rsa-sha256; cv=pass; b=X8qs202/kl/oAkAyS4IkkNVABrcAh3pVPPkUv5a5q6ycOCc0MTCLRL14OBUSaUSg1OrA8V pfgLYAhnBfm/CKOnzlFf77lhhNmb9czd2Ue90m6s7AAicBZGcdDS15zRZ1WTfxMB7gCUje KMyS5tIChzUrYEJ/scDyRVlWjB6tiLNVXsrwVJ3XIQxq8HQxYuIA0/mx+kbK5t3FhPy0ic M4rZrPf/+I/b6/iVdN3tRhgyjp6sv7ooVhmEsCCcggj/2XGBCiJ6yDALvfnNZJ6I2Sp9qh qIDTidSk1+q6xXrYPTrPWwJ2rknJXTAb7oTg1fHBUQQFhPmRZ0n8TW6hnAafKg== ARC-Authentication-Results: i=2; aspmx1.migadu.com; dkim=pass header.d=elephly.net header.s=zoho header.b=iHo+rzeW; spf=pass (aspmx1.migadu.com: domain of "guix-devel-bounces+larch=yhetil.org@gnu.org" designates 209.51.188.17 as permitted sender) smtp.mailfrom="guix-devel-bounces+larch=yhetil.org@gnu.org"; dmarc=none; arc=pass ("zohomail.com:s=zohoarc:i=1") Received: from localhost ([::1] helo=lists1p.gnu.org) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1qdQcx-0001vJ-7z; Tue, 05 Sep 2023 03:37:35 -0400 Received: from eggs.gnu.org ([2001:470:142:3::10]) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1qdQcu-0001v0-VK for guix-devel@gnu.org; Tue, 05 Sep 2023 03:37:33 -0400 Received: from sender3-of-o58.zoho.com ([136.143.184.58]) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1qdQcs-0004Ee-2d for guix-devel@gnu.org; Tue, 05 Sep 2023 03:37:32 -0400 ARC-Seal: i=1; a=rsa-sha256; t=1693899442; cv=none; d=zohomail.com; s=zohoarc; b=L2GQ6K00+8h5ftWhJYJ+sEsCoYgBGORe6zaJdwggoT4AtcFveiRQ1INz3koJ/X4kp0DIP0tVJoub8N8KdNLj9Hfs7gQ9o8gwpb2KDPJHZdJAxtY3hX4N3q/s1fSVF/V/9nBqSXOsrYgGTm39J5YIflQJ+IKRywYiwiCkoMPy66Y= ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=zohomail.com; s=zohoarc; t=1693899442; h=Content-Type:Content-Transfer-Encoding:Cc:Cc:Date:Date:From:From:In-Reply-To:MIME-Version:Message-ID:References:Subject:Subject:To:To:Message-Id:Reply-To; bh=cQSXM/d8Q429z6URqyEK4mTLFUsab6KbL7+4j0ceSoc=; b=JB0mJJoKbLWIrIyjRoRZNzx263dTY+puGGXofAD/Ae6TyJvecaT82pshmNRbhrZZdCh6/yOSGh5HRhdXvworkhDqFAdohfbwRay0VW2Zmqi6vZjqfMfJ3VmxIdQwPUkbhJSQIyruMg1GD9C1u0jEd+vqwXajdF/c4l+GG3S0cfY= ARC-Authentication-Results: i=1; mx.zohomail.com; dkim=pass header.i=elephly.net; spf=pass smtp.mailfrom=rekado@elephly.net; dmarc=pass header.from= DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; t=1693899442; s=zoho; d=elephly.net; i=rekado@elephly.net; h=References:From:From:To:To:Cc:Cc:Subject:Subject:Date:Date:In-reply-to:Message-ID:MIME-Version:Content-Type:Content-Transfer-Encoding:Message-Id:Reply-To; bh=cQSXM/d8Q429z6URqyEK4mTLFUsab6KbL7+4j0ceSoc=; b=iHo+rzeWlaLCfXF1/s2JXs+6cd2u3owLgTCZO/xGXgJP8jVHe+QLfs2uchwTbYcH 7ggp0B6Eor0JtGYMiBBy2RM9nH4IlsH9AGVsB/3cpxaBRK3IfaNVbWf8jX7KNckTHaI jJXZEhG2Y51WDkiKaUSGRu8Eow4EPBnWVJrT8Kp8= Received: from localhost (113-111-142-46.pool.kielnet.net [46.142.111.113]) by mx.zohomail.com with SMTPS id 1693899439492989.0331140258385; Tue, 5 Sep 2023 00:37:19 -0700 (PDT) References: <060dfa07107d0da36ebc7a9f094331163a8dd945.camel@gmail.com> <87wmxhi2pt.fsf@gmail.com> <874jkccizv.fsf@elephly.net> <87wmx8m5gb.fsf@wireframe> <871qfeb9am.fsf@elephly.net> <87edjdqs5t.fsf@gmail.com> User-agent: mu4e 1.10.5; emacs 28.2 From: Ricardo Wurmus To: Maxim Cournoyer Cc: Vagrant Cascadian , Attila Lendvai , Liliana Marie Prikler , Katherine Cox-Buday , guix-devel@gnu.org Subject: Replacing Mumi+Debbugs? Date: Tue, 05 Sep 2023 09:21:37 +0200 In-reply-to: <87edjdqs5t.fsf@gmail.com> Message-ID: <87fs3t9il0.fsf@elephly.net> MIME-Version: 1.0 Content-Type: text/plain; charset=utf-8 Content-Transfer-Encoding: quoted-printable X-ZohoMailClient: External Received-SPF: pass client-ip=136.143.184.58; envelope-from=rekado@elephly.net; helo=sender3-of-o58.zoho.com X-Spam_score_int: -20 X-Spam_score: -2.1 X-Spam_bar: -- X-Spam_report: (-2.1 / 5.0 requ) BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, RCVD_IN_DNSWL_NONE=-0.0001, RCVD_IN_MSPIKE_H5=0.001, RCVD_IN_MSPIKE_WL=0.001, SPF_HELO_NONE=0.001, SPF_PASS=-0.001 autolearn=ham autolearn_force=no X-Spam_action: no action X-BeenThere: guix-devel@gnu.org X-Mailman-Version: 2.1.29 Precedence: list List-Id: "Development of GNU Guix and the GNU System distribution." List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: guix-devel-bounces+larch=yhetil.org@gnu.org Sender: guix-devel-bounces+larch=yhetil.org@gnu.org X-Migadu-Country: US X-Migadu-Flow: FLOW_IN X-Migadu-Scanner: mx0.migadu.com X-Migadu-Spam-Score: -4.40 X-Spam-Score: -4.40 X-Migadu-Queue-Id: E495E46473 X-TUID: 5qYagUaHeKze Maxim Cournoyer writes: >> I=E2=80=99ll say that many of my gripes with (the GNU instance of) Debbu= gs are >> due to the fact that we can=E2=80=99t customize it to better suit our ne= eds =E2=80=94 it >> is a shared resource with a complicated maintenance story. So all >> changes went into Mumi as crude workarounds. I think this is a dead end >> and we=E2=80=99d be better off leaving the shared GNU instance of Debbugs >> behind. > > I'd be sad to loose at least two good things from Debbugs: > > 1. It's hosted by the GNU/FSF for us. It always work, and the rare > times it doesn't, the folks in #savannah are hard at work resolving the > problems. While hosting sourcehut is probably not too difficult, keeping > it up to date (Go...) and running would be yet another weigh on our > meager sysadmin team. Yes, this is a real concern. Infrastructure at scale is always a little messier than one would assume. > 2. Integration with Emacs. emacs-debbugs is useful. I think it's the > only successful thing we have at keeping track of old tickets and > resuming discussion or acting on these. > > I like how clean Mumi looks, compared to most forge issue trackers. I'm > not convinced by its search results (perhaps I'd need to get to know > what Xapian is). Xapian is a search engine for documents. It lets us create search indices over keywords extracted from documents and retrieve matching documents. It=E2=80=99s what =E2=80=9Cmu=E2=80=9D uses for its database; t= hat=E2=80=99s the origin of =E2=80=9Cmu=E2=80=9D in =E2=80=9Cmumi=E2=80=9D as we used to just leave all= the search business to =E2=80=9Cmu=E2=80=9D in early versions. All the things related to search are here: https://git.savannah.gnu.org/cgit/guix/mumi.git/tree/mumi/xapian.scm =E2=80=9Cindex-files=E2=80=9D opens all emails, extracts fields such as aut= hor, subject, status, body (for full text search), etc, and builds the search index/database. =E2=80=9Csearch=E2=80=9D converts the query string into a query object and = requests matching documents from the database. We=E2=80=99re constantly updating the index to match the growing collection= of Debbugs emails. We are testing the basic search interface here: https://git.savannah.gnu.org/cgit/guix/mumi.git/tree/tests/xapian.scm If there are bad results (and mumi should be used for a while longer to justify changing it) we should create test cases for them, so we get a chance to update the way we index the documents and create a query. Going forward we could also think about augmenting the search with text embeddings, e.g. by computing word vectors over the whole collection of emails, turning the search query into a word vector, and then search for the most similar vectors in the collection. This would give us very fuzzy matching of synonyms and related terms. fasttext and faiss can be used for these purposes. --=20 Ricardo