From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: X-Spam-Checker-Version: SpamAssassin 3.4.6 (2021-04-09) on dcvr.yhbt.net X-Spam-Level: X-Spam-ASN: AS29838 64.147.123.0/24 X-Spam-Status: No, score=-1.9 required=3.0 tests=BAYES_00,BODY_8BITS, DKIM_SIGNED,DKIM_VALID,DKIM_VALID_AU,DKIM_VALID_EF,RCVD_IN_DNSWL_HI, SPF_HELO_PASS,SPF_PASS,T_SCC_BODY_TEXT_LINE shortcircuit=no autolearn=ham autolearn_force=no version=3.4.6 Received: from wout2-smtp.messagingengine.com (wout2-smtp.messagingengine.com [64.147.123.25]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits) key-exchange X25519 server-signature RSA-PSS (4096 bits) server-digest SHA256) (No client certificate requested) by dcvr.yhbt.net (Postfix) with ESMTPS id 4BB141F542 for ; Tue, 13 Jun 2023 14:49:44 +0000 (UTC) Authentication-Results: dcvr.yhbt.net; dkim=pass (2048-bit key; unprotected) header.d=bsdio.com header.i=@bsdio.com header.a=rsa-sha256 header.s=fm3 header.b=qd0odx+q; dkim=pass (2048-bit key; unprotected) header.d=messagingengine.com header.i=@messagingengine.com header.a=rsa-sha256 header.s=fm2 header.b=IZ2HtHAf; dkim-atps=neutral Received: from compute3.internal (compute3.nyi.internal [10.202.2.43]) by mailout.west.internal (Postfix) with ESMTP id 1EA05320097C for ; Tue, 13 Jun 2023 10:49:43 -0400 (EDT) Received: from mailfrontend1 ([10.202.2.162]) by compute3.internal (MEProxy); Tue, 13 Jun 2023 10:49:43 -0400 DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=bsdio.com; h=cc :content-transfer-encoding:content-type:content-type:date:date :from:from:in-reply-to:message-id:mime-version:reply-to:sender :subject:subject:to:to; s=fm3; t=1686667782; x=1686754182; bh=SE amvePuYaXqCD/Cx49IeyIldWaeK8DEWOu0/ErEje8=; b=qd0odx+qKrfIkMLsbk qCkt0Z05hK14SGxiScGELA/mjRYzNqiBemVR7aLuT7FK1AErVvxWOdKEecl763FK kHf70ba9IS5qiAzfLVFc0nlGq2HkstDdADd2V+qEOjwX/ZfyhGv3rn46wxfbe0Vz +hqFKpATUHslCoTIaQLhQnEXRp3hGVzXLNQrxiL6l9wb3fxQWexOSLIbrDKRIhdF 6RrsyajNOo950d60xPo5mVuYt27lduISHUUJHvUtKCIIXR0tx1Gp11TFxEakARkN fdu5OeZCH5P7nqanryNlAuatCf4JAWgnwmZLVQPxKyVuWpsbNJbfAHO5ZRqOzhzd J4Cw== DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d= messagingengine.com; h=cc:content-transfer-encoding:content-type :content-type:date:date:feedback-id:feedback-id:from:from :in-reply-to:message-id:mime-version:reply-to:sender:subject :subject:to:to:x-me-proxy:x-me-proxy:x-me-sender:x-me-sender :x-sasl-enc; s=fm2; t=1686667782; x=1686754182; bh=SEamvePuYaXqC D/Cx49IeyIldWaeK8DEWOu0/ErEje8=; b=IZ2HtHAfdLwYj7jbwYfZ3W0DW+NGJ o29n/zvdnWiYp607slCVPzo7QtWQGakJOnqV4ZlFFCSitsl4G/dT2oIxJ1Ahw1iV Cy32tlDh5Sd1j6qu4k2GzSWQ0viFR+jbEcsLa/t3Nl3uFXzxvcJ+mRyLa4XoeHVA nRtAimytt1gws+Mn9wErZZaM0NsNJ/r2eN1S/5MGrWKcw6cqD4AqvzTFutk9xSsF kkpC6L5zo2qIfZ5fiPNlDYR4KuBFoQGGNrFmNXfMlWeBrn5PpRGc9RR8MQDFDVli HAj44X3Q5QoKkRSpw259LMAKbRXdT/FeErCLseci2lSAoyooMnfAepJcg== X-ME-Sender: X-ME-Received: X-ME-Proxy-Cause: gggruggvucftvghtrhhoucdtuddrgedvhedrgedujedgjeejucetufdoteggodetrfdotf fvucfrrhhofhhilhgvmecuhfgrshhtofgrihhlpdfqfgfvpdfurfetoffkrfgpnffqhgen uceurghilhhouhhtmecufedttdenucenucfjughrpefkffggfgfvhffutgfgsehtkeertd dtfeejnecuhfhrohhmpeftvggsvggttggrucevrhgrnhcuoehrvggsvggttggrsegsshgu ihhordgtohhmqeenucggtffrrghtthgvrhhnpedvfeektdffhfduhfegieegkedvuedtue eljedugeelvefhgeefkeeugfdtjedukeenucffohhmrghinhepghhrohhuphhsrdhiohdp ohhpvghnfhifrdhiohdpvgigrghmphhlvgdrnhgvthenucevlhhushhtvghrufhiiigvpe dtnecurfgrrhgrmhepmhgrihhlfhhrohhmpehrvggsvggttggrsegsshguihhordgtohhm X-ME-Proxy: Feedback-ID: i5b994698:Fastmail Received: by mail.messagingengine.com (Postfix) with ESMTPA for ; Tue, 13 Jun 2023 10:49:41 -0400 (EDT) Message-ID: Date: Tue, 13 Jun 2023 08:49:39 -0600 MIME-Version: 1.0 User-Agent: Mozilla/5.0 (X11; Linux x86_64; rv:102.0) Gecko/20100101 Thunderbird/102.11.0 Content-Language: en-US To: meta@public-inbox.org From: Rebecca Cran Subject: Help setting up a public-inbox instance: importing from maildir archive isn't working Content-Type: text/plain; charset=UTF-8; format=flowed Content-Transfer-Encoding: 8bit List-Id: I'm trying to set up a public-inbox instance to mirror the edk2-devel mailing list. I'm using version 1.9.0. I'm having problems importing a mirror of 105,000 messages from 2016 onward - when I configured it to pull them from an IMAP server it appeared to go through all of them, but then the web interface only showed the last 10 or so, with no more pages and the edk2-devel.git directory is only a few MB. When imap didn't work, I tried downloading them into a maildir and tried importing them via that instead, but that isn't working either. I was wondering if someone on this list could help point out what I'm doing wrong. The maildir is: ~$ du -h Maildump/ 4.0K    Maildump/Mail/cur 4.0K    Maildump/Mail/tmp 2.5G    Maildump/Mail/new 2.5G    Maildump/Mail 2.5G    Maildump/ I'm using the following configuration in ~/.public-inbox/config: [publicinbox]     wwwlisting = all [publicinbox "edk2-devel"]     address = devel@edk2.groups.io     inboxdir = /home/public-inbox/edk2-devel.git     watchheader = List-Id:     url = https://openfw.io/edk2-devel     watch = maildir:/home/public-inbox/Maildump/Mail/     watch = imaps://imap.example.net/INBOX ; redacted     indexlevel = full     replyto = :list     spamcheck = none     obfuscate = true Authentication for the imap server is handled via git-credential. I'm running the following commands: public-inbox-init -V2 -L full edk2-devel /home/public-inbox/edk2-devel.git https://openfw.io/edk2-devel devel@edk2.groups.io public-inbox-watcher # I run this in a screen session public-inbox-httpd     # I run this in a separate screen session, once public-inbox-watcher appears to have processed the existing messages -- Rebecca Cran