From mboxrd@z Thu Jan 1 00:00:00 1970 Path: news.gmane.io!.POSTED.blaine.gmane.org!not-for-mail From: Stefan Israelsson Tampe Newsgroups: gmane.lisp.guile.user,gmane.lisp.guile.devel Subject: Re: Announcement stis-engine Date: Sat, 14 Aug 2021 06:09:38 +0200 Message-ID: References: Mime-Version: 1.0 Content-Type: text/plain; charset="UTF-8" Injection-Info: ciao.gmane.io; posting-host="blaine.gmane.org:116.202.254.214"; logging-data="39825"; mail-complaints-to="usenet@ciao.gmane.io" To: Guile User , guile-devel Original-X-From: guile-user-bounces+guile-user=m.gmane-mx.org@gnu.org Sat Aug 14 06:10:08 2021 Return-path: Envelope-to: guile-user@m.gmane-mx.org Original-Received: from lists.gnu.org ([209.51.188.17]) by ciao.gmane.io with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.92) (envelope-from ) id 1mEkzo-000A9A-SV for guile-user@m.gmane-mx.org; Sat, 14 Aug 2021 06:10:08 +0200 Original-Received: from localhost ([::1]:40822 helo=lists1p.gnu.org) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1mEkzm-0005Vt-Sx for guile-user@m.gmane-mx.org; Sat, 14 Aug 2021 00:10:06 -0400 Original-Received: from eggs.gnu.org ([2001:470:142:3::10]:53726) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1mEkza-0005VQ-Pd; Sat, 14 Aug 2021 00:09:54 -0400 Original-Received: from mail-pl1-x631.google.com ([2607:f8b0:4864:20::631]:38723) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_128_GCM_SHA256:128) (Exim 4.90_1) (envelope-from ) id 1mEkzY-0006XN-Ji; Sat, 14 Aug 2021 00:09:54 -0400 Original-Received: by mail-pl1-x631.google.com with SMTP id a5so14545185plh.5; Fri, 13 Aug 2021 21:09:50 -0700 (PDT) DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=gmail.com; s=20161025; h=mime-version:references:in-reply-to:from:date:message-id:subject:to; bh=iHu/AkQuUuYv+ZhqS8+OVOYMTc7iwnTCUyotEve6cMU=; b=QKiNPq5syBa3ixws8aPU28aQ3H3OF4AJyikijvHloVRyqj2ZL9VVik2qsXafTkPJFG d4BH685MwjMyKL/UQqXaupn9uhE2rPj4hF9ch5VNA701seM/0TF/uUFD3F9aga+WdzJD 7WozmEYnwXI9CgabGjDL4AmF3ktMfy3GzVDpLV7cIBTO1bz/rasBy6jzn1BlUa8RVobl DFmsSpWBc7dJlj8nTpH6iaTMWMyzFI1M/TQ7vpOL025/PmMOjjUs76nZlSrnR0Z9zkXi cdeOTOro9UGJyJzWpCIAU2r5Qb4NZ+p98AiaXmbfBPEyql43NHVU4IgfuQv2j13rWBJ0 COCg== X-Google-DKIM-Signature: v=1; a=rsa-sha256; c=relaxed/relaxed; d=1e100.net; s=20161025; h=x-gm-message-state:mime-version:references:in-reply-to:from:date :message-id:subject:to; bh=iHu/AkQuUuYv+ZhqS8+OVOYMTc7iwnTCUyotEve6cMU=; b=t04kTq12FO71Z3QjAydtSeApnMgzhEbBfZaAeCT4jAhyzebLLObqAJCZS0IXAiHA0G PTe8+mTnIxvPkShfVfT6c5QhxkTgJV2ZbQT7HIzvz2P9af/3ucBJwRDQ0RPfnl/NBFPf 3fC1QxNPgz4jsuDao0bno+xk3gX0HZVw74nbh4igLbitY/6KGVE5vkzHnk4Pl3XPoBfI KmvBknsJzDTkLhLJ2C+RL11vCDTVYKE+VZo1NQDaCg6+CgvSWoziJjk9QxCAaRHPzYZ9 q0BO8k53VDJYSRTqH9cvBnYYgWRfXfQA80yeUp+OqDR0s11mfkem4EhHCCcmkPktzpKX awxQ== X-Gm-Message-State: AOAM533lZMF8ysHuj/IWG2R0h1ES9nhCOppyA/xi3HtY4k6mQMCH44CK kGGHr1e9xM/tgWdORCqRZfKONk+igSE1AFA/jlaujasUCkw= X-Google-Smtp-Source: ABdhPJzOtsz2ihD3Hhj+Ja/5Heg83R6JfrRvs1cwawZk3F0JOQ0R8IMRMrahux2DfuRP4GxKfvQ8ANrYTqjBGSqp90s= X-Received: by 2002:a65:6248:: with SMTP id q8mr5299923pgv.279.1628914188836; Fri, 13 Aug 2021 21:09:48 -0700 (PDT) In-Reply-To: Received-SPF: pass client-ip=2607:f8b0:4864:20::631; envelope-from=stefan.itampe@gmail.com; helo=mail-pl1-x631.google.com X-Spam_score_int: -20 X-Spam_score: -2.1 X-Spam_bar: -- X-Spam_report: (-2.1 / 5.0 requ) BAYES_00=-1.9, DKIM_SIGNED=0.1, DKIM_VALID=-0.1, DKIM_VALID_AU=-0.1, DKIM_VALID_EF=-0.1, FREEMAIL_FROM=0.001, HTML_MESSAGE=0.001, RCVD_IN_DNSWL_NONE=-0.0001, SPF_HELO_NONE=0.001, SPF_PASS=-0.001 autolearn=ham autolearn_force=no X-Spam_action: no action X-Content-Filtered-By: Mailman/MimeDel 2.1.23 X-BeenThere: guile-user@gnu.org X-Mailman-Version: 2.1.23 Precedence: list List-Id: General Guile related discussions List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Errors-To: guile-user-bounces+guile-user=m.gmane-mx.org@gnu.org Original-Sender: "guile-user" Xref: news.gmane.io gmane.lisp.guile.user:17683 gmane.lisp.guile.devel:20826 Archived-At: Okej the system starts to shape up. After some intensive hacking I managed to make a toolbox for piping binary and scheme streams. Currently it can pipe a list of 1000 000 elements typically around 1-4s. see https://gitlab.com/tampe/stis-engine On Sun, Aug 8, 2021 at 10:27 PM Stefan Israelsson Tampe < stefan.itampe@gmail.com> wrote: > I will start the development of stis-engine that is based on fibers and > will experiment with applications that separate into different network > components. > > Among things I plan to add serializers, deserializers, zipping and zero mq > networking that works > with fibers. E.g. we will stream things with fiber pipelines, use non > blocking zero mq calls, avoid > allocating large bytevectors, and use as little stack as possible in the > code. > > This code depends on stis-data and optionally guile-persists > > References: > https://gitlab.com/tampe/stis-engine > https://gitlab.com/tampe/guile-persist > https://gitlab.com/tampe/stis-data/ >