From mboxrd@z Thu Jan 1 00:00:00 1970 Return-Path: Received: from mp0.migadu.com ([2001:41d0:403:4876::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by ms13.migadu.com with LMTPS id KJjWInWp5mbwPQAAqHPOHw:P1 (envelope-from ) for ; Sun, 15 Sep 2024 09:31:33 +0000 Received: from aspmx1.migadu.com ([2001:41d0:403:4876::]) (using TLSv1.3 with cipher TLS_AES_256_GCM_SHA384 (256/256 bits)) by mp0.migadu.com with LMTPS id KJjWInWp5mbwPQAAqHPOHw (envelope-from ) for ; Sun, 15 Sep 2024 11:31:33 +0200 X-Envelope-To: larch@yhetil.org Authentication-Results: aspmx1.migadu.com; dkim=fail ("headers rsa verify failed") header.d=debbugs.gnu.org header.s=debbugs-gnu-org header.b=u7bfrel2; dkim=fail ("headers rsa verify failed") header.d=ngraves.fr header.s=ovhmo4487190-selector1 header.b=3LaiNyj2; spf=pass (aspmx1.migadu.com: domain of "guix-patches-bounces+larch=yhetil.org@gnu.org" designates 209.51.188.17 as permitted sender) smtp.mailfrom="guix-patches-bounces+larch=yhetil.org@gnu.org"; dmarc=pass (policy=none) header.from=gnu.org ARC-Message-Signature: i=1; a=rsa-sha256; c=relaxed/relaxed; d=yhetil.org; s=key1; t=1726392685; h=from:from:sender:sender:reply-to:reply-to:subject:subject:date:date: message-id:message-id:to:to:cc:cc:mime-version:mime-version: content-transfer-encoding:content-transfer-encoding:resent-cc: resent-from:resent-sender:resent-message-id:in-reply-to:in-reply-to: references:references:list-id:list-help:list-unsubscribe: list-subscribe:list-post:dkim-signature; bh=oRm8DGiHg7uzCk0s74NLc13lf+H0te8/dMzse2NxyRI=; b=SLTnAi5dW0mwl3FPnevDkAQ7/kZpyw3iJ4UluWKJ1xI2oKIXyx/Y8ck54nLeLzV5zA28Fz WshgRzKyAL1bCypTcSo4kBnMxXoSskjswe5t2AMQTCcUYlIZGPWk7Z6j2cLuYDOcTz+HZT dcERs3aSQuSZn0nP3ywhf8mX6pyr+1hnZ6P2j1jEEgshrh/e254KXYfXoBP2zQ9x8NO7yy gfjYyOg8sGUDMS5obGat1IWun/fPzuEDE0WE08gz67VfpYDPz2CnzQb4EsijgZmIeseCrt f/QXQSARQRpYE8OuMizbHg8ARK/zfj6WEVSzVFaCUtoRSiPTxNRiqll1MJ1MTg== ARC-Authentication-Results: i=1; aspmx1.migadu.com; dkim=fail ("headers rsa verify failed") header.d=debbugs.gnu.org header.s=debbugs-gnu-org header.b=u7bfrel2; dkim=fail ("headers rsa verify failed") header.d=ngraves.fr header.s=ovhmo4487190-selector1 header.b=3LaiNyj2; spf=pass (aspmx1.migadu.com: domain of "guix-patches-bounces+larch=yhetil.org@gnu.org" designates 209.51.188.17 as permitted sender) smtp.mailfrom="guix-patches-bounces+larch=yhetil.org@gnu.org"; dmarc=pass (policy=none) header.from=gnu.org ARC-Seal: i=1; s=key1; d=yhetil.org; t=1726392685; a=rsa-sha256; cv=none; b=GiXOU9/N+HWB0sfHMguQxWN3uwg5O43H0EBzxHNgM4tE+mqDiYQxNDkyhsYO+G7hLXLUFr ZrKctCOaSA4k6jvzDSrz0HXVGvIjE0trc+NZoTwzYohsuHqpWTC0SOE9jOegdjXeUVgg1O vjUO/ozsA2f0wmoOTRj9uDp/4/H+Cjm1JrHFox1b0banTL73OmqfH87vr00glSSmlFyBQa CZcU8+VVGGtc3M8t4Vxm66YsrWgIVeDn4F7FRsbCAaLtlBa7mLDBIR3ybWWX8M1s0UP8n2 DhglHtP0Nsyl8IMhw0LkWryVcGca6dRr/of7qJTLHUAGcL/csyJrf/KHT1LCZw== Received: from lists.gnu.org (lists.gnu.org [209.51.188.17]) (using TLSv1.2 with cipher ECDHE-RSA-AES256-GCM-SHA384 (256/256 bits)) (No client certificate requested) by aspmx1.migadu.com (Postfix) with ESMTPS id BB2E2E219 for ; Sun, 15 Sep 2024 11:31:25 +0200 (CEST) Received: from localhost ([::1] helo=lists1p.gnu.org) by lists.gnu.org with esmtp (Exim 4.90_1) (envelope-from ) id 1spl4v-0006uN-K9; Sun, 15 Sep 2024 04:57:57 -0400 Received: from eggs.gnu.org ([2001:470:142:3::10]) by lists.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_256_GCM_SHA384:256) (Exim 4.90_1) (envelope-from ) id 1spl4r-0006ry-TB for guix-patches@gnu.org; Sun, 15 Sep 2024 04:57:53 -0400 Received: from debbugs.gnu.org ([2001:470:142:5::43]) by eggs.gnu.org with esmtps (TLS1.2:ECDHE_RSA_AES_128_GCM_SHA256:128) (Exim 4.90_1) (envelope-from ) id 1spl4r-0005Lv-Hj for guix-patches@gnu.org; Sun, 15 Sep 2024 04:57:53 -0400 DKIM-Signature: v=1; a=rsa-sha256; q=dns/txt; c=relaxed/relaxed; d=debbugs.gnu.org; s=debbugs-gnu-org; h=MIME-Version:References:In-Reply-To:Date:From:To:Subject; bh=oRm8DGiHg7uzCk0s74NLc13lf+H0te8/dMzse2NxyRI=; b=u7bfrel29MO055GlHAR+BMylho3MkRkeQKVQ8teTI0v3cloF3czA/drZC8aSXUa34vJgD4FtRsxhM8f4TeV7XJEmcsaouq9o12NW7hkk5LvF+fBVpWTNPcKq+M9GyLS385wqSNE+JEHZyWQnnCsIg0yAi1WPhyPu5lXtr6mbyQ+hrWYlT57FowwNz5XNZRha3EqjQhzkNeiy3Fg+FT48pnARkYdlwXUCxkwHquZ69ooYC5lSm4ygNUEj3G1eu/57lomjdFLw/2WGJEHfoEmFVgpH42x5eD0XQAA4B2YzvhfL7Zmnq4B+KugWKPfATCrpthl6tllMKCUVNGZjRm6a7A==; Received: from Debian-debbugs by debbugs.gnu.org with local (Exim 4.84_2) (envelope-from ) id 1spl53-0005wU-4h for guix-patches@gnu.org; Sun, 15 Sep 2024 04:58:05 -0400 X-Loop: help-debbugs@gnu.org Subject: [bug#73266] [PATCH 7/9] gnu: Add python-curated-transformers. Resent-From: Nicolas Graves Original-Sender: "Debbugs-submit" Resent-CC: guix-patches@gnu.org Resent-Date: Sun, 15 Sep 2024 08:58:05 +0000 Resent-Message-ID: Resent-Sender: help-debbugs@gnu.org X-GNU-PR-Message: followup 73266 X-GNU-PR-Package: guix-patches X-GNU-PR-Keywords: patch To: 73266@debbugs.gnu.org Cc: ngraves@ngraves.fr Received: via spool by 73266-submit@debbugs.gnu.org id=B73266.172639066722756 (code B ref 73266); Sun, 15 Sep 2024 08:58:05 +0000 Received: (at 73266) by debbugs.gnu.org; 15 Sep 2024 08:57:47 +0000 Received: from localhost ([127.0.0.1]:48400 helo=debbugs.gnu.org) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1spl4k-0005ut-Gn for submit@debbugs.gnu.org; Sun, 15 Sep 2024 04:57:46 -0400 Received: from 11.mo581.mail-out.ovh.net ([87.98.173.157]:57857) by debbugs.gnu.org with esmtp (Exim 4.84_2) (envelope-from ) id 1spl4g-0005tk-2I for 73266@debbugs.gnu.org; Sun, 15 Sep 2024 04:57:42 -0400 Received: from director10.ghost.mail-out.ovh.net (unknown [10.109.139.40]) by mo581.mail-out.ovh.net (Postfix) with ESMTP id 4X62491l3Jz1Kb5 for <73266@debbugs.gnu.org>; Sun, 15 Sep 2024 08:57:29 +0000 (UTC) Received: from ghost-submission-55b549bf7b-7q4w2 (unknown [10.110.164.228]) by director10.ghost.mail-out.ovh.net (Postfix) with ESMTPS id 097391FD1D; Sun, 15 Sep 2024 08:57:29 +0000 (UTC) Received: from ngraves.fr ([37.59.142.110]) by ghost-submission-55b549bf7b-7q4w2 with ESMTPSA id 15ReNnih5mZcmxkAQ/de3A (envelope-from ); Sun, 15 Sep 2024 08:57:29 +0000 X-OVh-ClientIp: 86.246.19.221 Date: Sun, 15 Sep 2024 10:57:12 +0200 Message-ID: <20240915085720.13323-7-ngraves@ngraves.fr> X-Mailer: git-send-email 2.46.0 In-Reply-To: <20240915085720.13323-1-ngraves@ngraves.fr> References: <20240915085720.13323-1-ngraves@ngraves.fr> MIME-Version: 1.0 Content-Transfer-Encoding: 8bit X-Ovh-Tracer-Id: 11635331112642601698 X-VR-SPAMSTATE: OK X-VR-SPAMSCORE: 0 X-VR-SPAMCAUSE: gggruggvucftvghtrhhoucdtuddrgeeftddrudekfedgtdelucetufdoteggodetrfdotffvucfrrhhofhhilhgvmecuqfggjfdpvefjgfevmfevgfenuceurghilhhouhhtmecuhedttdenucenucfjughrpefhvfevufffkffojghfggfgsedtkeertdertddtnecuhfhrohhmpefpihgtohhlrghsucfirhgrvhgvshcuoehnghhrrghvvghssehnghhrrghvvghsrdhfrheqnecuggftrfgrthhtvghrnhepvdehleeiffehtedvlefhffffjeefgfduhfetkeevheeiteduiedugfekuedtheejnecuffhomhgrihhnpehgihhthhhusgdrtghomhenucfkphepuddvjedrtddrtddruddpkeeirddvgeeirdduledrvddvuddpfeejrdehledrudegvddruddutdenucevlhhushhtvghrufhiiigvpedtnecurfgrrhgrmhepihhnvghtpeduvdejrddtrddtrddupdhmrghilhhfrhhomhepnhhgrhgrvhgvshesnhhgrhgrvhgvshdrfhhrpdhnsggprhgtphhtthhopedupdhrtghpthhtohepjeefvdeiieesuggvsggsuhhgshdrghhnuhdrohhrghdpoffvtefjohhsthepmhhoheekuddpmhhouggvpehsmhhtphhouhht DKIM-Signature: a=rsa-sha256; bh=oRm8DGiHg7uzCk0s74NLc13lf+H0te8/dMzse2NxyRI=; c=relaxed/relaxed; d=ngraves.fr; h=From; s=ovhmo4487190-selector1; t=1726390649; v=1; b=3LaiNyj2sqVG4/lzEcPpJqGEH/lRN859BCiLFvC9RnnqfPym/4xYOW1fh+CozuUp6kYbea/S 0+OI7Bg1jQtDTargOQ10etUJ0mK3Jki2J+0shFvmLHgc3UJ37kZ4hnAGkXGhnIo0HpCKob2S+99 eIJk98NQArmad1KLgzQALsJNVz5JZKGvyNZ8n1NZAEdHth7+7LWEKb3NHbSPPr5jDHhJxqSpLqd Wu2AGwPF/6kjmcQ1cJS+EWcDwQaRWoInuqvs9wPtaYJ74WxUFHlvFG2AsjkJZNMRRRQzvLXNRj6 PzApyeD+bj2qtQEPPy7vCiYYJS3cvrTo7utlSyPCkqT4A== X-BeenThere: debbugs-submit@debbugs.gnu.org X-Mailman-Version: 2.1.18 Precedence: list X-BeenThere: guix-patches@gnu.org List-Id: List-Unsubscribe: , List-Archive: List-Post: List-Help: List-Subscribe: , Reply-to: Nicolas Graves X-ACL-Warn: , Nicolas Graves via Guix-patches From: Nicolas Graves via Guix-patches via Errors-To: guix-patches-bounces+larch=yhetil.org@gnu.org Sender: guix-patches-bounces+larch=yhetil.org@gnu.org X-Migadu-Flow: FLOW_IN X-Migadu-Country: US X-Migadu-Spam-Score: -4.41 X-Spam-Score: -4.41 X-Migadu-Queue-Id: BB2E2E219 X-Migadu-Scanner: mx10.migadu.com X-TUID: VhrG9CtSqqkd * gnu/packages/machine-learning.scm (python-curated-transformers): New variable. Change-Id: I42cf780097456f5a8a9a9efc2a56e2c082d2a938 --- gnu/packages/machine-learning.scm | 55 +++++++++++++++++++++++++++++++ 1 file changed, 55 insertions(+) diff --git a/gnu/packages/machine-learning.scm b/gnu/packages/machine-learning.scm index 89fcd3c1b7..d1b282fea8 100644 --- a/gnu/packages/machine-learning.scm +++ b/gnu/packages/machine-learning.scm @@ -2480,6 +2480,61 @@ (define-public python-cutlery @end itemize") (license license:expat))) +(define-public python-curated-transformers + (package + (name "python-curated-transformers") + (version "0.1.0") + (source + (origin + (method url-fetch) + (uri (pypi-uri "curated-transformers" version)) + (sha256 + (base32 "04k54r5cxjl3l7xs4kx4cfnqsjr7gdlr577sp7sl7qgrk3kfqjbm")))) + (build-system pyproject-build-system) + (arguments + (list + #:test-flags + '(list ; Most ignored tests require network. + "--ignore=curated_transformers/tests/tokenizers/test_auto_tokenizer.py" + "-k" (string-append "not test_special_pieces" + " and not test_auto_encoder" + " and not test_auto_decoder" + " and not test_auto_causal_lm" + " and not test_from_hf_hub_to_cache" + " and not test_from_hf_hub_to_cache_legacy" + " and not test_checkpoint_type_without_safetensors" + " and not test_hf_hub_failures" + ;; These have been added when downgrading curated_tokenizers. + " and not test_camembert_tokenizer_toy_tokenizer" + " and not test_roberta_tokenizer" + " and not test_xlmr_toy_tokenizer")))) + (propagated-inputs (list python-catalogue + python-cutlery + python-huggingface-hub + python-pytorch + python-tokenizers)) + (native-inputs (list python-pytest)) + (home-page "https://github.com/explosion/curated-transformers") + (synopsis "PyTorch library of transformer models and components") + (description + "This package provides a @code{PyTorch} library of transformer models and +components. It helps to download state-of-the-art models that are composed +from a set of reusable components. The stand-out features of Curated +Transformer are: + +@itemize +@item Supports state-of-the art transformer models, including LLMs such as +Falcon, Llama, and Dolly v2. +@item Each model is composed from a set of reusable building blocks, providing +many benefits: implementing a feature or bugfix benefits all models ; Adding +new models to the library is low-effort. +@item Consistent type annotations of all public APIs, hence a great coding +support from IDEs. Integrates well with your existing type-checked code. +@item Great for education, because the building blocks are easy to study. +@item Minimal dependencies. +@end itemize") + (license license:expat))) + (define-public python-autograd (let* ((commit "c6d81ce7eede6db801d4e9a92b27ec5d409d0eab") (revision "0") -- 2.46.0