unofficial mirror of 
 help / color / mirror / Atom feed
* Guix Day - Feb 2021 - Quality Assurance notes
@ 2021-02-08 10:00 Christopher Baines
  0 siblings, 0 replies; only message in thread
From: Christopher Baines @ 2021-02-08 10:00 UTC (permalink / raw)
  To: guix-devel

[-- Attachment #1: Type: text/plain, Size: 4367 bytes --]

Here are the notes from the Quality Assurance notes pad [1]. Thanks
everyone for participating!


## What does QA mean?  

 * Non broken packages  
   * exists for python packages on core-updates  
   * Telegram package broke shortly after being added (probably due to
     the Staging merge/qt update)
   * pre-merge automated GNU Guix builds for all dependents affected by
     the change, a bot on the mailing list for example, make it
     soft/hard requirement for merge
 * Non broken Guix (guix pull works)  
   * pull to latest version works from old release  
 * Substitute availability  
   * guix pull works with substitutes (exists today!

 * Usability on foreign distros
 * Graphical installer/installer script
 * Working guix pull from current released version to latest master
 * Documentation quality  
   * Having up to date documentation  
   * document all new features + 'guix pull --news' all new features  
 * Human testing first, then automated testing and fixing
 * Up to date packages
 * "guix lint" kind of things  
    * formatting  
    * spelling/grammar  
 * Working Guix system configuration  
   * Users provide configuration for tests to happen against  
 * Working Guix System services  
   * passing system tests for services  
   * guix lint style checks?  

### Things that are probably not QA  

 * User support  

 * How to get support when something breaks, and you're not on IRC or
   the mailing list

 * 'guix install' installs the most recent version which builds / is not

 * Recovery from bad states (when guix pull doesnt' work)
   * guix package --rollback without using 'guix' command  

 * Input validation (system services)  
   * Validate config upfront, to avoid errors deep in the config  
   * Config file validation, e.g. validating the NGinx config file  

### What to do about package quality (packages that build)?  

 * build speed, it's good to find out quickly which
   packages fail to build

 * Testing prior to merging patches (patch review)  
   * Avoiding breaking packages  
   * Automatically build packages affected by patches, to spot breakages  
 * Merging branches in to master (staging/core-updates/...)  
   * How to spot breakages  
 * List of broken packages  
   * Guix Data Service:
 * Comparing two commits  
   * Through
 * Checking for whether it builds on before updating

 * Manifest checking on (Cuirass), to see if packages

 * Distinguishing between "package not built" and "package known to fail
   to build"

 * Notifications (email) when packages fail to build    

### What to do about guix pull?  

 * Broken package references, more review/testing prior to merge  

 * Doing more checking in git pre push hooks?  
   * Server side Git hook checking

 * Doing more checking in git pre commit hooks?
   * guix lint
   * guix build

 * Breaking packages involved in \`make as-derivation\`  

 * guix pull checks if revision has been processed successfully on prior to pulling

### What to do about substitute availability?  

 * Using remote build information locally (don't build packages without
   substitutes if there's evidence that they fail)

 * "Negitive substitutes" that share information about build failures  

 * Speed/latency of fetching nars+narinfos  

 * Mirroring substitutes  

 * People running their own substitute servers

[-- Attachment #2: signature.asc --]
[-- Type: application/pgp-signature, Size: 987 bytes --]

^ permalink raw reply	[flat|nested] only message in thread

only message in thread, other threads:[~2021-02-08 17:19 UTC | newest]

Thread overview: (only message) (download: mbox.gz / follow: Atom feed)
-- links below jump to the message on this page --
2021-02-08 10:00 Guix Day - Feb 2021 - Quality Assurance notes Christopher Baines

unofficial mirror of 

This inbox may be cloned and mirrored by anyone:

	git clone --mirror guix-devel/git/0.git

	# If you have public-inbox 1.1+ installed, you may
	# initialize and index your mirror using the following commands:
	public-inbox-init -V2 guix-devel guix-devel/ \
	public-inbox-index guix-devel

Example config snippet for mirrors.
Newsgroups are available over NNTP:

AGPL code for this site: git clone http://ou63pmih66umazou.onion/public-inbox.git