[Mageia-dev] automated installer testing

Fri Apr 5 00:36:13 CEST 2013

On Thu, 04 Apr 2013, Nicolas Lécureuil wrote:
+
+> Le jeudi 28 mars 2013 13:57:11 Glen Ogilvie a écrit :
+> > Hi,
+> > 
+> > Has anyone done, or thought about, setting up some automated testing
+> > of the Mageia installer?
+> > 
+> > I am thinking something based on:
+> > https://wiki.mageia.org/en/Auto_inst, testing inside a VM, with
+> > a range of different installer configurations, like:
+> > 
+> > * different languages
+> > * Free / non-free
+> > * package selections, minimal, full, custom
+> > * partitioning optons
+> > * LVM options
+> > * encryption options
+> > * filesystem types
+> > * software raid options
+> > * known error cases (too small / filesystem), /boot on something not
+> > supported * grub and grub2
+> > * different CPUs, RAM, architectures.
+> > 
+> > I am thinking that if we had an auto-inst, with maybe 50 or so
+> > different test cases, all of which would then be verified by an ssh
+> > script connecting to the VM, or something like that.
+> > 
+> > I've found 3 bugs recently, all of which would have been able to be
+> > detected by something like what I am suggesting.
+> > 
+> > 
+> > Suggestions so far are:
+> > 
+> > nicolas vigier:
+> > * For automatic testing it would be possible to use OS-autoinst :
+> > http://www.os-autoinst.org/
+> > * What we need is someone to add support for Mageia installer :
+> > https://github.com/bmwiedemann/os-autoinst/tree/master/distri
+> > 
+> > Pierre-Malo Deniélou:
+> > "Great idea. Can you prototype it? We should use something like that for
+> > mageia 4."
+> > 
+> > Anne Nicolas:
+> > "I remember some people starting something about it Furthermore it could
+> > be interested to have some virtualization for basic tests once rebooted"
+> > 
+> > Regards
+> > Glen Ogilvie
+> 
+> we should look to openQA too. ( https://github.com/bmwiedemann/openQA )
+> but seems it needs a huge work to adapt but i think t's worth it
+
+openQA is a web frontent for OS-autoinst.
+
+