[Mageia-dev] automated installer testing

Fri Apr 5 19:58:13 CEST 2013

Le vendredi 5 avril 2013 00:36:13 nicolas vigier a écrit :
+> On Thu, 04 Apr 2013, Nicolas Lécureuil wrote:
+> > Le jeudi 28 mars 2013 13:57:11 Glen Ogilvie a écrit :
+> > > Hi,
+> > > 
+> > > Has anyone done, or thought about, setting up some automated testing
+> > > of the Mageia installer?
+> > > 
+> > > I am thinking something based on:
+> > > https://wiki.mageia.org/en/Auto_inst, testing inside a VM, with
+> > > a range of different installer configurations, like:
+> > > 
+> > > * different languages
+> > > * Free / non-free
+> > > * package selections, minimal, full, custom
+> > > * partitioning optons
+> > > * LVM options
+> > > * encryption options
+> > > * filesystem types
+> > > * software raid options
+> > > * known error cases (too small / filesystem), /boot on something not
+> > > supported * grub and grub2
+> > > * different CPUs, RAM, architectures.
+> > > 
+> > > I am thinking that if we had an auto-inst, with maybe 50 or so
+> > > different test cases, all of which would then be verified by an ssh
+> > > script connecting to the VM, or something like that.
+> > > 
+> > > I've found 3 bugs recently, all of which would have been able to be
+> > > detected by something like what I am suggesting.
+> > > 
+> > > 
+> > > Suggestions so far are:
+> > > 
+> > > nicolas vigier:
+> > > * For automatic testing it would be possible to use OS-autoinst :
+> > > http://www.os-autoinst.org/
+> > > * What we need is someone to add support for Mageia installer :
+> > > https://github.com/bmwiedemann/os-autoinst/tree/master/distri
+> > > 
+> > > Pierre-Malo Deniélou:
+> > > "Great idea. Can you prototype it? We should use something like that for
+> > > mageia 4."
+> > > 
+> > > Anne Nicolas:
+> > > "I remember some people starting something about it Furthermore it could
+> > > be interested to have some virtualization for basic tests once rebooted"
+> > > 
+> > > Regards
+> > > Glen Ogilvie
+> > 
+> > we should look to openQA too. ( https://github.com/bmwiedemann/openQA )
+> > but seems it needs a huge work to adapt but i think t's worth it
+> 
+> openQA is a web frontent for OS-autoinst.
+
+yes but w/o openQA you have errors when starting os-autoinst
+