zarb-ml/mageia-dev/attachments/20130329/790c34e6/attachment.html


1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74

<p dir="ltr"><br>
On 28 Mar 2013 00:57, &quot;Glen Ogilvie&quot; &lt;<a href="mailto:nelg@linuxsolutions.co.nz">nelg@linuxsolutions.co.nz</a>&gt; wrote:<br>
&gt;<br>
&gt; Hi,<br>
&gt;<br>
&gt; Has anyone done, or thought about, setting up some automated testing<br>
&gt;<br>
&gt; of the Mageia installer?<br>
&gt;<br>
&gt; I am thinking something based on:<br>
&gt;<br>
&gt; <a href="https://wiki.mageia.org/en/Auto_inst">https://wiki.mageia.org/en/Auto_inst</a>, testing inside a VM, with<br>
&gt;<br>
&gt; a range of different installer configurations, like:<br>
&gt;<br>
&gt; * different languages<br>
&gt;<br>
&gt; * Free / non-free<br>
&gt;<br>
&gt; * package selections, minimal, full, custom<br>
&gt;<br>
&gt; * partitioning optons<br>
&gt;<br>
&gt; * LVM options<br>
&gt;<br>
&gt; * encryption options<br>
&gt;<br>
&gt; * filesystem types<br>
&gt;<br>
&gt; * software raid options<br>
&gt;<br>
&gt; * known error cases (too small / filesystem), /boot on something not supported<br>
&gt;<br>
&gt; * grub and grub2<br>
&gt;<br>
&gt; * different CPUs, RAM, architectures.<br>
&gt;<br>
&gt; I am thinking that if we had an auto-inst, with maybe 50 or so<br>
&gt;<br>
&gt; different test cases, all of which would then be verified by an ssh<br>
&gt;<br>
&gt; script connecting to the VM, or something like that.<br>
&gt;<br>
&gt; I&#39;ve found 3 bugs recently, all of which would have been able to be<br>
&gt;<br>
&gt; detected by something like what I am suggesting.<br>
&gt;<br>
&gt; Suggestions so far are:<br>
&gt;<br>
&gt; nicolas vigier:<br>
&gt;<br>
&gt; * For automatic testing it would be possible to use OS-autoinst :<br>
&gt;<br>
&gt; <a href="http://www.os-autoinst.org/">http://www.os-autoinst.org/</a><br>
&gt;<br>
&gt; * What we need is someone to add support for Mageia installer :<br>
&gt;<br>
&gt; <a href="https://github.com/bmwiedemann/os-autoinst/tree/master/distri">https://github.com/bmwiedemann/os-autoinst/tree/master/distri</a><br>
&gt;<br>
&gt; Pierre-Malo Deniélou:<br>
&gt;<br>
&gt; &quot;Great idea. Can you prototype it? We should use something like that for <br>
&gt;<br>
&gt; mageia 4.&quot;<br>
&gt;<br>
&gt; Anne Nicolas:<br>
&gt;<br>
&gt; &quot;I remember some people starting something about it Furthermore it could<br>
&gt;<br>
&gt; be interested to have some virtualization for basic tests once rebooted&quot;</p>
<p dir="ltr">We had been talking about it at Mandriva times but I don&#39;t remember if something was done.</p>
<p dir="ltr">Something like testing the install goes to the end + system starts with for example console on serial port in kvm to parse it for errors and check the dm comes up + maybe run run some automated test scripts.<br>

</p>