----- Original Message -----
> Below is the current QA landscape.
>
> There are several hidden milestones here.
>
> + scheduling of pcp-daily in my QA farm has moved from ad hoc when time
> permits to cron-driven ... this means each host is getting exercised at
> least twice a week, or 28,000+ tests per week
>
> + failures in absolute terms are below 10 on all hosts, with some even
> showing the nirvana-like "0" failures
>
> + overall failure rate is below 1%
>
> + total failures are less than 100
>
> We have never been in such a good position, ever, in the past.
Mind == blown.
> Now if I can just get some assistance with the recalcitrant ones (115, 361,
> 753 and 944) we'll quickly get this down to "onesies and twosies" per host.
I've set aside time next week, so assistance on these is incoming. :)
> As always, I would encourage suggestions of platforms we should ADD or DROP
> from the QA farm.
Fedora 17 and 18 are past EOL (https://fedoraproject.org/wiki/End_of_life),
so they could be dropped I guess.
Looks like there's no OpenIndiana (any Solaris build?) there - did that
VM never get up / come back? I have one here I'll be attempting to get
into my QA farm next week, but its a year or two dated by now. I think
FreeBSD is up to v10 - I have a v9 somewhere, it exposed a few toolchain
updates/issues recently IIRC, so might be worth a look.
Win32/Win64? ;) /me runs ... still much dev work needed there first,
I know.
Thanks Ken!
--
Nathan
|