As someone that likes testing, this was pretty interesting. Maybe I should be a "consultant tester." :)
Use of Independent Testers for User Acceptance Testing.
For a client project that I just wrapped up, the client hired another consulting firm to provide someone to do user acceptance testing (UAT). UAT is very important in consulting. From the client side, it proves that they are getting what they asked for. From the consultant's side it validates that we delivered as agreed and that we should be paid accordingly.
So the client hired one person from a third-party consulting firm, though it is really more of a staffing firm than a true consulting firm. The plan was for him to go through the same source documents that we did, collaborate with the business user, and create tests that sampled the population to make sure we were meeting the business requirements. He was never supposed to rely on us, except for us to explain how we did something to see if it was the cause of a discrepancy.
Unfortunately, our client did not offer any assistance to the UAT tester. Without anyone to explain anything, the tester turned to us for help. For a while we were spending 25 percent of our time explaining things to him. That was bad for several reasons. First, we were on a tight deadline and this was an unscheduled task. Second, if we explain how something works to the tester, we are biasing him. We could have told him how to do everything and passed the UAT the first time, but we refrain from such unethical behavior.
Part of the reason it took so long to explain things was that our tester did not know SQL. Since pretty much everything he was checking on was SQL-related since it was a data warehouse reporting application, this was a serious time waster. I knew we were in trouble when I overheard my teammate explaining how to run a stored procedure in SQL Server Query Analyzer!
Despite this, I think hiring someone to do independent UAT if the client does not have the skills in-house is a good thing. Testers are less expensive than developers in general, even if they are consultant testers. And although he did not find many discrepancies, the challenge of making sure he didn’t certainly drove us on. [Darrell Norton's Blog]
10:51:03 PM
|