Winners 2016

Best Agile Project

Awarded for the best use of an agile approach in a software testing project.
Judges will be looking for:

  • Demonstration of an agile approach taken to the project
  • Excellent communication between the entrant and the development team
  • Outstanding communication demonstrated within the software testing team
  • Effective utilisation of a best practice method/technique
  • Successful outcome that meets the aims and targets set
  • Evidence of a commitment to high quality and standards
Category winner

Home Office – Immigration IT Portfolio

Immigration Platform Technologies (IPT) is replacing five outdated suites of technology systems used to support the immigration caseworking process in the UK. It is delivering Access UK (an online visa application service for customers in the UK) and Atlas (a modern caseworking system) to replace several outdated and expensive IT systems.

Best Mobile Testing Project

Awarded for the best use of technology and testing in a mobile application project.
Judges will be looking for:

  • Demonstration of the best use of technology in a mobile application project
  • Demonstration of a clear and concise “preparatory phase”
  • Clear and defined functional requirements
  • Effective utilisation of a best practice method/technique
  • A successful outcome that meets the aims and targets set
  • Evidence of a commitment to high quality and standards
Category winner

Tech Mahindra

This entry presents an “out-of-the box” mobile testing solution that was developed for a leading European retail customer. This solution was developed with a view to support improved end user experience while using mobile apps in both iOS and Android. Triggered by market competition and an accumulation of below-par ratings, this solution was first introduced in July 2015 and has since played a vital role in rejuvenating the retailer’s mobility aspirations. The business essentially wanted a quality gate to address mobile user experience issues with apps that were exhibiting optimal performance in the lab but failed to live up to expectation in the production environment. In terms of revenue they anticipated that better user experience could accelerate product sales (and as a result revenue) by about 25% from the current levels.

Best Test Automation Project – Functional

The award for the best use of automation in a software testing project.
Judges will be looking for:

  • Demonstration of the best use of automation in a software testing project
  • Utilisation of a well-developed test suite of testing scripts
  • Any technical problems that were encountered were successfully resolved
  • Effective utilisation of a best practice method/technique
  • A successful outcome that meets the aims and targets set
  • Evidence of a commitment to high quality and standards
Category winner

Maveric Systems in partnership with Metro Bank

With the ultimate aim of furthering their online presence and providing a unique user experience, Metro Bank embarked on revamping its existing internet banking portal for commercial customers. Assuring the quality of this initiative without sacrificing the three key tenets of quality assurance – quality, time and economy – Maveric Systems, the independent assurance provider for the initiative, completely automated the quality assurance engagement against the backdrop of the semi-agile development model and aggressive go-live timelines. With the use of a proprietary automation framework that achieved 85% automation, the testing strategy reaped the desired quality, cost, and time benefits through the use of open source tools, continuous regression, testing at API/Middleware level – all working towards the overarching goal of continuous integration.

Best Test Automation Project – Non-Functional

The award for the best use of automation in a software testing project.
Judges will be looking for:

  • Demonstration of the best use of automation in a software testing project
  • Utilisation of appropriate test technique to identify underlying root cause
  • Any technical problems that were encountered were successfully resolved
  • Effective utilisation of a best practice method/technique
  • A successful outcome that meets the aims and targets set
  • Evidence of a commitment to high quality and standards
Category winner

Tech Mahindra

Integrated continuous non functional testing.
This entry presents our solution for a leading European telco involving the adoption of continuous integration processes to execute and deliver the complete range of non-functional test services. The transformation from traditional NFT practices to i-CNFT (integrated continuous non-functional testing) was essentially driven by the adoption of DevOps methodologies. Over a period of 8 months this realignment of NFT has seen not only the introduction of automation tools to achieve faster turnaround times – but a paradigm shift in general practices and perception of NFT as a whole. The new way of working also saw the introduction of early NFT assurance, to mitigate issues early in the lifecycle and also shift right activities, to ensure that feedback from production systems was used to improve test input.

Graduate Tester of the Year

A recent graduate (who has graduated in the last 2 years) who has shown outstanding commitment and development in the testing field.
Judges will be looking for:

  • Evidence of outstanding commitment and development in the testing field
  • Excellent communication with colleagues and clients
  • Efforts to keep up-to-date with guidelines and trends / Dedication to self training
  • Effective utilisation of a best practice method/technique
  • Consistent successful outcomes that meet the aims and targets set
  • Evidence of a commitment to high quality and standards
Category winner

Aaron Gibbon, BJSS

Aaron Gibbon joined the autumn intake of the BJSS Graduate Programme in 2015 having just completed a First Class Honours degree in Computer Science and a Master of Engineering from the University of Leeds.

Tracing an interest in the fundamentals of testing from an early age, Aaron has played an important role in the testing of BJSS’ flagship NHS Spine 2 project, singlehandedly producing core test automation components on which the programme relies and which the NHS still continues to use. By engaging with the testing community, Aaron independently produced these components, saving the NHS the equivalent of 20,000 man-hours every week.
As a creative tester who respects quality and deadlines, Aaron hopes to specialise in performance and load testing, with a deep understanding of system architecture, Aaron wants to be able to debug and understand architectural issues and articulate the non-functional implications of certain architectures and to suggest improvements.

Testing Manager of the Year

Awarded to the most outstanding individual test manager or team leader over the last 12 months.
Judges will be looking for:

  • Consistent and outstanding leadership skills
  • Excellent people management skills
  • Outstanding communication with the software testing team
  • Examples of procedures put in place to ensure high quality results
  • Commitment to keep up-to-date with guidelines and trends
  • Evidence of a commitment to high quality and standards
Category winner

Isabelle Magnusson, Ticketmaster

We, her colleagues, have nominated Isabelle for all of her outstanding hard work and dedication over the last 12 months. She is brilliantly demonstrating our values of teamwork, accountability and service excellence throughout our projects and is working tirelessly building the QA team. She has an eye for details and her positive attitude makes the work a lot easier and more fun! This is not reflected only in the QA team, but also in the scrum teams, development teams and the product teams, making sure our focus is on delivering world-class products with high quality!

Best Overall Testing Project – Retail

Awarded to the most outstanding testing project in the retail sector.
Judges will be looking for:

  • Evidence of working closely with the organisation to deliver projects on time and within budget
  • Evidence that the entry is responsive to different and/or complex needs of the client
  • Effective utilisation of a best practice method/technique
  • A successful outcome that meets the aims and targets set
  • Evidence of a commitment to high quality and standards
Category winner

Marks and Spencer (M&S)

Founded in 1884, Marks and Spencer has grown from a single market stall to an international, multi-channel retailer with 914 UK stores, an e-commerce platform, and a customer base of 32 million.

 

In 2014, along with our IT implementation partner, Tata Consultancy Services (TCS), we initiated the ‘Distribution Centre 2’ (DC2) program, to rationalise our UK General Merchandise (GM) warehouse network. The program aims to lower our picking and fulfilment costs, by facilitating consolidation of our UK network activity, and enabling the direct to store service from our national distribution centre (NDC).

 

Our team partnered with TCS in a systems integrator role, to manage the end-to-end testing solution and program deployment, involving multiple vendors. Despite challenges faced by the engineering vendors, the program was completed on time, thanks to TCS’ effective tools and technology strategy.

Best Overall Testing Project – Finance

Awarded to the most outstanding testing project in the finance sector.
Judges will be looking for:

  • Evidence of working closely with the organisation to deliver projects on time and within budget
  • Evidence that the entry is responsive to different and/or complex needs of the client
  • Effective utilisation of a best practice method/technique
  • A successful outcome that meets the aims and targets set
  • Evidence of a commitment to high quality and standards
Category winner

Brickendon Consulting

Brickendon’s solution reduced the cost by 95%, saving around £15.3 million for its clients. The solution helped to fix the clients ‘ software development process hampered by conflicting demands, an ineffective test strategy and a lack of accountability and governance. The solution also helped to achieve steep decline in production issues.

Best Overall Testing Project – Gaming

Awarded to the most outstanding testing project in the gaming sector.
Judges will be looking for:

  • Evidence of working closely with the organisation to deliver projects on time and within budget
  • Evidence that the entry is responsive to different and/or complex needs of the client
  • Effective utilisation of a best practice method/technique
  • A successful outcome that meets the aims and targets set
  • Evidence of a commitment to high quality and standards
Category winner

Sony Interactive Entertainment Europe

Test data visualisation in games.
Faced with the challenge of testing a game featuring an expansive and complex world that would generate significant amounts of test data, a mapping tool was developed to visualise this data in a single location, which can be searched, filtered and displayed in an easily digestible way.

 

The interactive map consolidates and automatically visualises test data from various sources such as manual testing, AI driven automated testing telemetry, in-game defects and various game state information.
The tool functions in a similar way to Google Maps. The user is able to zoom, pan and browse the map in an intuitive way making it easily accessible.
The tool reduces the manual overhead required to gather each piece of data and enables and expedites informed decisions on risk, test coverage and/or focus for a range of stakeholders.

Amdocs Best Overall Testing Project – Communication

Awarded to the most outstanding testing project in the communication.
Judges will be looking for:

  • Evidence of working closely with the organisation to deliver projects on time and within budget
  • Evidence that the entry is responsive to different and/or complex needs of the client
  • Effective utilisation of a best practice method/technique
  • A successful outcome that meets the aims and targets set
  • Evidence of a commitment to high quality and standards
Category winner

Accenture in partnership with Virgin Media

With operational efficiency and customer experience critical to our telecoms business, we developed ‘Einstein’, an ingenious solution to resolve service faults more quickly and slash the number of call-outs to customers’ homes.
Testing Einstein was a challenge of unprecedented complexity. We were testing a system that was itself testing 9.4M pieces of customer equipment to remotely identify and prioritise network errors.
Unable to use a real-world test environment or build a simulation of comparable scale, our methodology was creative and pragmatic:

• Expanding standard test techniques to gather and risk-assess 1910 trillion fault scenarios
• Best-practice automation utilising intelligent, cognitive techniques
• Developing a virtual stub with a pre-existing test environment
• Reverse-engineering scenarios to ensure close-as-possible real-world experiences

 

The testing for Einstein was immensely successful:
• Executed on time, to budget
• 6 test phases completed in 3 months, despite 15 CRs
• 0 business-critical defects reported during warranty

 

This led to a high-quality release to achieve our goals:
• Reduction in call-outs, saving £450Kpa
• £1.5Mpa cost savings through fewer equipment swaps
• £1.2Mpa cost savings through faster phone resolutions
• 12% customer satisfaction

Best Use of Technology in a Project

Awarded for outstanding application of technology in a testing project.
Judges will be looking for:

  • Outstanding application of technology in a testing project
  • The latest, most up-to-date technology was correctly and effectively used
  • Demonstration of an outstanding approach and method taken to the project
  • Effective utilisation of a best practice method/technique
  • A successful outcome that meets the aims and targets set
  • Evidence of a commitment to high quality and standards
Category winner

Cognizant Technology Solutions

The client’s innovation focused on connected energy products and was designed to give people more control over their homes, anytime and anywhere. To assure best quality of the product, the testing service provider’s team designed a BDD-style testing framework with futuristic technologies like OCR and LUX sensors to validate the device displays, Appium for mobile testing, Selenium for web testing and Ember chip-enabled SiLabs USB dongle with AT-Commands to test the device firmware.

 

The testing team developed a mobile device farm as a replacement for a third party device testing solution, which reduced the overall cost of the mobile testing by 15%. Scheduled validation on devices (every few seconds) was automated, as it was unrealistic to test them manually. This reduced the need for hardware by at least 20% and reduced effort by nearly 40%. 85% of regression scripts were automated, giving test teams flexibility to execute on-demand.

 

The testing team developed a mobile device farm as a replacement for a third party device testing solution, which reduced the overall cost of the mobile testing by 15%. Scheduled validation on devices (every few seconds) was automated, as it was unrealistic to test them manually. This reduced the need for hardware by at least 20% and reduced effort by nearly 40%. 85% of regression scripts were automated, giving test teams flexibility to execute on-demand.

 

The testing team’s initiatives led to a steep drop in customer complaints (per 100K customer accounts), which were reduced, from 2507 (Q2 2015) to 1574 (Q2 2016).

Worksoft Testing Team of the Year

Awarded to the most outstanding overall testing team of the year.
Judges will be looking for:

  • Outstanding communication demonstrated within the software testing team
  • Evidence of achieving project aims and targets through effective team work
  • Evidence of successful team working/team building
  • Evidence of a strong team ethos
  • Evidence of a team commitment to high quality and standards
Category winner

Tech Mahindra

Teams are generally stable entities, working on the same project for many years, with cake days as staff reach 5, 10, 20 years of service, turnover replacing like with like, shared experiences, habits, routines and familiarity with the tasks at hand. Occasionally an opportunity is presented to create a completely new team – and our entry is one of those occasions.

Testing Management Team of the Year

Awarded to the testing management team that has shown consistently outstanding leadership.
Judges will be looking for:

  • Consistent and outstanding leadership skills
  • Excellent people management skills
  • Outstanding communication with the software testing team
  • Examples of procedures put in place to ensure high quality results
  • Keeping up-to-date with guidelines and trends
  • Evidence of a commitment to high quality and standards
Category winner

Lloyds Banking Group

Group Operations Business Testing Services (GOTS) management team plays a pivotal role in the planning and management of testing processes for a large UK based financial services group. Using a combination of innovation and automation, the GOTS team has been able to drive higher levels of efficiency and quality, which has become a market differentiator for the bank. The GOTS management team enables business process aligned testing for the bank and oversees a team of 140+ members working across geographies. The group overall demonstrates a culture that aligns with the organisation’s values, inspires individual and collective efforts while cementing diverse contributions.

The management team’s Business Continuity Plan was tested when floods hit one of the bank’s offshore sites. The team managed re-location of associates to alternate offshore sites and additional delivery responsibilities were shared across other locations, avoiding impact to business operations. The GOTS team has ensured zero critical defects for over 190 business critical projects worth £400 million budget with over £5 million in business testing spend.

Most Innovative Project

Awarded for the project that has significantly advanced the methods and practices of software testing.
Judges will be looking for:

  • The project has significantly advanced the methods and practices of software testing
  • Created new methods and tools in the testing field
  • An attempt to push boundaries within the industry
  • Successful delivery and execution of project
  • Consistent successful outcomes that meet the aims and targets set
  • Evidence of a commitment to high quality and standards
Category winner

Tech Mahindra

This entry presents the non-functional testing of an IoT (Internet of Things) platform for a tier 1 European electronics, healthcare and lighting customer. They were launching a personal health solution platform that combines health/wellness data from its own and third party wearable health devices like wristbands, NFC (near field communication) based watches and pedometers etc. Validating the non-functional aspects of this platform was always considered a challenge given the technologies involved and their complexities. This demanded a robust solution that could truly emulate multiple device communications to simulate real life load on servers and systems.

 

This is where the “Internet of Things” Non Functional Test Assurance (IoT-NFTA) solution was conceptualised. The solution helped to achieve improved end customer experience, accurately predict scalability and CAPEX requirements.

Best User Experience (UX) Testing in a Project

The award for the best use of user experience testing in a project.
Judges will be looking for:

  • Evidence of carrying out high quality end user research suitable for the project
  • Evidence of user engagement throughout the delivery
  • Effective utilisation of a best practice method/technique
  • Evidence of promoting innovation, research and best practices in the wider field of UX testing
  • A successful outcome that meets the aims and targets set
  • Evidence of a commitment to high quality and standards
Category winner

HARMAN Connected Services

Creating a world class betting and gaming experience with Ladbrokes
Ladbrokes is a world leader in the betting and gaming industry with over 2700 betting outlets in the UK, Ireland, Belgium and Spain and over 800,000 active online customers. (Ladbrokes PLC, 2016)

With HARMAN being their trusted technology partner, Ladbrokes had all the ingredients to build & test their multi-channel companion app “THE GRID”, which set a benchmark in the B&G industry with its industry first features.

HARMAN’s UX testing team’s role in this engagement was to primarily test/asses the ease of use of their multi-channel product. Also to collaborate effectively with the design & product development team to ensure the product is designed, operates & performs in an intuitive manner to the end users.

Leading Vendor

Awarded to the vendor who receives top marks for their product/service and customer service.
Judges will be looking for:

  • Evidence of a commitment to high quality and standards to customers
  • Commitment to customer satisfaction
  • Evidence of value for money
  • Evidence of reliability, flexibility and speed of installation
Category winner

nFocus Testing

nFocus Testing are an industry leading multi-awarding winning test consultancy operating across the UK since the year 2000, with specialisms around test management, test automation, agile, performance testing and DevOps.

 

This award submission covers a real success story from this year with one of the UK’s largest investment management and financial planning firms. The organisation approached nFocus with their existing testing tool hampering their move towards DevOps.

 

nFocus’ consultancy helped the company select the right tooling in VSTS, migrated existing assets into VSTS, and saved them £100k+ in efficiency gains and licensing costs. nFocus also further supported the client’s journey towards DevOps through test automation.
With an impressive client base, powerful testimonials, an innovative team including apprentices & grads, plus a unique approach to sales & marketing, nFocus have a recipe for continued success.

Micro Focus
European Software Testing Award

This main and overall award of the evening will be awarded to the tester, manager, or team that judges felt has excelled in all areas and surpassed every other individual, project, or organisation within the industry.

Award winner

Tech Mahindra

Outstanding Achievement Award

Voted on by the judges, this award is to celebrate an outstanding achievement by a renowned and acknowledged veteran in the testing field who has shown consistent commitment to the testing industry.

Award winner

Gojko Adžić