How Webomates helped Media and Advertising Giant accelerate their releases

The Profound Impact of Digitalization on Media and Advertising

A key insight from Google revealed that even a half-a-second delay can cause you a 20% drop in traffic? That’s the impact of digitalization!

OTT/Streaming services. Programmatic Advertising. Hyper-Personalization. Virtual reality. Augmented reality. Personalized content. Influencer marketing. Conversational AI. The media and advertising landscape is constantly evolving, with new buzzwords emerging even before we can fully grasp the previous ones. 

Companies need to lead these advancements—or risk losing out to the competition. This means focusing on trends like AI and ML that can help analyze user preferences and behavior to curate personalized content. The best example is the grand debut of Generative AI. Today, over two million developers use the ChatGPT platform, including more than 92% of Fortune 500 companies. 

Test applications and software in a way that’s faster and smarter.

Here, we explore how traditional media and advertising companies can achieve profitable growth by undertaking significant transformations. The key is to test applications and software more efficiently and intelligently.

Let’s dive into a case study to illustrate this further

Case Study: Enhancing Campaign Performance for a Media Giant Through Optimized Testing Solutions

Business Challenge

A prominent media company that offered custom ad solutions to its advertisers to create and run highly targeted and engaging campaigns over 11,000 TV programs from 170 networks across all platforms and devices faced challenges with its application.

The application required thorough testing, as there were several checkpoints for evaluating the campaigns’ performance.

• Precise Audience Targeting: The application relies on data-driven insights to help advertisers reach their desired demographics. This precision was crucial for advertisers to maximize the effectiveness of the campaigns and enhance the brands’ impact.
• Comprehensive Reporting: Comprehensive reporting with accurate metrics was essential for evaluating campaign success and facilitating informed decision-making based on real-time data.
• Campaign Optimization: One of the core challenges was optimizing campaigns across various screens. This required sophisticated testing to ensure that data-driven campaign improvements were effective across all platforms.
• Multiscreen Excellence: Testing multi-screen campaigns so that all campaigns performed consistently across various screens—whether on TVs, mobile devices, or desktops was complex.

The in-house technical teams faced several challenges, such as: 

• Integration testing issues due to multiple teams working on the same product across various locations. 
• High volume of work: The lack of AI tools made it difficult to innovate and scale.
• Dynamic requirements: The application kept evolving to align with business and technical needs.
• Technical Debt kept increasing due to False positives

The media company needed a robust testing solution that could address these complexities and provide a seamless, high-quality user experience across the platform.

How did Webomates Help

Webomates is an advanced, patented AI-driven Testing-as-a-Service (TaaS) platform. Our cloud-based solution provides functional software testing for User Interfaces (including native), mobile applications, APIs, and set-top/gateways. The platform is both language-agnostic and adaptable to any deployment environment. 

Webomates approach includes leveraging the power of its patented AI engines and the experience of capable testers to create hundreds or thousands of test cases and scripts and execute them using multiple testing execution techniques like AI automation and AiHealing.

1. Create High-Value Test Cases: Webomates set up a fully operational test automation framework for the application within 2 weeks with 386 complex test cases covering critical scenarios. 

These test cases focused on essential elements such as precise audience targeting, reporting accuracy, and multiscreen performance, ensuring that all key aspects of the application were rigorously tested.

2. Automate the Critical Test Cases: After a rigorous review, 307 high-priority test cases were automated, optimizing the testing process for efficiency and effectiveness.

Translating manual test cases to automated ones gives you enhanced efficiency, productivity, and testing coverage. However, not every test case can (or should) be automated. The decision to automate or not should be based on various factors, such as the testing objectives of the particular project, complexity, availability of skilled resources, and Return on Investment (ROI).

3. Comprehensive Testing: Webomates prepared tests that specifically addressed the complexities of the application’s streaming and multiscreen streaming. This comprehensive approach ensured that campaigns performed consistently and optimally, regardless of the platform or device on which they were displayed.

4. Parallel Automation: To expedite testing, parallel automation executions were set up for two different versions of the application’s streaming reports. This parallel execution significantly reduced the time required for testing, allowing for quicker releases and faster campaign optimizations.

5. Dynamic Test Data Management: A key innovation in the testing process was the use of Generative AI to create dynamic test data for testing multiple complex scenarios. Webomates’ AI engine can automatically generate diversified and sophisticated datasets for testing purposes.

6. Efficient Defect Management: Webomates CQ identified a comprehensive range of defects, categorizing them for prioritized resolution. 

It identified 98 defects out of which 95 were marked valid while 2 were considered invalid, and 1 could not be reproduced. 

Among the 95 valid defects, 13 were classified as Priority 1 (high priority), 44 as Priority 2, and 38 as lower priority, ensuring critical issues were addressed promptly.

7. Address False Failures: False failures are a common challenge in test automation, but Webomates’ trademarked “AiHealing ®” addresses false failures by identifying and fixing false positives in the test automation. It allows you to proactively update your scripts before they break.

It fixes automation scripts broken due to locators, timeouts, feature changes, and so on. Webomates AiHealed 383 Test cases for the application within just a few hours. 

Results and Impact

With Webomates’ holistic and AI-powered intelligent automation testing solutions, the media company was able to overcome the complexities of its application and achieve the following results:

• Increased Productivity: Webomates’ AI-based test automation helped them reduce testing efforts by 67%. They saved 103 Person Weeks/ 10 Months of the estimated effort, allowing teams to focus on other high-value activities.

• Optimized campaign performance: By ensuring the accuracy of audience targeting and campaign optimization, the media company saw improved campaign effectiveness and ROI.

• Detailed reporting: The comprehensive reporting that included access to accurate, real-time performance data empowered them to make data-driven, informed decisions and adjust campaigns as needed to maximize impact.

• Multiscreen consistency: Rigorous testing ensured a seamless, high-quality experience on any device, boosting user engagement and brand impact.

• Reduced time-to-market: The combination of parallel automation and dynamic test data management helped expedite the testing process, enabling faster releases and updates to the platform.

• Cost Efficiency: The company achieved a remarkable 67% reduction in QA costs. Webomates‘ cost-effective solution aided them in optimizing their software development budget and enabling them to reallocate funds towards critical business initiatives.

AI is there to help you increase your efficiency! Introduce your team to AI testing for improved efficiency and speed up your software delivery! Schedule a demo to discover the full potential of our AI-driven software testing solutions that can boost your business outcomes, increase productivity, and accelerate product releases. 

You can also reach out to us at info@webomates.com

Tags: Artificial Intelligence, Generative AI in Software Testing, Intelligent Test Automation, Software Testing, Test Automation, Testing as a service, Webomates