All posts by admin

Employing Right Strategy for Mobile App Testing Automation


Employing Right Strategy for Mobile App Testing Automation

Over the years mobile apps have become almost a core enterprise strategy. With the increasing competition, not just newest and most innovative ideas are found of great importance but also the user experience that these apps offer. Thus, to make your app completely bug-free has become important before you finally launch it. This need of making your app bug-proof has lead to the requirement of better testing strategy giving rise to the need of mobile test automation.

However, not all strategies are meant for every software type. This is why for different app type, a different strategy is needed. To pick the right strategy, it is important to consider certain factors.

Below you have the factors; a brief look at them will get you right decision.

Check if your test will do well for numerous or infinite permutation and combinations?

Most of the comprehensive strategies hold good for target devices that are relevant and special parameters for network infrastructure. For improving the testing strategies, any app maker needs to bring into use a combination of manual and automated testing tools that work effectively both for functional and non-functional areas. This increases the importance of choice of tools for getting your application well tested and then hit the market right on time without exceeding your budget.

How to overcome the challenges faced in mobile test automation process?

It is no difficult a task to overcome all kinds of challenges that one may have to face while conducting a mechanized testing process. Taking care of a certain factors can make things go smoothly. First on the list is to choose a powerful framework. This can be created if you simply optimize your choices for target devices by mixing simulators and real devices. Second, you’ll need to have a proper support for the app mobile platform together with other factors such as script reusability, ownership cost, and other expenses.

To know more please download full version of whitepaper.

Download Whitepaper

Testing Automation – Myth Demystification & Right Approach


An Introduction to Testing Automation

Testing automation is a boon in many ways. It assures better defect finding without the involvement of too much of strenuous efforts. However, it has to be noted that it cannot provide a complete substitution for human capacity required for designing and execution of the process, where a high level of mindfulness may be needed.

The Myths that Rule the Industry

Though it is true that a high demand for automation has become a norm for the industry, there are certain myths surrounding the fact. Many do feel that every new project has a requirement for it. Some even believe that with the increase in the usage of this new age testing methodology, there doesn’t remain the need of writing the test cases or run any manual testing process at all or even undergo any kind of impact analyses of the process.

One needs to remember this methodology is to remove the defects and lessen the efforts and not to change the entire scenario of the process. The other related elements still remain important and they cannot be nullified.

Demystification of the Myth

Mechanized efforts will surely improve the quality of the activities involved in the process and ensure higher efficiency of the tests conducted. But this cannot in any case completely nullify the human capacity needed for well thought out planning, high quality designing, and reasonable execution of a process. In this paper, you’ll learn vital aspects of testing mechanization and how it can be used in more effective manner.

To state it briefly and more precisely, any process should be automated in a gradual manner and that too after you’ve got hold of a proper repository for test case that includes all the assumptions made, clear-cut Quality Check and Quality Assurance processes along with a well-defined draft of testing objectives decided. Again proper estimation for the tasks and related objectives and vice-versa would be needed before you automate the process.

To know more about the Approach download and read full whitepaper.

Download Whitepaper

Importance of Functional Software Testing


Importance of Functional Software Testing

Almost similar to black box testing, functional software testing is an efficient method to validate the stability of an application. It is one of the common methods known and is far more popular than any other testing techniques. One of the main reasons behind its popularity is its usage during the development phase. Other than that, it is used for testing whether a particular piece of software is capable enough to be used by the organization or it has issues or technical glitches.

Why such a testing is often needed?

Often, a new code or program is added to the existing software. At such times, it is essential to have the system, i.e. the software along with its newly added and previously available functionality tested to know whether it is still working after the modifications.

As the test will require you to include the components of the application, the network, and the code database of the entire system software, it will also help you make out if everything within the software system from its code to its design structure is working in equilibrium. In other words, it will verify how smooth each of the parts of the system works when put together.

How to Benefit the Most From the Testing Practice?

In order to ensure that your functional software testing process turns out to be successful and remains completely result oriented throughout the process, it gets important that you take care of the extension of the requisite within your management policy. With a working management policy, you’ll be able to clearly mention the methodology for developing the test cases for testing particular features scheduled for the market release.

Again, the management should have a proper description of the ways to map out the cases for converting them into test cases capable of verification. This way, it will be easier to ensure if the software is capable enough to satisfy the functionality requirements. At the same time, it will prove beneficial in making sure that the software functionality remains unchanged even when you have introduced modifications into it.

To know more please download and read full whitepaper.
Download Whitepaper

Why do you need automation teams, why not empower your testers?

Automation-Team-whitepaper-1

The Current Approach to Test Automation is flawed

Since the dawn of the software era, companies have been trying to automate the most mundane tasks like regression testing. Unfortunately very few companies have been successful. The HPs, IBMs, and Microsoft’s of the world have the best-in-breed test automation solutions for their customers and in addition to it open source tools like Selenium and others are available for free. In spite of all the tool availability, 80% of the companies in the world are still below a 20% automation level. Specialized software companies are today addressing this challenge utilizing new approaches.


Testers and business analysts specialize in business processes. They have sound knowledge of the domain and business processes, and are critical in designing and defining the test scenarios. Running these well defined tests is a necessary evil, but using testers and business analysts to run these tests frequently is not the best use of their talent. To make the best use of their testers’ time, organizations realized the need for a test automation tool. They either licensed a test automation tool – QTP, Test Complete, Ranorex, Rational Functional Test, Silk Test, TFS – or used an open source tool like Selenium, Selendroid, Robotium, Robo framework, etc. In most cases, these test automation tools were handed directly over to the testing teams, with the assumption that the testers could simply use this “Test Automation” tool, and everything would be automated. However, they were only able to move the automation needle from 0% to 8-9%, which resulted in making the overall cost higher than testing everything manually!



When organizations realized that the test automation tools were too complex to be used by testers, they created automation teams. Today, test automation tools are owned mostly by a new team called the “Automation Team”, and the automation needle has moved up from 8-9% to 15-20%. This approach is still more expensive than testing the apps manually, and the addition of yet another team in the process has resulted in the need for an automation framework, additional management oversight, etc.



Companies are forced to deal with the complexity of the test automation tools, and are building automation frameworks or adding third party solutions like Qualitia, Turnkey C-Factory etc.. to ease the pain. A few firms have totally eliminated automation and are back to manual testing.

The primary objective for test automation was to take away the routine regression test execution burden from the creative testers. To achieve the objective, organizations bought test automation tools. To address the complexities of the test automation tools, companies formed automation teams. To address the complexities of test automation tools, companies built frameworks or purchased third party frameworks. All to achieve a 15-20% automation level. And in many cases, at a higher cost.

What companies need instead is a simple tool in the hands of their testers and business analysts, so that they can automate their routine business process executions and focus on the business outcome rather than the technical outcome.


Verifaya is one of script less test automation platform more suitable for testing teams to automate their mundane jobs like smoke tests and regression tests.

Verifaya is an automation platform that is script less hence easy to use by all testers with small learning curve. It has inbuilt libraries, hence automation is faster and no need to build reusable functions. Verifaya supports all latest technologies and devices, hence no need to use multiple tools for automation. Verifaya has an inbuilt framework, hence test cases are available within couple of weeks for running regression suites on software builds and most suitable for agile software development. Verifaya integrates with external test management, defect management; continuous integration etc., hence fits well into software development ecosystem seamlessly.


Download Whitepaper

Emerging drivers changing landscape of Software Testing Business

Software testing is omnipresent & the importance of software testing is undoubted. Testing process is one of the oldest forms of verification & validation carried out by software developer, engineer, practitioner or end user. Landscape of software testing has changed metamorphically with revolution of technology, business expectations, and IT adaptations from domain companies, methodology & ever increasing complexity of applications.


Emerging drivers which are redefining landscape of Software Testing Business


Rapid Adoption of IT systems:
Globally as more and more systems are being digitized, the need for testers has increased drastically. The availability of the resource pool that has the necessary domain knowledge is also shrinking which has lead to a resource pool crunch. That said, it would be paramount to ramp-up Business Analysts and Product Primes to acquire the pre-existing knowledge within the domain and innovate upon that knowledge. Bringing testers up to speed then becomes the responsibilities of the Analysts and Product primes. The secondary problem of non-availability of Skilled (automation scripts) testers to perform the necessary functions gives rise to a requirement of machine based frameworks to fill in the gaps of non-availability of the resource pool. This gives rise to the lateral industry of automated code generation for developers speeding solution development as well as automated test case generation aiding the Quality Assurance folks.


Impedance mis-match during knowledge transfer:
When the knowledge transfer of the Domain has to flow from the Analyst to the developers and testers, the impedance mis-match in translating the knowledge in terms of articulating the nuances of the innovation and the capability of a tester (as per say) to understand and assimilate that knowledge into the respective Testcases is mind numbingly high. This high mismatch in what was expected to be built and tested and what landed up getting built and tested will lead to heartburns during acceptance scenarios.


Complexity of the Product:
The choice of the technologies and frameworks and platforms used in manufacturing and building the solution also adds up to the complexity of the test cycles. ERP implementation, PDLC of a Enterprise Product, SaaS based Solution Delivery, Cloud Compute enabled solutions, Data Center Management, Legacy Integration etc, are not only rich in semantics from a Domain perspective but are also complex to assimilate to understand the breadth and depth of testing strategies required to validate and provide assurance of quality.


Heterogeneity of the Systems:
Added to the complexity of the product, the IT eco-system in which these product operates today are made up of different systems from vendors such as IBM, Oracle, Microsoft, SAP, Sun and HP (including home grown solution) that contains various platforms patched up together through ESB and SOA integration. Even the choice of Operating systems and hardware platforms have become varied that performing a configuration and version compatibility test for any given platform has started to look daunting.


Shrinking GTM and Focus on short gain cycles:
Typically the Product development lifecycles and Go to market cycles are shrinking in the light of ever changing business dynamics. Everyone wants to put the product out in the market as soon as possible capturing the customer share as soon to gain control on the changing business dynamics. Agility, it seems is paying dividends for such short GTMs and providing a quick ROI. SaaS based and On-line solutions are moving towards perpetual beta platforms which can rapidly adapt to the customers’ needs. This also holds true for ERP implementation cycles which are shrinking by the day. What used to take 5 years is now being reduced to 1 year implementation cycles with rapid customizations.


Shrinking IT Budgets:
Discretionary spend has been monitored more closely and also the overall IT budget is shrinking by the day. CFOs are breathing down the CTOs neck for efficiency and productivity for every dollar spent. This has lead to cost cutting in terms of support staff (people) and reduction in spend of applications and products (license). CFOs are moving away from making any large capital commitments at the outset impacting high CAPEX vendors. Converting the fixed costs to variable cost is the Financial Officers edict across LOBs.


Global Recession Driving Margin Pressures:
Global recession being the new reality, the pressure on margins (not to mention survival) is high. Corporates are looking for operational efficiencies to increase the margins to retain the operating profits while the top line sinks. Increasingly Corporates are betting on digitizing and automating all processes that can be automated which shall convert to cost savings by downsizing the cost centers.


Demand for Highly Reliable Products and Service:
The general tolerance for a good quality product has come down. Consumers are demanding ‘excellent’ quality products. In effect, what was excellent yesterday is just good enough today. Reliability and Relevance are the two parameters that are driving the world markets. If a product or a solution is not meeting the standards of ‘excellence’ then there is no place in the market for the solution. Corporates are trying to leverage machines (computers, robots, software) as much as possible to automate the core solutions. Automation unlike manual processes provides a high degree of reliability when employed throughout the production cycle.


Regulatory Compliance:
With the increase in the number of regulations in any given sector (HIPAA, SOX, GLBA etc…) the burden of certifying the product, platform, application or service has increased dramatically. This has led to the amortization of working capital from core production cycles (bread and butter cycles) to compliance activities. Given the same capital budget (which seemingly is shrinking as we speak), the number of activities in production has increased to cater to the compliance demands. Corporates again are seeking automated compliance testing tools to ensure certification which increases the operational efficiencies. The compliance requirements has made the Corporates to refactor the dynamics of a verification and validation LOB from a cost center to a value center.


Increased Threats and Security Compliance:
The threat levels have been ever increasing and the types and nature of threats have become innovative. Security Compliance has become a core activity of any validation cycles for products and solutions. Penetration testing, Functional Security, Security Standards Compliance and more adds to the release and build test cycles as a natural PDLC flow increasing the number of core activities to be performed by QA. Corporates and QA departments are seeking automation platforms in these and other areas to release enough bandwidth of the existing people so that what has to be (and can be) performed as manual verification has enough people available to perform.


As a result of the above drivers the demands of the broader industry can be captured as follows:


      * Increased specialization of product base moving the definition owners up the pyramid (moving from testers to analysts and product primes).
      * Business analysts and Product Managers are demanding tools which enables them to create test scenarios without having to write code
      * Demand for extreme traceability of Testcases and test steps to the requirements has increased rapidly.
      * Demand for pre-built adapters and catalogs which can readily integrate and work as expected during last mile integration is on the rise
      * Virtualization and Automation is becoming the norm of the day.
      * Demand for baseline Testcases covering top few probable customizations of a large product base is increasing. Pre-built Test Content ‘cartridges’ are the need of the day.
      * Demand for subscription based usage is on the rise.
      * Demand for outsourcing the validation and assurance and SLA management is on the rise.
      * Demand for metrics based reports with high degree of SLA while enabling automation is on the rise.
      * Demand for regulatory compliance catalogs for verification is on the rise.
      * Growing need for security verifications as part of the automation solutions is been on the rise.



Simply to put, testing is not a gating function anymore. Testing has become ever more so an inherent QoS (Quality of Service) across and throughout the life cycle of production or service delivery. Testing has become a change agent addressing risk early on in the lifecycle and continually assuring reliability, relevance and compliance apart from providing functional acceptance and assurance for the product or service. Testing as per say has become a value creator and quality differentiator for the end product to provide the required edge to compete in the market place of excellence.

Learn how Just Answer improved quality in agile development environment

Learn how Just Answer Improved quality in
agile development environment

...

“I was very impressed with the quality of Verifaya and with
how fast test cases were automated. The automated test
suite is contributing significantly to our quality.”

Challenges

  • Improve quality in agile development environment.
  • Reduce dependency on manual testing.
  • Expand test coverage.

RESULTS

  • Initial 646 test cases were automated in 4 months.
  • Test coverage increased from 646 to 2,400 test cases.
  • 92% of the regression suite is automated (more than 2,200 test cases).
  • A complete regression cycle runs on a daily basis.

Learn how one of the largest retailer achieve 350 automations completed in less than three months

Learn how one of the largest retailer
achieve 350 automations completed
in less than three months
This company (revenue: $17 billion) is a leading global supplier of office products and services.

Challenges

  • Improve quality in agile development environment.
  • Easy automation maintenance with daily high volume changes.
  • Expand test coverage .

APPROACH

Automation Project

Web based ecommerce application for ordering and processing of office supplies
supporting multiple languages/regions globally.

Technology

Dot Net, C#

Connectivity

Direct Access. Web site access from Verifaya
IP’s provided by customer.

RESULTS

  • 350 automations completed in less than three months.
  • Automated test cases for multiple regions across multiple browsers
  • Ability to run full regression on any frequency within each sprint.
  • Quick maintenance turnaround with frequent high volume changes.

Learn how a Global Medical Device Company achieved 100% of automation completed in 2 months

Learn how a Global
Medical Device Company achieved 100% of
automation completed in 2 months
Mettler Toledo (revenue: $2.5 billion) is global manufacturer and marketer of precision instruments for use in laboratory, industrial and food retailing applications

METTLER TOLEDO

“Verifaya has automated for us what QTP couldn’t.  What’s
more, the team is fast, thorough, and supplies exactly what
we need in terms of automated regression test support.”

Challenges

  • Inept Technology/Tools to support testing their WPF application.
  • Lack of skilled resources to build automation in house.
  • Low number of test executions due to high manual effort .

APPROACH

Automation Project

End to end testing for Device Service Management (DSM) application used to configure different instrument parameters and the SAP based application.

Technology

Dot Net, WPF, SAP

Connectivity

DSM front end application installed locally on Verifaya Machines and connected to back end MT systems via VPN

RESULTS

  • 100% of automation completed in 2 months.
  • Cost was reduced by replacing manual testing with automated testing
  • End to end testing with different applications on different environments
  • Expanded coverage by testing on mulitple environments

Learn how one of the largest Financial Services Company Automated test cases cover 7 global regions across multiple browsers

Learn how one of the largest Financial Services
Company Automated test cases cover 7 global
regions across multiple browsers
This financial services company (revenue: $35 billion) is the world’s largest card issuer by purchase volume, processing millions of transactions daily as the premium network for high-spending card members.

Challenges

  • Low percentage (<10%) automation achieved using QTP.
  • Predictability of outcome based pricing.
  • Improve quality in agile development environment.

APPROACH

Automation Project

End to end testing (UI, database and web services) of their Merchant Interactive
Web Solution (OMS). This application spans over 7 global regions/languages.

Technology

Dot Net

Connectivity

Application accessed via VPN

RESULTS

  • 92% of automation completed within each sprint.
  • Productivity of up to 4x compared to QTP.
  • Automated test cases cover 7 global regions across multiple browsers.
  • Ability to run full regression on any frequency within each sprint.