{"title":"Factors Affecting Test Automation Stability and Their Solutions","authors":"Nagmani Lnu","volume":206,"journal":"International Journal of Computer and Systems Engineering","pagesStart":114,"pagesEnd":118,"ISSN":"1307-6892","URL":"https:\/\/publications.waset.org\/pdf\/10013510","abstract":"<p>Test automation is a vital requirement of any organization to release products faster to their customers. In most cases, an organization has an approach to developing automation but struggles to maintain it. It results in an increased number of flaky tests, reducing return on investments and stakeholders\u2019 confidence. Challenges grow in multiple folds when automation is for User Interface (UI) behaviors. This paper describes the approaches taken to identify the root cause of automation instability in an extensive payments application and the best practices to address that using processes, tools, and technologies, resulting in a 75% reduction of effort. <\/p>","references":"[1]\tB. Shea, \u201cSoftware testing gets new respect,\u201d InformationWeek, July 2000. \r\n[2]\t\u201cTime Estimation for software testing,\u201d devmio - Software Know-How, 08-Feb-2016. (Online). Available: https:\/\/devm.io\/testing\/time-estimation-for-software-testing-128078#:~:text=Statistically %20speaking%2C%20testing%20occupies%2020,as%2035%20to%2050%20percent (Accessed: 18-Jan-2023). \r\n[3]\tZippia. \"16 Amazing Agile Statistics (2023): What Companies Use Agile Methodology\" Zippia.com. Nov. 27, 2022, https:\/\/www.zippia.com\/advice\/agile-statistics\/\r\n[4]\tR. Krish, \u201cTest automation framework \u2013 challenges in the ever changing technology scenario,\u201d Test Automation Framework \u2013 Challenges In The Ever Changing Technology Scenario - page 4. (Online). Available: https:\/\/www.siliconindia.com\/guestcontributor\/guestarticle\/383\/test-automation-framework-%E2%80%93-challenges-in-the-ever-changing-technology-scenario.html (Accessed: 26-Jan-2023). \r\n[5]\t\u201cHow to find flaky selenium test suite,\u201d LambdaTest, 06-Sep-2022. (Online). Available: https:\/\/www.lambdatest.com\/blog\/flaky-selenium-test-suite\/ (Accessed: 26-Jan-2023). \r\n[6]\tOwain Parry, Gregory Kapfhammer, Michael Hilton, and Phil McMinn, \u201cA survey of flaky tests a survey of flaky tests,\u201d A Survey of Flaky Tests. (Online). Available: https:\/\/dl.acm.org\/doi\/fullHtml\/10.1145\/3476105 (Accessed: 26-Jan-2023). \r\n[7]\tVinodjo, \u201cTest analytics - azure pipelines,\u201d Azure Pipelines | Microsoft Learn. (Online). Available: https:\/\/learn.microsoft.com\/en-us\/azure\/devops\/pipelines\/test\/test-analytics?view=azure-devops (Accessed: 26-Jan-2023). \r\n[8]\tsteved0x, \u201cAssociate automated tests with test cases azure test plans,\u201d Azure Test Plans | Microsoft Learn. (Online). Available: https:\/\/learn.microsoft.com\/en-us\/azure\/devops\/test\/associate-automated-test-with-test-case?view=azure-devops (Accessed: 26-Jan-2023). \r\n[9]\tK. Rungta, \u201cXpath in selenium,\u201d Guru99, 21-Dec-2022. (Online). Available: https:\/\/www.guru99.com\/xpath-selenium.html (Accessed: 26-Jan-2023). \r\n[10]\tM. Fayaz, \u201cAzure devops vs AWS Devops,\u201d Cloud Training Program. (Online). Available: https:\/\/k21academy.com\/amazon-web-services\/aws-devops-vs-azure-devops\/ (Accessed: 26-Jan-2023). \r\n[11]\tChcomley, \u201cWhat is azure devops? - azure DevOps,\u201d Azure DevOps | Microsoft Learn. (Online). Available: https:\/\/learn.microsoft.com\/en-us\/azure\/devops\/user-guide\/what-is-azure-devops?view=azure-devops (Accessed: 26-Jan-2023)\r\n[12]\tQentelli, \u201cIt Is Automation, Not Automagic: Avoiding Failures in Test Automation Projects,\u201d https:\/\/www.qentelli.com\/thought-leadership\/insights\/it-automation-not-automagic-avoiding-test-automation-failures (Accessed: 23-Dec-2023)","publisher":"World Academy of Science, Engineering and Technology","index":"Open Science Index 206, 2024"}