Search This Blog

Tuesday, May 10, 2016

Test Automation Tool Comparision Matrix

Feature QTP(UFT) Selenium Ranorex Coded UI Test Complete Sahi
Language Support VB Script Java, C#, Ruby, Python, Perl
PHP , Javascript
C#, Vb.Net C#, VB.Net VBScript, C#Script, Jscript,C++Script,DelphiScript TBD
Windows (Non-browser)
based Application support
Yes No Yes Yes Yes TBD
Browser support Google Chrome (uptill ver 23), Internet Explorer , Firefox ( ver 21)  Google Chrome , Internet Explorer , Firefox , Opera , HtmlUnit  Google Chrome , Internet Explorer , Firefox , Safari  IE (For building OR), Google Chrole, Firefox IE,Firefox,Chrome,Safari, Opera TBD
Environment Support Only Windows Windows , Linux , Solaris
OS X , Others (If brower & JVM or
Javascript support exists)
Windows Only Windows Only Windows TBD
Technologies Support a) Web based applications
b) Windows based applications
c) .Net applications
d) Swing Applications
e) SAP
f) Oracle Applications
g) Siebel
h) ActiveX applications
i) Peoplesoft
j) Mainframe terminal emulators
k) Web Services
l) Terminal Emulator
m) Delphi
n) Power Builder
o) Windows Mobile
p) SOAP
TBD
Windows Applications
a) Web based applications
b) Windows based applications
c) .Net applications
d)WPF
e)Qt
f)Java
g) Delphi
h)VB6
i)ActiveX
j)Microsoft Visual Fox Pro
k)Power Builder
l)Microsoft Office GUI
m)Microsoft Access
n)Microsoft Dynamics AX
o)Microsoft Dynamics CRM
p)Microsoft Dynamics NAV
q) AIr
r)Infragistics
s)Dev Express
t)Janus
u)Syncfunction
v)Telrik
w)Skinsoft

Web Applications

1)HTML5
2)Ajax
3)Silverlight
4)Ext Js
5)Adobe Flash/Flex/Air
6)JQuery
7)ASP.Net
8)Google Web Tool Kit
9)YUI Library
10)Java Applets
11)Sencha GXT
12)DHTMLX
13)SweetDevRia
14)MochiKit
15)MooTools
16)Pyjs
17)Rico
Web based applications
Windows Applications
Supported-Windows, Web, Mobile, Flash, .net, Java, PowerBuilder,Delphi,Flex,  Air,WebServices(SOAP)
Not Sure about ERP

TBD
Mobile (Phones & Tablets)
support
Different commercial product i.e.
HP UFT Mobile (formerly known as
MobileCloud for QTP)
Android , iPhone & iPad ,
Blackberry , Headless WebKit
Android , iOS Windows phone, windows phone apps. Android & iOS TBD
Framework Easily integrated with HP Quality Center or HP ALM (separate
commercial products)
Selenium + Eclipse + Maven / ANT
+ Jenkins / Hudson & its plugins /
Cruise Control + TestNG + SVN
Visual Studio +TFS+SVN+Jenkins Easily integrated with MTM. 1.  QAComplete & ALMComplete from SmartBear
2.  QC from HP
TBD
Continuous Integration Possible through Quality Center
/ ALM or Jenkins
Possible through Jenkins / Hudson
/ Cruise Contro
Possible through Jenkins / Hudson
/ Cruise Contro
Possible through Cruise Control Possbile through Jenkins TBD
Object Recognition
/ Storage
Inbuilt Object Repository (storing
Element Id, multiple attributes) along
with weightage that gives flexibility
on deviation acceptance in control
recognition
UI Maps and different object location
strategy such as -XPath Element ID
or attribute DOM
UI Maps and different object location
strategy such as -XPath Element ID
or attribute DOM
UI Maps and identification of objects by unique properties. Also support Xpath based object identification. Built-in Namemapping mechanism  TBD
Image based Tests Easily possible Possible but not easy Easily possible Not possible Possible TBD
Reports Quality Center has in-built awesome
dashboards
Integration with Jenkins can give
good reporting & dashboard
capabilities
Integration with Jenkins can give
good reporting & dashboard
capabilities
MSTest has built in reports. We can also create custom reports. Built-in reports Of TestComplete is informative and detailed reports also generated when integrated wth test management tools QAComplete, ALMComplete and QC TBD
Software Cost License & Annual maintenance
fees
Zero License & Annual maintenance
fees
License License & Annual maintenance
fees
TBD
Coding Experience of
Engineer
Not Much Should be very good along with
technical capabilities of integrating
different pieces of framework
Should be very good along with
technical capabilities of integrating
different pieces of framework
Should be very good at C# and object oriented concepts. Hands on scripting is madatory TBD
Script Creation Time Less High High Medium Medium TBD
Hardware resource (CPU
+ RAM) consumption during
script execution
High Low Low High High TBD
Product Support Dedicate HP support along with
support forums
Open Source Community Dedicate Ranorex support along with
support forums
Microsoft support along with forums. Smartbear support with open forums TBD