Skip to main content

Automated browser testing in 2018

Every now and then I do some research on browser testing. More specifically I try to find and evaluate what kind of ready to use solutions or libraries have emerged since my previous research or if some of the previously tested solutions has come up with something new.

Back in September 2017 I had some extra time on my hands and I used a couple of days to see what are the new and interesting solutions at that time. I came across some tools that I have used in the past and found two new interesting options in which one stood out.

Say hello to TestCafe


The most interesting solution that I found was called TestCafe. It's a open source Node.js library from a company called Developer Express Inc. They also have a commercial product called TestCafe (confusing) which I haven't tried as the open source library provided everything I was interested in and it seemed to be under active development.

The thing that caught my interest at first was that this library doesn't depend on WebDriver i.e. the API used by Selenium. All the browser testing tools that use real browsers and I have tried before have been dependent on WebDriver API meaning that even if the tool itself is e.g. a Node.js library it still needed to run the WebDriver Java API in the background.

Another thing where TestCafe excels compared to it's rivals is it's browser support. Basically all major browsers and operating systems are supported.

Writing tests with TestCafe


As TestCafe is a Node.js library the tests can be written in JavaScript and the library also provides TypeScript support. I've written a example with three test cases that can be found from my github repository, the last one fails on purpose to demonstrate failure reporting.

TestCafe uses a concept called Selectors for selecting DOM elements to test or to execute a action on. In addition it provides a concept of client functions that adds the ability to read data from client side e.g. the current URL of the browser window.

Running tests


Given that TestCafe is a Node.js library the tests can be executed with node as simply as running command npm test. Another option is to execute the tests in a docker container which is a great option for CI servers. I have created examples and instructions of both in my github repository.

Real life experiences


I have been using TestCafe in a work project since November 2017 to run browser tests locally with Node.js and in CI within docker. So far I have been very impressed on how good the performance and stability have been compared to previously used solutions. I'm still going to keep my eyes open for old and new rivals but for now I consider TestCafe to be the solution that I'll be using and comparing others to.

Other solutions to consider


Commercial tool from the same company Developer Express Inc. also called TestCafe. I haven't tried this one so I can't really say anything about it.

Cypress.io is another new tool that runs without WebDriver. This one supports only Chromium based browsers and I couldn't get anything but their own examples to run so my experience with this one wasn't so great.

Comments

  1. Thanks for the review! Here is an explanation of TestCafe version history:

    https://testcafe-discuss.devexpress.com/t/what-is-the-difference-between-the-open-source-version-and-the-paid-version-of-the-testcafe/253/2

    ReplyDelete
  2. I liked your article and its very interesting and thought that you might be interested in LambdaTest. LambdaTest is a newly launched cross-browser testing tool gaining popularity among testers community.

    Since you've already written a post on it, so I thought to introduce you to it. You can give it a look here: www.lambdatest.com. Please include this in your post if you think it deserves to be here.

    ReplyDelete

Post a Comment

Popular posts from this blog

DIY home automation, new generation

I've had my DIY home automation system for controlling outlets and reading sensor data running for about two years now. The system has been working fine and I haven't had any need to touch the code since I added the sensor reading to it, until a few months back.

Need for new functionality
Few months ago I got a new IoT toy for a lend from a friend until I'd get my own toys, a ruuvitag sensor beacon. Ever since I found the ruuvitag for the first time from kickstarter I had the idea of getting a bunch of ruuvitags and adding their weather station sensor readings as part of my home automation system.

The original home automation backend included only tellstick compatible devices and was written in Python, and in my mind it was kind of a hack. The ruuvitag beacons communicate via BLE i.e. Bluetooth Low Energy and that meant that I needed to add functionality to read the beacon data via bluetooth.

I found a ruuvitag Python library and initially thought that I'd just use that a…

Dedicated time for learning Python at work

In the spring of 2019 I had the opportunity to use some paid work time for learning something new.
I decided to spend the given time to brush up on my Python knowledge. I had some experience in programming with Python but not much and I didn't have a understanding of Python conventions or ecosystem.
Limited time frame I had a limited time frame that was split to four sessions. In addition to the time given for each session I spent at least the same amount of time on preparing each session.
First session, the basics It was quite hard to find a resource that summarised Python basics on a sufficient level but I managed to find Alex Martinelli's slides Python for Programmers from 2007 that contained exactly what I was looking for.
Even though the slides are from over a decade ago and the Python version was 2.x at that time all the information is still applicable to current Python 3.x version as is or with minor changes.
Second session, testing in Python Python has a good support fo…

DIY home automation v1

For years I've been interested in home automation. I've had remote controllable outlets from a few different manufacturers but I've never been quite satisfied with just the remote. What if I could control my outlets within my local network from any device, now that's something I wanted to have.

Controlling outlets from computer A few years back I bought a three pack of remote controllable nexa outlets. A while ago I discovered that another company manufactured a control unit that's plugged in to a USB port and best of all they provided linux software for it.

To make full use of these I'd need a computer that's always on and that's where I could make use of Raspberry Pi.

Setting up outlets
I had already set up my outlets with the remote that came in the retail pack just follow the manufacturer instructions.
It might be possible to configure the outlets completely via the software at least for some brands but I haven't tried it so I can't be sure.…