All notable changes to this project will be documented in this file. See standard-version for commit guidelines.
5.1.1 (2017-12-07)
- allow unknown options before parsing config file (98a5d5f)
5.1.0 (2017-12-06)
- allow to extend cli parser via CLI event (81fb51f)
5.0.1 (2017-12-05)
- validate timeout type in wait element actions (007a836)
5.0.0 (2017-12-01)
- Fixed not checking if dragTo is a valid element (13566a1)
- emit async INIT event instead of async plugins load (b21aa58)
- remove backwards compatibility for passing grep to readTests (ed4ece5)
- remove bluebird-q compatibility layer (7844620)
- remove deprecated BEGIN_SESSION and END_SESSION events (2c22d1d)
- remove deprecated CAPTURE event (d06a913)
- remove deprecated END_TEST event (9c7c8e2)
- remove deprecated WARNING event (c906b1f)
- remove q-promise-utils (67b3682)
5.0.0-alpha.12 (2017-11-02)
- load plugins only once (a56e39b)
5.0.0-alpha.11 (2017-11-01)
5.0.0-alpha.10 (2017-10-31)
5.0.0-alpha.9 (2017-10-19)
- errors: stacktraces of custom errors should include error message (63eb59b)
- pass current image path to reference image error (968fe9a)
5.0.0-alpha.8 (2017-08-31)
- errors: stacktraces of custom errors should include error message (63eb59b)
- pass current image path to reference image error (968fe9a)
5.0.0-alpha.7 (2017-08-28)
5.0.0-alpha.6 (2017-08-02)
5.0.0-alpha.5 (2017-07-11)
- tests statistic should listen events on main runner (e676c3a)
5.0.0-alpha.4 (2017-07-04)
- incorrect .js config resolving (db6b539)
- add method 'shouldSkip(browserId)' to suite instance (bad551c)
- provide the ability to modify retries count from plugins (deafd55)
5.0.0-alpha.3 (2017-06-08)
5.0.0-alpha.2 (2017-06-06)
- bug with count of failed tests in the statistic (ef550c5)
5.0.0-alpha.0 (2017-05-25)
- make setUrl work like url.resolve (dcf6f17)
4.19.3 (2017-05-03)
- lazy load of images in HTML report for retries (754368a)
4.19.2 (2017-03-27)
- enable correct suite through suite collection api (60c1147)
4.19.1 (2017-02-15)
- method "fullUrl" should resolve url in runtime (e796dce)
- Prevented EMFILE error (too many open files) (e8e4dca)
4.19.0 (2017-02-10)
- Pass suiteCollection on BEGIN event to allow to modify it (7d04923)
4.18.2 (2017-02-02)
- prevent endless loop when suitesPerSession is set to infinity (2b399b6)
4.18.1 (2017-01-25)
- Make clickable reason-links for skipped results in html report (d266665)
4.18.0 (2017-01-23)
- add method 'gemini.ctx' to tests API (66f2aa6)
4.17.1 (2017-01-18)
- roll back striptags version without breaking changes (cd4e26e)
4.17.0 (2017-01-16)
- Add test filename to html report's metaInfo section (0311f6d)
4.16.0 (2016-12-23)
- log a path to an HTML report after tests finish (86a8466)
- set default reporter for command 'update' (feb72bc)
- Add extended WebDriver error data in output (73a26ed)
4.15.0 (2016-12-21)
- Allow to ignore every element, matching selector (c36ed78)
- html-reporter: add ability to specify output path for each report (b25409e)
4.14.4 (2016-12-12)
- correct implementation of doubleClick action (f8746a9)
- emit browser start/stop events in correct places (e8a427e)
- IE9 does not include pseudo-element styles (906988b)
- Remove session id console output for skipped tests (6aa92e1)
4.14.3 (2016-12-05)
- correct implementation of doubleClick action (f8746a9)
4.14.2 (2016-11-24)
- emit browser start/stop events in correct places (e8a427e)
- IE9 does not include pseudo-element styles (906988b)
4.14.1 (2016-11-22)
- fix invalid urls to reference images (85a426d)
- fix invalid urls to reference images (ed2ac15)
- remove polyfill-service dependency (364bcbf), closes #673 #635
4.14.0 (2016-11-16)
- documentation: update information about using gemini options (251329b)
- correct exit on 'SIGHUP', 'SIGINT' or 'SIGTERM' (1f0ffbe)
- Implement advanced verification for suites with same names (2572af5)
- html-reporter: add ability to copy suite name and open suite urls (6219b74)
- Use reference images instead of actual(current) in HTML report (ef198bc)
4.13.4 (2016-11-07)
- config: throw error if value contain not valid json string (60cc4f0)
- config: use JSON.parse for plugins values from cli/env (6039fd1)
4.13.3 (2016-11-03)
- glob-extra: replace isMasks to isMask (830be2e)
- html-reporter: don't store ref when it equal with current image (3183c21)
- test: improve some tests (c56bdcb)
4.13.2 (2016-10-26)
4.13.1 (2016-10-25)
- do not show skipped tests in retries (799dc80)
4.13.0 (2016-10-19)
- cli: Add command 'list' to show list of browsers or sets from config (b5e4b4a)
- Implement readRawConfig static API method (b269b0b)
- Fix
startRunner
andendRunner
to correctly wait for promises, returned from plugins. - Various fixes related to
bluebird
migration. All "is not a function" errors now should be gone. - Fix assignment to const error in html report.
- Restore 4.10 plugin loading order — plugins now loaded before any tests files are read.
- Internal promises library changed
bluebird
. This should make gemini a little bit faster.
- Added the ability to specify exclude paths in which the gemini tests will not be searched, see documentation
- Fixed bug which causes skip errors which might be occur in listeners of
START_RUNNER
andEND_RUNNER
events
- Second attempt of fixing order of file read events
- Fixed bug which causes emitting
beforeFileRead
after the file has already been read in GeminiFacade
Identical to 4.11, published by mistake
## 4.11.0 - 2016-09-23- Do not delay retry failed tests until all tests finish. Retry ASAP
- Added
events
field forgemini
instance in plugins, see documentation for more details. - Updated
Quick start
section in documentation
- Lodash updated to v4.x
- Clone suite tree for each browser runner
- Use
catch
method instead offail
in q
- Fixed
Out of the bounds
error (see #543)
- Updated third party libraries, so Array.prototype methods won't be overwritten anymore
- Fixed abort of the broken session on test error
- Fixed incorrect creation of set with empty files
- Updated version of glob-extra
- Close browser session after error in a test
- Set left button as default for mouse button actions
- Fixed wrong validation of
grep
option from cli
- Fixed bug which causes
Cannot find files by mask gemini
error if sets in config are not specified (see #569) - Fixed bug which causes
/null
url in meta-info - Displaying the number of updated images via command
gemini update
in flat reporter
- Correctly display the images in the html report in case suite names contain non-urlsafe characters.
- Fixed critical bug which causes failing of browser requests
beforeFileRead
andafterFileRead
API events were added. This allows plugins to be notified when gemini is about to read a test file and when it was readCAPTURE
andEND_TEST
events were declared as deprecated.UPDATE_RESULT
andTEST_RESULT
events should be used instead of them respectively- Added the ability to see in flat reporter which states were really updated via gemini update command
- Added
sessionQuitTimeout
option which allows to change timeout for session termination - Disallowed usage of empty names for suites
- Added nodejs@6.x support
- Added
GEMINI_SKIP_BROWSERS
environment variable support - Added the ability to log config for each browser using
DEBUG=gemini:config
environment variable - Fix: escape special symbols in HTML report
- Fix: correct displaying of test url in meta-info of an HTML report
- Retry only failed states on fail instead of all states of the suite
- Add ability to set file masks for test paths in a
sets
option - Add ability to implement custom source path resolving for CSS files in coverage
- Fix: keep original stack when cloning error
- Revert code changes made for version 4.4.3
- Fix bug with resolving source paths in gemini coverage module
- Fixed retry of individual states (error with 'isCoverageEnabled on undefined')
- Support
changeOrientation
forappium
below 1.5.x - Back to upstream of
uglify-js
- Froze uglify-js version at v2.6.4
- Fixed bug with suites per browser limit
- Fixed ignoring of a caret for devices with pixel ratio different from 1
- Output path to html report to a console
- Updated version of looks-same dependency to 3.0.0
- Added option
compositeImage
which allows to test areas with height larger than viewport one, see documentation for more details. - Capture a viewport instead of a full page for all browsers.
⚠️ Tests in firefox will fail after updating to this version if you test areas which bottom bounds are outside of a viewport height. - Removed the hack for IE browsers related with two-step movement to
(0, 0)
on browser reset. - Fix: do not fail test if a hidden element was added to method
ignoreElements
. - Fix displaying of retries in HTML report after adding of
sessionId
in meta-info of HTML reporter.
- Added new browser option
screenshotMode
which allows to set an image capture mode, see the documentation for more details. - Added new action
changeOrientation
to tests API which allows to change orientation on touch enabled device, see the documentation for more details. - Supported displaying of
sessionId
in meta-info of HTML reporter. - Fix: do not emit an error if
browser.quit
fails, warning will be logged. - Fix: support passing of
sessionId
to an error if launching of a browser fails.
- Added option
sessionRequestTimeout
which sets a timeout for getting of browser sessions
- Supported displaying of meta-info in HTML reporter which contains suite/state url
- Supported displaying of retry reasons in reporters
- Supported passing of a suite error to all states of this suite
- Dropped throwing of critical errors in states, this means that a state failure always emits an
err
event - Fix: browser sessions will be freed immediately if there are no states to run instead of waiting for the end of all remaining running states in other browser sessions
- Fix: use top level windowSize
- Fix error object instance after serializing
- Fix image processing: use pixel ratio in subprocesses
- Fix failed suites count in summary line
- Throw error on image validation fail
- Show page screenshot on image validation error
- Fix documentation
- Fix: require default config by absolute path
- Fixed hang in browser pool queue when using
parallelLimit
option - Image processing moved to workers (test speed increased, memory usage decreased)
- Added ability to set
tempDir
option from cli - Do not retry failed test if it hasn't reference image
BREAKING CHANGES:
- Do not support node lower than 4.0
- Changed suite declaration. You don't need now to require gemini for each suite file
- Removed
gather command
. Useupdate
command instead - Now error data will be extended with path to image instead of image itself:
error.image
=>error.imagePath
- Fix: Child suite context should have same data as parent has (@j0tunn)
- Fixed element find caching (@j0tunn)
- Fixed
CLIENT_STOPPED_SESSION
bug when performing setWindowSize in post actions (@j0tunn) - Suite.browsers: ability to set browsers, in which suite should be run (@egavr)
- Added ability to use .js/.json config files (@j0tunn)
- Android support:
- Do zoom reset after page load instead of before screenshot (@SwinX)
- Fixed calibration for android emulators (@SwinX)
- Fixed image crop for big pixelRatio (@SwinX)
- Enable uncaughtException logging (@SwinX)
- Fix coverage (@benedfit):
- pass in all original options when processing media rules
- check length of selector after pseudo-elements have been removed
BREAKING CHANGES:
- Removed skip method for actions (@j0tunn)
- Accumulate "before" and "after" actions for nested suites (@j0tunn)
- Fix: specified name for NoRefImageError (@SwinX)
- Fixed bug in enable/disable logic in suite collection - may not work properly when disabling all suites and enabling only some states in specific suite (@j0tunn)
- Added possibility to enable/disable suites by full name (@j0tunn)
- Added possibility to specify
grep
condition forreadTests
API method (@SwinX)
- Fix update command called without any options (@sipayRT)
- Limited pool fix: push defer queue if failed to free browser (@j0tunn)
- Add editor files to the .npmignore (@j0tunn)
gemini update
command: ability to update only new and changed references (@sipayRT)SuiteCollection
: new API to run separate suites and states (@j0tunn)- Fix: free browser when reset failed (@j0tunn)
- Fix: provide image for errors during actions chain execution (@leonsabr)
- Run heavy operations in separate processes (@j0tunn)
- Force quit on second Ctrl+C (@j0tunn)
- Do not get browser session for suites without states (@j0tunn)
- Do not get browser session and do not perform any pre-actions for skipped suite (@j0tunn)
BREAKING CHANGES:
- New skip method API (@leonsabr)
- Browser now can be specified only by browser id matcher (string or RegExp)
- skip now accepts optional second parameter - reason, which will be displayed in reporters
- Deprecated options removed:
strictComparison
,referenceImageAbsence
(@SevInf, @j0tunn) - Deprecated API method
gemini.buildDiff
removed (@j0tunn) - Russian documentation removed (@j0tunn)
gemini.readTests
now returnsSuiteCollection
instance instead ofrootSuite
object (@j0tunn)gemini gather
deprecated in favor ofgemini update
(@sipayRT)
- Remove restirction for maximum open concurrent sockets (@j0tunn)
- Show reference image if test failed due to lack of it (@sipayrt)
- Fixed result in HTML report for sibling states appear several times on retry (@SwinX)
- Fix: in LimitedPool next browser request will be triggered if failed to receive browser from underlying pool (@SwinX)
- Implemented TestCounter class for reporters (@SwinX)
- Fixed undefined session id in vflat reporter (@SwinX)
- Immediately quit browser if failed to create it (@SwinX)
- Fix: wrong initial-scale meta data (@sipayrt)
- Fix: build crashed on 'gather' command (@SwinX)
- Fix: html reporter correctly handles
error
event if no data about state passed
- Implemented suite retry on compare diff and critical errors (@SwinX)
- Only maximize PhantomJS browser if windowSize is not configured (@davidchin)
- Allow tests to skip by browser id (@davidchin)
- Do not fail tests on error from grid-side (@sipayrt)
- Fix: run 'afterHook' if some state failed (@j0tunn)
- Fix: run 'postActions' if state or 'afterHook' failed (@j0tunn)
- Fix: free browser after cancel (@j0tunn)
- Fix: keep original error if 'afterHook' or 'postActions' failed (@j0tunn)
- Show error message + whole page screenshot on test fail (@sipayrt)
- Fix: clean browsers pool after finalization (@SwinX)
- Fix: check for global window variable on client-side (@eroshinev)
- Do not fail tests if browsers specified from env does not exists in config (@sipayrt)
- Fix counting of skipped test by flat reporter (@sipayrt)
- Pass sessionId on events for correctly TC work (@sipayrt)
- Fix: return correct exit code on test failing (@sipayrt)
- Fix handling of END_RUNNER event (@sipayrt)
- Fix: END_RUNNER event delivered to plugins in case of critical error (@SwinX)
- Fix: make screenshot after prepareScreenshot() has been executed (@sipayrt)
- Remove spaces from env GEMINI_BROWSERS (@sipayrt)
-
Add Android support (@SevInf)
-
Fix: return same config object for each config.forBrowser request (@j0tunn)
-
Fix "undefined" output instead of browser name in the flat reporter (@scf2k)
-
Show current image for tests which have no reference images (@hatroman)
-
Screenshot whole page when gemini can't find a selector (@scf2k)
-
Add
retry
option. See docs (@sipayrt) -
Fix: fire END_SUITE event when nested suites are done (@scf2k)
- Added the
vflat
reporter (@unlok)
-
Path to the plugin configuration fixed (@SevInf)
-
Sets support (@j0tunn)
-
mouseUp action: make element argument optional (@just-boris).
-
Print browserId and sessionId in critical error reports (@SevInf).
-
html report: load report images in lazy mode (@scf2k).
- Fix: correct handling of no-ref-image error (@j0tunn).
-
Inline sourcemaps support in coverage calculation (@j0tunn).
-
Create HTML report dir before copying files (@SevInf).
-
API: do not override options with CLI flags and env vars by default (@SevInf).
-
Fail when removed option is detected and warn if removed env var is detected (@SevInf).
-
Reports now always will be generated, even when there is a critical error (@zumra6a).
-
Correctly cancel queued tests after critical error (@SevInf).
-
Produce more debug information in various modules (@SevInf).
-
In case of a critical error, try to print what test was executed when it happened (@SevInf).
-
Corrected updates (@maximerassi).
Previous version was published without a tarball once again. Republishing.
## 0.13.0-beta — 2015-07-29-
BREAKING CHANGE: new config format. See docs.
New config allows to set many previously global options on per-browser basis. The following things have changed in this config:
-
rootUrl
,gridUrl
,tolerance
,strictComparison
,screenshotsDir
,windowSize
options can now be set separately for each browser:gridUrl: http://grid.example.com browsers: firefox: # Uses gridUrl from top level desiredCapabilities: ... chrome: # Overrides top-level value gridUrl: http://chrome.example.com desiredCapabilities: ...
-
projectRoot
,sourceRoot
,plugins
,debug
,parallelLimit
,diffColor
,referenceImageAbsence
are moved intosystem
section and can not be set per-browser.system: debug: true diffColor: #ff0000 plugins: teamcity: true ...
-
browsers
are no longer default tophantomjs
. If you've used this default, set up the browser explicitly:browsers: phantomjs: desiredCapabilities: browserName: phantomjs
-
coverage settings are now grouped under
system.coverage
section:- to enable coverage, set
system.coverage.enabled
to true. coverageExclude
is moved tosystem.coverage.exclude
.coverageNoHtml
is replaced bysystem.coverage.html
. Set it to false to disable html report generaion.
- to enable coverage, set
-
--noCalibrate
custom capability is replaced bycalibrate
option which can be set for every or any particular browser. -
browser capabilites are set in
desiredCapabilites
option.browsers: chrome: desiredCapabilities: browserName: 'chrome', version: '45'
-
top-level
capabilities
option is replaced bydesiredCapabilites
option. -
http
settings are removed. Use new optionhttpTimeout
to set timeout. Setting retires is no longer possible. -
sessionMode
is replaced by more flexiblesuitesPerSession
setting (see below).
-
-
The way config options are overriden by CLI flags and environment variables are now unified (option path is converted to
--option-path
for cli andgemini_option_path
for environment variables). Due to this change, some old flags and environment variables won't work:-
--sorce-root
andGEMINI_SOURCE_ROOT
becomes--system-source-root
andgemini_system_source_root
respectively. -
--debug
andGEMINI_DEBUG
becomes--system-debug=true
andgemini_system_debug
respectively. -
--coverage
andGEMINI_COVERAGE
becomes--system-coverage-enabled=true
andgemini_system_coverage_enabled
respecitvely. -
--coverage-no-html
andGEMINI_COVERAGE_NO_HTML
becomes--system-coverage-html=false
andgemini_system_coverage_html
respectively. -
GEMINI_ROOT_URL
becomesgemini_root_url
. -
GEMINI_GRID_URL
becomesgemini_grid_url
. -
GEMINI_SCREENSHOTS_DIR
becomesgemini_screenshots_dir
. -
GEMINI_WINDOW_SIZE
becomesgemini_window_size
.
-
-
API:
Gemini
constuctor does not accepts overrides object anymore. -
sessionMode
is replaced bysuitesPerSession
option which specifies number of test suites to run in a single WebDriver session. Value of.inf
is equivalent toperBrowser
session mode and value of1
is equivalent toperSuite
. This option can be set globally or separately for each browser. -
New option
sessionsPerBrowser
allows to launch multiple session for each browser and run tests in parallel.
- Correctly restore window size when
setWindowSize
is called inbefore
callback (@SevInf).
- Correctly calculate element position if WebDriver returns screenshot thinner then document (@SevInf).
-
More clear error when capture are is hidden (@hatroman).
-
Mouse cursor is moved to (0,0) before the first test (@j0tunn).
Republish 0.12.4 due to another npm bug.
## 0.12.4 - 2015-05-28-
Fix calibration to work in Chrome 43+ (@SevInf).
-
Original window size is restored after suite with
setWindowSize
action is finished (@scff). -
windowSize
option is ignored in Opera Presto browsers (@SevInf).
- Sizzle: work with selectors ending with space (@SevInf).
- Fix client bridge script injection (@SevInf).
CRITICAL BUG WAS INTRODUCED IN THIS VERSION.
Version was deleted from npm, use 0.12.2 instead.
-
If CSS3 selectors are not supported by particular browser, Sizzle.js will be used for all queries in that browser (@SevInf).
-
Coverage now correctly detects intersection of the elements and capture area (@scff).
- When capturing element is visible compltely in the viewport do not scroll to element's location while taking the screenshot (@scff).
- Fix calibration in IE8 and add functional tests for it (@SevInf).
- Calibration affects only top and left sides of the screenshot (@scff).
-
Take into account horizontal scrolling when validating capture area for viewport screenshot (@scf2k).
-
Add missing pollyfills for IE8. This allows to gather coverage in ie8 (@SevInf).
-
Correctly report execptions, thrown during coverage gathering (@SevInf).
- Republish 0.11.1 due to npm registry bug.
- Fix crash after all tests are finished (@SevInf).
-
Plugins support (@Saulis).
Check out documentation and some plugin examples:
-
Add
flick
action for touch devices (@scf2k). -
Add
sessionMode
property which allows to choose when new WebDriver session is created (@SevInf). -
Automatically kill browser session on
SIGHUP
,SIGINT
andSIGTERM
(@j0tunn). -
Allow to switch image background in HTML reoport (@unlok).
-
url.resolve
is not used anymore for computing absolute URLs fromrootUrl
and suite URL. It is now just joined with a single/
in between (@j0tunn). -
Update
png-image
so it can be built withgcc
4.6 (@j0tunn). -
Correctly expose
__gemini
variable in client scripts (@vlkosinov). -
Grep pattern now checked when suites load, not when they are executed (@hatroman).
-
HTML report refactoring (@hatroman).
-
Fix calibration to work in IE8 again (@SevInf)
-
Client scripts which gemini injects into page are now bundled together and minified (@scf2k).
-
Update
png-img
version bringing support for nodev0.12
andiojs
(@j0tunn). -
Don't inject main client script twice (@scf2k)
-
Ported 0.9.9 changes (@SevInf)
- Use document height instead of body height to determine whether webdriver returns document or viewport screenshot (@SevInf)
-
Basic support for IE8 browser (@SevInf).
This change required a large rewrite of the all client-side scripts which can cause some breaking changes. For example, bounds of a capture region are calculated more precisely now. You'll probably need to re-gather your screenshots.
-
Calibration now correctly works in IE9 (@SevInf).
-
Added an option
referenceImageAbsence
(@hatroman).This option allows to change default behaviour of the tests to produce the warning if there is no reference image. Default behaviour is still the test failure.
-
Re-add
tolerance
setting, which now sets max allowed CIEDE2000 difference between image colors. It is now configurable on 3 levels:-
tolerance
option in config -
setTolerance
method for a suite -
optional parameter to
capture
method:suite.capture('name', {tolerance: 20}, function() {});
-
-
Programmatic API method
buildDiff
is now deprecated: it has access only to global tolerance, so diff it produces might not show exactly what caused test to fail. Method is kept for backward compatibility, but users of a programmatic API now encouraged to usesaveDiffTo
method of test result (passed to reporter) instead. -
Warn if coverage for CSS file cannot be calculated due to same-origin policy (@SevInf)
- Adds new option
--browser
to the CLI andbrowsers
to the API which allows to run tests in a subset of browsers (@SevInf).
-
Work correctly if WebDriver implementation returns screenshot with a browser chrome. This is done via calibration step after first launch of the browsers (@scf2k).
-
Add ability to ignore certain elements when comparing screenshots. Use
suite.ignoreElements(selector1, selector2, ...)
to specify the selectors to ignore (@SevInf). -
Add
tap
action for touch devices (@scf2k). -
gemini
is now works correctly if page changes during the test (@scf2k). -
Correctly handle missing timeout in waitForElementXXX (@SevInf).
-
Correctly report image path in
gather
API (@SevInf).
-
Add new wait methods (@SevInf):
-
waitForElementToShow
-
waitForElementToHide
-
waitForJSCondition
-
- Work on a pages that modify
Array.prototype
(@SevInf).
- Works on Windows again (@SevInf).
-
Add
sendFile
action which now should be used instead ofsendKeys
to set a file toinput[type=file]
elements (@SevInf). -
Correctly parse box-shadow in IE9 (@scf2k).
-
Fail only single test if reference image is not found (@SevInf).
- Coverage generator now follows symlinks while resolving the paths to CSS files. So the final report will have real paths but not pointing to symlinks.
-
Move the coverage HTML templating code to separate module (gemini-coverage).
-
Detailed error message when capture region exceeds screenshot area. Such error also will now fail only single state instead of a whole testing process (@SevInf).
- Ignore
@keyframes
at-rule while collecting coverage (@scf2k).
-
Replace
GraphicsMagick
with lightweightpng-img
library (@j0tunn). As for this version,gemini
no longer requires any external tool for image processing. -
CSS coverage now supports source maps (@scf2k).
If your CSS has the sourcemap, coverage report will show original files.
You can use
sourceRoot
option to tellgemini
where are your sources located on a filesystem. -
CSS coverages statistics will now also be written to
coverage.json
file (@scf2k). -
Add
coverageExclude
option to allow exclude certain files from coverage report (@scf2k). -
Add index page to coverage report and improve appearance of a the coverage pages (@scf2k).
-
Restructure documentation and add quick start guide in russian and english (@jk708).
- Reset cursor position before reloading the page. When resetting it just after page load, old cursor position may trigger some transitions which will not be finished before first screenshot.
test
command will exit with correct codes
-
New image comparison algorithm is implemented:
-
gm compare
replaced with custom diff. For now, GraphicsMagick is still required for other image manipulations. -
tolerance
setting is removed in favor of "strict mode": by default, only noticable changes (according to ciede2000 metric) will be treated as failure, to treat all changes that way user can enablestrictComparison
option. -
in case if some element in focus during test can potentially have blinking caret displayed, diff will try to ignore caret.
-
-
Remove built-in TeamCity reporter. If you really want it, you can adapt 0.7.x reporter to the current version of
gemini
and publish it in separate package. -
Remove legacy ability to specify browsers as array which was deprecated since 0.4.0.
-
Add experimental programmatic API.
-
Add
--grep
option togather
andtest
commands, which allows to execute only suites, matching the pattern (@scf2k). -
Show required dimensions in error message when origin does not fir to full-page screenshot (@scf2k)
-
Show meaningful error when capture area origin does not fit to full-page screenshot. This change can break some of your tests (@scf2k).
-
Add experimental CSS-coverage report. Enable with
--coverage
CLI flag orcoverage: true
in config (@scf2k). -
Add ability to override
gridUrl
,rootUrl
,screenshotsDir
,debug
config options by their respective CLI options or environment variables (@arikon). -
Add config option
windowSize
to specify default size of the browser windows (@scf2k). -
Add action
setWindowSize
to specify browser window size during the tests (@scf2k).
Was republished as 0.7.0 due to a breaking change.
## 0.6.4 - 2014-08-13-
Add command line completion (@unlok).
-
Show an error, when config file has unknown options.
-
Add
focus(element)
action (@arikon).
- Allow to use empty string with
sendKeys
. It can be used to focus on an element without changing states.
- Reset mouse position for each suite. Previously, cursor may stay at the position left from a previous suite and some elements was captured with hover effect when there shouldn't be any.
- Fix incorrect capture region rounding, causing bottom row of the element to be cropped sometimes.
-
:before
and:after
pseudo-elements outline and shadow are now taken into account when calculating capture region(@incorp).This change can break some of your tests. Re-gather reference images to fix the problem.
-
Added
tolerance
config option which can be used to specify maximum error rate before images will be treated as unequal. Default tolerance to 0. This is stricter then previous versions: now every, even slightest difference between reference and current images will fail tests.Set
tolerance
to 0.001 in.gemini.yml
to restore 0.5.x behavior. -
Coordinates of capture region are now rounded to capture maximal area. Previously, border pixels could be cropped, due to rounding error. This change can break some of your tests. Re-gather reference images to fix the problem.
-
Added ability to change diff highlight color in config file.
-
Change diff highlight style
-
Global installations of
gemini
now runs local one, if available.
-
Browsers are now launched once for each run (previously, they were launched once per suite). This greatly reduces total tests run time, but can break some of your code, i.e. each
mouseDown
should always be closed bymouseUp
.Previously, this was not required if
mouseDown
was used once for suite.It will show warning if versions of the modules does not match.
-
flat
reporter replacestree
. Tree reporter can not work with new browser launch model. -
Add
parallelLimit
option that allows to limit number of browsers run in parallel. -
Add
suite.after()
which can be used to perform some action after all of the states without taking screenshot. -
Unknown errors, returned by Selenium have more detailed report.
-
Fix
--version
option.
- Fix missing images in html report.
- Correctly detect crop region in Firefox
-
Crop region for screenshots is calculated via client script inside browser instead of
gemini
. This allows to issue fewer requests to Selenium Server speeding up total tests run time. This feature breaks compatibility with old browsers (IE
< 9). -
New config format, which allows to specify full set of capabilities for browsers:
browsers: phantomjs: phantomjs opera12: browserName: opera version: '12.06' platform: 'WINDOWS' firefox28: browserName: firefox version: '28.0' firefox27: browserName: firefox version: '27.0'
-
Correctly capture screenshots of regions out of initial browser viewport in browsers, that can't capture full page (
Opera
andChrome
at the time of writing). -
outline-width
of an elements is now also taken into account when calculating crop region. -
Add
debug
options to config file. If set totrue
,gemini
will print debug logs to STDOUT. (@arikon). -
Add
http
section to config file which allows to configure HTTP timeout (http.timeout
) retry count (http.retries
) and delay between retries (http.retryDelay
). (@arikon). -
Asynchronous errors stacktraces in browser actions (such as not found element) will point to users code.
-
More HTTP requests to Selenium will run in parallel speeding up
gather
/test
commands (@arikon). -
If
gemini
is run without subcommand, help text will be shown.
-
Enhanced html report:
-
suites are now collapsible;
-
all but failed suites are collapsed by default;
-
buttons to expand all, collapse all and expand only errors are added;
-
stats of total numbers of tests run, failed, succeeded and skipped are shown at the top.
-
-
Allow to use multiple reporters in
test
command. -
Throw error when creating multiple suites of the same name within the same parent.
-
Throw error when creating multiple states of the same name within the suite.
-
Throw error when creating suite that will be unable to run ( has states and hasn't url or capture region);
-
Check argument types of
SuiteBuilder
methods. -
Check argument types of all actions methods.
-
Shorter stacktraces for invalid elements errors.
-
Correctly handle offsets in
mouseMove
actions. -
Fix error when
gridUrl
was required even if there is onlyphantomjs
browser.
-
Allow to override
gridUrl
androotUrl
settings with cli options--grid-url
and--root-url
. -
Correctly report error, when wrong argument passed to an action.
-
Ability to set additional capabilities for all browsers, using
capabilities
option in.gemini.yml
:capabilities: option1: value, option2: value
-
Non-existent directories, passed to
gather
andtest
commands will be filtered out -
If fatal error occurs,
gemini
will always exit with 1 status code -
If test fails or state error occurs,
gemini
will always exit with 2 status code. -
When
gemini
is unable to launch browser, more clearer error message will be displayed.
-
Elements to take screen shots of and elements to perform action on are now defined differently.
setElements
andsetDynmaicElements
methods removed.New way to define elements for screenshot:
suite.setCaptureElements('.selector1', '.selector2', ...)
Or using array:
suite.setCaptureElements(['.selector1', '.selector2', ...])
To get element to perform action on, you can now pass selectors directly to the actions:
suite.capture('state', function(actions, find) { actions.click('.button'); });
To avoid multiple lookups for the same element you can use
find
function which is now passed to the state callback:suite.capture('state', function(actions, find) { var button = find('.button'); actions.mouseMove(button); .click(button); });
-
Add
suite.before(function(action, find))
which can be used to perform some actions before the first state. Context is shared between before hook and all of suite's state callbacks.You can use
before
to look for element only once for the state:suite.before(function(actions, find) { this.button = find('.buttons'); }) .capture('hovered', function(actions, find) { actions.mouseMove(this.button); }) .capture('pressed', function(actions, find) { actions.mouseDown(this.button); });
Or to perform some actions before first state without taking screenshot:
suite.before(function(actions, find) { actions.click('.button'); });
-
Add
suite.skip()
method which allows to skip suite in some set of browsers:-
suite.skip()
- skip in all browsers. -
suite.skip('chrome')
- skip in all versions of Chrome. -
suite.skip({name: 'chrome', version: '33.0'})
- skip in Chrome 33.0 -
suite.skip(['chrome', 'opera'])
- skip in Chrome and Opera
-
-
Public API now has constants for special keys to use in
sendKeys
actions (i.e.gemini.CONTROL
forCTRL
key).
- Fix a bug with incorrect reference to the suite in states. Because of this bug dynamic elements was not updated properly.
-
New test suites API. Plans are replaced by test suites defined by explicit call.
Old version:
module.exports = function(plan) { plan.setName('some name') .setElements(...) .setDynamicElements(...) .capture(...) };
New API:
var gemini = require('gemini'); gemini.suite('some name', function(suite) { suite.setElements(...) .setDynamicElements(...) .capture(...) };
Suites also can be nested. In this case, child suite inherits all properties from the parent.
gemin.suite('parent', function(suite) { gemini.suite('child', function(child) { gemini.suite('grandchild', function(grandchild) { }); }); });
-
.reload()
method is removed. Use nested suite if you need to reload browser. -
Added action to run any JS code in browser context:
actions.executeJS(function(window) { window.alert('Hello!'); });
-
sendKeys
action can optionally take an receive an element to send keys to.actions.sendKeys(elements.someInput, 'hello');
-
Added ability to specify browser version in
.gemini.yml
browsers: - {name: 'phantomjs', version: '1.9'}
-
Tree reporter is now used for
gather
command.
-
phantomjs
always starts maximized. This fixes the error, when some shadows didn't fit in crop rectangle. -
Action on dynamic element that does not currently exists causes non-fatal error. Such error will fail only one state, the rest will continue running.
-
gather
command now reports browser name. -
browsers are always closed, even if there was an error.
- Initial release