Implement #105

[mottosso]

Here's one way of achieving #105.

1. Generate a dictionary of every member in PySide2.
2. For each other binding, compare available members with those
3. A member available in PySide2, but not in another, that is a bug.

Some problems include (1), PySide2 not yet being complete, so things like QtOpenGL is missing and (2) PySide2 including quite a few unique members compared to PyQt5, which should theoretically be quite similar.

Example output

Here's what I got in this initial commit.

======================================================================
FAIL: test_membership.test_PyQt5_members
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/usr/lib/python2.7/unittest/case.py", line 329, in run
    testMethod()
  File "/usr/local/lib/python2.7/dist-packages/nose/case.py", line 197, in runTest
    self.test(*self.arg)
  File "/workspace/Qt.py/test_membership.py", line 37, in test_PyQt5_members
    assert not missing, "PyQt5 has missing members: %s" % message
AssertionError: PyQt5 has missing members:
QtWebKit:
 - WebCore
 - __doc__
 - __file__
 - __name__
 - __package__
QtCore:
 - ClassInfo
 - Connection
 - MetaFunction
 - QBasicMutex
 - QFactoryInterface
 - QJsonArray
 - QT_TRANSLATE_NOOP3
 - QT_TRANSLATE_NOOP_UTF8
 - SIGNAL
 - SLOT
 - __moduleShutdown
 - __version__
 - __version_info__
 - qAcos
 - qAsin
 - qAtan
 - qAtan2
 - qExp
 - qFabs
 - qFastCos
 - qFastSin
 - qFuzzyIsNull
 - qTan
 - qtTrId
QtGui:
 - QAccessibleEvent
 - QMatrix
 - QPyTextObject
 - QStringListModel
 - QToolBarChangeEvent
QtScript:
 - QScriptClass
 - QScriptClassPropertyIterator
 - QScriptContext
 - QScriptContextInfo
 - QScriptEngine
 - QScriptEngineAgent
 - QScriptExtensionInterface
 - QScriptExtensionPlugin
 - QScriptProgram
 - QScriptString
 - QScriptValue
 - QScriptValueIterator
 - QScriptable
 - __doc__
 - __file__
 - __name__
 - __package__
QtNetwork:
 - QIPv6Address
-------------------- >> begin captured stdout << ---------------------
Trying pyqt5
--------------------- >> end captured stdout << ----------------------

======================================================================
FAIL: test_membership.test_PyQt4_members
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/usr/lib/python2.7/unittest/case.py", line 329, in run
    testMethod()
  File "/usr/local/lib/python2.7/dist-packages/nose/case.py", line 197, in runTest
    self.test(*self.arg)
  File "/workspace/Qt.py/test_membership.py", line 69, in test_PyQt4_members
    assert not missing, "PyQt4 has missing members: %s" % message
AssertionError: PyQt4 has missing members:
QtWebKit:
 - WebCore
QtCore:
 - ClassInfo
 - Connection
 - MetaFunction
 - QAbstractProxyModel
 - QBasicMutex
 - QFactoryInterface
 - QFileDevice
 - QItemSelectionRange
 - QJsonArray
 - QJsonDocument
 - QJsonParseError
 - QJsonValue
 - QMessageLogContext
 - QSortFilterProxyModel
 - QT_TRANSLATE_NOOP3
 - QT_TRANSLATE_NOOP_UTF8
 - QtInfoMsg
 - __moduleShutdown
 - __version__
 - __version_info__
 - qAcos
 - qAsin
 - qAtan
 - qAtan2
 - qExp
 - qFabs
 - qFastCos
 - qFastSin
 - qFuzzyIsNull
 - qInstallMessageHandler
 - qTan
 - qtTrId
QtGui:
 - QAccessibleEvent
 - QGuiApplication
 - QPagedPaintDevice
 - QSurface
 - QSurfaceFormat
 - QToolBarChangeEvent
 - QTouchDevice
 - QWindow
QtScript:
 - QScriptExtensionInterface
 - QScriptExtensionPlugin
 - QScriptProgram
 - QScriptable
QtNetwork:
 - QIPv6Address
-------------------- >> begin captured stdout << ---------------------
Trying pyqt4
--------------------- >> end captured stdout << ----------------------

======================================================================
FAIL: test_membership.test_PySide_members
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/usr/lib/python2.7/unittest/case.py", line 329, in run
    testMethod()
  File "/usr/local/lib/python2.7/dist-packages/nose/case.py", line 197, in runTest
    self.test(*self.arg)
  File "/workspace/Qt.py/test_membership.py", line 101, in test_PySide_members
    assert not missing, "PySide has missing members: %s" % message
AssertionError: PySide has missing members:
QtCore:
 - Connection
 - QAbstractProxyModel
 - QBasicMutex
 - QFileDevice
 - QItemSelectionRange
 - QJsonArray
 - QJsonDocument
 - QJsonParseError
 - QJsonValue
 - QMessageLogContext
 - QtInfoMsg
 - qInstallMessageHandler
QtGui:
 - QGuiApplication
 - QPagedPaintDevice
 - QSurface
 - QSurfaceFormat
 - QTouchDevice
 - QWindow

[mottosso]

Missed the most important file!

[fredrikaverpil]

This is nice. I'm checking the code out now.

[fredrikaverpil]

I've never seen the use of from PySide2 import __all__ before. Nice one, since import * doesn't work!

[fredrikaverpil]

Would you mind expanding this comment on why these are not considered members?

Is it because they are either internals (__something__) or binding-specific (doesn't have an equivalent in PySide2)?

[fredrikaverpil]

Or is it because these have no no Qt4-equivalent?

[mottosso]

Added comment.

[fredrikaverpil]

Good job! This is an awesome addition to the project @mottosso 😀

Have you seen that the Travis CI tests output looks a bit garbled?
https://travis-ci.org/mottosso/Qt.py/jobs/156129566#L2916-L2927

[mottosso]

Have you seen that the Travis CI tests output looks a bit garbled?

That's the generated membership test. I figure, for now, it might be worth keeping an eye on exactly how it's working since it's a bit ad-hoc.

[mottosso]

Ok, it's not perfect, but will do for a first pass.

Let's keep it in mind for future improvements and corrections; in particular about including members as they become available through PySide2.

[fredrikaverpil]

Sounds good!