Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

e2e: fixes 6.09 #17205

Merged
merged 1 commit into from
Sep 6, 2023
Merged

e2e: fixes 6.09 #17205

merged 1 commit into from
Sep 6, 2023

Conversation

yevh-berdnyk
Copy link
Contributor

No description provided.

@yevh-berdnyk yevh-berdnyk self-assigned this Sep 6, 2023
@status-im-auto
Copy link
Member

status-im-auto commented Sep 6, 2023 •
edited
Loading

Jenkins Builds

Click to see older builds (4)
❔ Commit #️⃣ Finished (UTC) Duration Platform Result
✔️ b259fe9 #1 2023-09-06 11:05:33 ~10 min android-e2e 🤖apk 📲
✔️ b259fe9 #1 2023-09-06 11:06:49 ~11 min android 🤖apk 📲
✔️ b259fe9 #1 2023-09-06 11:07:30 ~12 min tests 📄log
✔️ b259fe9 #1 2023-09-06 11:07:57 ~12 min ios 📱ipa 📲
❔ Commit #️⃣ Finished (UTC) Duration Platform Result
✔️ 39343fc #2 2023-09-06 12:12:57 ~6 min android-e2e 🤖apk 📲
✔️ 39343fc #2 2023-09-06 12:13:10 ~6 min ios 📱ipa 📲
✔️ 39343fc #2 2023-09-06 12:13:35 ~6 min android 🤖apk 📲
✔️ 39343fc #2 2023-09-06 12:21:17 ~14 min tests 📄log
✔️ 7609a07 #4 2023-09-06 13:32:37 ~8 min android-e2e 🤖apk 📲
✔️ 7609a07 #4 2023-09-06 13:33:42 ~9 min android 🤖apk 📲
✔️ 7609a07 #3 2023-09-06 13:33:51 ~10 min tests 📄log
✔️ 7609a07 #4 2023-09-06 13:37:49 ~14 min ios 📱ipa 📲

@status-im-auto
Copy link
Member

79% of end-end tests have passed

Total executed tests: 43
Failed tests: 9
Passed tests: 34

IDs of failed tests: 702958,702786,702731,702807,702733,702808,702813,702732,703503

Failed tests (9)

Click to expand
  • Rerun failed tests

    • Class TestCommunityOneDeviceMerged:

    1. test_community_discovery, id: 703503 
    Test is not run, e2e blocker

    [[reason: [NOTRUN] https://github.com//issues/17175]]

    Class TestActivityMultipleDevicePRTwo:

    1. test_activity_center_admin_notification_accept_swipe, id: 702958

    Device 2: Find Button by xpath: //*[@content-desc='password-input']/../following-sibling::*//*[@text='Join Community']
    Device 2: Tap on found: Button 

    medium/test_activity_center.py:385: in test_activity_center_admin_notification_accept_swipe
    self.community_2.join_community()
../views/chat_view.py:424: in join_community
    self.community_status_joined.wait_for_visibility_of_element(60)
../views/base_element.py:139: in wait_for_visibility_of_element
    raise TimeoutException(
 Device 2: Text by accessibility id:`status-tag-positive` is not found on the screen after wait_for_visibility_of_element



    Device sessions

    Class TestGroupChatMultipleDeviceMergedNewUI:

    1. test_group_chat_join_send_text_messages_push, id: 702807

    Device 2: Text is Delivered
    Device 1: Looking for a message by text: Hey, admin! 

    critical/chats/test_group_chat.py:231: in test_group_chat_join_send_text_messages_push
    self.errors.verify_no_errors()
base_test_case.py:193: in verify_no_errors
    pytest.fail('\n '.join([self.errors.pop(0) for _ in range(len(self.errors))]))
 No PN was received on new message for message in group chat



    Device sessions

    2. test_group_chat_offline_pn, id: 702808

    Device 3: Looking for a message by text: message from old member
    Device 3: Looking for a message by text: message from new member 

    critical/chats/test_group_chat.py:441: in test_group_chat_offline_pn
    self.errors.verify_no_errors()
base_test_case.py:193: in verify_no_errors
    pytest.fail('\n '.join([self.errors.pop(0) for _ in range(len(self.errors))]))
 Messages PN was not fetched from offline



    Device sessions

    3. test_group_chat_pin_messages, id: 702732 

    Test is not run, e2e blocker

    [[reason: [NOTRUN] Pin feature is in development]]

    Class TestCommunityMultipleDeviceMergedTwo:

    1. test_community_mentions_push_notification, id: 702786

    # STEP: Invited member gets push notification with the mention and tap it
    Device 2: Getting PN by 'user_2' 

    critical/test_public_chat_browsing.py:1148: in test_community_mentions_push_notification
    self.errors.verify_no_errors()
base_test_case.py:193: in verify_no_errors
    pytest.fail('\n '.join([self.errors.pop(0) for _ in range(len(self.errors))]))
 Push notification with the mention was not received by admin
E    Can not edit a message with a mention
E    Push notification with the mention was not received by the invited member

    [[Issue with username in PN, issue #6 in 15500]]

    Device sessions

    Class TestOneToOneChatMultipleSharedDevicesNewUi:

    1. test_1_1_chat_pin_messages, id: 702731 

    Test is not run, e2e blocker

    [[reason: [NOTRUN] Pin feature is in development]]

    2. test_1_1_chat_text_message_delete_push_disappear, id: 702733

    Device 1: Could not reach home view by pressing system back button
    Device 2: Could not reach home view by pressing system back button 

    critical/chats/test_1_1_public_chats.py:1328: in test_1_1_chat_text_message_delete_push_disappear
    self.errors.verify_no_errors()
base_test_case.py:193: in verify_no_errors
    pytest.fail('\n '.join([self.errors.pop(0) for _ in range(len(self.errors))]))
 Push notification doesn't appear



    Device sessions

    3. test_1_1_chat_push_emoji, id: 702813

    Device 1: Find Button by xpath: //*[contains(@content-desc,'Status')]
    Device 1: Tap on found: Button 

    critical/chats/test_1_1_public_chats.py:1166: in test_1_1_chat_push_emoji
    self.device_1.driver.fail("Push notification with emoji was not received")
base_test_case.py:181: in fail
    pytest.fail('Device %s: %s' % (self.number, text))
 Device 1: Push notification with emoji was not received



    Device sessions

    Passed tests (34)

    Click to expand

    Class TestOneToOneChatMultipleSharedDevicesNewUiTwo:

    1. test_1_1_chat_mute_chat, id: 703496
    Device sessions

    2. test_1_1_chat_is_shown_message_sent_delivered_from_offline, id: 702783
    Device sessions

    3. test_1_1_chat_delete_via_long_press_relogin, id: 702784
    Device sessions

    Class TestCommunityMultipleDeviceMerged:

    1. test_community_emoji_send_copy_paste_reply, id: 702840
    Device sessions

    2. test_community_contact_block_unblock_offline, id: 702894
    Device sessions

    3. test_community_mark_all_messages_as_read, id: 703086
    Device sessions

    4. test_community_links_with_previews_github_youtube_twitter_gif_send_enable, id: 702844
    Device sessions

    5. test_community_unread_messages_badge, id: 702841
    Device sessions

    6. test_community_message_delete, id: 702839
    Device sessions

    7. test_community_message_send_check_timestamps_sender_username, id: 702838
    Device sessions

    8. test_community_one_image_send_reply, id: 702859
    Device sessions

    9. test_community_message_edit, id: 702843
    Device sessions

    10. test_community_several_images_send_reply, id: 703194
    Device sessions

    Class TestActivityCenterContactRequestMultipleDevicePR:

    1. test_activity_center_contact_request_accept_swipe_mark_all_as_read, id: 702851
    Device sessions

    2. test_activity_center_contact_request_decline, id: 702850
    Device sessions

    Class TestCommunityOneDeviceMerged:

    1. test_community_copy_and_paste_message_in_chat_input, id: 702742
    Device sessions

    2. test_community_navigate_to_channel_when_relaunch, id: 702846
    Device sessions

    3. test_restore_multiaccount_with_waku_backup_remove_switch, id: 703133
    Device sessions

    4. test_community_undo_delete_message, id: 702869
    Device sessions

    5. test_community_mute_community_and_channel, id: 703382
    Device sessions

    Class TestActivityMultipleDevicePRTwo:

    1. test_activity_center_mentions, id: 702957
    Device sessions

    Class TestOneToOneChatMultipleSharedDevicesNewUi:

    1. test_1_1_chat_edit_message, id: 702855
    Device sessions

    2. test_1_1_chat_message_reaction, id: 702730
    Device sessions

    3. test_1_1_chat_non_latin_messages_stack_update_profile_photo, id: 702745
    Device sessions

    4. test_1_1_chat_emoji_send_reply_and_open_link, id: 702782
    Device sessions

    5. test_1_1_chat_send_image_save_and_share, id: 703391
    Device sessions

    Class TestCommunityMultipleDeviceMergedTwo:

    1. test_community_leave, id: 702845
    Device sessions

    2. test_community_markdown_support, id: 702809
    Device sessions

    3. test_community_hashtag_links_to_community_channels, id: 702948
    Device sessions

    Class TestActivityMultipleDevicePR:

    1. test_activity_center_reply_read_unread_delete_filter_swipe, id: 702947
    Device sessions

    2. test_navigation_jump_to, id: 702936
    Device sessions

    Class TestGroupChatMultipleDeviceMergedNewUI:

    1. test_group_chat_reactions, id: 703202
    Device sessions

    2. test_group_chat_send_image_save_and_share, id: 703297
    Device sessions

    3. test_group_chat_mute_chat, id: 703495
    Device sessions

    @status-im-auto
    Copy link
    Member

    65% of end-end tests have passed

    Total executed tests: 43
Failed tests: 15
Passed tests: 28

    IDs of failed tests: 702855,702730,702958,702786,702745,702731,702807,702839,702733,702808,702813,702782,703391,702732,703503

    Failed tests (15)

    Click to expand
  • Rerun failed tests

    • Class TestCommunityMultipleDeviceMergedTwo:

    1. test_community_mentions_push_notification, id: 702786

    # STEP: Invited member gets push notification with the mention and tap it
    Device 2: Getting PN by 'user_2' 

    critical/test_public_chat_browsing.py:1149: in test_community_mentions_push_notification
    self.errors.verify_no_errors()
base_test_case.py:191: in verify_no_errors
    pytest.fail('\n '.join([self.errors.pop(0) for _ in range(len(self.errors))]))
 Push notification with the mention was not received by admin
E    Can not edit a message with a mention
E    Push notification with the mention was not received by the invited member

    [[Issue with username in PN, issue #6 in 15500]]

    Device sessions

    Class TestCommunityMultipleDeviceMerged:

    1. test_community_message_delete, id: 702839

    Device 2: Looking for a message by text: delete for me
    Device 1: Looking for a message by text: delete for me 

    critical/test_public_chat_browsing.py:643: in test_community_message_delete
    self.errors.verify_no_errors()
base_test_case.py:191: in verify_no_errors
    pytest.fail('\n '.join([self.errors.pop(0) for _ in range(len(self.errors))]))
 Deleted message is shown in channel



    Device sessions

    Class TestCommunityOneDeviceMerged:

    1. test_community_discovery, id: 703503 

    Test is not run, e2e blocker

    [[reason: [NOTRUN] https://github.com//issues/17175]]

    Class TestGroupChatMultipleDeviceMergedNewUI:

    1. test_group_chat_join_send_text_messages_push, id: 702807

    Device 2: Text is Delivered
    Device 1: Looking for a message by text: Hey, admin! 

    critical/chats/test_group_chat.py:231: in test_group_chat_join_send_text_messages_push
    self.errors.verify_no_errors()
base_test_case.py:191: in verify_no_errors
    pytest.fail('\n '.join([self.errors.pop(0) for _ in range(len(self.errors))]))
 No PN was received on new message for message in group chat



    Device sessions

    2. test_group_chat_offline_pn, id: 702808

    Device 3: Looking for a message by text: message from old member
    Device 3: Looking for a message by text: message from new member 

    critical/chats/test_group_chat.py:442: in test_group_chat_offline_pn
    self.errors.verify_no_errors()
base_test_case.py:191: in verify_no_errors
    pytest.fail('\n '.join([self.errors.pop(0) for _ in range(len(self.errors))]))
 Messages PN was not fetched from offline



    Device sessions

    3. test_group_chat_pin_messages, id: 702732 

    Test is not run, e2e blocker

    [[reason: [NOTRUN] Pin feature is in development]]

    Class TestOneToOneChatMultipleSharedDevicesNewUi:

    1. test_1_1_chat_edit_message, id: 702855 

    Test setup failed: base_test_case.py:316: in create_shared_drivers
    test_suite_data.current_test.testruns[-1].jobs[drivers[i].session_id] = i + 1
 '_asyncio.Future' object has no attribute 'session_id'

During handling of the above exception, another exception occurred:
critical/chats/test_1_1_public_chats.py:834: in prepare_devices
    self.drivers, self.loop = create_shared_drivers(2)
base_test_case.py:322: in create_shared_drivers
    test_suite_data.current_test.testruns[-1].error += str(e)
E   TypeError: unsupported operand type(s) for +=: 'NoneType' and 'str'



    2. test_1_1_chat_message_reaction, id: 702730 

    Test setup failed: base_test_case.py:316: in create_shared_drivers
    test_suite_data.current_test.testruns[-1].jobs[drivers[i].session_id] = i + 1
 '_asyncio.Future' object has no attribute 'session_id'

During handling of the above exception, another exception occurred:
critical/chats/test_1_1_public_chats.py:834: in prepare_devices
    self.drivers, self.loop = create_shared_drivers(2)
base_test_case.py:322: in create_shared_drivers
    test_suite_data.current_test.testruns[-1].error += str(e)
E   TypeError: unsupported operand type(s) for +=: 'NoneType' and 'str'



    3. test_1_1_chat_non_latin_messages_stack_update_profile_photo, id: 702745 

    Test setup failed: base_test_case.py:316: in create_shared_drivers
    test_suite_data.current_test.testruns[-1].jobs[drivers[i].session_id] = i + 1
 '_asyncio.Future' object has no attribute 'session_id'

During handling of the above exception, another exception occurred:
critical/chats/test_1_1_public_chats.py:834: in prepare_devices
    self.drivers, self.loop = create_shared_drivers(2)
base_test_case.py:322: in create_shared_drivers
    test_suite_data.current_test.testruns[-1].error += str(e)
E   TypeError: unsupported operand type(s) for +=: 'NoneType' and 'str'



    4. test_1_1_chat_pin_messages, id: 702731 

    Test is not run, e2e blocker

    [[reason: [NOTRUN] Pin feature is in development]]

    5. test_1_1_chat_text_message_delete_push_disappear, id: 702733 

    Test setup failed: base_test_case.py:316: in create_shared_drivers
    test_suite_data.current_test.testruns[-1].jobs[drivers[i].session_id] = i + 1
 '_asyncio.Future' object has no attribute 'session_id'

During handling of the above exception, another exception occurred:
critical/chats/test_1_1_public_chats.py:834: in prepare_devices
    self.drivers, self.loop = create_shared_drivers(2)
base_test_case.py:322: in create_shared_drivers
    test_suite_data.current_test.testruns[-1].error += str(e)
E   TypeError: unsupported operand type(s) for +=: 'NoneType' and 'str'



    6. test_1_1_chat_push_emoji, id: 702813 

    Test setup failed: base_test_case.py:316: in create_shared_drivers
    test_suite_data.current_test.testruns[-1].jobs[drivers[i].session_id] = i + 1
 '_asyncio.Future' object has no attribute 'session_id'

During handling of the above exception, another exception occurred:
critical/chats/test_1_1_public_chats.py:834: in prepare_devices
    self.drivers, self.loop = create_shared_drivers(2)
base_test_case.py:322: in create_shared_drivers
    test_suite_data.current_test.testruns[-1].error += str(e)
E   TypeError: unsupported operand type(s) for +=: 'NoneType' and 'str'



    7. test_1_1_chat_emoji_send_reply_and_open_link, id: 702782 

    Test setup failed: base_test_case.py:316: in create_shared_drivers
    test_suite_data.current_test.testruns[-1].jobs[drivers[i].session_id] = i + 1
 '_asyncio.Future' object has no attribute 'session_id'

During handling of the above exception, another exception occurred:
critical/chats/test_1_1_public_chats.py:834: in prepare_devices
    self.drivers, self.loop = create_shared_drivers(2)
base_test_case.py:322: in create_shared_drivers
    test_suite_data.current_test.testruns[-1].error += str(e)
E   TypeError: unsupported operand type(s) for +=: 'NoneType' and 'str'



    8. test_1_1_chat_send_image_save_and_share, id: 703391 

    Test setup failed: base_test_case.py:316: in create_shared_drivers
    test_suite_data.current_test.testruns[-1].jobs[drivers[i].session_id] = i + 1
 '_asyncio.Future' object has no attribute 'session_id'

During handling of the above exception, another exception occurred:
critical/chats/test_1_1_public_chats.py:834: in prepare_devices
    self.drivers, self.loop = create_shared_drivers(2)
base_test_case.py:322: in create_shared_drivers
    test_suite_data.current_test.testruns[-1].error += str(e)
E   TypeError: unsupported operand type(s) for +=: 'NoneType' and 'str'



    Class TestActivityMultipleDevicePRTwo:

    1. test_activity_center_admin_notification_accept_swipe, id: 702958

    Device 2: Find Button by xpath: //*[@content-desc='password-input']/../following-sibling::*//*[@text='Join Community']
    Device 2: Tap on found: Button 

    medium/test_activity_center.py:385: in test_activity_center_admin_notification_accept_swipe
    self.community_2.join_community()
../views/chat_view.py:424: in join_community
    self.community_status_joined.wait_for_visibility_of_element(60)
../views/base_element.py:139: in wait_for_visibility_of_element
    raise TimeoutException(
 Device 2: Text by accessibility id:`status-tag-positive` is not found on the screen after wait_for_visibility_of_element



    Device sessions

    Passed tests (28)

    Click to expand

    Class TestActivityMultipleDevicePR:

    1. test_activity_center_reply_read_unread_delete_filter_swipe, id: 702947
    Device sessions

    2. test_navigation_jump_to, id: 702936
    Device sessions

    Class TestCommunityMultipleDeviceMergedTwo:

    1. test_community_leave, id: 702845
    Device sessions

    2. test_community_markdown_support, id: 702809
    Device sessions

    3. test_community_hashtag_links_to_community_channels, id: 702948
    Device sessions

    Class TestCommunityMultipleDeviceMerged:

    1. test_community_emoji_send_copy_paste_reply, id: 702840
    Device sessions

    2. test_community_contact_block_unblock_offline, id: 702894
    Device sessions

    3. test_community_mark_all_messages_as_read, id: 703086
    Device sessions

    4. test_community_links_with_previews_github_youtube_twitter_gif_send_enable, id: 702844
    Device sessions

    5. test_community_unread_messages_badge, id: 702841
    Device sessions

    6. test_community_message_send_check_timestamps_sender_username, id: 702838
    Device sessions

    7. test_community_one_image_send_reply, id: 702859
    Device sessions

    8. test_community_message_edit, id: 702843
    Device sessions

    9. test_community_several_images_send_reply, id: 703194
    Device sessions

    Class TestOneToOneChatMultipleSharedDevicesNewUiTwo:

    1. test_1_1_chat_mute_chat, id: 703496
    Device sessions

    2. test_1_1_chat_is_shown_message_sent_delivered_from_offline, id: 702783
    Device sessions

    3. test_1_1_chat_delete_via_long_press_relogin, id: 702784
    Device sessions

    Class TestCommunityOneDeviceMerged:

    1. test_community_copy_and_paste_message_in_chat_input, id: 702742
    Device sessions

    2. test_community_navigate_to_channel_when_relaunch, id: 702846
    Device sessions

    3. test_restore_multiaccount_with_waku_backup_remove_switch, id: 703133
    Device sessions

    4. test_community_undo_delete_message, id: 702869
    Device sessions

    5. test_community_mute_community_and_channel, id: 703382
    Device sessions

    Class TestGroupChatMultipleDeviceMergedNewUI:

    1. test_group_chat_reactions, id: 703202
    Device sessions

    2. test_group_chat_send_image_save_and_share, id: 703297
    Device sessions

    3. test_group_chat_mute_chat, id: 703495
    Device sessions

    Class TestActivityCenterContactRequestMultipleDevicePR:

    1. test_activity_center_contact_request_accept_swipe_mark_all_as_read, id: 702851
    Device sessions

    2. test_activity_center_contact_request_decline, id: 702850
    Device sessions

    Class TestActivityMultipleDevicePRTwo:

    1. test_activity_center_mentions, id: 702957
    Device sessions

    @yevh-berdnyk yevh-berdnyk merged commit 7609a07 into develop Sep 6, 2023
    2 checks passed
    @yevh-berdnyk yevh-berdnyk deleted the tests/fixes-6-09 branch September 6, 2023 13:35
    Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
    Reviewers

    @pavloburykh pavloburykh pavloburykh approved these changes

    @qoqobolo qoqobolo qoqobolo approved these changes

    @churik churik Awaiting requested review from churik churik is a code owner

    Assignees

    @yevh-berdnyk yevh-berdnyk

    Labels
    tests
    Projects
    Pipeline for QA
    Archived in project
    Legacy QA Automation Project
    Archived in project
    Milestone
    No milestone
    Development

    Successfully merging this pull request may close these issues.
    4 participants
    @yevh-berdnyk @status-im-auto @qoqobolo @pavloburykh