WP CLI command for background synchronization

[antonkorotkov]

Since we are going to clean up the current implementation if CLI #450, it may be a good point to start adding new features to it #447.

• The new command (sync) should basically do the same as Sync processes do on the Settings -> Sync tab.
• It should support the mode argument to control the Sync type (for images and non-images).
• Should have an argument for Bulk Size.
• Any other arguments that could be useful?

[ewsopp]

@alimuzzaman can you test this please?

[alimuzzaman]

OK, testing.

[alimuzzaman]

I ran this command wp stateless sync files --force --url=https://test2.stateless.ci/ --b

@planv why did it ran ten batches for only 4 attachment?
The sync has been done at the last batch.
Is this expected?

wp stateless sync files --force --url=https://test2.stateless.ci/ --b
...
Launching external command 'wp stateless sync files --force --batch=1 --batches=10 --limit=100 --url=https://test2.stateless.ci/'
Waiting...
Starting extract attachments.
Success: Stateless Media is synced
Media which have been checked: 0
Synced stateless for 0 attachments
Spent Time: 0 sec
...
Launching external command 'wp stateless sync files --force --batch=2 --batches=10 --limit=100 --url=https://test2.stateless.ci/'
Waiting...
Starting extract attachments.
Success: Stateless Media is synced
Media which have been checked: 0
Synced stateless for 0 attachments
Spent Time: 0 sec
...
Launching external command 'wp stateless sync files --force --batch=3 --batches=10 --limit=100 --url=https://test2.stateless.ci/'
Waiting...
Starting extract attachments.
Success: Stateless Media is synced
Media which have been checked: 0
Synced stateless for 0 attachments
Spent Time: 0 sec
...
Launching external command 'wp stateless sync files --force --batch=4 --batches=10 --limit=100 --url=https://test2.stateless.ci/'
Waiting...
Starting extract attachments.
Success: Stateless Media is synced
Media which have been checked: 0
Synced stateless for 0 attachments
Spent Time: 0 sec
...
Launching external command 'wp stateless sync files --force --batch=5 --batches=10 --limit=100 --url=https://test2.stateless.ci/'
Waiting...
Starting extract attachments.
Success: Stateless Media is synced
Media which have been checked: 0
Synced stateless for 0 attachments
Spent Time: 0 sec
...
Launching external command 'wp stateless sync files --force --batch=6 --batches=10 --limit=100 --url=https://test2.stateless.ci/'
Waiting...
Starting extract attachments.
Success: Stateless Media is synced
Media which have been checked: 0
Synced stateless for 0 attachments
Spent Time: 0 sec
...
Launching external command 'wp stateless sync files --force --batch=7 --batches=10 --limit=100 --url=https://test2.stateless.ci/'
Waiting...
Starting extract attachments.
Success: Stateless Media is synced
Media which have been checked: 0
Synced stateless for 0 attachments
Spent Time: 0 sec
...
Launching external command 'wp stateless sync files --force --batch=8 --batches=10 --limit=100 --url=https://test2.stateless.ci/'
Waiting...
Starting extract attachments.
Success: Stateless Media is synced
Media which have been checked: 0
Synced stateless for 0 attachments
Spent Time: 0 sec
...
Launching external command 'wp stateless sync files --force --batch=9 --batches=10 --limit=100 --url=https://test2.stateless.ci/'
Waiting...
Starting extract attachments.
Success: Stateless Media is synced
Media which have been checked: 0
Synced stateless for 0 attachments
Spent Time: 0 sec
...
Launching external command 'wp stateless sync files --force --batch=10 --batches=10 --limit=100 --url=https://test2.stateless.ci/'
Waiting...
Starting extract attachments.
Success: Stateless Media is synced
Media which have been checked: 4
Synced stateless for 3 attachments
Spent Time: 2 sec

[alimuzzaman]

@ewsopp everything else is ok.

[planv]

@alimuzzaman

why did it ran ten batches for only 4 attachment?
Ten batches - it is count batches by default.

The sync has been done at the last batch.
Is this expected?

Yes, because we use argument batch for calculating LIMIT on SQL query.

[planv]

Added new sync option use_wildcards
#449 (comment)

[alimuzzaman]

use_wildcards is working fine.