[18.0][MIG] base_import_async: Migration to 18.0

base_import_async/README.rst

@@ -0,0 +1,154 @@
+===================
+Asynchronous Import
+===================
+
+.. 
+ !!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!
+ !! This file is generated by oca-gen-addon-readme !!
+ !! changes will be overwritten. !!
+ !!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!
+ !! source digest: sha256:e7bcaae80fd59cc8e45b2784606eb026fba7dfcac892ad4a986f51e0dc248e1e
+ !!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!
+
+.. |badge1| image:: https://img.shields.io/badge/maturity-Production%2FStable-green.png
+ :target: https://odoo-community.org/page/development-status
+ :alt: Production/Stable
+.. |badge2| image:: https://img.shields.io/badge/licence-AGPL--3-blue.png
+ :target: http://www.gnu.org/licenses/agpl-3.0-standalone.html
+ :alt: License: AGPL-3
+.. |badge3| image:: https://img.shields.io/badge/github-OCA%2Fqueue-lightgray.png?logo=github
+ :target: https://github.com/OCA/queue/tree/18.0/base_import_async
+ :alt: OCA/queue
+.. |badge4| image:: https://img.shields.io/badge/weblate-Translate%20me-F47D42.png
+ :target: https://translation.odoo-community.org/projects/queue-18-0/queue-18-0-base_import_async
+ :alt: Translate me on Weblate
+.. |badge5| image:: https://img.shields.io/badge/runboat-Try%20me-875A7B.png
+ :target: https://runboat.odoo-community.org/builds?repo=OCA/queue&target_branch=18.0
+ :alt: Try me on Runboat
+
+|badge1| |badge2| |badge3| |badge4| |badge5|
+
+This module extends the standard CSV import functionality to import
+files in the background using the OCA/queue framework.
+
+**Table of contents**
+
+.. contents::
+ :local:
+
+Usage
+=====
+
+The user is presented with a new checkbox in the import screen. When
+selected, the import is delayed in a background job.
+
+This job in turn splits the CSV file in chunks of minimum 100 lines (or
+more to align with record boundaries). Each chunk is then imported in a
+separate background job.
+
+When an import fails, the job is marked as such and the user can read
+the error in the job status. The CSV chunk being imported is stored as
+an attachment to the job, making it easy to download it, fix it and run
+a new import, possibly in synchronous mode since the chunks are small.
+
+Any file that can be imported by the standard import mechanism can also
+be imported in the background.
+
+This module's scope is limited to making standard imports asynchronous.
+It does not attempt to transform the data nor automate ETL flows.
+
+Other modules may benefit from this infrastructure in the following way
+(as illustrated in the test suite):
+
+1. create an instance of base_import.import and populate its fields
+ (res_model, file, file_name),
+2. invoke the do method with appropriate options (header, encoding,
+ separator, quoting, use_queue, chunk_size).
+
+Known issues / Roadmap
+======================
+
+- There is currently no user interface to control the chunk size, which
+ is currently 100 by default. Should this proves to be an issue, it is
+ easy to add an option to extend the import screen.
+- Validation cannot be run in the background.
+
+Changelog
+=========
+
+13.0.1.0.0 (2019-12-20)
+-----------------------
+
+- [MIGRATION] from 12.0 branched at rev. a7f8031
+
+Bug Tracker
+===========
+
+Bugs are tracked on `GitHub Issues <https://github.com/OCA/queue/issues>`_.
+In case of trouble, please check there if your issue has already been reported.
+If you spotted it first, help us to smash it by providing a detailed and welcomed
+`feedback <https://github.com/OCA/queue/issues/new?body=module:%20base_import_async%0Aversion:%2018.0%0A%0A**Steps%20to%20reproduce**%0A-%20...%0A%0A**Current%20behavior**%0A%0A**Expected%20behavior**>`_.
+
+Do not contact contributors directly about support or help with technical issues.
+
+Credits
+=======
+
+Authors
+-------
+
+* Akretion
+* ACSONE SA/NV
+
+Contributors
+------------
+
+Sébastien Beau (Akretion) authored the initial prototype.
+
+Stéphane Bidoul (ACSONE) extended it to version 1.0 to support
+multi-line records, store data to import as attachments and let the user
+control the asynchronous behaviour.
+
+Other contributors include:
+
+- Anthony Muschang (ACSONE)
+
+- David Béal (Akretion)
+
+- Jonathan Nemry (ACSONE)
+
+- Laurent Mignon (ACSONE)
+
+- Dennis Sluijk (Onestein)
+
+- Guewen Baconnier (Camptocamp)
+
+- `Trobz <https://trobz.com>`__:
+
+ - Dzung Tran <dungtd@trobz.com>
+ - Do Anh Duy <duyda@trobz.com>
+
+- Daniel Duque (FactorLibre)
+
+Other credits
+-------------
+
+The migration of this module from 17.0 to 18.0 was financially supported
+by Camptocamp
+
+Maintainers
+-----------
+
+This module is maintained by the OCA.
+
+.. image:: https://odoo-community.org/logo.png
+ :alt: Odoo Community Association
+ :target: https://odoo-community.org
+
+OCA, or the Odoo Community Association, is a nonprofit organization whose
+mission is to support the collaborative development of Odoo features and
+promote its widespread use.
+
+This module is part of the `OCA/queue <https://github.com/OCA/queue/tree/18.0/base_import_async>`_ project on GitHub.
+
+You are welcome to contribute. To learn how please visit https://odoo-community.org/page/Contribute.

base_import_async/__init__.py

@@ -0,0 +1,3 @@
+# License AGPL-3.0 or later (https://www.gnu.org/licenses/agpl).
+
+from . import models

base_import_async/__manifest__.py

@@ -0,0 +1,25 @@
+# @author Stéphane Bidoul <stephane.bidoul@acsone.eu>
+# @author Sébastien BEAU <sebastien.beau@akretion.com>
+# License AGPL-3.0 or later (https://www.gnu.org/licenses/agpl).
+
+{
+ "name": "Asynchronous Import",
+ "summary": "Import CSV files in the background",
+ "version": "18.0.1.0.0",
+ "author": "Akretion, ACSONE SA/NV, Odoo Community Association (OCA)",
+ "license": "AGPL-3",
+ "website": "https://github.com/OCA/queue",
+ "category": "Generic Modules",
+ "depends": ["base_import", "queue_job"],
+ "data": [
+ "data/queue_job_function_data.xml",
+ ],
+ "assets": {
+ "web.assets_backend": [
+ "base_import_async/static/src/js/import_model.esm.js",
+ "base_import_async/static/src/xml/import_data_sidepanel.xml",
+ ],
+ },
+ "installable": True,
+ "development_status": "Production/Stable",
+}

base_import_async/data/queue_job_function_data.xml

@@ -0,0 +1,21 @@
+<odoo noupdate="1">
+ <record id="job_function_base_import_import_split_file" model="queue.job.function">
+ <field name="model_id" ref="base_import.model_base_import_import" />
+ <field name="method">_split_file</field>
+ <field
+ name="related_action"
+ eval='{"func_name": "_related_action_attachment"}'
+ />
+ </record>
+ <record
+ id="job_function_base_import_import_import_one_chunk"
+ model="queue.job.function"
+ >
+ <field name="model_id" ref="base_import.model_base_import_import" />
+ <field name="method">_import_one_chunk</field>
+ <field
+ name="related_action"
+ eval='{"func_name": "_related_action_attachment"}'
+ />
+ </record>
+</odoo>

base_import_async/i18n/base_import_async.pot

@@ -0,0 +1,78 @@
+# Translation of Odoo Server.
+# This file contains the translation of the following modules:
+# * base_import_async
+#
+msgid ""
+msgstr ""
+"Project-Id-Version: Odoo Server 16.0\n"
+"Report-Msgid-Bugs-To: \n"
+"Last-Translator: \n"
+"Language-Team: \n"
+"MIME-Version: 1.0\n"
+"Content-Type: text/plain; charset=UTF-8\n"
+"Content-Transfer-Encoding: \n"
+"Plural-Forms: \n"
+
+#. module: base_import_async
+#. odoo-python
+#: code:addons/base_import_async/models/queue_job.py:0
+#, python-format
+msgid "Attachment"
+msgstr ""
+
+#. module: base_import_async
+#: model:ir.model,name:base_import_async.model_base_import_import
+msgid "Base Import"
+msgstr ""
+
+#. module: base_import_async
+#. odoo-python
+#: code:addons/base_import_async/models/base_import_import.py:0
+#, python-format
+msgid ""
+"Import %(model)s from file %(file_name)s - #%(chunk)s - lines %(from)s to "
+"%(to)s"
+msgstr ""
+
+#. module: base_import_async
+#. odoo-python
+#: code:addons/base_import_async/models/base_import_import.py:0
+#, python-format
+msgid "Import %(model)s from file %(from_file)s"
+msgstr ""
+
+#. module: base_import_async
+#. odoo-javascript
+#: code:addons/base_import_async/static/src/xml/import.xml:0
+#, python-format
+msgid "Import in the background"
+msgstr ""
+
+#. module: base_import_async
+#: model:ir.model,name:base_import_async.model_queue_job
+msgid "Queue Job"
+msgstr ""
+
+#. module: base_import_async
+#. odoo-javascript
+#: code:addons/base_import_async/static/src/xml/import.xml:0
+#, python-format
+msgid ""
+"When checked, the import will be executed as a background job, after "
+"splitting your file in small chunks that will be processed independently. "
+"Use this to import very large files."
+msgstr ""
+
+#. module: base_import_async
+#. odoo-javascript
+#: code:addons/base_import_async/static/src/js/import.js:0
+#, python-format
+msgid "You can check the status of this job in menu 'Queue / Jobs'."
+msgstr ""
+
+#. module: base_import_async
+#. odoo-javascript
+#: code:addons/base_import_async/static/src/js/import.js:0
+#, python-format
+msgid "Your request is being processed"
+msgstr ""

base_import_async/i18n/es.po

@@ -0,0 +1,88 @@
+# Translation of Odoo Server.
+# This file contains the translation of the following modules:
+# * base_import_async
+#
+msgid ""
+msgstr ""
+"Project-Id-Version: Odoo Server 16.0\n"
+"Report-Msgid-Bugs-To: \n"
+"PO-Revision-Date: 2023-09-25 09:34+0000\n"
+"Last-Translator: Asier Neira <asier_neira@hotmail.com>\n"
+"Language-Team: none\n"
+"Language: es\n"
+"MIME-Version: 1.0\n"
+"Content-Type: text/plain; charset=UTF-8\n"
+"Content-Transfer-Encoding: \n"
+"Plural-Forms: nplurals=2; plural=n != 1;\n"
+"X-Generator: Weblate 4.17\n"
+
+#. module: base_import_async
+#. odoo-python
+#: code:addons/base_import_async/models/queue_job.py:0
+#, python-format
+msgid "Attachment"
+msgstr "Archivo adjunto"
+
+#. module: base_import_async
+#: model:ir.model,name:base_import_async.model_base_import_import
+msgid "Base Import"
+msgstr "Importación Base"
+
+#. module: base_import_async
+#. odoo-python
+#: code:addons/base_import_async/models/base_import_import.py:0
+#, python-format
+msgid ""
+"Import %(model)s from file %(file_name)s - #%(chunk)s - lines %(from)s to "
+"%(to)s"
+msgstr ""
+"Importar %(model)s del archivo %(file_name)s - #%(chunk)s - líneas %(from)s "
+"a %(to)s"
+
+#. module: base_import_async
+#. odoo-python
+#: code:addons/base_import_async/models/base_import_import.py:0
+#, python-format
+msgid "Import %(model)s from file %(from_file)s"
+msgstr "Importar %(model)s del fichero %(from_file)s"
+
+#. module: base_import_async
+#. odoo-javascript
+#: code:addons/base_import_async/static/src/xml/import.xml:0
+#, python-format
+msgid "Import in the background"
+msgstr "Importación en segundo plano"
+
+#. module: base_import_async
+#: model:ir.model,name:base_import_async.model_queue_job
+msgid "Queue Job"
+msgstr "Cola de trabajo"
+
+#. module: base_import_async
+#. odoo-javascript
+#: code:addons/base_import_async/static/src/xml/import.xml:0
+#, python-format
+msgid ""
+"When checked, the import will be executed as a background job, after "
+"splitting your file in small chunks that will be processed independently. "
+"Use this to import very large files."
+msgstr ""
+"Si esta opción está seleccionada, la importación se ejecutará como un "
+"trabajo en segundo plano, tras dividir el archivo en pequeños trozos que se "
+"procesarán de forma independiente. Utilícelo para importar archivos muy "
+"grandes."
+
+#. module: base_import_async
+#. odoo-javascript
+#: code:addons/base_import_async/static/src/js/import.js:0
+#, python-format
+msgid "You can check the status of this job in menu 'Queue / Jobs'."
+msgstr ""
+"Puede comprobar el estado de este trabajo en el menú 'Cola / Trabajos'."
+
+#. module: base_import_async
+#. odoo-javascript
+#: code:addons/base_import_async/static/src/js/import.js:0
+#, python-format
+msgid "Your request is being processed"
+msgstr "Su solicitud está siendo procesada"