Move logic away from PHP into Rust backend

[VermiumSifell]

Summary

Move all database related tasks and backend stuff into Rust code

Motivation

Makes PHP build faster, separation of backend and frontend makes it easier to read the code and improve it, this also allows us to write a new frontend in future without being too much of a hassle

Additional context

Docker #25
Rspamd #40

[VermiumSifell]

We need to fix database stuff into diesel.rs first:

• Migrations (Diesel migrations #22)

Some of the PHP variables are stored here: https://github.com/ZynerOrg/zynerone/blob/master/data/web/inc/vars.inc.php

Function files checked:

• other
• acl
• address_rewriting
• admin
• app_passwd
• customize
• dkim
• docker
• domain_admin
• netfilter
• fwdhost
• mailbox
• mailq
• oauth2
• policy
• presets
• pushover
• quarantine
• quota_notification
• ratelimit
• rspamd
• tls_policy_maps
• transports

REST Endpoints:

• System

  • Host
  • Containers (code inspiration)
    • container_post__stop
    • container_post__start
    • container_post__restart
    • container_post__top
    • container_post__stats
    • container_post__exec__mailq__delete
    • container_post__exec__mailq__hold
    • container_post__exec__mailq__cat
    • container_post__exec__mailq__unhold
    • container_post__exec__mailq__deliver
    • container_post__exec__mailq__list
    • container_post__exec__mailq__flush
    • container_post__exec__mailq__super_delete
    • container_post__exec__system__fts_rescan
    • container_post__exec__system__df
    • container_post__exec__system__mysql_upgrade
    • container_post__exec__system__mysql_tzinfo_to_sql
    • container_post__exec__reload__dovecot
    • container_post__exec__reload__postfix
    • container_post__exec__reload__nginx
    • container_post__exec__sieve__list
    • container_post__exec__sieve__print
    • container_post__exec__maildir__cleanup
    • container_post__exec__rspamd__worker_password
    • get_container_stats
    • exec_cmd_container
    • exec_run_handler

• Mail

  • Needs investigation
    • Sender ACL Handles
      • Read function
    • Active User Sieve
      • Read function
    • Shared Aliases
      • Read function
    • Direct Aliases
      • Read function
    • EAS Cache
      • Delete function
    • SOGo Profile
      • Delete function
  • Domains
    • Create function (endpoint reference)
    • Read function v1 (endpoint reference)
    • Read function v2 (endpoint reference)
    • Update function (endpoint reference)
    • Delete function (endpoint reference)
    • Tags
      • Delete function
    • Domain Wide Footer
      • Read function
      • Update function
    • Aliases
      • Create function
      • Read function v1
      • Read function v2
      • Update function
      • Delete function
    • Templates
      • Create function
      • Read function
      • Update function
      • Delete function
  • Mailboxes
    • Create function
    • Read function v1
    • Read function v2
    • Update function
    • Delete function
    • Tags
      • Delete function
    • Filter
      • Delimiter Action
        • Read function
        • Update function
      • Sieve
        • Create function
        • Read function
        • Update function
        • Delete function
      • Spam
        • Score
          • Read function
          • Update function
    • Quarantine
      • Notification
        • Read function
        • Update function
      • Category
        • Read function
        • Update function
    • TLS Policies
      • Read function
      • Update function
    • Templates
      • Create function
      • Read function
      • Update function
      • Delete function
    • Aliases
      • Read function v1
      • Read function v2
      • Normal
        • Create function
        • Update function
        • Delete function
      • Time Limited
        • Create function
        • Read function
        • Update function
        • Delete function
    • Syncjobs
      • Create function
      • Read function v1
      • Read function v2
      • Update function
      • Delete function
  • Filters (global)
    • Sieve
      • Create function
      • Read function

• Calendar (low knowledge about these endpoints)

  • Resources
    • Create function
    • Read function v1
    • Read function v2
    • Update function
    • Delete function

Other information:

Update SOGo Static View

  if ($_action != 'get' && in_array($_type, array('domain', 'alias', 'alias_domain', 'resource')) && getenv('SKIP_SOGO') != "y") {
    update_sogo_static_view();
  }

Endpoints:

• Rewrite this code into the Rust API (https://github.com/ZynerOrg/zynerone/tree/master/data/Dockerfiles/dockerapi), this also makes us use one less container! Make use of this crate: https://docs.rs/docker-api/latest/docker_api/index.html While doing this, make sure to point the frontend to it: https://github.com/ZynerOrg/zynerone/blob/master/data/web/inc/functions.docker.inc.php
• Mail Endpoints
  • Domains (https://github.com/ZynerOrg/zynerone/blob/master/data/web/inc/functions.mailbox.inc.php)
  • Mailboxes (https://github.com/ZynerOrg/zynerone/blob/master/data/web/inc/functions.mailbox.inc.php)
  • Aliases
    • Time Limited Alias
      • Create (https://github.com/ZynerOrg/zynerone/blob/master/data/web/inc/functions.mailbox.inc.php#L14-L77)
  • Rspamd (https://github.com/ZynerOrg/zynerone/blob/master/data/web/inc/functions.rspamd.inc.php)
  • App Passwords (https://github.com/ZynerOrg/zynerone/blob/master/data/web/inc/functions.app_passwd.inc.php)
  • Address Rewriting (https://github.com/ZynerOrg/zynerone/blob/master/data/web/inc/functions.address_rewriting.inc.php)
  • DKIM (https://github.com/ZynerOrg/zynerone/blob/master/data/web/inc/functions.dkim.inc.php)
  • Mail Queue (https://github.com/ZynerOrg/zynerone/blob/master/data/web/inc/functions.mailq.inc.php)
  • Forwarding Hosts (https://github.com/ZynerOrg/zynerone/blob/master/data/web/inc/functions.fwdhost.inc.php)
  • Presets (https://github.com/ZynerOrg/zynerone/blob/master/data/web/inc/functions.presets.inc.php) All presets are currently stored here: https://github.com/ZynerOrg/zynerone/tree/master/data/web/inc/presets
  • TLS Policy Maps (https://github.com/ZynerOrg/zynerone/blob/master/data/web/inc/functions.tls_policy_maps.inc.php)
  • Quarantine (https://github.com/ZynerOrg/zynerone/blob/master/data/web/inc/functions.quarantine.inc.php)
  • Policies (https://github.com/ZynerOrg/zynerone/blob/master/data/web/inc/functions.policy.inc.php)
  • Quota Notifications (https://github.com/ZynerOrg/zynerone/blob/master/data/web/inc/functions.quota_notification.inc.php)
  • Ratelimits (https://github.com/ZynerOrg/zynerone/blob/master/data/web/inc/functions.ratelimit.inc.php)
  • Transports (https://github.com/ZynerOrg/zynerone/blob/master/data/web/inc/functions.transports.inc.php)
  • SPF Validation (https://github.com/ZynerOrg/zynerone/blob/master/data/web/inc/spf.inc.php)
  • Validate Sieve filters in backend (https://github.com/ZynerOrg/zynerone/blob/master/data/web/inc/ajax/sieve_validation.php)
• Security Endpoints
  • Netfilter (https://github.com/ZynerOrg/zynerone/blob/master/data/web/inc/functions.fail2ban.inc.php)
  • Admin Users (https://github.com/ZynerOrg/zynerone/blob/master/data/web/inc/functions.admin.inc.php)
  • ACL (https://github.com/ZynerOrg/zynerone/blob/master/data/web/inc/functions.acl.inc.php)
  • Domain Admin Users (https://github.com/ZynerOrg/zynerone/blob/master/data/web/inc/functions.domain_admin.inc.php)
  • OAuth2 (https://github.com/ZynerOrg/zynerone/blob/master/data/web/inc/functions.oauth2.inc.php)
• UI Endpoints
  • Customization of UI (https://github.com/ZynerOrg/zynerone/blob/master/data/web/inc/functions.customize.inc.php)
  • DNS records (https://github.com/ZynerOrg/zynerone/blob/master/data/web/inc/ajax/dns_diagnostics.php)
• Notification endpoints
  • Pushover (https://github.com/ZynerOrg/zynerone/blob/master/data/web/inc/functions.pushover.inc.php) Either rewrite or abondon the code

Other:

• Helper functions (can be found here: https://github.com/ZynerOrg/zynerone/blob/master/data/web/inc/functions.inc.php)
• Replace API documentation with the new Rust API (https://github.com/ZynerOrg/zynerone/tree/master/data/web/api)