Skip to content

Magento 2.2.1 mysql hight memory usage #12341

Closed
@ghost

Description

Preconditions

  1. Magento 2.2.1
  2. Apache 2.4.25
  3. MySQL 5.7.20
  4. Ubuntu 17.04
  5. Virtual machine hardware (Esxi 5.5)
    - CPU: Intel Xeon E5-1650 V3 @ 3.50GHz X 8
    - RAM: 64 GO
  6. I have a lot of products with big content description and attributes in 6 languages. +/- 65000 products. Database is big!
  7. PHP 7.1.11

Steps to reproduce

  1. magento index:reindex
    or
  2. magento deploy:mode:set production

I have to regularly (several times a day) use the command sudo service mysql restart in order to free some memory. If I do not do this, the server stops responding.

Expected result

  1. Command success and correct memory usage.

Actual result

  1. Process use all memory available and can not finish

My MySQL cnf file "/etc/mysql/conf.d/my.cnf":

The MySQL database server configuration file.

You can copy this to one of:

- "/etc/mysql/my.cnf" to set global options,

- "~/.my.cnf" to set user-specific options.

One can use all long options that the program supports.

Run program with --help to get a list of available options and with

--print-defaults to see which it would actually understand and use.

For explanations see

http://dev.mysql.com/doc/mysql/en/server-system-variables.html

This will be passed to all mysql clients

It has been reported that passwords should be enclosed with ticks/quotes

escpecially if they contain "#" chars...

Remember to edit /etc/mysql/debian.cnf when changing the socket location.

Here is entries for some specific programs

The following values assume you have at least 32M ram

[mysqld_safe]
socket = /var/run/mysqld/mysqld.sock
nice = 0

[mysqld]

* Basic Settings

user = mysql
pid-file = /var/run/mysqld/mysqld.pid
socket = /var/run/mysqld/mysqld.sock
port = 3306
basedir = /usr
datadir = /var/lib/mysql
tmpdir = /tmp
lc-messages-dir = /usr/share/mysql
skip-external-locking

Instead of skip-networking the default is now to listen only on

localhost which is more compatible and is not less secure.

bind-address = 127.0.0.1

* Fine Tuning

key_buffer_size = 64M
max_allowed_packet = 64M
thread_stack = 192K
thread_cache_size = 8
wait_timeout = 28800
connect_timeout = 120

This replaces the startup script and checks MyISAM tables if needed

the first time they are touched

myisam-recover-options = BACKUP
#max_connections = 100
#table_cache = 64
#thread_concurrency = 10

* Query Cache Configuration

query_cache_limit = 16M
query_cache_size = 256M
table_open_cache = 6000
key_buffer_size = 1024M

* Logging and Replication

Both location gets rotated by the cronjob.

Be aware that this log type is a performance killer.

As of 5.1 you can enable the log at runtime!

#general_log_file = /var/log/mysql/mysql.log
#general_log = 1

Error log - should be very few entries.

log_error = /var/log/mysql/error.log

Here you can see queries with especially long duration

#log_slow_queries = /var/log/mysql/mysql-slow.log
#long_query_time = 2
#log-queries-not-using-indexes

The following can be used as easy to replay backup logs or for replication.

note: if you are setting up a replication slave, see README.Debian about

other settings you may need to change.

#server-id = 1
#log_bin = /var/log/mysql/mysql-bin.log
expire_logs_days = 10
max_binlog_size = 100M
#binlog_do_db = include_database_name
#binlog_ignore_db = include_database_name

* InnoDB

innodb_buffer_pool_size = 4G
innodb_log_file_size = 16M

InnoDB is enabled by default with a 10MB datafile in /var/lib/mysql/.

Read the manual for more InnoDB related options. There are many!

* Security Features

Read the manual, too, if you want chroot!

chroot = /var/lib/mysql/

For generating SSL certificates I recommend the OpenSSL GUI "tinyca".

ssl-ca=/etc/mysql/cacert.pem

ssl-cert=/etc/mysql/server-cert.pem

ssl-key=/etc/mysql/server-key.pem

memory

Metadata

Metadata

Assignees

No one assigned

    Labels

    Issue: Format is validGate 1 Passed. Automatic verification of issue format passed

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions