Fix compile when memory grows afterward

Fix compile when memory grows afterward #516