Performance issues on self hosted

Hey,

we are currently struggling with massive performance issues after importing big volume of data (approx. 700k per table across 4 main tables that are linked together and being used for automation purposes). Tables typically have 10-15 fields, where approx. 20% are lookups & links.

Issues are with general app usage - browsing through data, trying to create new field, renaming existing field, searching for records etc. We are experiencing issues with api as well, where n8n automations typically time out at some point (they do sometimes go through. API requests are mostly checking if data exists based off specified parameters and creating it if it doesn’t (this involves checking whether all relations between databases exist and creating them too).

We’re hosting on elestio with following specifications:

Server type: LARGE-4C-8G (4 VCPU s - 8 GB RAM - 160 GB storage) Provider: hetzner

We’re also in talks with elestio support to see what solutions they suggest as a fix to this issue.

Hey @davidok,

with these information is very difficult to say what could be the problem.
There are a lot of factors that might influence performances, like tables structure, view filters applied, number of elements linked per row, number and type of API requests made per table.

Moreover, some operations need to block everything else for the time required to complete. For example adding/removing and in some cases changing a field will block every other request (both read and writes) on the table and in some circumstances also the linked table.

We are currently working on some optimizations around formula fields that will be included in the next release, but it’s difficult to say if they will solve your problem.

Could you please provide more details about tables structure and everything that can help reproduce your use case?

I can’t guarantee a quick response as it might take some time to understand the causes, but we will do our best.

It would also be useful if you can share how you’re self-hosting, which environment variables you set, and how many API requests are being made.