Significant Compilation Time Increase with Growing Number of Model Files - Incremental Compilation Possible?

[w1992wishes]

As the number of model files under the schema increases, the compilation time significantly increases, leading to a long response time for the first request after each model file compilation. Are there any optimization strategies for this issue? Currently, it appears to be a full compilation every time. Is incremental compilation possible?

[ifokeev]

Hi @w1992wishes! It's because cube stack container is not optimized for schema caching, you need to define schemaVersion somehow in you config similar to https://github.com/mlcraft-io/mlcraft/blob/main/services/cubejs/index.js#L43

[w1992wishes]

Hi @w1992wishes! It's because cube stack container is not optimized for schema caching, you need to define schemaVersion somehow in you config similar to https://github.com/mlcraft-io/mlcraft/blob/main/services/cubejs/index.js#L43

Thanks, I have already defined schemaVersion. However, there are some scenarios where I indeed need to update the schema, and in those cases, it significantly impacts the existing queries.