Performance: Slow export caused by inefficient collections

[pmzandbergen]

For a larger shop (39 stores, 82.500+ products) it takes a long time to generate the export (almost one hour for a feed of just over 60MB). This is mainly caused by the way the product iterator is designed. It doesn't take into account the primary selection criteria used by ExportEntity::shouldExport (linked to website, visibility, etc.). All products for every single store are iterated, which is not very efficient.

Suggestions

• Limit the collection / iterator to products which should be exported (quick & best win)
• Create a collection for multiple stores at once (mainly improves the performance for shops where multiple store views share a large amount of products)

[ah-net]

Late reply but this has been added to our backlog

[kaplansin]

store level export feature can be solution for this issue @ah-net