You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Hi @Mardl,
Did you get a chance to look into it? I am fairly new to this module so it is possible that I may have made some mistake while preparing the csv file. I have shared the sample content of the sheet in the ticket itself. Could you at least point me in the right direction so that I can find a workaround or root cause of this problem ?
I was able to resolve the issue of "additional categories" after removing categories from other store views. Kept the categories for admin store view only and it stopped creating additional categories after import.
Issue with custom options is still there though. Not sure if I am doing something wrong or it's a bug.
Preconditions
Project Environment
Magento Cloud Version: 2.4.2-p1
PHP: 7.4
Database: MariaDB 10.4.14
Techdivision Import Cli : 3.8.53
Steps to reproduce
Sample Import File Data
Actual Result
Prduct is imported with all the attributes.
Custom Options for products are not created.
Products are assigned to their respective categories but some phantom categories are created after the import.
Also getting the following exception if trying to update existing products using import. This issue is intermittent.
{"message":" _______ _ _____ _ _ _\n|__ __| | | | __ \\(_) (_) (_)\n | | ___ ___| |__ | | | |___ ___ ___ _ ___ _ __\n | |/ _ \\/ __| \\_ \\| | | | \\ \\ / / / __| |/ _ \\| \\_ \\\n | | __/ (__| | | | |__| | |\\ V /| \\__ \\ | (_) | | | |\n |_|\\___|\\___|_| |_|_____/|_| \\_/ |_|___/_|\\___/|_| |_|\n Now start import with serial 4d71c4b3-8674-4e47-96f3-21b9599f6ea4 [catalog_product => add-update]\n+--------------------------------+-------+----------------------------------------------------------------------------------+\n| Variable | Value | Description |\n+--------------------------------+-------+----------------------------------------------------------------------------------+\n| innodb_flush_log_at_trx_commit | 1 | Your setting for may result in a significantly slower performance. Consider to s |\n| | | witch this value to 0 or 2 to improve performance. Read more about that topic on |\n| | | the MySQL website https://dev.mysql.com/doc/refman/5.7/en/innodb-parameters.html |\n| | | #sysvar_innodb_flush_log_at_trx_commit. |\n+--------------------------------+-------+----------------------------------------------------------------------------------+\n[2022-04-04 15:00:13] logger/system.NOTICE: Successfully processed file \"product-import_20220404-080011_01.csv\" with \"1182\" lines (skipped \"0\") in \"0.129460\" s {\"operation-name\":\"general/catalog_product/collect-data\"} {\"serial\":\"4d71c4b3-8674-4e47-96f3-21b9599f6ea4\",\"memory_peak_usage\":\"32 MB\"}\n[2022-04-04 15:00:13] logger/system.NOTICE: Observer \"TechDivision\\Import\\Observers\\GenericHookAwareColumnCollectorObserver\" successfully updated status data for \"collected_columns\" {\"serial\":\"4d71c4b3-8674-4e47-96f3-21b9599f6ea4\",\"memory_peak_usage\":\"32 MB\"}\n[2022-04-04 15:00:17] logger/system.NOTICE: Successfully processed file \"product-import_20220404-080011_01.csv\" with \"1182\" lines (skipped \"0\") in \"4.729939\" s {\"operation-name\":\"general/eav_attribute/convert\"} {\"serial\":\"4d71c4b3-8674-4e47-96f3-21b9599f6ea4\",\"memory_peak_usage\":\"34 MB\"}\n[2022-04-04 15:00:18] logger/system.NOTICE: Successfully processed file \"product-import_20220404-080011_01.csv\" with \"1182\" lines (skipped \"0\") in \"0.169692\" s {\"operation-name\":\"general/catalog_category/convert\"} {\"serial\":\"4d71c4b3-8674-4e47-96f3-21b9599f6ea4\",\"memory_peak_usage\":\"34 MB\"}\n[2022-04-04 15:00:18] logger/system.NOTICE: Successfully processed file \"category-import_20220404-150018_01.csv\" with \"4\" lines (skipped \"0\") in \"0.000354\" s {\"operation-name\":\"ce/catalog_category/sort\"} {\"serial\":\"4d71c4b3-8674-4e47-96f3-21b9599f6ea4\",\"memory_peak_usage\":\"34 MB\"}\n[2022-04-04 15:00:18] logger/system.NOTICE: Successfully processed file \"category-create_20220404-150018_01.csv\" with \"4\" lines (skipped \"0\") in \"0.079053\" s {\"operation-name\":\"ee/catalog_category/add-update\"} {\"serial\":\"4d71c4b3-8674-4e47-96f3-21b9599f6ea4\",\"memory_peak_usage\":\"34 MB\"}\n[2022-04-04 15:00:18] logger/system.NOTICE: Successfully processed file \"category-path_20220404-150018_01.csv\" with \"12\" lines (skipped \"0\") in \"0.014969\" s {\"operation-name\":\"ee/catalog_category/add-update.path\"} {\"serial\":\"4d71c4b3-8674-4e47-96f3-21b9599f6ea4\",\"memory_peak_usage\":\"34 MB\"}\nPHP Notice: Trying to access array offset on value of type bool in /var/www/migration/vendor/techdivision/import/src/Subjects/AbstractSubject.php on line 1412\nPHP Notice: Trying to access array offset on value of type bool in /var/www/migration/vendor/techdivision/import/src/Subjects/AbstractSubject.php on line 1413\n[2022-04-04 15:00:18] logger/system.ERROR: PDOException: SQLSTATE[23000]: Integrity constraint violation: 1062 Duplicate entry 'coloured-diamond-jewellery-3' for key 'URL_REWRITE_REQUEST_PATH_STORE_ID' in /var/www/migration/vendor/techdivision/import/src/Actions/Processors/AbstractBaseProcessor.php:222\nStack trace:\n#0 /var/www/migration/vendor/techdivision/import/src/Actions/Processors/AbstractBaseProcessor.php(222): PDOStatement->execute()\n#1 /var/www/migration/vendor/techdivision/import/src/Actions/Processors/UrlRewriteCreateProcessor.php(61): TechDivision\\Import\\Actions\\Processors\\AbstractBaseProcessor->execute()\n#2 /var/www/migration/vendor/techdivision/import/src/Actions/GenericIdentifierAction.php(73): TechDivision\\Import\\Actions\\Processors\\UrlRewriteCreateProcessor->execute()\n#3 /var/www/migration/vendor/techdivision/import/src/Actions/GenericIdentifierAction.php(60): TechDivision\\Import\\Actions\\GenericIdentifierAction->create()\n#4 /var/www/migration/vendor/techdivision/import-category/src/Services/CategoryBunchProcessor.php(1166): TechDivision\\Import\\Actions\\GenericIdentifierAction->persist()\n#5 /var/www/migration/vendor/techdivision/import-category/src/Observers/UrlRewriteObserver.php(238): TechDivision\\Import\\Category\\Services\\CategoryBunchProcessor->persistUrlRewrite()\n#6 /var/www/migration/vendor/techdivision/import-category/src/Observers/UrlRewriteObserver.php(108): TechDivision\\Import\\Category\\Observers\\UrlRewriteObserver->persistUrlRewrite()\n#7 /var/www/migration/vendor/techdivision/import-category/src/Observers/UrlRewriteUpdateObserver.php(89): TechDivision\\Import\\Category\\Observers\\UrlRewriteObserver->process()\n#8 /var/www/migration/vendor/techdivision/import-category/src/Observers/AbstractCategoryImportObserver.php(54): TechDivision\\Import\\Category\\Observers\\UrlRewriteUpdateObserver->process()\n#9 /var/www/migration/vendor/techdivision/import/src/Subjects/AbstractSubject.php(1042): TechDivision\\Import\\Category\\Observers\\AbstractCategoryImportObserver->handle()\n#10 [internal function]: TechDivision\\Import\\Subjects\\AbstractSubject->importRow()\n#11 /var/www/migration/vendor/techdivision/import/src/Adapter/Goodby/Interpreter.php(149): call_user_func()\n#12 /var/www/migration/vendor/techdivision/import/src/Adapter/Goodby/Interpreter.php(135): TechDivision\\Import\\Adapter\\Goodby\\Interpreter->delegate()\n#13 /var/www/migration/vendor/techdivision/import/src/Adapter/Goodby/Interpreter.php(74): TechDivision\\Import\\Adapter\\Goodby\\Interpreter->notify()\n#14 /var/www/migration/vendor/techdivision/import/src/Adapter/Goodby/Lexer.php(127): TechDivision\\Import\\Adapter\\Goodby\\Interpreter->interpret()\n#15 /var/www/migration/vendor/techdivision/import/src/Adapter/CsvImportAdapter.php(142): TechDivision\\Import\\Adapter\\Goodby\\Lexer->parse()\n#16 /var/www/migration/vendor/techdivision/import/src/Subjects/AbstractSubject.php(884): TechDivision\\Import\\Adapter\\CsvImportAdapter->import()\n#17 /var/www/migration/vendor/techdivision/import/src/Subjects/SubjectExecutor.php(131): TechDivision\\Import\\Subjects\\AbstractSubject->import()\n#18 /var/www/migration/vendor/techdivision/import/src/Plugins/SubjectPlugin.php(168): TechDivision\\Import\\Subjects\\SubjectExecutor->execute()\n#19 /var/www/migration/vendor/techdivision/import/src/Plugins/SubjectPlugin.php(120): TechDivision\\Import\\Plugins\\SubjectPlugin->processSubject()\n#20 /var/www/migration/vendor/techdivision/import/src/Plugins/PluginExecutor.php(117): TechDivision\\Import\\Plugins\\SubjectPlugin->process()\n#21 /var/www/migration/vendor/techdivision/import/src/Modules/PluginModule.php(144): TechDivision\\Import\\Plugins\\PluginExecutor->execute()\n#22 /var/www/migration/vendor/techdivision/import-app-simple/src/Simple.php(622): TechDivision\\Import\\Modules\\PluginModule->process()\n#23 /var/www/migration/vendor/techdivision/import-cli/src/Command/AbstractImportCommand.php(114): TechDivision\\Import\\App\\Simple->process()\n#24 /var/www/migration/vendor/symfony/console/Command/Command.php(255): TechDivision\\Import\\Cli\\Command\\AbstractImportCommand->execute()\n#25 /var/www/migration/vendor/symfony/console/Application.php(1009): Symfony\\Component\\Console\\Command\\Command->run()\n#26 /var/www/migration/vendor/symfony/console/Application.php(273): Symfony\\Component\\Console\\Application->doRunCommand()\n#27 /var/www/migration/vendor/symfony/console/Application.php(149): Symfony\\Component\\Console\\Application->doRun()\n#28 /var/www/migration/vendor/techdivision/import-cli-simple/bootstrap.php(53): Symfony\\Component\\Console\\Application->run()\n#29 /var/www/migration/vendor/techdivision/import-cli-simple/bin/import-simple.php(54): require('/var/www/migrat...')\n#30 /var/www/migration/vendor/techdivision/import-cli-simple/bin/import-simple(2): require('/var/www/migrat...')\n#31 {main}\n\nNext PDOException: SQLSTATE[23000]: Integrity constraint violation: 1062 Duplicate entry 'coloured-diamond-jewellery-3' for key 'URL_REWRITE_REQUEST_PATH_STORE_ID' when executing SQL \"INSERT\n INTO url_rewrite\n (entity_type,\n entity_id,\n request_path,\n target_path,\n redirect_type,\n store_id,\n description,\n is_autogenerated,\n metadata)\n VALUES (category,\n 230,\n coloured-diamond-jewellery,\n catalog/category/view/id/230,\n 0,\n 3,\n ,\n 1,\n )\" in /var/www/migration/vendor/techdivision/import/src/Actions/Processors/AbstractBaseProcessor.php:236\nStack trace:\n#0 /var/www/migration/vendor/techdivision/import/src/Actions/Processors/UrlRewriteCreateProcessor.php(61): TechDivision\\Import\\Actions\\Processors\\AbstractBaseProcessor->execute()\n#1 /var/www/migration/vendor/techdivision/import/src/Actions/GenericIdentifierAction.php(73): TechDivision\\Import\\Actions\\Processors\\UrlRewriteCreateProcessor->execute()\n#2 /var/www/migration/vendor/techdivision/import/src/Actions/GenericIdentifierAction.php(60): TechDivision\\Import\\Actions\\GenericIdentifierAction->create()\n#3 /var/www/migration/vendor/techdivision/import-category/src/Services/CategoryBunchProcessor.php(1166): TechDivision\\Import\\Actions\\GenericIdentifierAction->persist()\n#4 /var/www/migration/vendor/techdivision/import-category/src/Observers/UrlRewriteObserver.php(238): TechDivision\\Import\\Category\\Services\\CategoryBunchProcessor->persistUrlRewrite()\n#5 /var/www/migration/vendor/techdivision/import-category/src/Observers/UrlRewriteObserver.php(108): TechDivision\\Import\\Category\\Observers\\UrlRewriteObserver->persistUrlRewrite()\n#6 /var/www/migration/vendor/techdivision/import-category/src/Observers/UrlRewriteUpdateObserver.php(89): TechDivision\\Import\\Category\\Observers\\UrlRewriteObserver->process()\n#7 /var/www/migration/vendor/techdivision/import-category/src/Observers/AbstractCategoryImportObserver.php(54): TechDivision\\Import\\Category\\Observers\\UrlRewriteUpdateObserver->process()\n#8 /var/www/migration/vendor/techdivision/import/src/Subjects/AbstractSubject.php(1042): TechDivision\\Import\\Category\\Observers\\AbstractCategoryImportObserver->handle()\n#9 [internal function]: TechDivision\\Import\\Subjects\\AbstractSubject->importRow()\n#10 /var/www/migration/vendor/techdivision/import/src/Adapter/Goodby/Interpreter.php(149): call_user_func()\n#11 /var/www/migration/vendor/techdivision/import/src/Adapter/Goodby/Interpreter.php(135): TechDivision\\Import\\Adapter\\Goodby\\Interpreter->delegate()\n#12 /var/www/migration/vendor/techdivision/import/src/Adapter/Goodby/Interpreter.php(74): TechDivision\\Import\\Adapter\\Goodby\\Interpreter->notify()\n#13 /var/www/migration/vendor/techdivision/import/src/Adapter/Goodby/Lexer.php(127): TechDivision\\Import\\Adapter\\Goodby\\Interpreter->interpret()\n#14 /var/www/migration/vendor/techdivision/import/src/Adapter/CsvImportAdapter.php(142): TechDivision\\Import\\Adapter\\Goodby\\Lexer->parse()\n#15 /var/www/migration/vendor/techdivision/import/src/Subjects/AbstractSubject.php(884): TechDivision\\Import\\Adapter\\CsvImportAdapter->import()\n#16 /var/www/migration/vendor/techdivision/import/src/Subjects/SubjectExecutor.php(131): TechDivision\\Import\\Subjects\\AbstractSubject->import()\n#17 /var/www/migration/vendor/techdivision/import/src/Plugins/SubjectPlugin.php(168): TechDivision\\Import\\Subjects\\SubjectExecutor->execute()\n#18 /var/www/migration/vendor/techdivision/import/src/Plugins/SubjectPlugin.php(120): TechDivision\\Import\\Plugins\\SubjectPlugin->processSubject()\n#19 /var/www/migration/vendor/techdivision/import/src/Plugins/PluginExecutor.php(117): TechDivision\\Import\\Plugins\\SubjectPlugin->process()\n#20 /var/www/migration/vendor/techdivision/import/src/Modules/PluginModule.php(144): TechDivision\\Import\\Plugins\\PluginExecutor->execute()\n#21 /var/www/migration/vendor/techdivision/import-app-simple/src/Simple.php(622): TechDivision\\Import\\Modules\\PluginModule->process()\n#22 /var/www/migration/vendor/techdivision/import-cli/src/Command/AbstractImportCommand.php(114): TechDivision\\Import\\App\\Simple->process()\n#23 /var/www/migration/vendor/symfony/console/Command/Command.php(255): TechDivision\\Import\\Cli\\Command\\AbstractImportCommand->execute()\n#24 /var/www/migration/vendor/symfony/console/Application.php(1009): Symfony\\Component\\Console\\Command\\Command->run()\n#25 /var/www/migration/vendor/symfony/console/Application.php(273): Symfony\\Component\\Console\\Application->doRunCommand()\n#26 /var/www/migration/vendor/symfony/console/Application.php(149): Symfony\\Component\\Console\\Application->doRun()\n#27 /var/www/migration/vendor/techdivision/import-cli-simple/bootstrap.php(53): Symfony\\Component\\Console\\Application->run()\n#28 /var/www/migration/vendor/techdivision/import-cli-simple/bin/import-simple.php(54): require('/var/www/migrat...')\n#29 /var/www/migration/vendor/techdivision/import-cli-simple/bin/import-simple(2): require('/var/www/migrat...')\n#30 {main}\n\nNext TechDivision\\Import\\Exceptions\\WrappedColumnException: SQLSTATE[23000]: Integrity constraint violation: 1062 Duplicate entry 'coloured-diamond-jewellery-3' for key 'URL_REWRITE_REQUEST_PATH_STORE_ID' when executing SQL \"INSERT\n INTO url_rewrite\n (entity_type,\n entity_id,\n request_path,\n target_path,\n redirect_type,\n store_id,\n description,\n is_autogenerated,\n metadata)\n VALUES (category,\n 230,\n coloured-diamond-jewellery,\n catalog/category/view/id/230,\n 0,\n 3,\n ,\n 1,\n )\" in file category-url-rewrite_20220404-150018_01.csv on line 2 in /var/www/migration/vendor/techdivision/import/src/Subjects/AbstractSubject.php:1437\nStack trace:\n#0 /var/www/migration/vendor/techdivision/import/src/Subjects/AbstractSubject.php(960): TechDivision\\Import\\Subjects\\AbstractSubject->wrapException()\n#1 /var/www/migration/vendor/techdivision/import/src/Subjects/SubjectExecutor.php(131): TechDivision\\Import\\Subjects\\AbstractSubject->import()\n#2 /var/www/migration/vendor/techdivision/import/src/Plugins/SubjectPlugin.php(168): TechDivision\\Import\\Subjects\\SubjectExecutor->execute()\n#3 /var/www/migration/vendor/techdivision/import/src/Plugins/SubjectPlugin.php(120): TechDivision\\Import\\Plugins\\SubjectPlugin->processSubject()\n#4 /var/www/migration/vendor/techdivision/import/src/Plugins/PluginExecutor.php(117): TechDivision\\Import\\Plugins\\SubjectPlugin->process()\n#5 /var/www/migration/vendor/techdivision/import/src/Modules/PluginModule.php(144): TechDivision\\Import\\Plugins\\PluginExecutor->execute()\n#6 /var/www/migration/vendor/techdivision/import-app-simple/src/Simple.php(622): TechDivision\\Import\\Modules\\PluginModule->process()\n#7 /var/www/migration/vendor/techdivision/import-cli/src/Command/AbstractImportCommand.php(114): TechDivision\\Import\\App\\Simple->process()\n#8 /var/www/migration/vendor/symfony/console/Command/Command.php(255): TechDivision\\Import\\Cli\\Command\\AbstractImportCommand->execute()\n#9 /var/www/migration/vendor/symfony/console/Application.php(1009): Symfony\\Component\\Console\\Command\\Command->run()\n#10 /var/www/migration/vendor/symfony/console/Application.php(273): Symfony\\Component\\Console\\Application->doRunCommand()\n#11 /var/www/migration/vendor/symfony/console/Application.php(149): Symfony\\Component\\Console\\Application->doRun()\n#12 /var/www/migration/vendor/techdivision/import-cli-simple/bootstrap.php(53): Symfony\\Component\\Console\\Application->run()\n#13 /var/www/migration/vendor/techdivision/import-cli-simple/bin/import-simple.php(54): require('/var/www/migrat...')\n#14 /var/www/migration/vendor/techdivision/import-cli-simple/bin/import-simple(2): require('/var/www/migrat...')\n#15 {main} {\"serial\":\"4d71c4b3-8674-4e47-96f3-21b9599f6ea4\",\"memory_peak_usage\":\"36 MB\"}\n[2022-04-04 15:00:18] logger/system.ERROR: Can't finish import with serial 4d71c4b3-8674-4e47-96f3-21b9599f6ea4 in 5.360415 s {\"serial\":\"4d71c4b3-8674-4e47-96f3-21b9599f6ea4\",\"memory_peak_usage\":\"36 MB\"}\n SQLSTATE[23000]: Integrity constraint violation: 1062 Duplicate entry 'coloured-diamond-jewellery-3' for key 'URL_REWRITE_REQUEST_PATH_STORE_ID' when executing SQL \"INSERT\n INTO url_rewrite\n (entity_type,\n entity_id,\n request_path,\n target_path,\n redirect_type,\n store_id,\n description,\n is_autogenerated,\n metadata)\n VALUES (category,\n 230,\n coloured-diamond-jewellery,\n catalog/category/view/id/230,\n 0,\n 3,\n ,\n 1,\n )\" in file category-url-rewrite_20220404-150018_01.csv on line 2\n[2022-04-04 15:00:18] logger/system.ERROR: SQLSTATE[23000]: Integrity constraint violation: 1062 Duplicate entry 'coloured-diamond-jewellery-3' for key 'URL_REWRITE_REQUEST_PATH_STORE_ID' when executing SQL \"INSERT\n INTO url_rewrite\n (entity_type,\n entity_id,\n request_path,\n target_path,\n redirect_type,\n store_id,\n description,\n is_autogenerated,\n metadata)\n VALUES (category,\n 230,\n coloured-diamond-jewellery,\n catalog/category/view/id/230,\n 0,\n 3,\n ,\n 1,\n )\" in file category-url-rewrite_20220404-150018_01.csv on line 2 {\"serial\":\"4d71c4b3-8674-4e47-96f3-21b9599f6ea4\",\"memory_peak_usage\":\"36 MB\"}","context":[],"level":200,"level_name":"INFO","channel":"import_feed","datetime":{"date":"2022-04-04 15:00:18.212492","timezone_type":3,"timezone":"UTC"},"extra":{"file":"/var/www/migration/app/code/BestResponseMedia/ImportProducts/Model/FilePreparation/Entities/ProductImportFileGenerator.php","line":208,"class":"BestResponseMedia\\ImportProducts\\Model\\FilePreparation\\Entities\\ProductImportFileGenerator","function":"initiateProductImport"}}
Expected Result
The text was updated successfully, but these errors were encountered: