Importation de flux xml dans Flexi

Hello

creating assets for 2000 items is a lot,
it could even timeout , the joomla assets creating functions are used

e.g. if you wanted to trigger the Joomla Smart search index creation , you may need as much as 0.2 - 1 second per item (if you have a 10,000 item site) so for 2,000 items you would need as much as 400-2000 seconds to update the Joomla smart search index

Regards

micker wrote: sans vouloir te vendre un composant ..; (j'ai aucune actions) a mmon avis utilise FLEXIimport pour ca ...
il gère parfaitement ce genre de chose grâce à des taches crons et autres subtilités
a+

J'ai juste ce problème d'assets à résoudre. Mais si ce n'est pas concluant ( je suis relativement pressé) , je suis tout disposé à utiliser ce composant que je ne connais pas.
Est ce que tu l'as utilisé ou quelqu'un d'autre ?
Voilà ce que je fais en gros:
Je dois parser surtout plusieurs flux RSS (chaque jour) et je dois enregistrer tout en bdd ( au alentour de 6 champs différents par item), ce qui fait au total en gros 2500 items. Il y a aussi une vérification quotitienne des articles obsolètes (date dépassée) qui sont alors effacés automatiquement ainsi bien sur que leur champs associés.
Pour ce qui est de la suppression, je n'ai pas de soucis.
Seule l'enregistrement en bdd à cause des assets me pose problème.
En résumé, FLEXIimport est-il capable d'importer les données de plusieurs flux RSS en mettant correctement les assets?

Merci,

Eric

ggppdk wrote: Hello

creating assets for 2000 items is a lot,
it could even timeout , the joomla assets creating functions are used

e.g. if you wanted to trigger the Joomla Smart search index creation , you may need as much as 0.2 - 1 second per item (if you have a 10,000 item site) so for 2,000 items you would need as much as 400-2000 seconds to update the Joomla smart search index

Regards

Yes, I have a 504 error .
I have timeout too with for example 300 items.
I don't know how to do this...

Regards

Hello

note about the built-in CSV import we have:

- [v2.1.1] data preview of all parsed lines (thus you verify the CSV format)

- [v2.1.1] the import procedure was made multi-step via using AJAX !! and you can set number of items pers step (with ability to continue stopped import if you have not closed browser window or if you restore session after browser crashes) [v2.1.1]

- [v2.1.0] also you may want to set the default configuration for import task in Component configuration so that you do not have to re-enter it

- [v2.1.0] you can import images and files from a server folder, with checking if they exist

FLEXI import permet d'importer de tres gros quantités de données ... utiliser sur de tres gros site (nouvelobservateur ...) avec un super support, et c'est des francais ....
si tu es pressé fonce
a+

[edit by ggppdk]
please also see my previous post

Hello,

I ve look the csv import, but I see that only use one category. I must complete around 100 category with my 2000 items, so I must have 100 csv different, no ?

Regard,

Eric

You can use our solution flexIMPORT:
extensions.netassopro.com/extens ... fleximport

seabird wrote: Hello,

I ve look the csv import, but I see that only use one category. I must complete around 100 category with my 2000 items, so I must have 100 csv different, no ?

Regard,

Eric

Hello,
no use a single file,
-- check the checkbox option for using the column "catid" for primary category ID,
-- and check the checkbox option for using column "cid" for a comma separated list of secondary category IDs

Also alternatively you can use FLEXimport

Regards

Hello,

I just tested importing a csv file with my items. the csv file is 1 Mo with 2000 items.
Its very long too for execute.
I test with 100 items ( csv = 49k), it take 10 min ..)
But, I see execution continued in the background.

ps:There is problem with accent in csv file. text is cut before special character.
Example: if there is"Jour du cinéma" in csv file, there is: "Jour du cin" in the bdd. in v2.0.2



Regards

Hello

i was talking about latest available FLEXIcontent version: v2.1.1 r1793+

Regards