Plugin ComplexVariableFlattener - Problem with data

@Helene
I added the pluging and somehow I am not getting good one of the objects that I think I should get. The primitive types are good but the others not
I dont understand why the object which has “aktion: Keine” is not added in the logs, I mean I dont see “KEINE”, check the photo from the engine:

09:48:58.274 [ThreadPoolTaskScheduler-1] DEBUG o.c.o.s.i.e.EngineImportScheduler - Scheduling import round for VariableUpdateEngineImportMediator
09:48:58.274 [ThreadPoolTaskScheduler-1] DEBUG o.c.o.s.i.e.f.i.VariableUpdateInstanceFetcher - Fetching historic variable instances …
09:48:58.294 [ThreadPoolTaskScheduler-1] DEBUG o.c.o.s.i.e.f.i.VariableUpdateInstanceFetcher - Fetched [1] running historic variable instances for set start time within [20] ms
09:48:58.294 [ThreadPoolTaskScheduler-1] DEBUG o.c.o.s.i.e.f.i.VariableUpdateInstanceFetcher - Fetching historic variable instances …
09:48:58.321 [ThreadPoolTaskScheduler-1] DEBUG o.c.o.s.i.e.f.i.VariableUpdateInstanceFetcher - Fetched [8] running historic variable instances which started after set timestamp with page size [10000] within [27] ms
09:48:58.321 [ThreadPoolTaskScheduler-1] WARN o.c.o.ComplexVariableFlattener - =================================PLUGIN ComplexVariableFlattener STARTED===========================================
09:48:58.321 [ThreadPoolTaskScheduler-1] DEBUG o.c.o.ComplexVariableFlattener - adapting variable mutationId (v1) of process-instance 432323…
09:48:58.321 [ThreadPoolTaskScheduler-1] DEBUG o.c.o.ComplexVariableFlattener - adapting variable aktionData (v1) of process-instance 432331…
09:48:58.321 [ImportJobExecutor-pool-3] DEBUG o.c.o.s.e.j.i.RunningUserTaskElasticsearchImportJob - Executing import to elasticsearch took [187] ms
09:48:58.769 [ThreadPoolTaskScheduler-1] INFO o.c.o.ComplexVariableFlattener - variable-attribute ‘aussteuerungsgrund’ of ‘aktionData’ is null and won’t be imported
09:48:58.769 [ThreadPoolTaskScheduler-1] INFO o.c.o.ComplexVariableFlattener - variable-attribute ‘auftragBeschreibung’ of ‘aktionData’ is null and won’t be imported
09:48:58.770 [ThreadPoolTaskScheduler-1] DEBUG o.c.o.ComplexVariableFlattener - adapting variable kundePersonData (v1) of process-instance 432331…
09:48:58.779 [ThreadPoolTaskScheduler-1] INFO o.c.o.ComplexVariableFlattener - variable-attribute ‘kundenstamm.inhaber.todesdatum’ of ‘kundePersonData’ is null and won’t be imported
09:48:58.780 [ThreadPoolTaskScheduler-1] DEBUG o.c.o.ComplexVariableFlattener - adapting variable eNutzungAusschluesseDmnResult (v1) of process-instance 432331…
09:48:58.780 [ThreadPoolTaskScheduler-1] DEBUG o.c.o.ComplexVariableFlattener - adapting variable task-url (v1) of process-instance 432323…
09:48:58.780 [ThreadPoolTaskScheduler-1] DEBUG o.c.o.ComplexVariableFlattener - adapting variable mutationId (v9) of process-instance 12422…
09:48:58.780 [ThreadPoolTaskScheduler-1] DEBUG o.c.o.ComplexVariableFlattener - adapting variable inputChannel (v1) of process-instance 12422…
09:48:58.780 [ThreadPoolTaskScheduler-1] DEBUG o.c.o.ComplexVariableFlattener - adapting variable eNutzungVolljaehrigDmnResult (v1) of process-instance 432331…
09:48:58.784 [ThreadPoolTaskScheduler-1] INFO o.c.o.s.i.e.s.VariableUpdateInstanceImportService - Refuse to add variable [aktionData.verarbeitungsArt] from variable import adapter plugin. Variable has no timestamp.
09:48:58.784 [ThreadPoolTaskScheduler-1] INFO o.c.o.s.i.e.s.VariableUpdateInstanceImportService - Refuse to add variable [aktionData.aktion] from variable import adapter plugin. Variable has no timestamp.
09:48:58.784 [ThreadPoolTaskScheduler-1] INFO o.c.o.s.i.e.s.VariableUpdateInstanceImportService - Refuse to add variable [aktionData.enutzungAktionData.enutzungPersonAktionen._listsize] from variable import adapter plugin. Variable has no timestamp.
09:48:58.784 [ThreadPoolTaskScheduler-1] INFO o.c.o.s.i.e.s.VariableUpdateInstanceImportService - Refuse to add variable [kundePersonData.kundenstamm.kundenstammStatus] from variable import adapter plugin. Variable has no timestamp.
09:48:58.784 [ThreadPoolTaskScheduler-1] INFO o.c.o.s.i.e.s.VariableUpdateInstanceImportService - Refuse to add variable [kundePersonData.kundenstamm.inhaber.typ] from variable import adapter plugin. Variable has no timestamp.
09:48:58.784 [ThreadPoolTaskScheduler-1] INFO o.c.o.s.i.e.s.VariableUpdateInstanceImportService - Refuse to add variable [kundePersonData.kundenstamm.inhaber.personNr] from variable import adapter plugin. Variable has no timestamp.
09:48:58.784 [ThreadPoolTaskScheduler-1] INFO o.c.o.s.i.e.s.VariableUpdateInstanceImportService - Refuse to add variable [kundePersonData.kundenstamm.inhaber.personOid] from variable import adapter plugin. Variable has no timestamp.
09:48:58.784 [ThreadPoolTaskScheduler-1] INFO o.c.o.s.i.e.s.VariableUpdateInstanceImportService - Refuse to add variable [kundePersonData.kundenstamm.inhaber.anrede] from variable import adapter plugin. Variable has no timestamp.
09:48:58.784 [ThreadPoolTaskScheduler-1] INFO o.c.o.s.i.e.s.VariableUpdateInstanceImportService - Refuse to add variable [kundePersonData.kundenstamm.inhaber.displayName] from variable import adapter plugin. Variable has no timestamp.
09:48:58.784 [ThreadPoolTaskScheduler-1] INFO o.c.o.s.i.e.s.VariableUpdateInstanceImportService - Refuse to add variable [kundePersonData.kundenstamm.inhaber.displayNameEFinance] from variable import adapter plugin. Variable has no timestamp.
09:48:58.784 [ThreadPoolTaskScheduler-1] INFO o.c.o.s.i.e.s.VariableUpdateInstanceImportService - Refuse to add variable [kundePersonData.kundenstamm.inhaber.sprache] from variable import adapter plugin. Variable has no timestamp.
09:48:58.784 [ThreadPoolTaskScheduler-1] INFO o.c.o.s.i.e.s.VariableUpdateInstanceImportService - Refuse to add variable [kundePersonData.kundenstamm.inhaber.geburtsdatum._listsize] from variable import adapter plugin. Variable has no timestamp.
09:48:58.784 [ThreadPoolTaskScheduler-1] INFO o.c.o.s.i.e.s.VariableUpdateInstanceImportService - Refuse to add variable [kundePersonData.kundenstamm.inhaber.istGesperrt] from variable import adapter plugin. Variable has no timestamp.
09:48:58.784 [ThreadPoolTaskScheduler-1] INFO o.c.o.s.i.e.s.VariableUpdateInstanceImportService - Refuse to add variable [kundePersonData.kundenstamm.inhaber.kesrMassnahmen] from variable import adapter plugin. Variable has no timestamp.
09:48:58.784 [ThreadPoolTaskScheduler-1] INFO o.c.o.s.i.e.s.VariableUpdateInstanceImportService - Refuse to add variable [kundePersonData.kundenstamm.inhaber.identifikation] from variable import adapter plugin. Variable has no timestamp.
09:48:58.784 [ThreadPoolTaskScheduler-1] INFO o.c.o.s.i.e.s.VariableUpdateInstanceImportService - Refuse to add variable [kundePersonData.kundenstamm.kundenstammNr] from variable import adapter plugin. Variable has no timestamp.
09:48:58.784 [ThreadPoolTaskScheduler-1] INFO o.c.o.s.i.e.s.VariableUpdateInstanceImportService - Refuse to add variable [kundePersonData.kundenstamm.kundenstammOid] from variable import adapter plugin. Variable has no timestamp.
09:48:58.784 [ThreadPoolTaskScheduler-1] INFO o.c.o.s.i.e.s.VariableUpdateInstanceImportService - Refuse to add variable [kundePersonData.kundenstamm.marktsegment] from variable import adapter plugin. Variable has no timestamp.
09:48:58.784 [ThreadPoolTaskScheduler-1] INFO o.c.o.s.i.e.s.VariableUpdateInstanceImportService - Refuse to add variable [kundePersonData.kundenstamm.kundengruppe] from variable import adapter plugin. Variable has no timestamp.
09:48:58.784 [ThreadPoolTaskScheduler-1] INFO o.c.o.s.i.e.s.VariableUpdateInstanceImportService - Refuse to add variable [kundePersonData.kundenstamm.lebensphasePk] from variable import adapter plugin. Variable has no timestamp.
09:48:58.784 [ThreadPoolTaskScheduler-1] INFO o.c.o.s.i.e.s.VariableUpdateInstanceImportService - Refuse to add variable [kundePersonData.kundenstamm.bezeichnung] from variable import adapter plugin. Variable has no timestamp.
09:48:58.784 [ThreadPoolTaskScheduler-1] INFO o.c.o.s.i.e.s.VariableUpdateInstanceImportService - Refuse to add variable [kundePersonData.kundenstamm.hasBav] from variable import adapter plugin. Variable has no timestamp.
09:48:58.784 [ThreadPoolTaskScheduler-1] INFO o.c.o.s.i.e.s.VariableUpdateInstanceImportService - Refuse to add variable [kundePersonData.personen._listsize] from variable import adapter plugin. Variable has no timestamp.
09:48:58.784 [ThreadPoolTaskScheduler-1] INFO o.c.o.s.i.e.s.VariableUpdateInstanceImportService - Refuse to add variable [kundePersonData.eltern._listsize] from variable import adapter plugin. Variable has no timestamp.
09:48:58.784 [ThreadPoolTaskScheduler-1] INFO o.c.o.s.i.e.s.VariableUpdateInstanceImportService - Refuse to add variable [kundePersonData.productIds._listsize] from variable import adapter plugin. Variable has no timestamp.
09:48:58.784 [ThreadPoolTaskScheduler-1] INFO o.c.o.s.i.e.s.VariableUpdateInstanceImportService - Refuse to add variable [kundePersonData.hasKollektivzeichnungsrechte] from variable import adapter plugin. Variable has no timestamp.
09:48:58.784 [ThreadPoolTaskScheduler-1] INFO o.c.o.s.i.e.s.VariableUpdateInstanceImportService - Refuse to add variable [kundePersonData.existingETeilnahmen._listsize] from variable import adapter plugin. Variable has no timestamp.
09:48:58.784 [ThreadPoolTaskScheduler-1] INFO o.c.o.s.i.e.s.VariableUpdateInstanceImportService - Refuse to add variable [kundePersonData.existingETeilnahmenPartnerkundenstamm._listsize] from variable import adapter plugin. Variable has no timestamp.
09:48:58.785 [ThreadPoolTaskScheduler-1] INFO o.c.o.s.i.e.s.VariableUpdateInstanceImportService - Refuse to add variable [eNutzungAusschluesseDmnResult.eNutzungVerarbeitung] from variable import adapter plugin. Variable has no timestamp.
09:48:58.785 [ThreadPoolTaskScheduler-1] INFO o.c.o.s.i.e.s.VariableUpdateInstanceImportService - Refuse to add variable [eNutzungAusschluesseDmnResult.kundenstammInhaberMinderjaehrig] from variable import adapter plugin. Variable has no timestamp.
09:48:58.785 [ThreadPoolTaskScheduler-1] INFO o.c.o.s.i.e.s.VariableUpdateInstanceImportService - Refuse to add variable [eNutzungVolljaehrigDmnResult._listsize] from variable import adapter plugin. Variable has no timestamp.
09:48:58.785 [ThreadPoolTaskScheduler-1] DEBUG o.c.o.s.e.ElasticsearchImportJobExecutor - ElasticsearchImportJobExecutor: Currently active [0] jobs and [0] in queue of job type [VariableUpdateElasticsearchImportJob]
09:48:58.785 [ThreadPoolTaskScheduler-1] DEBUG o.c.o.s.i.e.m.VariableUpdateEngineImportMediator - Maximum idle backoff reached, this mediator will not backoff any further than 30000s.
09:48:58.785 [ThreadPoolTaskScheduler-1] DEBUG o.c.o.s.i.e.m.VariableUpdateEngineImportMediator - Was not able to produce a new job, sleeping for [30000] ms
09:48:58.785 [ImportJobExecutor-pool-5] DEBUG o.c.o.s.e.w.v.ProcessVariableUpdateWriter - Creating imports for 4 [variables].
09:48:58.785 [ThreadPoolTaskScheduler-1] DEBUG o.c.o.s.i.e.EngineImportScheduler - Next round!
09:48:58.785 [ThreadPoolTaskScheduler-1] DEBUG o.c.o.s.i.e.m.TenantImportMediator - can import next page [false]
09:48:58.785 [ThreadPoolTaskScheduler-1] DEBUG o.c.o.s.i.e.m.ProcessDefinitionEngineImportMediator - can import next page [false]
09:48:58.785 [ThreadPoolTaskScheduler-1] DEBUG o.c.o.s.i.e.m.DecisionDefinitionEngineImportMediator - can import next page [false]

Hey @hahi,

From the logs it looks to me like your variables are missing timestamps:

Refuse to add variable [aktionData.aktion] from variable import adapter plugin. Variable has no timestamp

Are you filling in all the required fields in PluginVariableDto in your plugin implementation?

@Helene Thank you very much for the answer, I solved it yesterday and all is good now. The problem was exactly the “timestamps”. I was under pressure to release some new versions but at the end I found the solution thank you very much you are always very helpful.