Upsert not working properly.

  • 22 January 2021
  • 4 replies

Userlevel 2
Badge +1

Hello -  


I’m attempting to create a data space that houses some survey data.  The idea here is the customer takes this survey along the road of the customer experience and self assesses their improvements. 

I want to load their answers (which includes a survey answer timestamp) and then as the rule runs daily it should be bring any new people who have answered the survey and also the original people should they take the survey again in say, six months. Use case would be customer X takes the survey on 1/1 and then on 9/1 takes it again after working with the CSM for awhile.  The rules sees the timestamp is different than the 1/1 and makes a new record.  Now the CSM can see both survey responses from teh same person and see what improvements have changes.


I have the following identifiers to help assist with this upsert:

GS Company ID

Survey Answered time stamp

email address.


Every time I do a test data load it’s just duplicating the information, even though, according to upsert, this data is the same so no action should be taken.  Is there a step I’m missing that’s causing this duplicate data to populate?


Best answer by phani_kumar 25 January 2021, 11:08

View original

4 replies

Userlevel 7
Badge +2

@Justin Bills sorry for the inconvenience. Let me check this and get back to you.

Userlevel 2
Badge +1

Thanks @sai_ram - So it appears that duplicates aren’t getting generated after I cleared the data source and ran it again a few times.  What is confusing is that the logs show that the rule succeeded and 200 accounts passed and none failed.


What I would have expected to see here was that 0 accounts passed because none of them meet the criteria to be upserted. 



Userlevel 5
Badge +3

Hi @Justin Bills 

I guess if you are working with Data Designer to create your Survey Data Space Object. By default, the Data Designer works as Upsert Operation.

But, if you are using Rules, please convert the “Survey Answered timestamp” field to Date Data Type and use that as one of your identifiers. And in the rule execution history every time it shows success records count even though there are no New records. 

For ex: if you run the rule in Live and 200 records are created in the Object and in the next minute again if you run the rule and if we check the execution history we can see 200 records got successed.

But if we validate the Object we can see only 200 records, not 400 records.



Userlevel 2
Badge +1

Thanks, it does appear to be working properly now!