Pick the Delta Data From Specific Files or Tables

If I run the graph at 9 O'clock, it should pick the data with the latest updated timestamp records like from 8 to 9 O'clock updated records from the table. How to pick the delta data from specific files or tables?
  • Interview Candidate
  • 3
  • 10547

Showing Answers 1 - 3 of 3 Answers

Babita Singha

  • Mar 30th, 2016
 

You can use ctime, mtime, atime function.
Eg find < search_dir > -ctime -1 => it will give you files created in less than 24 hours.

  Was this answer useful?  Yes

irfan1patel1

  • Jun 18th, 2017
 

You will definitely need a column in file or table which has the update timestamp. Based on timestamp you can simply filter the records using filter by expression

  Was this answer useful?  Yes

Mahesh

  • May 26th, 2021
 

1 - if its a table it should have a column with timestamp and accordingly you filter out the records
2 - if its a file again if there is a timestamp column its easier, else read the file and look it up and join on key and timestamp, anything that does not join is new.

  Was this answer useful?  Yes

Give your answer:

If you think the above answer is not correct, Please select a reason and add your answer below.

 

Related Answered Questions

 

Related Open Questions