Cache Priming with Snapshots


#1

Customers dealing with especially large volumes of data commonly have an ETL process that runs just once a day, typically at night when loads are lower and servers are cheaper.

For these types of setups it’s wise to change up the default dashboard settings, which are focused more on a real time data visualization environment. What you really need is for your dashboards to simply update once per day, soon after your ETL process has been run. There’s no reason for it to re-run your queries multiple times a day, or for it not to be already cached before the first person logs in to look at it in the morning.

This can be quite easily handled by setting up Chartio Snapshots for your dashboard for a time period soon after your ETL process was run, and setting your cache duration to be 24 hours.

Steps

  1. On the dashboard you’d like to cache prime, select Settings in the bottom right sidebar.
    dashboard select settings

  2. Set your Cache Duration to be 24 Hours
    24 hour cache duration

  3. Enable Snapshots and set the Snapshot Hour to be some time after your ETL process.
    Enable Snapshots
    Remember, the Snapshot Hour is currently set using UTC time. Adjust accordingly.

  4. Click Update to save your changes.

Now the Snapshots feature will kick off fresh queries of your dashboards every day at that hour. This primes the cache for the remaining 24 hours that you’ve now set your cache duration to. This means when your team wakes up in the morning they’ll get the latest updates right away, and unnecessary queries won’t be run every hour or so as people continue to view it throughout the day.