Data Flare

Data Flare

  • Docs
  • API

›Persisting your results

Getting Started

  • Introduction
  • Writing your first suite of checks
  • Supported Scala and Spark versions

Available Checks

    Metrics based checks

    • Introduction to metrics and metric based checks
    • Metrics based checks on a single Dataset
    • Metrics based checks on a pair of Datasets
    • Track metrics not involved in any checks
    • Available metrics
  • Arbitrary checks

Persisting your results

  • Persisting results from your checks
  • Persisting metrics over time

Developer docs

  • Developer documentation

Persisting metrics over time

To persist the metrics from your ChecksSuite simply pass in a MetricsPersister to your ChecksSuite. You can either use one of the provided implementations or extend MetricsPersister if you wish to use some other storage solution.

Example:

import com.github.timgent.dataflare.checkssuite.ChecksSuite
import com.github.timgent.dataflare.repository.ElasticSearchMetricsPersister
import com.sksamuel.elastic4s.Index

import scala.concurrent.ExecutionContext.Implicits.global

val esHosts = Seq("1.2.3.4")
val esMetricsPersister = ElasticSearchMetricsPersister(esHosts, Index("metrics_index"))
val checksSuite = ChecksSuite("metricsPersister", metricsPersister = esMetricsPersister)

As per qc results persistence you can also pass an ElasticClient to instantiate an ElasticSearchMetricsPersister if you wish to set custom properties like authentication for your ElasticSearch cluster.

← Persisting results from your checksDeveloper documentation →
Data Flare
Docs
Getting StartedAPI Reference
Community
Stack Overflow
More
GitHubStar