You'll need to connect to different databases, pull new data at scheduled intervals, prevent overwrites, monitor the performance of your operations, and more. It might takes months to build those features into a robust and repeatable pipelined infrastructure - that's months of wasted time for your data scientists and engineers.
Use Cadence's intuitive scheduling interface to craft complex execution pipelines. Cadence can intelligently modify your schedule to avoid data corruption and maximize throughput.
Choose which hardware you want each job to run on — Cadence will spin up the machine of your choice, load your supporting libraries, execute your job, and clean up afterwards.
Track the health of your jobs — if they're failing, Cadence provides error logs to help you debug quickly. If asked, Cadence will learn your jobs' write patterns and can notify you of subtle data errors that might not otherwise raise execution errors.
Fine-tune Cadence's access level to each of your data targets. Your data is always stored on your own instances, and all your sensitive metadata that we're required to store is encrypted.
Register the database nodes and database tables (data targets) that your jobs will operate on. In most cases, this is as easy as providing a connection string.
A kit is a zipped folder containing your data operation's code and any necessary supporting libraries. Upload your kits through the Cadence interface.
Once you have kits, define and schedule jobs to execute your code. To create a job, you supply a runner script, the schedule to run the job, and the hardware that should be provisioned. You can also specify inter-job dependencies and enable advanced health checks.
As your jobs are run, the Cadence dashboard displays the health of each of your jobs. The dashboard shows the output your jobs produce to enable easy debugging. Additionally, Cadence can notify you of subtler data errors based on that job's previous activity.
Whether you just use data for business intelligence or data is your core competency, Cadence can save your business time and money.