1. How does file processing work?
Data Monkey is a tool designed to simplify routine file processing. Files are often used as an interface between two systems, and wrangling the data into compatible formats can be a time-consuming task. Data Monkey provides a simple, configuration-based approach that lets you quickly decide how an incoming file should be processed. In addition, Data Monkey provides a way to both validate and manipulate the data in the file itself -- you need to know that the data fits your expectations, and you need a way to change the data itself.
2. How does file processing work?
Once a configuration has been created, a file can be processed in one of the following ways:
- Upload your file on the Data Monkey site for quick processing on our high-performance servers. You’ll be able to monitor progress during the process and view the output on the site .
- Download the Data Monkey Python library and process the file locally with a few simple commands -- your data stays on your servers for complete data privacy.
3. Which data formats are supported?
Data Monkey currently supports the following file types: CSV, Excel, and JSON.
Our monkeys are working hard to support additional formats in the near future, including text files (fixed-width format), SQL queries, and direct links to REST APIs. Please let us know if there is a particular format you’d like to see!
4. Is Data Monkey free to use?
It is free to create Configurations on the Data Monkey site and use them for local file processing. Uploading your file for Data Monkey to process your file will require a paid membership.
5. How do I manage configurations?
You can create, edit, or copy configurations on the dashboard. You can also view the number of times a configuration has been used, download the configuration for local processing, or use the configuration to process a new file upload on the Data Monkey site.
6. Where is my data stored?
If you choose to use Data Monkey to process files, your data will be stored on our secure cloud. We take data privacy and security very seriously, and it will only be accessible by you. For local processing, your data will never leave your servers -- Data Monkey does not send any telemetry or relay any information about the files you process.
7. What are example use cases?
- A client delivers an extract from their internal system in an Excel file. You’ve always had issues with data integrity, and the fields they send seem to change regularly. You use Data Monkey to create an easy to update configuration that validates all of data you expect in the report has been sent, and that it fits the expected files you’ve defined.
- An internal system is able to provide a JSON file that contains data you’d like to share with leadership. You use a Data Monkey configuration to process the file into an Excel spreadsheet for easier consumption. The original JSON contains far more data than necessary, so you limit the number of fields and set filters for the data you know leadership would like to see.
- You were provided with a massive CSV file that contains millions of rows of data. You need to transform this data into a report, but don’t have time to work with a programmer. You create a configuration that lets you first merge data (e.g. first name and last name) into easier to manage output. You then take advantage of the data modifiers to manipulate your data into exactly what you need -- all without a single line of code.
- You’re a programmer that needs to import a pesky Excel file into your database. You create a configuration to process the file directly into a python dictionary. You’ve been burned by bad data before, so you make extensive use of data validators to get a report of any missing values.