Squid launches a new product: the Export App
An issue that we see repeatedly with Big Data platforms is that people struggle to pull data out of them. They mainly want to run their own analysis in Excel, for instance to check something, build a report in PowerPoint, or simply because it’s easier for them to do their stuff like that. Basically, people have their own way to use data which often requires the capability to export data in a fast and easy way.
That’s why we made an Export App.
Why the app is the solution?
The export app has been built especially to provide the best way to export data from the raw data platform. Through a simple and intuitive path users are able to select, visualize and export data in few clicks. The application provides also preconfigured access to an export API in order to programmatically automate recurring tasks.
Easy Path -> Demo
Music Brainz is a community-maintained open source encyclopedia of music information where all of the various pieces of information about music is stored, from artists and their releases to works and their composers. We used MB as a data source to demonstrate the Export-App he in three easy steps: – Select – Preview – Export –
I begin by defining the data selection, that is what and how I want to export my data. I can select the range period, add multiple filters to even restrict the dataset, select the dimension to group by the result, and what metrics I need to compute.
First, select the range period. Using the datepicker, I can choose the First Month of data, the Last Month of data or a Custom Range.
Second, select the filters. In this example I only want to export Album data. I can select multiple values for any filter available. Note that the filter selection is optional.
Third, select the Dimensions. This is where I choose how I want my data grouped by. I can select dimensions and reorder them by drag and drop.
Last, select the Metrics. This is where I chose what I want to compute. Here I just want to compute the number of releases. The application will automatically provide the metrics value on the whole selected dataset.
I can preview what I selected and check if I’ll export what I need. Here I can easily understand that Bloc Party’s Album “ A Weekend in the City” from Wichita Recordings Label has been released 7 times.
I can also preview selection with a Time Serie (here by country) :
Once I am satisfied with the data, the last step is to click on the “Prepare Download” button. This will trigger the data export. Note that it may take some time for the database to process the data, depending on the number of records and the complexity of the export request.
When the data is ready, a link will appear to download.
- Range Period: Choice between first month, last month and custom range
- Filters: Define your selection based on any available filter.
- Dimensions: Exported dimensions list is defined by simple drag and drop
- Metrics: Select the metrics to compute, and automatically preview the metric value
- Export: Ability to export a complete data set based once configuration carried out.
- Automation: Exports can easily be scripted as they rely on a Rest API and as cURL sample scripts are automatically displayed.
- Preview: get a quick glimpse at the data using the preview. Three different visualizations:
– Data Table: check the first 1000 lines of the export; you can sort the table on any selected metric.
– Bar Chart: check the dataset on a single dimensio
– Time Series: check the time distribution of the dataset; you can optionally select a second dimension to analyze the evolution