Data Transformation Pipeline

Summary

Designing a tool to simplify a manual task done in spreadsheets, replacing it with an intuitive data remediation process and an elegant user interface. 

Overview

ICX4 is a London-based fintech that specialises in data remediation, analysis, and regulation compliance for big banks. I worked with data and business analysts, stakeholders, clients, and front and back-end developers. Our goal was to design and test products to streamline our clients'  legacy data systems and improve their efficiency and compliance. 

I was given a brief to design a process to replace the in-house data transformation process with an online application that external users could easily complete. Users had to be able to see the whole process at a glance, and easily manipulate the tools. The process was known internally as the Pipeline Builder. It would replace the manual manipulation of raw data done by the analysts in spreadsheets, into information that was accurate and easy to read.

Requirements

The business requirements document was specific on the resulting data but not the manual process that the data analysts went through. I had several discussions with a wide range of users to nail what the problem was and what the objective might be. 

Process

I discussed the process of data manipulation with the data analysts who'd use the system I designed, and who were also expert at the spreadsheet version of it themselves. I sketched designs on paper which helped me understand the process myself, and went over each sketch with teh analysts for feedback. 

Pipeline sketchesPipeline sketches

Design

The design had to be built within the constraints of a boot strap library, which I discussed with the front-end team. They also helped determine the best UI elements to use that would indicate the order of tools used during the data transformation process. 

That process wasn't completely defined, but we knew that certain tools could only be used in a particular order, some at the last stage of the process, and the number of tools in any given process could vary from as few as five up to 500. So it had to be scaleable. 

Design 1Design 1

Challenges

The challenge was to show the user the whole process on a single screen while ensuring that a new user would understand the necessary ordering of the tools. Each tool needed to display its name, metrics, and whether it was editable. 

I worked on the copy instructing the user how to understand and user the Pipeline Builder, to ensure that it was as brief and accurate as possible, testing it with non-experts. 

Outcome

I tested the wireframes on paper and then with an InVision prototype for the usability of the UI. I worked with a visual design to finesse the screens into an elegant interface and appropriate branding. 

The business had a change in strategy so unfortunately I wasn't able to see the project through to final completion. So who knows if the spreadsheets are still the favourite!

Design 2Design 2